WO2021016845A1 - White balance calibration method and device, and photographing device - Google Patents

Abstract

A white balance calibration method and device, and a photographing device. The method comprises: obtaining a first white balance value of a marker in a first environment, the first environment satisfying an environmental condition of desired white balance; obtaining a second white balance value of the marker in a second environment; and determining a white balance calibration parameter in the second environment according to the first white balance value and the second white balance value. By using the first environment as a reference for the white balance calibration in the second environment, the photographing device of the present invention can make a user quickly perform white balance calibration of the second environment. In addition, since the first environment satisfies an environmental condition of desired white balance, the use of the first environment as the reference of the white balance calibration of the second environment also quickly calibrates the white balance of the photographing device in the second environment, so as to quickly adjust the photographing device to suitable white balance, thereby facilitating outputting, by the photographing device, a scene satisfying a photographing effect desired by a user.

Description

White balance calibration method, device and shooting device Technical field

The invention relates to the field of parameter calibration of photographing devices, and in particular to a white balance calibration method, device and photographing device.

Background technique

With the development of photography technology, users have higher and higher requirements for taking pictures, and the use scenes of shooting devices are becoming more and more abundant, such as using the shooting device to take pictures in some special environments such as underwater environments. At present, most of the shooting devices are calibrated for white balance (AWB, Automatic white balance) in a laboratory or in a conventional environment. The white balance value of the image obtained by using the above shooting device in a conventional environment meets the white balance standard; while in a special environment The white balance value of the image obtained by using the above-mentioned imaging device in, has a large deviation compared with the standard white balance value. Therefore, the image captured by the camera in a special environment cannot well restore the colors of the special environment.

Summary of the invention

The invention provides a white balance calibration method, device and photographing device.

Specifically, the present invention is implemented through the following technical solutions:

According to a first aspect of the present invention, there is provided a white balance calibration method applied to a photographing device, the method including:

Acquiring a first white balance value of the marker in a first environment, where the first environment meets environmental conditions of the desired white balance;

Acquiring a second white balance value of the marker in the second environment;

According to the first white balance value and the second white balance value, a white balance calibration parameter in the second environment is determined.

According to a second aspect of the present invention, there is provided a white balance calibration device applied to a photographing device, the white balance calibration device comprising:

Storage device for storing program instructions;

One or more processors call program instructions stored in the storage device, and when the program instructions are executed, the one or more processors are individually or collectively configured to implement the following operations:

Acquiring a first white balance value of the marker in a first environment, where the first environment meets environmental conditions of the desired white balance;

Acquiring a second white balance value of the marker in the second environment;

According to the first white balance value and the second white balance value, a white balance calibration parameter in the second environment is determined.

According to a third aspect of the present invention, there is provided a photographing device, the photographing device comprising:

Image acquisition module for shooting images;

Storage device for storing program instructions;

One or more processors call program instructions stored in the storage device, and when the program instructions are executed, the one or more processors are individually or collectively configured to implement the following operations:

Acquiring a first white balance value of the marker in a first environment, where the first environment meets environmental conditions of the desired white balance;

Acquiring a second white balance value of the marker in the second environment;

According to the first white balance value and the second white balance value, a white balance calibration parameter in the second environment is determined.

It can be seen from the technical solutions provided by the above embodiments of the present invention that the photographing device of the present invention uses the first environment as a reference for white balance calibration in the second environment, allowing users to quickly perform white balance calibration in the second environment; An environment satisfies the environmental conditions of the desired white balance. Using the first environment as a reference for the white balance calibration of the second environment also quickly calibrates the white balance of the camera in the second environment, thereby quickly adjusting the camera to a suitable white balance. The balance helps the camera to output images that meet the user's desired shooting effect.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present invention, the following will briefly introduce the accompanying drawings used in the description of the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative labor.

FIG. 1 is a method flowchart of a white balance calibration method in an embodiment of the present invention;

2 is a usage scene diagram of a white balance calibration method in an embodiment of the present invention;

3 is a method flowchart of a white balance calibration method in another embodiment of the present invention;

4 is a method flowchart of a white balance calibration method in another embodiment of the present invention;

FIG. 5 is a method flowchart of a white balance calibration method in still another embodiment of the present invention;

6 is a structural block diagram of a white balance calibration device in an embodiment of the present invention;

Fig. 7 is a structural block diagram of a photographing device in an embodiment of the present invention.

Detailed ways

The white balance value of the image obtained by using the existing camera in a special environment has a large deviation compared with the standard white balance value. In addition, there is currently a lack of color cards to calibrate the white balance of the camera in a special environment. Therefore, the image captured by the camera in the special environment cannot well restore the colors of the special environment.

In this regard, the camera of the present invention uses the first environment as a reference for white balance calibration in the second environment, allowing users to quickly perform white balance calibration in the second environment; at the same time, since the first environment meets the environmental conditions of the desired white balance , Using the first environment as a reference for white balance calibration in the second environment also quickly calibrates the white balance of the camera in the second environment, so that the camera can be quickly adjusted to a proper white balance, which is beneficial for the output of the camera to satisfy the user The picture of the desired shooting effect.

The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

It should be noted that, in the case of no conflict, the following embodiments and features in the implementation can be combined with each other.

The white balance calibration method of the embodiment of the present invention may be applied to a photographing device, and the photographing device may include, but is not limited to, a camera, an aerial vehicle, a handheld pan/tilt and other equipment with a photographing function.

Fig. 1 is a method flowchart of a white balance calibration method in an embodiment of the present invention. As shown in Fig. 1, the white balance calibration method of this embodiment may include the following steps:

S101: Acquire a first white balance value of the marker in a first environment, where the first environment meets the environmental conditions of the expected white balance;

The type of the marker can be selected according to needs. For example, in some embodiments, the marker has a single color suitable for the white balance standard. Optionally, the color of the marker is white, and the marker can be a white card or other White marker; of course, the color of the marker can also be other single colors suitable for the white balance standard. In some embodiments, the marker is the user's hand area. When the user performs white balance calibration on the camera, the user does not need to prepare additional markers, and directly uses the hand area as the marker to make the white balance of the camera The calibration process is more convenient and practical. It is understandable that the marker is not limited to the marker or the user's hand area with a single color suitable for the white balance standard listed in the above-mentioned embodiment, and other markers can also be selected.

The first white balance value can be obtained by the camera in real time, or can be stored in the camera in advance.

Wherein, the process of obtaining the first white balance value of the marker in the first environment may include but is not limited to the following steps:

(1) When the marker is placed in the first environment, photograph the marker to obtain the first image;

(2) According to the first image, determine the first white balance value of the marker.

In some embodiments, before the landmark is photographed and the first image is obtained, the first target frame is displayed on the shooting screen of the photographing device to prompt that the landmark is at least partially placed in the first target frame to ensure that the photographing device captures To the marker. The first target frame of this embodiment is set in the central area of the shooting frame. Of course, the above-mentioned first target frame can also be set at other positions of the shooting frame. The first target frame can be rectangular, square, or other shapes, which is not specifically limited here.

Further, in some embodiments, when the camera detects that the marker satisfies the first preset strategy, the camera captures the marker to obtain the first image. Wherein, the marker satisfies the first preset strategy to ensure the accuracy of the first white balance value determined by the camera. Optionally, the first preset strategy includes: the area ratio of the marker in the first target frame exceeds a first preset ratio threshold, and the first preset ratio threshold can be set as needed, such as the first preset The threshold of the proportion can be greater than or equal to 80% and less than or equal to 100%, or can be set to other values. Optionally, the first preset strategy includes: the marker is located at the center position of the first target frame, for example, the center position of the marker coincides with the center position of the first target frame. Of course, the first preset strategy can also be set to other. For example, when the marker is a square card, the four corners of the card coincide with the four corners of the first target frame, or the edge of the card coincides with the edge of the first target frame, and so on.

In some embodiments, the camera uses the above steps (1) and (2) to obtain the first white balance value in real time; in some embodiments, the camera uses the above steps (1) and (2) to obtain the first white balance value in advance. The white balance value is stored in the storage unit of the photographing device, such as a hard disk. When the photographing device performs white balance calibration, it can directly obtain the pre-stored first white balance value from the storage unit.

The user may trigger the camera to perform step S101, or when the camera recognizes the landmark, the camera automatically triggers the camera to perform step S101.

Optionally, in some embodiments, before the marker is photographed and the first image is obtained, the white balance calibration method further includes: receiving a first trigger instruction, that is, triggering the imaging device to perform the steps by the first trigger instruction In S101, the function of triggering the camera to execute step S101 by the user is realized. Among them, the first trigger instruction is used to instruct the camera to enter the custom white balance calibration mode. The first trigger instruction can be sent by an external device capable of controlling the camera such as a mobile phone, a tablet computer, or a remote control, or it can be sent by the camera on the camera. When the control part such as a button, button or knob is triggered, the user operates an external device or control part to trigger the camera to execute S101. In this embodiment, when the imaging device detects that the marker satisfies the first preset strategy and receives the first trigger instruction, it will capture the marker to obtain the first image.

Among them, the environmental condition of the desired white balance can be an environmental condition that meets the standard white balance, that is, the white balance of the shooting device in the first environment meets the standard white balance. At this time, the first white balance value also meets the standard white balance requirements. The device uses the first environment that meets the environmental conditions of the standard white balance as a reference, and performs white balance calibration on the second environment, thereby restoring the white balance of the camera in the second environment to the standard white balance, which is beneficial for the camera to output high-quality images ; Of course, the desired environmental conditions for white balance can also be environmental conditions with other white balance effects. The environmental conditions with other white balance effects are used as a reference to perform white balance calibration on the second environment so that the camera is in the second environment To achieve different shooting effects.

S102: Acquire a second white balance value of the marker in the second environment;

In this embodiment, the first environment and the second environment have different environmental conditions, such as different locations in the same area, different time periods in the same scene, different areas, and so on.

For example, in some embodiments, the first environment and the second environment are different locations in the same area, where different locations have different background colors. Optionally, the first environment includes an environment on the ground or an environment in the air, and the second environment includes an environment under water. The white balance of the camera in the environment on the ground or in the air is effective for the camera in the underwater environment. The white balance is calibrated so that the white balance of the image captured by the camera under the underwater environment can achieve the white balance effect of the camera on the ground or in the air; of course, the first environment and the second environment can also interact In other words, the first environment includes the underwater environment, and the second environment includes the ground environment or the air environment. The white balance of the shooting device in the underwater environment is used to determine the white balance of the shooting device in the ground environment or the air environment. The balance is calibrated to make the white balance of the camera in an environment on the ground or in the air the white balance effect of the camera in an underwater environment. It can be understood that the first environment and the second environment may also be other different positions in the same area, such as different depth positions in the same area, different horizontal positions in the same area, and so on.

In some embodiments, the first environment and the second environment are in different time periods of the same scene, wherein there are changes in ambient light in different time periods. For example, in different periods of a certain area on the ground, different periods of a certain area in the air, or different periods of the same water area, due to changes in sunlight throughout the day, the above-mentioned areas have different ambient light at different time periods, causing the camera to be There are differences in the white balance of the images taken at different time periods in the above areas. After the white balance calibration is performed, the white balance effects of the images captured by the photographing device in each time period can be made consistent, which meets the photographing needs of users. Optionally, the first environment can be a non-sunset period and a non-sunrise period of a certain aerial scene, and the second environment can be a sunset period or a sunrise period of the above aerial scene. Of course, the first environment and the second environment can also be Different time periods in other scenes, or other different time periods in the above scenes.

In some embodiments, the first environment and the second environment are different areas, such as different water areas. Due to the change of the color of the water area, the white balance of the images taken by the camera in the different water areas is different. After performing white balance calibration, the camera can have the same white balance effect in different areas.

In this embodiment, the second white balance value is acquired by the camera in real time, wherein acquiring the second white balance value of the marker in the second environment may include but is not limited to the following steps:

(1) When the marker is placed in the second environment, photograph the marker to obtain a second image;

(2) According to the second image, determine the second white balance value of the marker.

In some embodiments, before the marker is taken and the second image is obtained, the second target frame is displayed on the shooting screen of the camera to prompt the marker to be placed in the second target frame to ensure that the camera captures the marker. The second target frame in this embodiment is set in the central area of the shooting frame. Of course, the above-mentioned second target frame can also be set at other positions of the shooting frame. The second target frame can be rectangular, square, or other shapes, and is not specifically limited here.

Further, in some embodiments, when the camera detects that the marker satisfies the second preset strategy, the camera captures the marker to obtain the second image. Wherein, the marker satisfies the second preset strategy to ensure the accuracy of the second white balance value determined by the camera. Optionally, the second preset strategy includes: the area ratio of the marker in the second target frame exceeds a second preset ratio threshold, and the second preset ratio threshold can be set as required, such as the second preset The threshold of the proportion can be greater than or equal to 80% and less than or equal to 100%, or can be set to other values. Optionally, the second preset strategy includes: the marker is located at the center position of the second target frame, for example, the center position of the marker coincides with the center position of the second target frame. Of course, the second preset strategy can also be set to other, for example, when the marker is a square card, the four corners of the card coincide with the four corners of the second target frame, or the edge of the card coincides with the edge of the second target frame, and so on.

The user may trigger the camera to perform step S102, or when the camera recognizes the landmark, the camera automatically triggers the camera to perform step S102.

Optionally, in some embodiments, before the marker is photographed and the second image is obtained, the white balance calibration method further includes: receiving a second trigger instruction, that is, triggering the imaging device to perform the steps by the second trigger instruction In S102, the function of triggering the camera to execute step S102 by the user is realized. Wherein, the second trigger instruction is used to instruct the camera to enter the custom white balance calibration mode. The second trigger instruction can be sent by an external device capable of controlling the camera such as a mobile phone, a tablet computer, or a remote controller, or it can be sent by the camera on the camera. When the control part such as a button, button or knob is triggered, the user operates an external device or control part to trigger the camera to execute S102. In this embodiment, when the imaging device detects that the marker satisfies the second preset strategy and receives the second trigger instruction, the imaging device captures the marker to obtain the second image.

It should be noted that determining the white balance value of the marker based on the image, such as determining the first white balance value of the marker based on the first image and determining the second white balance value of the marker based on the second image, uses the existing white balance The detection algorithm is implemented.

It can be understood that the first trigger instruction and the second trigger instruction mentioned in the embodiment of the present invention may not be triggered by the user, but may be generated by detecting preset conditions. For example, during the shooting process, if the current The environment and the previous environment may cause the white balance difference of the captured image, you can automatically enter the custom white balance calibration mode, and prompt the user to perform the white balance calibration operation.

Further, after receiving the first trigger instruction, it can be assumed that the user is in the custom white balance calibration mode before ending the custom white balance calibration mode without the second trigger instruction. For example, after shooting the first image in the first environment, the second target frame is displayed on the shooting screen of the shooting device, so that when the user shoots an image again, the image defaults to the second image, so that the user can Operate continuously and quickly. In practical applications, multiple first images can be taken in the first environment, and multiple second images can be taken in the second environment. When performing white balance calibration, multiple first images and multiple second images can be taken separately. The two images are fused, and they can also be used in multiple first images and multiple second images respectively. For example, it can be selected by the user. In this way, it can avoid the lack of image quality in some cases. When the white balance calibration is not effective.

S103: Determine a white balance calibration parameter in the second environment according to the first white balance value and the second white balance value.

In this embodiment, the first white balance value includes at least two of the following: the first color component ratio R/G of the red component R and the green component G of the marker in the first environment, and the marker in the first environment The second color component ratio R/B of the red component R and the blue component B, and the third color component ratio G/B of the green component G and blue component B of the marker in the first environment; correspondingly, the second The white balance value includes at least two of the following: the fourth color component ratio R1/B1 of the red component R1 and the green component G1 of the marker in the second environment, the red component R1 and blue of the marker in the second environment The fifth color component ratio R1/B1 of the component B1, and the sixth color component ratio G1/B1 of the green component G1 and the blue component B1 of the marker in the second environment.

In this embodiment, the color component ratios of the first white balance value and the second white balance value correspond to each other, that is, if the first white balance value includes: R/G and R/B, the second white balance value includes : R1/G1 and R1/B1; if the first white balance value includes: R/G and G/B, the second white balance value includes: R1/G1 and G1/B1; if the first white balance value includes: R /B and G/B, the second white balance value includes: R1/B1 and G1/B1; if the first white balance value includes: R/G, R/B and G/B, the second white balance value includes : R1/G1, R1/B1 and G1/B1. According to the ratio of the corresponding color components in the first white balance value and the second white balance value, the white balance calibration parameter in the second environment can be determined.

In this embodiment, when determining the white balance calibration parameters in the second environment based on the first white balance value and the second white balance value, the second set of color component ratios is determined based on at least two of the following three sets of color component ratios. White balance calibration parameters under the environment: R/G and R1/G1, R/B and R1/B1, G/B and G1/B1. Further, the white balance calibration parameter includes at least two of the following ratios: R/G: R1/G1, R/B: R1/B1, G/B: G1/B1.

Specifically, the following formula (1) is used to calculate the white balance calibration parameters x, y, and z:

In some embodiments, two of x, y, and z are determined according to the first white balance value and the second white balance value; in some embodiments, according to the first white balance value and the second white balance value , Determine x, y, and z.

Of course, the calculation method of the white balance calibration parameters x, y, z is not limited to the above formula (1), and other methods may also be used.

Since there may be changes in ambient light and/or background color in different locations in the second environment, resulting in white balance differences between the images captured by the camera at different locations in the second environment, the above steps S101 to S101 can be used. S103 performs white balance calibration on different positions in the second environment to obtain white balance calibration parameters for different positions in the second environment, so that the white balance of the images captured by the camera at different positions in the second environment has the same effect. In this embodiment, the white balance calibration parameter changes with the change of the position of the marker in the second environment. Optionally, the white balance calibration parameter changes with the change of the depth position of the marker in the second environment. Take seawater as an example. As the depth deepens, the color of the seawater gradually darkens. The white balance calibration parameters change with the depth position of the marker in the seawater; optionally, the white balance calibration parameters follow the level of the marker in the second environment. The position (the horizontal direction is the direction perpendicular to the depth direction) changes.

In a specific embodiment, the first environment is a water environment, and the second environment is an underwater environment. As shown in FIG. 2, the implementation process of the white balance calibration method specifically includes:

(1) When on the water, the user operates the buttons on the camera to trigger the camera to enter the custom white balance calibration mode. A first target frame appears in the shooting screen, prompting the user to place the white card (that is, the white card) in the second A target frame (full of the first target frame) is then photographed to obtain the first image; the gain value of the white card in the first target frame in the first environment calculated by the shooting device (ie R/ At least two of G, R/B and G/B), and save the gain value in the first environment in the storage unit of the camera;

(2) After entering underwater, the user operates the button on the camera to trigger the camera to enter the custom white balance calibration mode, the camera pops up the second target frame, and fills the second target with the same white card in step (1) Frame, the second image is obtained by shooting; the shooting device calculates the gain value of the white card in the second target frame in the second environment according to the second image (ie at least two of R1/G1, R1/B1 and G1/B1) ；

(3) Determine the white balance calibration parameters x, y, and z in the second environment based on the gain value in the first environment obtained in step (1) and the gain value in the second environment obtained in step (2).

Among them, the user can use the above white balance calibration process to complete the white balance calibration of the camera in the second environment every time before using the camera to shoot in the second environment; of course, the above white balance calibration can also be completed at a certain time After the process, save the determined white balance calibration parameters in the second environment in the camera. Next time you use the camera to shoot in the second environment, directly call the white balance calibration in the second environment saved in the camera. The parameters can make the images shot in the second environment have the desired white balance effect, without the user having to repeat the white balance calibration. As shown in FIG. 3, the white balance calibration method of this embodiment may further include:

S301: Save the white balance calibration parameter in the shooting device.

In this embodiment, the white balance calibration parameters are stored in the storage unit of the shooting device, which is convenient for the next use. The white balance calibration parameters can be stored in the hard disk of the camera, or the white balance calibration parameters can be stored in other storage units of the camera. Further, the white balance calibration parameters of different positions in the second environment and the corresponding positions of the second environment are stored in the photographing device in a one-to-one correspondence.

So far, the white balance calibration of the shooting device in the second environment is completed. When the shooting device is shooting in the second environment, the white balance parameters can be used to calibrate the real-time shot images, so that the images shot in the second environment can be calibrated. The ratio between the red component, the green component and the blue component is the same as the ratio between the red component, the green component and the blue component of the image captured by the camera in the first environment, so that the camera captured in the second environment The image has the desired white balance effect to meet the user's shooting needs.

Referring to FIG. 4, the white balance calibration method of this embodiment may further include the following steps:

S401: Acquire a target image in the second environment;

In some embodiments, step S401 is executed by the user triggering the camera. The user can operate an external device capable of controlling the camera, such as a mobile phone, tablet, remote control, etc., to trigger the camera to execute step S401. Of course, the user can also operate the camera The shutter button on the button or the button on the handle of the hand-held pan/tilt trigger triggers the camera to perform step S401.

In some embodiments, step S401 is automatically triggered by the camera. For example, when the camera follows the target in the second environment, it automatically acquires the target image in the second environment.

S402: Perform white balance correction on the target image according to the white balance calibration parameter.

When performing white balance correction on the target image according to the white balance calibration parameters, specifically, obtain the red component R2, green component G2, and blue component B2 of each pixel of the target image, and for each pixel, the following adjustments are used At least two of the strategies:

Adjusted to

will

Adjusted to

will

Adjusted to

So that the white balance of the target image meets the expected white balance effect.

Further, in some embodiments, the white balance calibration method may further include the following steps:

S501: It is detected that the camera is in the second environment, and the camera is triggered to enter the white balance correction mode;

The imaging device of this embodiment performs white balance correction on the target image according to the white balance calibration parameters in the white balance correction mode, that is, step S402 is executed after step S501.

Wherein, the camera can perform step S401 and step S501 at the same time, or can perform step S401 and step S501 in a sequential order. In the embodiment shown in FIG. 5, the camera first performs step S501 and then step S401.

In this embodiment, the camera detects that the camera is in the second environment, that is, automatically enters the white balance correction mode to perform white balance correction on the target image, and the camera can directly output the target image that meets the desired white balance effect. It is understandable that in other embodiments, the user can also trigger the camera to enter the white balance correction mode. The user can trigger the camera to enter the white balance correction mode by operating an external device, or by operating a specific button on the camera, A specific button or specific knob triggers the camera to enter the white balance correction mode.

Corresponding to the white balance calibration method of the foregoing embodiment, an embodiment of the present invention also provides a white balance calibration device, which can be applied to a photographing device. Referring to FIG. 6, the white balance calibration device of this embodiment may include: a first storage device and a first processor.

The first storage device is used to store program instructions; one or more first processors call the program instructions stored in the first storage device. When the program instructions are executed, the one or more first processors individually or jointly The ground is configured to perform the following operations: obtain the first white balance value of the marker in the first environment, the first environment meets the environmental conditions of the desired white balance; obtain the second white balance value of the marker in the second environment ; According to the first white balance value and the second white balance value, determine the white balance calibration parameters in the second environment.

The first processor can implement the white balance calibration method of the embodiment shown in FIG. 1, FIG. 3, FIG. 4, and FIG. 5, and the white balance calibration device of this embodiment can be described with reference to the white balance calibration method of the above embodiment .

An embodiment of the present invention also provides a photographing device. Referring to FIG. 7, the photographing device of this embodiment may include: an image acquisition module, a second storage device, and a second processor.

Among them, the image acquisition module is used to capture images; the second storage device is used to store program instructions; one or more second processors call the program instructions stored in the second storage device, and when the program instructions are executed, one or more The second processor is individually or collectively configured to perform the following operations: obtain the first white balance value of the marker in the first environment, the first environment meets the environmental conditions of the desired white balance; obtain the marker in the second The second white balance value under the environment; according to the first white balance value and the second white balance value, the white balance calibration parameter under the second environment is determined.

The second processor can implement the white balance calibration method of the embodiments shown in FIG. 1, FIG. 3, FIG. 4, and FIG. 5 of the present invention. The white balance calibration method of the foregoing embodiment may be referred to for the description of the photographing device in this embodiment.

The photographing device in this embodiment includes an aerial photographing aircraft or a handheld gimbal, and may also include a camera or other photographing devices.

The aforementioned storage device may include volatile memory, such as random-access memory (RAM); the storage device may also include non-volatile memory, such as flash memory ( flash memory, hard disk drive (HDD) or solid-state drive (SSD); the storage device may also include a combination of the foregoing types of memory.

The foregoing processor may be a central processing unit (CPU). The processor can also be other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application-specific integrated circuit (ASIC), field-programmable gate array (FPGA) ) Or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.

In addition, an embodiment of the present invention also provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of the white balance calibration method in the foregoing embodiment are implemented.

The computer-readable storage medium may be an internal storage unit of the photographing device described in any of the foregoing embodiments, such as a hard disk or a memory. The computer-readable storage medium may also be an external storage device of the camera, such as a plug-in hard disk, a smart media card (SMC), an SD card, a flash memory card (Flash Card), etc. equipped on the device . Further, the computer-readable storage medium may also include both an internal storage unit of the photographing device and an external storage device. The computer-readable storage medium is used to store the computer program and other programs and data required by the photographing device, and can also be used to temporarily store data that has been output or will be output.

A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing relevant hardware through a computer program. The program can be stored in a computer readable storage medium. During execution, it may include the procedures of the above-mentioned method embodiments. Wherein, the storage medium may be a magnetic disk, an optical disc, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM), etc.

The above-disclosed are only some embodiments of the present invention, which of course cannot be used to limit the scope of rights of the present invention. Therefore, equivalent changes made according to the claims of the present invention still fall within the scope of the present invention.

Claims (73)

1. A white balance calibration method applied to a photographing device, characterized in that the method includes:

   Acquiring a first white balance value of the marker in a first environment, where the first environment meets environmental conditions of a desired white balance;

   Acquiring a second white balance value of the marker in the second environment;

   According to the first white balance value and the second white balance value, a white balance calibration parameter in the second environment is determined.
2. The method according to claim 1, wherein the first environment and the second environment are different locations in the same area, wherein different locations have different background colors.
3. The method according to claim 2, wherein the first environment includes an environment on the ground or an air environment, and the second environment includes an underwater environment.
4. The method according to claim 1, wherein the first environment and the second environment are in different time periods of the same scene, wherein there are changes in ambient light in different time periods.
5. The method according to claim 1, wherein the marker has a single color suitable for white balance standards.
6. The method of claim 5, wherein the color of the marker is white.
7. The method of claim 1, wherein the marker is a user's hand area.
8. The method according to claim 1, wherein the first white balance value is pre-stored in the photographing device.
9. The method according to claim 1, wherein the obtaining the first white balance value of the marker in the first environment comprises:

   When the marker is placed in the first environment, photograph the marker to obtain a first image;

   According to the first image, the first white balance value of the marker is determined.
10. The method according to claim 9, characterized in that, before the photographing the landmark to obtain the first image, the method further comprises:

    A first target frame is displayed on the shooting screen of the shooting device to prompt that the marker is at least partially placed in the first target frame.
11. The method according to claim 10, wherein the photographing the landmark to obtain the first image comprises:

    When it is detected that the area proportion of the marker in the first target frame exceeds a first preset proportion threshold or the marker is located at the center of the first target frame, photograph the marker, Get the first image.
12. The method according to claim 9, characterized in that, before the photographing the marker to obtain the first image, the method further comprises:

    A first trigger instruction is received, where the first trigger instruction is used to instruct the camera to enter a custom white balance calibration mode.
13. The method according to claim 1, wherein said obtaining a second white balance value of the marker in a second environment comprises:

    When the marker is placed in the second environment, photograph the marker to obtain a second image;

    According to the second image, a second white balance value of the marker is determined.
14. The method according to claim 13, characterized in that, before the photographing the landmark to obtain the second image, the method further comprises:

    A second target frame is displayed on the shooting screen of the shooting device to prompt that the marker is placed in the second target frame.
15. The method according to claim 14, wherein the photographing the marker to obtain the second image comprises:

    When it is detected that the area proportion of the marker in the second target frame exceeds a second preset proportion threshold or the marker is located at the center of the second target frame, the marker is photographed, Get the second image.
16. The method according to claim 13, characterized in that, before the photographing the landmark to obtain the second image, the method further comprises:

    A second trigger instruction is received, where the second trigger instruction is used to instruct the camera to enter the custom white balance calibration mode.
17. The method according to claim 1, wherein the first white balance value includes at least two of the following:

    The first color component ratio of the red component to the green component of the marker in the first environment, the second color component ratio of the red component to the blue component of the marker in the first environment, and the The third color component ratio of the green component and the blue component of the marker in the first environment;

    The second white balance value includes at least two of the following:

    The fourth color component ratio of the red component to the green component of the marker in the second environment, the fifth color component ratio of the red component to the blue component of the marker in the second environment, and the The ratio of the sixth color component of the green component to the blue component of the marker in the second environment;

    The color component ratios of the first white balance value and the second white balance value correspond to each other.
18. The method according to claim 17, wherein the determining the white balance calibration parameter in the second environment according to the first white balance value and the second white balance value comprises:

    Determine the white balance calibration parameter in the second environment according to at least two sets of color component ratios among the following three sets of color component ratios:

    The first color component ratio and the fourth color component ratio, the second color component ratio and the fifth color component ratio, and the third color component ratio and the sixth color component ratio.
19. The method according to claim 18, wherein the white balance calibration parameter includes at least two of the following ratios:

    The ratio of the first color component ratio and the fourth color component ratio, the ratio of the second color component ratio and the fifth color component ratio, and the third color component ratio and the sixth color The ratio of the component ratios.
20. The method of claim 1, wherein the white balance calibration parameter changes with the position of the marker in the second environment.
21. 22. The method of claim 20, wherein the white balance calibration parameter changes with the depth position of the marker in the second environment.
22. The method of claim 1, wherein the method further comprises:

    The white balance calibration parameters are stored in the camera.
23. The method of claim 1, wherein the method further comprises:

    Acquiring a target image in the second environment;

    Perform white balance correction on the target image according to the white balance calibration parameter.
24. The method of claim 23, wherein the method further comprises:

    Detecting that the photographing device is in the second environment, triggering the photographing device to enter a white balance correction mode;

    In the white balance correction mode, white balance correction is performed on the target image according to the white balance calibration parameters.
25. A white balance calibration device applied to a photographing device, wherein the white balance calibration device includes:

    Storage device for storing program instructions;

    One or more processors call program instructions stored in the storage device, and when the program instructions are executed, the one or more processors are individually or collectively configured to implement the following operations:

    Acquiring a first white balance value of the marker in a first environment, where the first environment meets environmental conditions of a desired white balance;

    Acquiring a second white balance value of the marker in the second environment;

    According to the first white balance value and the second white balance value, a white balance calibration parameter in the second environment is determined.
26. The device according to claim 25, wherein the first environment and the second environment are different locations in the same area, wherein different locations have different background colors.
27. The device according to claim 26, wherein the first environment includes an environment on the ground or an air environment, and the second environment includes an underwater environment.
28. The device according to claim 25, wherein the first environment and the second environment are in different time periods of the same scene, wherein there are changes in ambient light in different time periods.
29. The device of claim 25, wherein the marker has a single color suitable for white balance standards.
30. The device of claim 29, wherein the color of the marker is white.
31. The device of claim 25, wherein the marker is a user's hand area.
32. The device according to claim 25, wherein the first white balance value is pre-stored in the photographing device.
33. The device according to claim 25, wherein when the one or more processors obtain the first white balance value of the marker in the first environment, they are separately or collectively further configured to implement Do as follows:

    When the marker is placed in the first environment, photograph the marker to obtain a first image;

    According to the first image, the first white balance value of the marker is determined.
34. The device according to claim 33, wherein the one or more processors are separately or collectively further configured to perform the following operations before taking the marker to obtain the first image:

    A first target frame is displayed on the shooting screen of the shooting device to prompt that the marker is at least partially placed in the first target frame.
35. The device according to claim 34, wherein the one or more processors are separately or collectively further configured to perform the following operations when photographing the landmark to obtain the first image:

    When it is detected that the area proportion of the marker in the first target frame exceeds a first preset proportion threshold or the marker is located at the center of the first target frame, photograph the marker, Get the first image.
36. The device according to claim 33, wherein the one or more processors are separately or collectively further configured to perform the following operations before taking the marker to obtain the first image:

    A first trigger instruction is received, where the first trigger instruction is used to instruct the camera to enter a custom white balance calibration mode.
37. The device according to claim 25, wherein when the one or more processors obtain the second white balance value of the marker in the second environment, they are separately or collectively further configured to use To implement the following operations:

    When the marker is placed in the second environment, photograph the marker to obtain a second image;

    According to the second image, a second white balance value of the marker is determined.
38. The device according to claim 37, wherein the one or more processors are separately or collectively further configured to perform the following operations before capturing the landmark and obtaining the second image:

    A second target frame is displayed on the shooting screen of the shooting device to prompt that the marker is placed in the second target frame.
39. The device according to claim 38, wherein the one or more processors are separately or collectively further configured to perform the following operations when photographing the marker to obtain the second image:

    When it is detected that the area proportion of the marker in the second target frame exceeds a second preset proportion threshold or the marker is located at the center of the second target frame, the marker is photographed, Get the second image.
40. The device according to claim 37, wherein the one or more processors are separately or collectively further configured to perform the following operations before capturing the landmark and obtaining the second image:

    A second trigger instruction is received, where the second trigger instruction is used to instruct the camera to enter the custom white balance calibration mode.
41. The device according to claim 25, wherein the first white balance value comprises at least two of the following:

    The first color component ratio of the red component to the green component of the marker in the first environment, the second color component ratio of the red component to the blue component of the marker in the first environment, and the The third color component ratio of the green component and the blue component of the marker in the first environment;

    The second white balance value includes at least two of the following:

    The fourth color component ratio of the red component to the green component of the marker in the second environment, the fifth color component ratio of the red component to the blue component of the marker in the second environment, and the The ratio of the sixth color component of the green component to the blue component of the marker in the second environment;

    The color component ratios of the first white balance value and the second white balance value correspond to each other.
42. The device according to claim 41, wherein the one or more processors determine the white balance calibration in the second environment according to the first white balance value and the second white balance value. Parameters, individually or collectively, are further configured to implement the following operations:

    Determine the white balance calibration parameter in the second environment according to at least two sets of color component ratios among the following three sets of color component ratios:

    The first color component ratio and the fourth color component ratio, the second color component ratio and the fifth color component ratio, and the third color component ratio and the sixth color component ratio.
43. The device of claim 42, wherein the white balance calibration parameter comprises at least two of the following ratios:

    The ratio of the first color component ratio and the fourth color component ratio, the ratio of the second color component ratio and the fifth color component ratio, and the third color component ratio and the sixth color The ratio of the component ratios.
44. The device of claim 25, wherein the white balance calibration parameter changes with the position of the marker in the second environment.
45. The device of claim 44, wherein the white balance calibration parameter changes with the depth position of the marker in the second environment.
46. The apparatus according to claim 25, wherein the one or more processors, individually or collectively, are further configured to perform the following operations:

    The white balance calibration parameters are stored in the camera.
47. The apparatus according to claim 25, wherein the one or more processors, individually or collectively, are further configured to perform the following operations:

    Acquiring a target image in the second environment;

    Perform white balance correction on the target image according to the white balance calibration parameter.
48. The device according to claim 47, wherein the one or more processors are separately or collectively further configured to perform the following operations:

    Detecting that the photographing device is in the second environment, triggering the photographing device to enter a white balance correction mode;

    In the white balance correction mode, white balance correction is performed on the target image according to the white balance calibration parameters.
49. A photographing device, characterized in that the photographing device comprises:

    Image acquisition module for shooting images;

    Storage device for storing program instructions;

    One or more processors call program instructions stored in the storage device, and when the program instructions are executed, the one or more processors are individually or collectively configured to implement the following operations:

    Acquiring a first white balance value of the marker in a first environment, where the first environment meets environmental conditions of a desired white balance;

    Acquiring a second white balance value of the marker in the second environment;

    According to the first white balance value and the second white balance value, a white balance calibration parameter in the second environment is determined.
50. The photographing device according to claim 49, wherein the first environment and the second environment are different locations in the same area, wherein different locations have different background colors.
51. The photographing device according to claim 50, wherein the first environment includes an environment on the ground or an air environment, and the second environment includes an underwater environment.
52. The photographing device according to claim 49, wherein the first environment and the second environment are in different time periods of the same scene, wherein there are changes in ambient light in different time periods.
53. The imaging device of claim 49, wherein the marker has a single color suitable for a white balance standard.
54. The imaging device of claim 53, wherein the color of the marker is white.
55. The photographing device according to claim 49, wherein the marker is a user's hand area.
56. The photographing device according to claim 49, wherein the first white balance value is pre-stored in the photographing device.
57. The photographing device according to claim 49, wherein the one or more processors are separately or collectively further configured to be used for obtaining the first white balance value of the marker in the first environment. Perform the following operations:

    When the marker is placed in the first environment, photograph the marker to obtain a first image;

    According to the first image, the first white balance value of the marker is determined.
58. The photographing device according to claim 57, wherein the one or more processors are separately or collectively further configured to perform the following operations before photographing the landmark to obtain the first image:

    A first target frame is displayed on the shooting screen of the shooting device to prompt that the marker is at least partially placed in the first target frame.
59. The photographing device according to claim 58, wherein the one or more processors are separately or collectively further configured to perform the following operations when photographing the landmark to obtain the first image:

    When it is detected that the area proportion of the marker in the first target frame exceeds a first preset proportion threshold or the marker is located at the center of the first target frame, photograph the marker, Get the first image.
60. The photographing device according to claim 57, wherein the one or more processors are separately or collectively further configured to perform the following operations before photographing the landmark to obtain the first image:

    A first trigger instruction is received, where the first trigger instruction is used to instruct the camera to enter a custom white balance calibration mode.
61. The photographing device according to claim 49, wherein when the one or more processors obtain the second white balance value of the marker in the second environment, they are separately or collectively further configured to Used to implement the following operations:

    When the marker is placed in the second environment, photograph the marker to obtain a second image;

    According to the second image, a second white balance value of the marker is determined.
62. The photographing device according to claim 61, wherein the one or more processors are separately or collectively further configured to perform the following operations before photographing the landmark to obtain the second image:

    A second target frame is displayed on the shooting screen of the shooting device to prompt that the marker is placed in the second target frame.
63. The photographing device according to claim 62, wherein the one or more processors are separately or collectively further configured to perform the following operations when photographing the landmark to obtain the second image:

    When it is detected that the area proportion of the marker in the second target frame exceeds a second preset proportion threshold or the marker is located at the center of the second target frame, the marker is photographed, Get the second image.
64. The photographing device according to claim 61, wherein the one or more processors are separately or collectively further configured to perform the following operations before photographing the landmark to obtain the second image:

    A second trigger instruction is received, where the second trigger instruction is used to instruct the camera to enter the custom white balance calibration mode.
65. The photographing device according to claim 49, wherein the first white balance value comprises at least two of the following:

    The first color component ratio of the red component to the green component of the marker in the first environment, the second color component ratio of the red component to the blue component of the marker in the first environment, and the The third color component ratio of the green component and the blue component of the marker in the first environment;

    The second white balance value includes at least two of the following:

    The fourth color component ratio of the red component to the green component of the marker in the second environment, the fifth color component ratio of the red component to the blue component of the marker in the second environment, and the The ratio of the sixth color component of the green component to the blue component of the marker in the second environment;

    The color component ratios of the first white balance value and the second white balance value correspond to each other.
66. The photographing device according to claim 65, wherein the one or more processors determine the white balance in the second environment according to the first white balance value and the second white balance value. When calibrating parameters, individually or collectively, they are further configured to implement the following operations:

    Determine the white balance calibration parameter in the second environment according to at least two sets of color component ratios among the following three sets of color component ratios:

    The first color component ratio and the fourth color component ratio, the second color component ratio and the fifth color component ratio, and the third color component ratio and the sixth color component ratio.
67. The photographing device according to claim 66, wherein the white balance calibration parameter comprises at least two of the following ratios:

    The ratio of the first color component ratio and the fourth color component ratio, the ratio of the second color component ratio and the fifth color component ratio, and the third color component ratio and the sixth color The ratio of the component ratios.
68. The photographing device according to claim 49, wherein the white balance calibration parameter changes with the position of the marker in the second environment.
69. The photographing device according to claim 68, wherein the white balance calibration parameter changes with the depth position of the marker in the second environment.
70. The photographing device according to claim 49, wherein the one or more processors are separately or collectively further configured to perform the following operations:

    The white balance calibration parameters are stored in the camera.
71. The photographing device according to claim 49, wherein the one or more processors are separately or collectively further configured to perform the following operations:

    Acquiring a target image in the second environment;

    Perform white balance correction on the target image according to the white balance calibration parameter.
72. The photographing device according to claim 71, wherein the one or more processors are separately or collectively further configured to perform the following operations:

    Detecting that the photographing device is in the second environment, triggering the photographing device to enter a white balance correction mode;

    In the white balance correction mode, white balance correction is performed on the target image according to the white balance calibration parameters.
73. The photographing device according to claim 49, wherein the photographing device comprises an aerial photography aircraft or a handheld pan/tilt.

Images