WO2019047077A1

WO2019047077A1 - White balance processing method of terminal, and terminal and computer-readable storage medium

Info

Publication number: WO2019047077A1
Application number: PCT/CN2017/100776
Authority: WO
Inventors: 缪威
Original assignee: 深圳传音通讯有限公司
Priority date: 2017-09-06
Filing date: 2017-09-06
Publication date: 2019-03-14
Also published as: CN111602390A

Abstract

Disclosed are a white balance processing method of a terminal, and a terminal and a computer-readable storage medium. The method comprises: when a photographing request is detected, starting a color temperature sensor on a terminal, and acquiring the current color temperature value of a photographed object in a viewfinder image of the terminal; determining three primary color RGB data of the photographed object according to the current color temperature value of the photographed object; and determining a white balance parameter according to the RGB data, and carrying out white balance processing on an original imaged picture. The present invention can obtain more accurate RGB data, and a white balance parameter determined according to the more accurate RGB data is also more accurate, and can more truly restore the actual color of a photographed object as closely as possible to the effect of a human eye, thereby improving the user experience.

Description

Terminal white balance processing method, terminal and computer readable storage medium

Technical field

The present invention relates to the field of camera technologies, and in particular, to a terminal white balance processing method, a terminal, and a computer readable storage medium.

Background technique

With the rapid development of the smart phone industry, people are increasingly demanding the camera's camera effect, for example, requiring the image color to be as realistic as possible and close to the human eye.

The human eye has a certain adaptability to the color temperature, so the color seen is less affected by the color temperature shift, and the terminal camera does not have this ability, so the photograph taken and the color seen by the human eye will have a large deviation. , need to perform white balance processing. Some white balance methods are based on the gray world hypothesis algorithm.

The algorithm considers that the statistical average of the three color components of the R, G, and B components of the captured image should be equal. Therefore, the target image is adjusted by statistically averaging the captured image so that the target image is R = G = B, so that the image reaches white balance. Therefore, how to accurately obtain the RGB data of the subject becomes a technical problem worth studying.

In the prior art, it is generally an ISP (Image Signal) on the terminal. Processor image signal processing) reading the captured initial image to obtain the RGB data of the subject. The accuracy of the RGB is determined by the camera and the ISP. The RGB data is greatly affected by the terminal camera and the ISP, and is easily changed by any factor. This leads to inaccurate RGB data.

Summary of the invention

The main object of the present invention is to provide a terminal white balance processing method, which aims to solve the problem that the accuracy of the RGB data of the subject determining the white balance parameter is greatly affected by the terminal camera and the ISP, and is easily caused by any change of factors. The data is not accurate technical issues.

To achieve the above objective, the present invention provides a terminal white balance processing method, and the method includes:

When a shooting request is detected, a color temperature sensor on the terminal is activated to acquire a current color temperature value of the subject in the terminal framing image;

Determining three primary color RGB data of the subject according to a current color temperature value of the subject;

The white balance parameter is determined according to the RGB data, and the original image is subjected to white balance processing.

In an optional implementation manner, after the step of detecting the shooting request, the method includes:

Detecting whether the color temperature sensor is faulty;

If it is detected that the color temperature sensor is not faulty, performing the step of starting the color temperature sensor on the terminal;

If it is detected that the color temperature sensor is faulty, the RGB data of the subject determined according to the image signal processor is acquired, the white balance parameter is determined according to the RGB data, and the terminal framing image is subjected to white balance processing.

In an optional implementation manner, the step of determining a white balance parameter according to the RGB data includes:

A reference area in the subject is determined based on the RGB data, and a white balance parameter is determined based on RGB data of the reference area.

In an optional implementation manner, the determining, according to the RGB data, the reference area in the object includes:

Determining a first ratio of red to blue and a second ratio of red to green according to the RGB data;

If the first ratio is smaller than the first threshold, and the second ratio is smaller than the second threshold, the region corresponding to the RGB ratio is the first reference region, and the first reference region is the reference region.

In an optional implementation manner, if the first ratio is less than the first threshold, and the second ratio is less than the second threshold, the region corresponding to the RGB ratio is after the step of the first reference region include:

If there are multiple first reference regions, compare RGB sizes of the plurality of first reference regions;

A first reference region having the largest RGB is determined, and the first reference region corresponding to the maximum RGB is a reference region.

In an optional implementation manner, the method for processing a terminal white balance further includes:

Obtaining a current color temperature value of the subject when detecting that a color temperature value of the subject changes within the terminal view image;

The current color temperature value is converted into RGB data, and the white balance parameter is updated according to the RGB data.

In an optional implementation manner, the step of determining the three primary colors RGB data of the subject according to the current color temperature value of the subject includes:

Converting a color temperature value of all the objects in the terminal view image into RGB data, and acquiring an average value of the three color channels of the object in R, G, and B according to the RGB data, the average value being the The three primary color RGB data of the subject.

In an optional implementation manner, the determining the white balance parameter according to the RGB data, and performing white balance processing on the original imaging image includes:

Determining an RGB gain value of the white balance according to the RGB data of the reference area, and determining a last correction value of all the objects according to the RGB gain value and RGB data of all the objects;

The RGB data of the corresponding area of all the subjects on the original imaged image is adjusted to the correction value.

In addition, in order to achieve the above object, the present invention further provides a terminal, the terminal comprising: a processor, a color temperature sensor, a camera, a memory, and a terminal white balance processing stored on the memory and executable on the processor The program, when the terminal white balance processing program is executed by the processor, implements the following steps:

In addition, in order to achieve the above object, the present invention further provides a computer readable storage medium, where the terminal white balance processing program is stored, and when the terminal white balance processing program is executed by the processor, the following steps are implemented. :

In the embodiment of the invention, the color temperature sensor is activated to perform color temperature detection, the color temperature value obtained by the color temperature sensor is converted into RGB data, and the final white balance parameter is determined according to the RGB data, and white balance processing is performed; Compared with the camera or ISP, the detected color temperature value is more accurate, and the RGB data converted from the detected color temperature value is more accurate, so the white balance parameter determined according to the more accurate RGB data is also more accurate. To be accurate, it is more realistic to restore the actual color of the subject, as close as possible to the effect of the human eye, and enhance the user experience.

DRAWINGS

1 is a schematic structural diagram of a terminal in a hardware operating environment according to an embodiment of the present invention;

2 is a schematic flowchart of a first embodiment of a method for processing white balance of a terminal according to the present invention;

3 is a schematic flowchart of step S30 in the third embodiment of the terminal white balance processing method according to the present invention;

4 is a schematic flowchart of a prior art process related to a seventh embodiment of a white balance processing method of the present invention;

FIG. 5 is a schematic flowchart diagram of a seventh embodiment of a method for processing a terminal white balance according to the present invention.

The implementation, functional features, and advantages of the present invention will be further described in conjunction with the embodiments.

Detailed ways

It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

In the following description, the use of suffixes such as "module", "component" or "unit" for indicating an element is merely an explanation for facilitating the present invention, and has no specific meaning per se. Therefore, "module", "component" or "unit" can be used in combination.

As shown in FIG. 1, FIG. 1 is a schematic structural diagram of a terminal in a hardware operating environment according to an embodiment of the present invention.

The terminal in the embodiment of the present invention may be a PC, or may be a smart phone, a tablet computer, an e-book reader, and an MP3 (Moving Picture). Experts Group Audio Layer III, Motion Picture Expert Compress Standard Audio Level 3) Player, MP4 (Moving Picture Experts Group Audio Layer IV, motion imaging experts compress standard audio layers 3) players, laptops, PDAs, personal digital assistants (Personal Digital Assistant, PDA), Portable Media Player (Portable Media) Players, PMPs, navigation devices, portable computers, and the like have portable display devices, and fixed terminals such as desktop computers.

The following description will be made by taking a mobile terminal as an example, and those skilled in the art will understand that the configuration according to an embodiment of the present invention can be applied to a fixed type of terminal, in addition to an element particularly for mobile purposes.

As shown in FIG. 1, the terminal may include a processor 1001, such as a CPU, a color temperature sensor 1002, a camera 1003, a memory 1005, and a communication bus 1004. Among them, the communication bus 1004 is used to implement connection communication between these components. The memory 1005 may be a high speed RAM memory or a stable memory (non-volatile) Memory), such as disk storage. The memory 1005 can also optionally be a storage device independent of the aforementioned processor 1001. The color temperature sensor 1002 can be a chip. Camera 1003 can be one or more cameras.

Optionally, the terminal may further include an RF (Radio) Frequency, RF) circuits, sensors, audio circuits, WiFi modules, and more. Among them, sensors such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display according to the brightness of the ambient light, and the proximity sensor may turn off the display and/or when the mobile terminal moves to the ear. Backlighting. As a kind of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (usually three axes), and can detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of the mobile terminal (such as horizontal and vertical screen switching, Related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; of course, the mobile terminal can also be equipped with other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc. No longer.

It will be understood by those skilled in the art that the terminal structure shown in FIG. 1 does not constitute a limitation to the terminal, and may include more or less components than those illustrated, or a combination of certain components, or different component arrangements.

As shown in FIG. 1, a memory white balance processing program is included in a memory 1005 as a computer storage medium.

In the terminal shown in FIG. 1, the camera 1003 is used for framing shooting; the color temperature sensor 1002 is for detecting the color temperature value of the subject in the camera framing image area; and the processor 1001 can be used to call the terminal white stored in the memory 1005. Balance the handler and do the following:

Further, the processor 1001 may call the terminal white balance processing program stored in the memory 1005, and further perform the following operations:

The step after detecting the shooting request includes:

Detecting whether the color temperature sensor is faulty;

The step of determining a white balance parameter according to the RGB data includes:

The determining the reference area in the subject according to the RGB data comprises:

If the first ratio is less than the first threshold, and the second ratio is less than the second threshold, the step of the region corresponding to the RGB ratio being the first reference region includes:

The terminal white balance processing method further includes:

The step of determining the three primary colors RGB data of the subject according to the current color temperature value of the subject includes:

The determining the white balance parameter according to the RGB data, and performing white balance processing on the original imaging image includes:

Referring to FIG. 2, in the first embodiment of the terminal white balance processing method of the present invention, the terminal white balance processing method includes:

Step S10, when detecting the shooting request, starting a color temperature sensor on the terminal, and acquiring a current color temperature value of the object in the terminal framing image;

The terminal generally has a plurality of white balance modes. In this embodiment, one of the automatic white balance modes is used. When the terminal is in the automatic white balance mode, the user inputs a shooting request to the terminal, and the input mode is different according to the terminal. If the terminal is a mobile phone, the user inputs a shooting request, and if the terminal is a camera, the user button is turned on as a shooting request. When the terminal receives the shooting request input by the user, the terminal processor can detect the shooting request, activate the color temperature sensor while starting the shooting device (such as the camera). The color temperature sensor may be adjacent to the camera, and may be connected to the camera under the lens to obtain a color temperature value of the subject within the range of the camera frame.

The subject may have one color or multiple colors. Therefore, the color temperature sensor can detect a plurality of color temperature values.

Step S11, determining three primary color RGB data of the subject according to a current color temperature value of the subject;

Since the subject may be one or more, and the color may be one or more, there may be one or more color temperature values, and there may be more than one corresponding RGB data. The RGB data can refer to three values of red, green, and blue, and can also refer to the ratio of the three values of the three colors. The ratio can have various forms, such as R:G:B=1:1:2 It can also be R:G=1:2, and R:B=1:3. In the case of proportional adjustment, the white balance parameter can be expressed by the ratio between the gain coefficients of the three primary colors of red, green, and blue. According to the ratio between the gain coefficients of the three colors, respectively, the three colors in the color of the captured object. Make adjustments.

The RGB data is obtained according to the color temperature value, and can be calculated according to a specific table or formula, or can be obtained by calling a specific function calculation. Since the conversion of the color temperature value to the RGB data belongs to the prior art, it will not be described again.

Step S12, determining a white balance parameter according to the RGB data, and performing white balance processing on the original image.

The original imaging image in this embodiment refers to an initial image captured by the photographing device that has not been subjected to white balance processing. The RGB data may be multiple, and the RGB data may be averaged according to the RGB data. After the algorithm is calibrated and output to the white balance processing module, the white balance processing module converts the average RGB data into a white balanced RGB gain parameter. White balance processing; a special RGB data (such as white or near-white RGB data) in the RGB data may be selected, and the RGB data is algorithmically calibrated, and then output to the white balance processing module to be converted into a white balance parameter. Or select a special value in the RGB data, perform an operation (such as averaging calculation) to obtain an RGB data, and after performing algorithm calibration, the output to the white balance processing module is converted into a white balance parameter; or A specific algorithm that determines which white balance parameters are determined based on which RGB data.

In the prior art, the sensor (sensor) in the camera device generally outputs the original image, and the ISP (Image Signal) Processor, image signal processing) generally by counting the R/G (red/green) of the entire image, B/G (blue/green), then use an algorithm to estimate which ones need to be reduced to R:G:B=1:1:1. Obtaining RGB data here involves two key components, one is the camera and the other is the ISP. Finally, the accuracy of RGB is affected by these two components, and because the two components need to perform other functions at the same time, the performance requirements of the components are better. At the same time, the acquisition of the physical object RGB is not as good as the function focusing on the color acquisition component.

In this embodiment, at the same time as the terminal photographs, the color temperature sensor is activated to perform color temperature detection, the color temperature value obtained by the color temperature sensor is converted into RGB data, and the final white balance parameter is determined according to the RGB data, and white balance processing is performed; The color temperature sensor has higher accuracy than the camera or ISP, and the detected color temperature value is more accurate, and the RGB data converted from the detected color temperature value is also more accurate, so the white balance parameter determined according to the more accurate RGB data is It is also more accurate, and it can more realistically restore the actual color of the subject, as close as possible to the effect of the human eye, and enhance the user experience.

Further, in the second embodiment of the terminal white balance processing method of the present invention, based on the first embodiment, after the step of detecting the photographing request in the step S10, the step includes:

Step S20, detecting whether the color temperature sensor is faulty;

Step S21, if it is detected that the color temperature sensor has no fault, performing the step of starting the color temperature sensor on the terminal;

Step S22, if it is detected that the color temperature sensor is faulty, acquiring RGB data of the object determined according to the image signal processor, determining a white balance parameter according to the RGB data, and performing white balance processing on the terminal view image.

The color temperature sensor is used as an important component for detecting the color temperature value of the subject, determining the RGB data of the subject, and determining the white balance parameter. In the event of a failure, the image signal processor (ISP) can be used as a spare component in order not to affect the user experience. That is, after detecting the shooting request, if the color temperature sensor is detected to be faulty, the image signal processor (ISP) can be called to read the original image, obtain RGB data, and perform traditional white balance processing; if the color temperature sensor is detected to operate normally, The color temperature sensor is preferentially used to obtain the white balance parameter to ensure the accuracy of the parameter.

In the embodiment, when the color temperature sensor is faulty, the secondary spare component is set, that is, the image signal processor replaces the color temperature sensor, so that when the color temperature sensor is faulty, the terminal can still perform normal white balance processing when shooting. To ensure a good user experience; at the same time, if the color temperature sensor is not faulty, it is preferable to use the color temperature sensor to obtain important parameters and to ensure the accuracy of the finally obtained white balance parameter.

Further, in the third embodiment of the terminal white balance processing method of the present invention, based on the first embodiment or the second embodiment, the step of determining the white balance parameter according to the RGB data in the step S12 includes:

Step S30, determining a reference area in the object according to the RGB data;

Step S31, determining a white balance parameter according to the RGB data of the reference area.

According to a certain algorithm, the reference region in the subject can be determined from the RGB data; the characteristics of the corresponding RGB data can also be determined according to the characteristics of the reference region, thereby determining the reference region. When performing white balance processing, the camera generally needs to select a reference point, and determine the white balance parameter according to the RGB data of the reference point. If the RGB data of the reference point is adjusted to 1:1:1, the entire image can be Restore its true color. The reference area selected in this embodiment is the reference point.

The RGB data can be expressed in the form of (R:G:B). In general, the closer the R, G, and B are, the closer the color of the object is to white or gray or black. According to the conventional white balance technique, white balance calibration is generally performed by using white or gray or black as a reference point, so that an object region having the closest three values of R, G, and B can be selected as the reference region.

The reference area of the subject is determined according to the RGB data converted by the color temperature sensor, and the reference area is used as a reference point for the white balance processing of the imaging apparatus, and the white balance parameter is determined according to the RGB data of the reference area, so that the white balance can be more accurately obtained. The parameter maximizes the image to restore its true color, closer to what the human eye sees, and enhances the user experience.

Specifically, as shown in FIG. 3, step S30 includes:

Step S32, determining a first ratio of red to blue and a second ratio of red to green according to the RGB data;

Step S33: If the first ratio is smaller than the first threshold, and the second ratio is smaller than the second threshold, the region corresponding to the RGB ratio is the first reference region, and the first reference region is the reference region.

The first ratio determined in this embodiment is a ratio of red to blue, and the second ratio is a ratio of red to green, but in practice, the first ratio may refer to a ratio of any two of the three colors of RGB, such as a ratio of red to green. , red-blue ratio, blue-red ratio, etc., the second ratio is determined according to the first ratio, and one color of the first ratio is replaced. If the first ratio is red-green ratio, the second ratio may be red-blue ratio, green blue Than wait.

The first threshold and the second threshold may be the same or different, and should be small enough to reduce the judgment error, which may be set by the terminal or set by the user. If the first ratio is less than the first threshold and the second ratio is less than the second threshold, the three values of the RGB of the corresponding object are relatively close, and the corresponding object region is the first reference region, and the first reference region can be determined as the reference. region.

In this embodiment, by comparing whether the ratio of any two colors of the RGB three colors is smaller than the threshold value, it is further determined whether the RGB three color values are close to each other, and then the region where the RGB three color values are close is used as the reference region, so that the RGB data for determining the white balance parameter is further Accurate, which in turn makes the white balance parameter more accurate and better to restore the actual color of the object.

Further, if the first ratio is smaller than the first threshold and the second ratio is smaller than the second threshold in step S32, the step of the region corresponding to the RGB ratio being the first reference region includes:

Step S33, if there are multiple first reference regions, compare RGB data sizes of the plurality of first reference regions;

Step S34, determining a first reference area having the largest RGB data, and the first reference area corresponding to the maximum RGB data is a reference area.

RGB data can be expressed in the form of (R:G:B). Generally speaking, the closer the R, G, and B are, the closer the color of the object is to white or gray or black, and the larger the three values of R, G, and B are. The closer the object is to white, the smaller it is closer to black. The white area in the subject can be judged based on this rule. The reference area using the white area as the white balance is more accurate than the other colors. Therefore, after the first reference area is determined, if there are multiple first reference areas, it can be determined according to a certain algorithm or a preset rule. White area.

The method used in this embodiment is to compare RGB data sizes. Because RGB data involves the size of three colors, if you want to make a size comparison, you need to determine a value. Since the RGB three values have a small difference (the first reference area ratio is less than the threshold), the maximum of the three colors can be selected to be compared with the maximum of the other areas RGB (for example, RGB1=(250,253) , 252), RGB2 = (250, 254, 252), can be directly compared), you can also use the average of the three colors to compare, or you can choose the largest RGB data according to the specific algorithm. The first reference area corresponding to the maximum RGB data is a reference area.

In this embodiment, by determining the maximum RGB data from the first reference area, and further determining that the first reference area corresponding to the maximum RGB data is the reference area, the white area in the first reference area may be selected as the reference area of the last white balance or The reference area, because of the special nature of white, allows the final imaging to be more accurately restored.

Further, in the fourth embodiment of the terminal white balance processing method of the present invention, the terminal white balance processing method further includes:

Step S40: When it is detected that the color temperature value of the object in the terminal framing image changes, the current color temperature value of the object is acquired;

Step S41, converting the current color temperature value into RGB data, and updating the white balance parameter according to the RGB data.

The color temperature sensor monitors the color temperature of the subject in real time during shooting. If the color temperature changes during shooting, the change should be fed back to the processor and return to the current color temperature value after the subject changes. The changed color temperature value is converted into RGB data by a certain algorithm, and the white balance parameter determined according to the color temperature value before the change is updated according to the RGB data.

In this embodiment, the color temperature sensor responds to the color temperature change in real time, and the changed color temperature value can be fed back in real time, so that the current white balance parameter can be updated according to the change of the color temperature of the subject, so that the picture taken by the terminal at any time can be Obtain a more accurate white balance parameter for white balance processing, and then restore the true color of the subject.

Further, in the fifth embodiment of the terminal white balance processing method of the present invention, based on the first embodiment or the second embodiment or the third embodiment or the fourth embodiment, step S11 includes:

Step S50, converting the color temperature values of all the objects in the terminal framing image into RGB data, and obtaining an average value of the three color channels of the object in R, G, and B according to the RGB data, wherein the average value is The three primary colors RGB data of the subject.

There may be more than one subject, and the same subject or different subjects may have multiple colors, so the color temperature sensor may detect many color temperature values. The plurality of color temperature values detected by the color temperature sensor are converted into a plurality of RGB data, and the RGB data may be values of the object on the three color channels of R, G, and B. Calculating an average value of all the objects in the framing image of the entire camera in the R, G, and B color channels according to all the RGB data, and finally obtaining a unique RGB value, the RGB value is three of the subject The primary color RGB data is to be used as a basis for determining the white balance parameter.

In this embodiment, the unique RGB data that ultimately determines the white balance parameter is determined by the plurality of RGB data converted from the plurality of color temperature values, so that the step of determining the white balance parameter is performed smoothly; determining the subject in R, G, and B. The average value of the color channels is used as the unique RGB data, which integrates the overall RGB data of the subject, ensuring a certain degree of accuracy, and ensuring accurate restoration of the actual object color by the subsequent white balance processing.

Further, in the sixth embodiment of the terminal white balance processing method of the present invention, based on the first embodiment or the second embodiment or the third embodiment or the fourth embodiment or the fifth embodiment, step S12 includes:

Step S60, determining an RGB gain value of the white balance according to the RGB data of the reference area, and determining a final correction value of all the objects according to the RGB gain value and RGB data of all the objects;

Step S61, adjusting RGB data of corresponding regions of all the subjects on the original imaging image to the correction value.

In general, after adjusting the RGB data as the reference area to 1:1:1, the colors of other areas are also restored to their true colors.

There are three CCD electronic coupling components inside the camera. They respectively sense the blue, green and red light. In the preset case, the electronic amplification ratios of the three photosensitive circuits are the same, which is 1:1:1, white balance. The adjustment is to change this proportional relationship according to the scene being adjusted. For example, the ratio of blue, green, and red light of the adjusted scene is 2:1:1 (more blue light ratio, higher color temperature), then the ratio of white balance adjustment is 1:2:2, the adjusted circuit The proportion of the apparent blue in the magnification ratio is reduced, and the ratio of green to red is increased, so that the adjusted scene passes through the white balance adjustment circuit to the captured image, and the ratios of blue, green, and red are the same. That is to say, if the white that is adjusted is a little blue, then the white balance adjustment changes the normal proportional relationship to weaken the amplification of the blue circuit, and at the same time increases the ratio of green and red, so that the resulting image is still white.

In this embodiment, the RGB gain value of the white balance is to adjust the RGB data of the reference region to an amplification ratio of 1:1:1, such as the RGB data of the reference region is R:G:B=1:1:2, Adjust it to R:G:B=1:1:1 The required magnification ratio is R:G:B=2:2:1.

In the RGB data value of all the subjects in the embodiment, the RGB data (three ratios) of the subject in the original image or the original image, the RGB gain value according to the white balance and the RGB data of the subject The final correction value of all the subjects, that is, the last restored RGB data, is determined.

After determining the above white balance parameter, the RGB data of the corresponding area of the subject on the original image is adjusted to the correction value according to the RGB gain value of the white balance.

In this embodiment, the white balance RGB gain value is determined according to the RGB value of the reference region, and then the RGB data of the subject converted from the color temperature value detected by the color temperature sensor is used to determine the RGB of the corresponding region of the subject on the original imaging image. The final correction value avoids the inaccuracy of the final correction value due to the inaccuracy of the camera or ISP, so that the final restored color is closer to the real color, and the picture is closer to the human eye to improve the user experience.

For ease of understanding, referring to FIG. 4 and FIG. 5, in the seventh embodiment of the terminal white balance processing method of the present invention, based on Google Android Software Architecture, This Embodiment is described. 4 is a related prior art drawing, and FIG. 5 is a schematic view of a modification of the present embodiment.

This embodiment is based on the Google Android software architecture (can be Android 6.0 and above) and the three-party color temperature sensor chip implementation, the relevant code is written in the hal layer (hardware abstraction layer), the kernel layer (kernel layer), and the three-party algorithm library.

The shooting of this embodiment is started by a three-party camera application, and the user opens the camera. The app starts shooting, and opens the three-party library when the hal layer starts isp processing. Specifically, the loadSmartCam() is called in the constructor of the hal layer IspTuningMgr to open the three-party library libsmartcam_asb5.so, and the color temperature sensor driver interface is called in the three-party library to obtain the color temperature. In IspTuningMgr::init, call the start function in the library to start working (call the wake-up awake interface of the color temperature sensor driver interface), call the correlation function in the library in IspTuningMgr::setAWBGain to obtain the color temperature and convert it into RGB values, and perform algorithm calibration. And output the final RGB value to 3A (automatic exposure control (AE), auto focus control (AF), automatic white balance control (AWB)) for AWB processing, and finally through ISP image processing, and finally achieve dynamic calibration according to color temperature.

The embodiment can be based on the kernel driver of kernel-3.18, and the driver is written according to the nxu8010 chip data manual of the color temperature sensor, and mainly realizes the following functional interfaces: an initialization node, a node for obtaining the value of RGBW, and a node for letting the chip sleep, The node used to wake up the chip, the node used to provide factory and engineering mode display information, and the node used to view the working state during debugging.

This embodiment can implement the processing of opening the three-party library and the 3A and the ISP based on the 3A and ISP related files of the hal layer of the MTK platform. The call to the driver interface and the algorithm processing can be implemented based on the three-party library file libsmartcam_asb5.so of NEUSCHIPS. Code debugging can be performed based on the Android system compilation environment.

The specific function or proper noun or interface layer in this embodiment is an Android system or related prior art, and will not be described again.

As can be seen from the technical scheme diagram and description, the present embodiment compensates the RGB gain of the automatic white balance, so that the picture obtains a color similar to the eye, so that the picture color is more realistic and accurate.

In addition, the embodiment of the present invention further provides a computer readable storage medium, where the terminal white balance processing program is stored, and when the terminal white balance processing program is executed by the processor, the implementation is as described in the foregoing embodiment. The steps described. Because the specific content is generally consistent, it will not be repeated.

It is to be understood that the term "comprises", "comprising", or any other variants thereof, is intended to encompass a non-exclusive inclusion, such that a process, method, article, or It also includes other elements that are not explicitly listed, or elements that are inherent to such a process, method, item, or system. An element defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in a process, method, article, or system that includes the element, without further limitation.

The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

Through the description of the above embodiments, those skilled in the art can clearly understand that the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is better. Implementation. Based on such understanding, portions of the technical solution of the present invention that contribute substantially or to the prior art may be embodied in the form of a software product stored in a storage medium (such as a ROM/RAM as described above). , a disk, an optical disk, including a number of instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the methods described in various embodiments of the present invention.

The above are only the preferred embodiments of the present invention, and are not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the description of the present invention and the drawings are directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of the present invention.

Claims

A terminal white balance processing method, wherein the terminal white balance processing method comprises:

When a shooting request is detected, a color temperature sensor on the terminal is activated to acquire a current color temperature value of the subject in the terminal framing image;

Determining three primary color RGB data of the subject according to a current color temperature value of the subject;

The white balance parameter is determined according to the RGB data, and the original image is subjected to white balance processing.
The terminal white balance processing method according to claim 1, wherein the step of detecting the photographing request comprises:

Detecting whether the color temperature sensor is faulty;

If it is detected that the color temperature sensor is not faulty, performing the step of starting the color temperature sensor on the terminal;

If it is detected that the color temperature sensor is faulty, the RGB data of the subject determined according to the image signal processor is acquired, the white balance parameter is determined according to the RGB data, and the terminal framing image is subjected to white balance processing.
The terminal white balance processing method according to claim 1, wherein the step of determining a white balance parameter according to the RGB data comprises:

A reference area in the subject is determined based on the RGB data, and a white balance parameter is determined based on RGB data of the reference area.
The terminal white balance processing method according to claim 3, wherein the determining the reference region in the subject based on the RGB data comprises:

Determining a first ratio of red to blue and a second ratio of red to green according to the RGB data;

If the first ratio is smaller than the first threshold, and the second ratio is smaller than the second threshold, the region corresponding to the RGB ratio is the first reference region, and the first reference region is the reference region.
The terminal white balance processing method according to claim 4, wherein if the first ratio is smaller than a first threshold and the second ratio is smaller than a second threshold, an area corresponding to the RGB ratio is The steps of the first reference area are followed by:

If there are multiple first reference regions, compare RGB sizes of the plurality of first reference regions;

A first reference region having the largest RGB is determined, and the first reference region corresponding to the maximum RGB is a reference region.
The terminal white balance processing method according to claim 1, wherein the terminal white balance processing method further comprises:

Obtaining a current color temperature value of the subject when detecting that a color temperature value of the subject changes within the terminal view image;

The current color temperature value is converted into RGB data, and the white balance parameter is updated according to the RGB data.
The terminal white balance processing method according to claim 1, wherein the determining the three primary colors RGB data of the subject according to the current color temperature value of the subject comprises:

Converting a color temperature value of all the objects in the terminal view image into RGB data, and acquiring an average value of the three color channels of the object in R, G, and B according to the RGB data, the average value being the The three primary color RGB data of the subject.
The terminal white balance processing method according to claim 3, wherein the step of determining a white balance parameter according to the RGB data, and performing white balance processing on the original imaging image comprises:

Determining an RGB gain value of the white balance according to the RGB data of the reference area, and determining a last correction value of all the objects according to the RGB gain value and RGB data of all the objects;

The RGB data of the corresponding area of all the subjects on the original imaged image is adjusted to the correction value.
A terminal, comprising: a processor, a color temperature sensor, a camera, a memory, and a terminal white balance processing program stored on the memory and executable on the processor, the terminal white balance The following steps are implemented when the handler is executed by the processor:

When a shooting request is detected, a color temperature sensor on the terminal is activated to acquire a current color temperature value of the subject in the terminal framing image;

Determining three primary color RGB data of the subject according to a current color temperature value of the subject;

The white balance parameter is determined according to the RGB data, and the original image is subjected to white balance processing.
A computer readable storage medium, wherein the computer readable storage medium stores a terminal white balance processing program, and when the terminal white balance processing program is executed by the processor, the following steps are implemented:

When a shooting request is detected, a color temperature sensor on the terminal is activated to acquire a current color temperature value of the subject in the terminal framing image;

Determining three primary color RGB data of the subject according to a current color temperature value of the subject;

The white balance parameter is determined according to the RGB data, and the original image is subjected to white balance processing.