CN114765681A - Method, device, terminal, system and storage medium for detecting color temperature - Google Patents

Abstract

The present application relates to the technical field of color temperature detection and processing, and provides a color temperature detection method, device, terminal, system and storage medium. The present application obtains the comprehensive photosensitive information collected by various focusing pixels in the image sensor to ambient light; the color channels used by different focusing pixels are different; based on the preset corresponding relationship between the comprehensive photosensitive information and the color temperature, the The color temperature corresponding to the comprehensive photosensitive information is used as the color temperature measured by the image sensor for the ambient light. It can be seen that in the above method for detecting color temperature, the color temperature detection function is transferred to the image sensor, and the color temperature of the ambient light is measured through a variety of focusing pixels in different color channels of the image sensor. The color temperature detection of light does not need to install additional color temperature sensors, which saves installation space and adapts to the development of miniaturization of equipment.

Description

Method, device, terminal, system and storage medium for detecting color temperature

technical field

The present application relates to the technical field of color temperature detection processing, and in particular, to a method, device, terminal, system and storage medium for detecting color temperature.

Background technique

With the development of sensor processing technology, a technology for detecting color temperature using a sensor has emerged. This technology is widely used in terminals such as mobile phones and tablet computers. The terminal can obtain the color temperature based on the installed color temperature sensor, and then realize intelligent adjustment based on the detected color temperature.

However, with the development trend of miniaturization of terminals, there is gradually less space for installing various devices in the terminal. In the case of ensuring that the terminal performs intelligent adjustment based on the detected color temperature, it is necessary to further save the installation space of the terminal to adapt to the development trend of miniaturization of the terminal.

SUMMARY OF THE INVENTION

The embodiments of the present application provide a method, device, terminal, system and storage medium for detecting color temperature, which can realize color temperature detection on the basis of ensuring the focusing function of an image sensor.

A method for detecting color temperature, the method comprising:

Obtain the comprehensive photosensitive information collected by various focusing pixels in the image sensor to the ambient light; the color channels used by different focusing pixels are different;

Based on the preset correspondence between the comprehensive light-sensing information and the color temperature, the color temperature corresponding to the comprehensive light-sensing information is determined as the color temperature measured by the image sensor for the ambient light.

In one of the embodiments, the color channel used by one of the focus pixels of the plurality of focus pixels is a white channel.

In one of the embodiments, before acquiring the comprehensive light-sensing information obtained by multiple focusing pixels in the image sensor collected from the ambient light, the method further includes:

When the image sensor is in a non-imaging mode, each imaging pixel in the image sensor is controlled to be in a photosensitive measurement off state, and the various focusing pixels are controlled to be in a photosensitive measurement on state.

In one embodiment, the method further includes:

Determine the corresponding relationship between the preset comprehensive photosensitive information and light intensity,

Based on the preset correspondence between the comprehensive light-sensing information and light intensity, the light intensity corresponding to the comprehensive light-sensing information is determined, and the light intensity corresponding to the comprehensive light-sensing information is used as a reference light intensity; the reference light intensity It is used to adjust the screen brightness of the terminal screen under the ambient light.

In one embodiment, the method further includes:

When the image sensor is in the imaging mode, based on the light intensity corresponding to the comprehensive light-sensing information and the color temperature corresponding to the comprehensive light-sensing information, the white balance for the image sensor is adjusted.

In one of the embodiments,

The method also includes:

Obtaining the calibrated color temperature of multiple test ambient lights; the multiple test ambient lights are given ambient lights in the test scene;

Obtain the comprehensive photosensitive information collected by the multiple focusing pixels on the multiple test ambient lights, and obtain multiple sets of color temperature photosensitive test results; wherein, the calibration color temperature and comprehensive photosensitive information in the color temperature photosensitive test results of the same group corresponds to the same test. ambient light;

Based on the multiple sets of color temperature sensitivity test results, determine the corresponding relationship between the comprehensive photosensitive information and the color temperature;

and / or,

The method also includes:

Acquiring the calibrated light intensities of multiple test ambient lights; the multiple test ambient lights are given ambient lights in the test scene;

Acquire comprehensive photosensitive information collected by multiple focusing pixels for the multiple test ambient lights, and obtain multiple sets of light intensity photosensitive test results; wherein, the calibrated light intensity and comprehensive photosensitive information in the same group of light intensity photosensitive test results correspond to the same test ambient light;

Based on the multiple sets of light-intensity photosensitive test results, the corresponding relationship between the comprehensive photosensitive information and the light intensity is determined.

In one embodiment, the acquiring comprehensive photosensitive information obtained by multiple focusing pixels in the image sensor collected from ambient light includes:

Acquiring the photosensitive information collected by each focusing pixel on the ambient light;

Statistically adopt the photosensitive information of multiple focusing pixels of the same color channel to obtain the statistical photosensitive information of the same focusing pixel;

Based on statistical photosensitive information of various focusing pixels, the comprehensive photosensitive information is obtained.

In one of the embodiments, the pixel photosensitive area of the image sensor is divided into a plurality of calibration areas, and each calibration area includes the plurality of focusing pixels;

The determining the color temperature corresponding to the comprehensive light-sensing information as the color temperature of the ambient light measured by the image sensor based on the corresponding relationship between the preset comprehensive light-sensing information and the color temperature includes:

determining the color temperature of each calibration area based on the corresponding relationship between the preset comprehensive photosensitive information and the color temperature;

Based on the color temperature statistics of the plurality of calibration regions, the color temperature measured by the image sensor for the ambient light is obtained.

In one embodiment, for the same calibration area, the number of focus pixels using different color channels is the same; and/or, for any two calibration areas, the number of focus pixels using the same color channel is the same.

A device for detecting color temperature, the device comprising:

The comprehensive photosensitive information acquisition module is used to obtain the comprehensive photosensitive information collected by various focusing pixels in the image sensor to ambient light; the color channels used by different kinds of focusing pixels are different;

A color temperature measurement module, configured to determine the color temperature corresponding to the comprehensive light-sensing information as the color temperature measured by the image sensor for the ambient light based on the preset correspondence between the comprehensive light-sensing information and the color temperature.

A terminal includes a memory and a processor, the memory stores a computer program, and the processor implements the above method when executing the computer program.

A color temperature detection system, the system includes an image sensor and a processor;

The image sensor is configured to send the comprehensive photosensitive information obtained by collecting ambient light with various focusing pixels of different color channels to the processor;

The processor is configured to execute the above method based on the comprehensive photosensitive information.

In one embodiment, the image sensor includes white focus pixels with a white channel.

A computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements the above-mentioned method.

In the above method, device, terminal, system and storage medium for detecting color temperature, the terminal obtains comprehensive photosensitive information obtained by collecting ambient light from various focusing pixels in the image sensor; the color channels used by different focusing pixels are different; The corresponding relationship between the comprehensive photosensitive information and the color temperature is determined, and the color temperature corresponding to the comprehensive photosensitive information is determined as the color temperature measured by the image sensor for the ambient light. It can be seen that in the above method of detecting color temperature, the color temperature detection function is transferred to the image sensor, and the color temperature of the ambient light is measured by using a variety of focusing pixels with different color channels on the image sensor, so as to ensure that the image sensor realizes the focusing function. The color temperature detection of ambient light makes the terminal unnecessary to install a color temperature sensor, saves the installation space of the terminal, and adapts to the miniaturization development of the terminal.

Description of drawings

1 is an application environment diagram of a method for detecting color temperature in one embodiment;

2 is a schematic flowchart of a method for detecting color temperature in one embodiment;

3 is a schematic flowchart of a method for detecting color temperature in one embodiment;

4 is a structural block diagram of an apparatus for detecting color temperature in one embodiment;

5 is a schematic diagram of a white focus imaging array unit in one embodiment;

6 is a schematic diagram of a green focus imaging array unit in one embodiment;

7 is a schematic diagram of a red focus imaging array unit in one embodiment;

8 is a schematic diagram of a blue focus imaging array unit in one embodiment;

9 is a schematic diagram of the connection between a focusing pixel and a color temperature detector in one embodiment;

10 is a schematic diagram of an imaging array unit in one embodiment;

11 is a schematic diagram of a combination of a focus imaging array unit and an imaging array unit in one embodiment;

12 is a schematic diagram of a combination of a focus imaging array unit and an imaging array unit in one embodiment;

13 is a schematic diagram of a combination of a focus imaging array unit and an imaging array unit in one embodiment;

14 is a schematic diagram of a combination of a focus imaging array unit and an imaging array unit in one embodiment;

15 is a schematic diagram of a combination of a focus imaging array unit and an imaging array unit in one embodiment;

FIG. 16 is an internal structure diagram of a terminal in one embodiment.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application will be described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application.

Reference in this application to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor a separate or alternative embodiment that is mutually exclusive of other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described in this application may be combined with other embodiments.

The method for detecting color temperature provided in this application can be applied to terminals such as mobile phones, tablet computers, notebook computers, and portable wearable devices.

In one embodiment, with reference to FIG. 1 and FIG. 2 , the method for detecting color temperature provided by the present application is introduced, and the method is applied to a terminal as an example for introduction:

Step S201 , acquiring comprehensive light-sensing information obtained by multiple types of focusing pixels in the image sensor collected from ambient light; different color channels used by different types of focusing pixels.

As shown in Figure 1, the image sensor is provided with a variety of focus pixels (such as focus pixel A, focus pixel B, focus pixel C, and focus pixel D); different types of focus pixels use different color channels, for example, focus pixels The color channel used by A is the white channel, the color channel used by the focus pixel B is the green channel, the color channel used by the focus pixel C is the blue channel, and the color channel used by the focus pixel D is the red channel.

The focusing pixel measures the ambient light to obtain photosensitive information. The representation form of the photosensitive information can be brightness information or light intensity information. There is a positive correlation between the brightness information and the light intensity information. The greater the light intensity, the greater the brightness.

Various focusing pixels measure ambient light to obtain corresponding photosensitive information, such as focusing pixel A to obtain photosensitive information a, focusing pixel B to measure photosensitive information b, focusing pixel C to measure photosensitive information c, and focus pixel D to measure photosensitive information d .

Step S202 , based on the preset correspondence between the comprehensive light-sensing information and the color temperature, determine the color temperature corresponding to the comprehensive light-sensing information as the color temperature measured by the image sensor for ambient light.

The photosensitive information set including the above-mentioned photosensitive information a, photosensitive information b, photosensitive information c, and photosensitive information d can be understood as comprehensive photosensitive information; that is, comprehensive photosensitive information is a collection of photosensitive information corresponding to different color channels.

As the color temperature of the ambient light changes, the photosensitive information measured by various focusing pixels will also change accordingly; therefore, the comprehensive photosensitive information formed by the photosensitive information corresponding to various color channels is summarized and analyzed with the change of color temperature. The corresponding relationship between the comprehensive photosensitive information and the color temperature can be determined. In the corresponding relationship, the light-sensing information of multiple color channels may correspond to one color temperature.

After obtaining the comprehensive photosensitive information, the terminal can determine the corresponding color temperature based on the preset corresponding relationship between the comprehensive photosensitive information and the color temperature, and use the color temperature as the color temperature measured by the image sensor for ambient light.

It can be seen that, in the above-mentioned method for detecting color temperature provided by the present application, the comprehensive light-sensing information collected by various focusing pixels in the image sensor to the ambient light is obtained; the color channels used by different kinds of focusing pixels are different; based on the preset comprehensive light-sensing information The corresponding relationship between the information and the color temperature is determined, and the color temperature corresponding to the comprehensive photosensitive information is determined as the color temperature measured by the image sensor for the ambient light. That is to say, the color temperature detection function is transferred to the image sensor, and the color temperature of the ambient light is measured through a variety of focusing pixels in different color channels on the image sensor, so as to ensure that the image sensor can detect the color temperature of the ambient light when the focusing function is realized. Therefore, the terminal does not need to install the color temperature sensor separately, saves the installation space of the terminal, and adapts to the miniaturization development of the terminal.

In some embodiments, in order to ensure the accuracy of color temperature detection, it is necessary to introduce the photosensitive information corresponding to the white channel; since the image sensor does not have pixels corresponding to the white channel, if the white channel is introduced into the imaging pixels of the image sensor, it will reduce the The imaging color recovery of the imaging pixel affects the imaging function of the image sensor.

Therefore, in one embodiment, a white channel can be introduced on the focusing pixel, that is, the imaging function and focusing function of the image sensor are not affected, and color temperature detection can also be realized. Specifically, the color channel used by one of the multiple focus pixels is a white channel.

In one embodiment, step S201 may specifically include the following steps: acquiring the light-sensing information collected by each focusing pixel for ambient light; counting the light-sensing information of a plurality of focusing pixels using the same color channel to obtain the statistical light-sensing information of the same focusing pixel information; based on the statistical photosensitive information of various focusing pixels, comprehensive photosensitive information is obtained.

Exemplarily, if the image sensor includes 400 focus pixels, there are 100 white focus pixels (ie, focus pixels using a white channel), 100 red focus pixels, 100 green focus pixels, and 100 blue focus pixels. 100; then after the terminal obtains the photosensitive information collected by the above 400 focusing pixels for ambient light, it counts the photosensitive information of the same color channel to obtain the corresponding statistical photosensitive information, such as counting the photosensitive information of the white focusing pixels, and obtains the white channel Corresponding statistical photosensitive information; the statistical method can be the sum of photosensitive information of the same color channel.

Based on the statistical light-sensing information corresponding to the white channel, the statistical light-sensing information corresponding to the red channel, the statistical light-sensing information corresponding to the green channel, and the statistical light-sensing information corresponding to the blue channel, a set of statistical light-sensing information, ie, comprehensive light-sensing information, can be formed.

In the above-mentioned embodiment, in the case where there are multiple focusing pixels in various color channels, the accuracy of color temperature detection can be ensured by classifying and counting the photosensitive information of different color channels.

Further, the pixel photosensitive area of the image sensor is divided into a plurality of calibration areas, and each calibration area includes a plurality of focusing pixels. When the above-mentioned step S203 is executed, the following steps may be included: determining the color temperature of each calibration area based on the preset corresponding relationship between the comprehensive photosensitive information and the color temperature; Measured color temperature.

Exemplarily, if the pixel photosensitive area of the image sensor is divided into calibration areas ① to ⑥, wherein, the focus pixels included in each calibration area are of the same type, for example, all include white focus pixels, red focus pixels, and blue focus pixels. pixel and green focus pixel. The terminal can count the comprehensive photosensitive information of each calibration area and determine the corresponding color temperature; if the terminal determines that the color temperatures of the calibration areas ① to ⑥ are 2500K (Kelvin), 2600K, 3000K, 2600K, 2650K, and 2600K respectively, because the above calibration areas are Among them, there are many calibration areas with a color temperature of 2600K. Therefore, 2600K can be used as the color temperature measured by the image sensor for ambient light.

In the above manner, the pixel photosensitive area of the image sensor is divided into different calibration areas, the color temperature of each calibration area is counted, and the final color temperature is determined, which can improve the accuracy of color temperature detection.

Further, for the same calibration area, the number of focusing pixels using different color channels is the same; for example, for the calibration area ①, the numbers of white focusing pixels, red focusing pixels, green focusing pixels and blue focusing pixels are all 100, which can be Ensure the accuracy of color temperature detection.

Further, for any two calibration areas, the number of focusing pixels using the same color channel is the same; for example, for the calibration area ① and the calibration area ②, the number of white focusing pixels is 100 to ensure the accuracy of color temperature detection. .

In one embodiment, before performing step S201, the terminal may further perform the following steps: the image sensor is in a non-imaging mode, each imaging pixel in the image sensor is controlled to be in a photosensitive measurement off state, and multiple focusing pixels are controlled to be in a photosensitive measurement mode On state.

That is to say, if the image sensor is in the non-imaging mode, the imaging pixels of the image sensor can be in the photosensitive measurement off state, and only various focusing pixels are turned on, and then according to the comprehensive photosensitive information collected from the ambient light by the various focusing pixels that are turned on, Determining the color temperature of the ambient light can further save the power consumption of the terminal and prolong the service life of the image sensor.

Further, if the image sensor is in the non-imaging mode, and the pixel photosensitive area of the image sensor is divided into multiple calibration areas; then in order to further save the power consumption of the terminal, the focus pixels of each calibration area can be controlled to be in the photosensitive measurement open state, that is, The photosensitive measurement is turned on at different time periods. For example, the focusing pixels in the calibration areas ①, ③ and ④ are in the photosensitive measurement on state during the first period, and the focusing pixels in the calibration areas ②, ⑤ and ⑥ are in the photosensitive measurement off state during the first period; In the adjacent second period, the focusing pixels in the calibration areas ①, ③ and ④ are in the photosensitive measurement off state during the second period, and the focusing pixels in the calibration areas ②, ⑤ and ⑥ are in the photosensitive measurement on state in the first period.

In one embodiment, after performing step S201, the terminal may further perform the following steps: determine the correspondence between the preset comprehensive light-sensing information and the light intensity, based on the correspondence between the preset comprehensive light-sensing information and light intensity relationship, determine the light intensity corresponding to the comprehensive photosensitive information, and use the light intensity corresponding to the comprehensive photosensitive information as the reference light intensity; the reference light intensity is used to adjust the screen brightness of the terminal screen under ambient light.

In the above-mentioned embodiment, the terminal can also determine the corresponding light intensity based on the comprehensive photosensitive information collected by various focusing pixels for ambient light, and the light intensity can be used as the screen brightness of the management terminal screen, so that the terminal does not need to install additional light The strong detector further saves the installation space and is beneficial to the miniaturization of the terminal.

In one embodiment, the terminal may further perform the following steps to determine the correspondence between the comprehensive light-sensing information and the color temperature. The steps performed by the terminal specifically include: acquiring the calibrated color temperature of multiple test ambient lights; multiple test ambient lights given ambient light in the test scene; information, and obtain multiple sets of color temperature sensitivity test results; among them, the calibrated color temperature and comprehensive sensitivity information in the same group of color temperature sensitivity test results correspond to the same test ambient light; Correspondence.

It can be seen that by giving test ambient light with different color temperatures, the corresponding comprehensive photosensitive information is obtained; and according to the corresponding comprehensive photosensitive information corresponding to the calibrated color temperature of the same test ambient light, multiple sets of color temperature photosensitive test results are obtained; The corresponding relationship between the comprehensive photosensitive information and the color temperature determined by the test result is more accurate, and the accuracy of the color temperature detection is improved.

Further, when the pixel photosensitive area of the image sensor is divided into a plurality of calibration areas, the corresponding relationship between the comprehensive photosensitive information and the color temperature of each calibration area can be determined respectively. For example, when the color temperature of a given test ambient light is 3000K, obtain the sensitivity information collected by the white/green/red/blue focusing pixels in the calibration area ① for the test ambient light, and count the statistical sensitivity corresponding to the same color channel information to form comprehensive photosensitive information, and then obtain a set of color temperature photosensitive test results including the comprehensive photosensitive information and the calibrated color temperature of 3000K; according to the above method, obtain multiple sets of color temperature photosensitive test results, and determine the calibration area ① The difference between the comprehensive photosensitive information and the color temperature corresponding relationship.

In one embodiment, the terminal may further perform the following steps to determine the correspondence between the comprehensive light-sensing information and the light intensity. The steps performed by the terminal specifically include: acquiring the calibrated light intensity of multiple test ambient lights; multiple test ambient lights given ambient light in the test scene; Sensitivity information to obtain multiple sets of light intensity sensitization test results; among them, the calibrated light intensity and comprehensive sensitization information in the same group of luminous intensity sensitization test results correspond to the same test ambient light; based on the multiple sets of light intensity sensitization test results, determine the comprehensive sensitization information Correspondence between light intensity.

It can be seen that the corresponding comprehensive photosensitive information is obtained by giving test ambient light of different light intensities; and according to the calibration light intensity corresponding to the same test ambient light and the corresponding comprehensive photosensitive information, multiple sets of light-intensity photosensitive test results are obtained; The corresponding relationship between the comprehensive photosensitive information and the light intensity determined by the group light intensity photosensitive test results is more accurate, and the accuracy of light intensity detection is improved.

Further, when the pixel photosensitive area of the image sensor is divided into a plurality of calibration areas, the corresponding relationship between the comprehensive photosensitive information and the light intensity of each calibration area can be determined respectively. For a specific method, reference may be made to the above content of obtaining the correspondence between the comprehensive photosensitive information of the calibration area ① and the color temperature, which will not be repeated here.

In one embodiment, the terminal may further perform the following steps: when the image sensor is in the imaging mode, adjust the white balance for the image sensor based on the light intensity corresponding to the comprehensive light-sensing information and the color temperature corresponding to the comprehensive light-sensing information.

That is to say, the terminal can use the comprehensive photosensitive information measured by various focusing pixels of different channels to obtain the corresponding color temperature and light intensity, and adjust the white balance of the image sensor according to the obtained color temperature and light intensity to improve the imaging quality.

In one embodiment, the structure of the focusing pixel is a metal shielding photodiode structure, a dual photodiode (dual PD pixel) structure, or an on-chip microlens photodiode structure (2×1 OCL pixels or 2×2 OCL pixels; OCL: OnChip Lens, on-chip microlenses).

In order to better understand the above method, an application example of the method for detecting color temperature of the present application is introduced with reference to FIG. 3 . This application example can be applied to a terminal, and the specific steps are as follows:

Step S301, obtaining the calibration color temperature of multiple test ambient lights; multiple test ambient lights given ambient light in the test scene;

Step S302, acquiring comprehensive light-sensing information collected by multiple focusing pixels in the image sensor for multiple test ambient lights, and obtaining multiple sets of color temperature sensing test results; wherein, different color channels are used by different focusing pixels, and the color temperature of the same group is different. The calibrated color temperature and comprehensive photosensitive information in the photosensitive test results correspond to the same test ambient light;

Step S303, based on the multiple sets of color temperature sensitivity test results, determine the corresponding relationship between the comprehensive photosensitive information and the color temperature;

Step S304, the image sensor is in a non-imaging mode, each imaging pixel in the image sensor is controlled to be in a photosensitive measurement off state, and multiple focusing pixels are controlled to be in a photosensitive measurement on state;

Step S305, acquiring comprehensive photosensitive information obtained by collecting ambient light from various focusing pixels in the image sensor;

Step S306 , based on the preset correspondence between the comprehensive light-sensing information and the color temperature, determine the color temperature corresponding to the comprehensive light-sensing information and use it as the color temperature measured by the image sensor for ambient light.

In the above application example, the corresponding comprehensive photosensitive information is obtained by giving test ambient lights of different light intensities; and multiple sets of light-intensity photosensitive test results are obtained according to the calibrated light intensity corresponding to the same test ambient light and the corresponding comprehensive photosensitive information ; The corresponding relationship between the comprehensive photosensitive information and the light intensity determined according to the multiple groups of light intensity photosensitive test results is more accurate, and the accuracy of the light intensity detection is improved. In addition, the color temperature detection function is transferred to the image sensor, and the color temperature of the ambient light is measured through a variety of focusing pixels in different color channels of the image sensor, so as to ensure the imaging function and focusing function of the image sensor. Color temperature detection makes it unnecessary to install a color temperature sensor on the terminal, saves the installation space of the terminal, and adapts to the miniaturization development of the terminal.

It should be understood that although the steps in the flowcharts of FIG. 1 to FIG. 3 are shown in sequence according to the arrows, these steps are not necessarily executed in the sequence shown by the arrows. Unless explicitly stated herein, the execution of these steps is not strictly limited to the order, and the steps may be executed in other orders. Moreover, at least a part of the steps in FIG. 1 to FIG. 3 may include multiple steps or multiple stages, and these steps or stages are not necessarily executed and completed at the same time, but may be executed at different times. The order of execution is also not necessarily sequential, but may be performed alternately or alternately with other steps or at least a portion of a step or phase within the other steps.

In one embodiment, as shown in Figure 4, a device for detecting color temperature is provided, comprising:

The comprehensive light-sensing information acquisition module 401 is used to obtain comprehensive light-sensing information collected by various focusing pixels in the image sensor to ambient light; the color channels used by different kinds of focusing pixels are different;

The color temperature measurement module 402 is configured to determine the color temperature corresponding to the comprehensive light-sensing information as the color temperature measured by the image sensor on the ambient light based on the preset corresponding relationship between the comprehensive light-sensing information and the color temperature.

In one embodiment, the color channel employed by one of the plurality of focus pixels is a white channel.

In one embodiment, the device further includes: a photosensitive measurement state control module, configured to control each imaging pixel in the image sensor to be in a photosensitive measurement off state when the image sensor is in a non-imaging mode, and control the Various focusing pixels are in the photometric ON state.

In one embodiment, the device further includes: a screen brightness control module, configured to determine the corresponding relationship between the preset comprehensive photosensitive information and the light intensity, based on the preset comprehensive photosensitive information and the light intensity Corresponding relationship, determine the light intensity corresponding to the comprehensive photosensitive information, and use the light intensity corresponding to the comprehensive photosensitive information as the reference light intensity; the reference light intensity is used to adjust the screen brightness of the terminal screen under the ambient light .

In one embodiment, the device further includes: a white balance adjustment module, configured to adjust the target based on the light intensity corresponding to the comprehensive light-sensing information and the color temperature corresponding to the comprehensive light-sensing information when the image sensor is in an imaging mode. White balance of the image sensor.

In one embodiment, the device further includes: a first correspondence determination module, configured to acquire the calibrated color temperature of multiple test ambient lights; the ambient lights given by the multiple test ambient lights in the test scene; acquire The multiple types of focusing pixels collect comprehensive photosensitive information from the multiple test ambient lights to obtain multiple sets of color temperature photosensitive test results; wherein, the calibrated color temperature and comprehensive photosensitive information in the color temperature photosensitive test results of the same group corresponds to the same test environment light; based on the multiple sets of color temperature sensitivity test results, determine the corresponding relationship between the comprehensive photosensitive information and the color temperature.

In one embodiment, the device further includes: a second correspondence determination module, configured to acquire the calibrated light intensities of multiple test ambient lights; the multiple test ambient lights are given ambient lights in the test scene; Acquire comprehensive photosensitive information collected by multiple focusing pixels for the multiple test ambient lights, and obtain multiple sets of light intensity photosensitive test results; wherein, the calibrated light intensity and comprehensive photosensitive information in the same group of light intensity photosensitive test results correspond to the same Test the ambient light; determine the correspondence between the comprehensive photosensitive information and the light intensity based on the multiple sets of light intensity photosensitive test results.

In one embodiment, the comprehensive photosensitive information acquisition module 401 is further configured to acquire photosensitive information collected by each focusing pixel on the ambient light; count the photosensitive information of multiple focusing pixels using the same color channel, and obtain the same Statistical photosensitive information of various focusing pixels; based on the statistical photosensitive information of various focusing pixels, the comprehensive photosensitive information is obtained.

In one embodiment, the pixel photosensitive area of the image sensor is divided into multiple calibration areas, and each calibration area includes the multiple types of focusing pixels; the color temperature measurement module 402 is further configured to The corresponding relationship between the photosensitive information and the color temperature is synthesized to determine the color temperature of each calibration area; based on the color temperature statistics of the plurality of the calibration areas, the color temperature measured by the image sensor for the ambient light is obtained.

In one embodiment, for the same calibration area, the number of focus pixels using different color channels is the same; and/or, for any two calibration areas, the number of focus pixels using the same color channel is the same.

For the specific limitation of the device for detecting color temperature, please refer to the limitation on the method for detecting color temperature above, which will not be repeated here. Each module in the above-mentioned apparatus for detecting color temperature may be implemented in whole or in part by software, hardware and combinations thereof. The above modules can be embedded in or independent of the processor in the computer device in the form of hardware, or stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

The present application also provides a color temperature detection system, which includes an image sensor and a processor; the image sensor is used to send the comprehensive photosensitive information obtained by collecting ambient light by various focusing pixels with different color channels to the processing a processor; the processor is configured to execute the method described in any of the other embodiments based on the integrated light-sensing information.

Further, the above-mentioned image sensor includes white focus pixels using a white channel.

In some embodiments, an image sensor provided by the present application is described with reference to FIG. 5 . The image sensor includes white focus pixels Wa and Wb using a white channel; wherein, the white focus pixels Wa and Wb use the light-sensing information collected by ambient light for For color temperature detection of ambient light.

The white focus pixel Wa is introduced in conjunction with FIG. 5. The white focus pixel Wa includes a photosensitive area and a non-photosensitive area. The black part in the white focus pixel Wa represents the non-photosensitive area, and the white part is the sensing white light area. Similarly, the white focus pixel Wb can be Referring to the above content, it will not be repeated here. And the positions of the white focus pixels Wa and Wb can be interchanged.

That is to say, a white channel is introduced into the focusing pixels of the image sensor to form white focusing pixels. The photosensitive information collected by the white focusing pixels from ambient light can be used for both imaging focusing and color temperature detection without affecting the image sensor. Based on the focusing function, the image sensor can detect the color temperature of the ambient light.

In the above embodiment, in the process of color temperature detection, if the photosensitive information corresponding to other color channels, such as the photosensitive information corresponding to the red channel, is required, the red imaging pixel (R as shown in Figure 5) can be used to collect ambient light. It can be understood that the photosensitive information collected by the blue imaging pixels (B) and green imaging pixels (G) shown in FIG. 5 to ambient light can also be used for color temperature detection. Wherein, the imaging pixels of the above-mentioned color channels do not have non-photosensitive areas similar to focusing pixels, but only include photosensitive areas for imaging.

That is to say, in the above method, the photosensitive information corresponding to the white channel required for color temperature detection is acquired by focusing pixels, and the photosensitive information corresponding to the red channel/blue channel/green channel required for color temperature detection is acquired by imaging pixels. obtained, thereby ensuring the accuracy of color temperature detection. However, in this method, even if the image sensor is in the non-imaging mode, if color temperature detection is required, it is necessary to control the focusing pixels and the imaging pixels to be in the photosensitive measurement open state, which has a problem of large power consumption.

Thus, in some embodiments, the image sensor further includes at least one of red focus pixels with a red channel, blue focus pixels with a blue channel, or green focus pixels with a green channel. At least one of the light-sensing information collected by the red focusing pixels for ambient light, the light-sensing information collected by the blue focusing pixels for ambient light, and the light-sensing information collected by the green focusing pixels for ambient light is used for color temperature detection.

That is to say, the photosensitive information corresponding to each color channel required for color temperature detection is provided by focusing pixels, without imaging pixels. If the image sensor is in non-imaging mode and color temperature needs to be detected at this time, it is only necessary to control the focusing pixels to be in photosensitive measurement Turn on state to reduce power consumption.

Further, for the imaging pixels included in the image sensor, the switches connected to the imaging pixels are different from the switches connected to the color focus pixels. Therefore, if the image sensor is in the non-imaging mode, the switch connected to the imaging pixel can be used to control the imaging pixel to be in the photometric off state, and the switch connected to the focus pixel can be used to control the focus pixel to be in the photometric measurement on state, so as to obtain the photosensitive information corresponding to the color channel. , to achieve color temperature detection.

Wherein, a pixel unit including color focus pixels (the pixel unit may be a 2*2 pixel matrix) can be called a focus unit; if the color focus pixel is a white focus pixel, then the focus unit can be called a white focus unit, such as W110a and W110b shown in FIG. 5 . In the white focus unit W110a, the white focus pixels Wa are diagonally distributed with G, and R and B are diagonally distributed.

In some embodiments, the image sensor further includes an imaging unit located between the two focusing units, that is, an imaging unit is spaced between the two focusing units. Among them, a pixel unit that only includes imaging pixels is called an imaging unit, such as 120 shown in FIG. 5 . In the imaging unit 120, only imaging pixels R, G, and B are included, and two G are diagonally distributed, and R and B are diagonally distributed.

If the focus units distributed on both sides of the imaging unit contain the same color focus pixels, then the focus blocking structures of the same focus color focus pixels form a left and right focus blocking structure pair.

Exemplarily, as shown in FIG. 5 , the white focusing units W110a and W110b distributed on both sides of the imaging unit 120 include white focusing pixels, and the blocking area of the white focusing pixel Wa is located on the left, and the blocking area of the white focusing pixel Wb is located on the right. , that is, the focus blocking structures of the white focus pixels Wa and Wb form a pair of left and right focus blocking structures. The unit formed by the white focus unit W110a, the white focus unit W110b and the imaging unit 120 may be referred to as a white focus imaging array unit (W pattern).

Also exemplarily, as shown in FIG. 6 , the green focusing units G110a and G110b distributed on both sides of the imaging unit 120 include green focusing pixels, and the shielding area of the green focusing pixel Ga is located on the right, and the shielding area of the green focusing pixel Gb is located on the right side. On the left, the focus blocking structures of the green focus pixels Ga and Gb form a pair of left and right focus blocking structures. The unit formed by the green focusing unit G110a, the green focusing unit G110b and the imaging unit 120 may be referred to as a green focusing imaging array unit (G pattern).

Also exemplarily, as shown in FIG. 7 , the red focusing units R110a and R110b distributed on both sides of the imaging unit 120 include red focusing pixels, and the shielding area of the red focusing pixel Ra is located on the left, and the shielding area of the red focusing pixel Rb is located at the left. On the right, that is, the focus blocking structures of the red focus pixels Ra and Rb form a pair of left and right focus blocking structures. The unit formed by the red focusing unit R110a, the red focusing unit R110b and the imaging unit 120 may be referred to as a red focusing imaging array unit (R pattern).

For another example, as shown in FIG. 8 , the blue focus units B110a and B110b distributed on both sides of the imaging unit 120 both include blue focus pixels, and the occlusion area of the blue focus pixel Ba is located on the right, and the blue focus pixel Bb The occlusion area of is located on the left, that is, the focus occlusion structures of the blue focus pixels Ba and Bb form a pair of left and right focus occlusion structures. The unit formed by the blue focusing unit B110a, the blue focusing unit B110b and the imaging unit 120 may be referred to as a blue focusing imaging array unit (B pattern).

In one embodiment, as shown in FIG. 9 , the image sensor further includes a color temperature processor, each color focusing pixel is connected to the color temperature processor, and each color focusing pixel transmits the photosensitive information obtained by collecting the ambient light to the color temperature processor, so as to The color temperature processor is made to determine the color temperature of the ambient light based on the light-sensing information corresponding to each color channel. It can be understood that the color temperature processor in the above embodiment is built into the image sensor, which further saves the space of terminals such as mobile phones; in other embodiments, the color temperature processor can also be externally placed in the image sensor.

In the above embodiment, if the focusing units distributed on both sides of the imaging unit 120 contain the same color focusing pixels and form a pair of left and right focusing blocking structures, the distribution direction of the focusing units may be referred to as the first direction. Wherein, as shown in FIG. 10 , if a plurality of imaging units 120 are arranged adjacently along the first direction, the correspondingly formed units may be referred to as imaging array units (CX pattern).

In some embodiments, the above-mentioned focus imaging array units may be adjacently arranged along a second direction orthogonal to the first direction, but in order to ensure the imaging effect, two focus imaging array units may be arranged at intervals along the second direction At least one imaging array unit, ie, an image sensor, includes at least one imaging array unit located between two in-focus imaging array units.

The focusing imaging array units distributed on both sides of the imaging array unit CX pattern may correspond to the same color channel. As shown in FIG. 11 , the focusing imaging array units W pattern are all white and distributed along the second direction on both sides of the imaging array unit CX pattern. side.

In order to further ensure the accuracy of color temperature detection, the focusing imaging array units distributed on both sides of the imaging array unit CX pattern along the second direction can correspond to different color channels, such as the white focusing imaging array unit W pattern and the red focusing imaging array unit R pattern , another example is the green focusing imaging array unit G pattern and the blue focusing imaging array unit B pattern, and another example is the white focusing imaging array unit W pattern and the green focusing imaging array unit Gpattern. As shown in FIG. 12 , the in-focus imaging array units distributed along the second direction on both sides of the imaging array unit CX pattern are a white in-focus imaging array unit W pattern and a red in-focus imaging array unit R pattern.

That is to say, the focusing units distributed on both sides of the imaging unit 120 along the second direction contain different color focusing pixels. As shown in FIG. 12 , the focusing units distributed along the second direction on both sides of the imaging unit 120 are white focusing units and The red focusing unit, the focusing pixels included in the white focusing unit and the red focusing unit are white focusing pixels and red focusing pixels, respectively.

In some embodiments, if the image sensor simultaneously introduces white pixels, green pixels, blue pixels and red pixels into the focus pixels, in order to ensure the uniformity of the distribution of each pixel and the accuracy of color temperature detection, the imaging array unit CX is spaced The color pixels corresponding to at least four adjacent focus imaging array units in the pattern are different from each other. As shown in FIG. 13 , the white focus imaging array unit W pattern, the red focus imaging array unit R pattern, the blue focus imaging array unit B pattern and the green focus imaging array unit G pattern are evenly distributed on both sides of each imaging array unit CXpattern.

That is, the image sensor includes four focusing units arranged in sequence along the second direction, the four focusing units contain different color focusing pixels, and two adjacent focusing units in the four focusing units are separated by imaging units. As shown in FIG. 13 , the white focus unit, the red focus unit, the blue focus unit and the green focus unit are arranged in sequence along the second direction; and an imaging unit is spaced between the two adjacent focus units, such as the white focus unit and the green focus unit. An imaging unit is spaced between the red focusing units, for example, an imaging unit is spaced between the red focusing unit and the blue focusing unit.

Further, as shown in FIG. 14 , the above-mentioned at least four focusing imaging array units can be arranged adjacently at intervals in a white focusing imaging array unit, a green focusing imaging array unit, a red focusing imaging array unit, and a blue focusing imaging array. unit. That is to say, the four focusing units arranged in sequence along the second direction are respectively a white focusing unit, a green focusing unit, a red focusing unit and a blue focusing unit in sequence.

Further, if the requirements for imaging effects are high, as shown in FIG. 15 , the above-mentioned white focus imaging array unit, green focus imaging array unit, red focus imaging array unit, blue focus imaging array unit and imaging unit included in the imaging array unit 120 can be two. Further, the number of imaging array units spaced between two focusing imaging array units may also be two or more.

Further, the structure of the focusing pixel in the above-mentioned embodiment is a metal shielding photodiode structure, a dual photodiode (dual PD pixel) structure or an on-chip microlens photodiode structure (2×1 OCL pixel or 2×2 OCL pixel; OCL: On Chip Lens) , on-chip microlenses), which are widely used in image sensors with various focusing structures.

In one embodiment, a terminal is provided, which may be a mobile phone, a tablet computer, a portable wearable device, etc., and its internal structure diagram may be as shown in FIG. 16 . The terminal includes a processor, a memory, a communication interface, a display screen and an input device connected through a system bus. Among them, the processor of the terminal is used to provide computing and control capabilities. The memory of the terminal includes a non-volatile storage medium and an internal memory. The nonvolatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the execution of the operating system and computer programs in the non-volatile storage medium. The communication interface of the terminal is used for wired or wireless communication with other terminals, and the wireless communication can be realized by WIFI, operator network, NFC (Near Field Communication) or other technologies. The computer program, when executed by a processor, implements a method of detecting color temperature. The display screen of the terminal may be a liquid crystal display screen or an electronic ink display screen, and the input device of the terminal may be a touch layer covered on the display screen, or a button, a trackball or a touchpad set on the terminal shell, or An external keyboard, trackpad, or mouse, etc.

Those skilled in the art can understand that the structure shown in FIG. 16 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer equipment to which the solution of the present application is applied. Specific terminals may include There are more or fewer components than shown in the figures, or some components are combined, or have a different arrangement of components.

In one embodiment, a terminal is provided, including a memory and a processor, the memory stores a computer program, and the processor implements the steps in the above-mentioned method embodiments when the computer program is executed.

In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, implements the steps in each of the foregoing method embodiments.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program, and the above-mentioned computer program can be stored in a non-volatile computer-readable storage medium , when the computer program is executed, it may include the processes of the above-mentioned method embodiments. Wherein, any reference to memory, storage, database or other media used in the various embodiments provided in this application may include at least one of non-volatile and volatile memory. The non-volatile memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash memory or optical memory, and the like. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, the RAM may be in various forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM).

The technical features of the above embodiments can be combined arbitrarily. In order to make the description simple, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features It is considered to be the range described in this specification.

The above examples only represent several embodiments of the present application, and the descriptions thereof are relatively specific and detailed, but should not be construed as a limitation on the scope of the invention patent. It should be pointed out that for those skilled in the art, without departing from the concept of the present application, several modifications and improvements can be made, which all belong to the protection scope of the present application. Therefore, the scope of protection of the patent of the present application shall be subject to the appended claims.

Claims (14)

1. A method of detecting color temperature, the method comprising:

acquiring comprehensive photosensitive information acquired by collecting ambient light by various focusing pixels in an image sensor; the different focusing pixels adopt different color channels;

and determining the color temperature corresponding to the comprehensive sensitization information as the color temperature of the image sensor for measuring the ambient light based on the corresponding relation between the preset comprehensive sensitization information and the color temperature.

2. The method of claim 1, wherein the color channel used by the focusing pixel of one of the plurality of focusing pixels is a white channel.

3. The method of claim 1, wherein prior to obtaining the integrated exposure information collected for the ambient light by the plurality of focusing pixels in the image sensor, the method further comprises:

and when the image sensor is in a non-imaging mode, controlling each imaging pixel in the image sensor to be in a photosensitive measurement closed state, and controlling the various focusing pixels to be in a photosensitive measurement open state.

4. The method of claim 1, further comprising:

determining the corresponding relation between the preset comprehensive photosensitive information and the light intensity,

determining light intensity corresponding to the comprehensive sensitization information based on the corresponding relation between the preset comprehensive sensitization information and the light intensity, and taking the light intensity corresponding to the comprehensive sensitization information as reference light intensity; the reference light intensity is used for adjusting the screen brightness of the terminal screen under the ambient light.

5. The method of claim 4, further comprising:

and when the image sensor is in an imaging mode, adjusting white balance aiming at the image sensor based on the light intensity corresponding to the comprehensive sensitization information and the color temperature corresponding to the comprehensive sensitization information.

6. The method according to any one of claims 1 to 5,

the method further comprises the following steps:

obtaining calibration color temperatures of a plurality of test environment lights; the plurality of test ambient lights are given an ambient light under a test scenario;

acquiring comprehensive sensitization information acquired by the multiple focusing pixels for the multiple testing environment lights to obtain multiple groups of color temperature sensitization testing results; the calibration color temperature and the comprehensive sensitization information in the same color temperature sensitization test result correspond to the same test environment light;

determining a corresponding relation between comprehensive sensitization information and color temperature based on the multiple groups of color temperature sensitization test results;

and/or the presence of a gas in the gas,

the method further comprises the following steps:

obtaining the calibration light intensity of a plurality of test environment lights; the plurality of test ambient lights are given an ambient light under a test scenario;

acquiring comprehensive light sensing information acquired by a plurality of focusing pixels on the plurality of testing environment lights to obtain a plurality of groups of light intensity light sensing test results; the calibration light intensity and the comprehensive light sensing information in the light intensity light sensing test results of the same group correspond to the same test environment light;

and determining the corresponding relation between the comprehensive light-sensitive information and the light intensity based on the light-sensitive test results of the multiple groups of light intensities.

7. The method of claim 1, wherein the obtaining of the integrated exposure information collected for the ambient light by the plurality of focusing pixels in the image sensor comprises:

acquiring photosensitive information acquired by each focusing pixel on the ambient light;

counting the photosensitive information of a plurality of focusing pixels adopting the same color channel to obtain the statistical photosensitive information of the same focusing pixels;

and obtaining the comprehensive photosensitive information based on the statistical photosensitive information of various focusing pixels.

8. The method of claim 7, wherein a pixel photosensitive area of the image sensor is divided into a plurality of calibration areas, each calibration area including the plurality of focusing pixels;

the determining, based on a preset correspondence between the comprehensive sensitization information and the color temperature, the color temperature corresponding to the comprehensive sensitization information as the color temperature measured by the image sensor for the ambient light includes:

determining the color temperature of each calibration area based on the corresponding relation between the preset comprehensive sensitization information and the color temperature;

and obtaining the color temperature measured by the image sensor on the ambient light based on the color temperature statistics of the plurality of calibration areas.

9. The method according to claim 8, wherein the number of focusing pixels adopting different color channels is the same for the same calibration area; and/or the number of focusing pixels adopting the same color channel is consistent for any two calibration areas.

10. An apparatus for detecting a color temperature, the apparatus comprising:

the comprehensive photosensitive information acquisition module is used for acquiring comprehensive photosensitive information acquired by collecting ambient light by various focusing pixels in the image sensor; the different focusing pixels adopt different color channels;

and the color temperature measuring module is used for determining the color temperature corresponding to the comprehensive sensitization information as the color temperature of the image sensor for measuring the ambient light based on the corresponding relation between the preset comprehensive sensitization information and the color temperature.

11. A terminal comprising a memory and a processor, the memory storing a computer program, characterized in that the processor, when executing the computer program, implements the method of any of claims 1 to 9.

12. A color temperature detection system, characterized in that the system comprises an image sensor and a processor;

the image sensor is used for sending comprehensive photosensitive information acquired by collecting ambient light by various focusing pixels adopting different color channels to the processor;

the processor configured to perform the method of any one of claims 1 to 9 based on the integrated exposure information.

13. The system of claim 12, wherein the image sensor comprises a white focus pixel employing a white channel.

14. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method of any one of claims 1 to 9.

Images