CN116437224A

CN116437224A - Electronic device, color temperature detection method and image data processing device

Info

Publication number: CN116437224A
Application number: CN202111673585.XA
Authority: CN
Inventors: 高云山
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2021-12-31
Filing date: 2021-12-31
Publication date: 2023-07-14

Abstract

The application provides an electronic device, comprising: an image pickup device for acquiring image data; a color temperature detecting device for acquiring color temperature distribution data corresponding to the image data; the image data processing device is electrically connected with the image pickup device and the color temperature detection device respectively and is used for processing the image data according to the color temperature distribution data so as to obtain processed image data; and a display panel electrically connected with the image data processing device and used for outputting and displaying images according to the processed image data. The electronic equipment is favorable for improving the accuracy of the acquired color temperature distribution data, so that the white balance effect of an original image is improved, and the display effect of the processed image is improved. The application also provides a color temperature detection device, an image processing method and an image data processing device.

Description

Electronic device, color temperature detection method and image data processing device

Technical Field

The present invention relates to the field of imaging technologies, and in particular, to an electronic device, a color temperature detection device applied to the electronic device, an image processing method, and an image data processing device storing the image processing method.

Background

Smart electronic devices (e.g., cell phones, computers, etc.) typically include a camera module and a display module. The camera module is used for acquiring image data, and the display module is used for displaying images according to the image data.

Automatic white balance (Automatic white balance, AWB) is an important imaging indicator for camera modules. In some complex scenes with multiple types of light sources, it is difficult to improve AWB accuracy of the camera module. The existing AWB method under the mixed color temperature mainly comprises the following steps: and acquiring an original image, carrying out data statistics and simulation on the original image, acquiring color temperature data, and correcting the original image by the color temperature data to obtain a corrected image.

In the AWB method described above, the corrected color temperature is realized based on statistics and simulation of the original image, not the color temperature in the actual scene. The AWB method described above may result in inaccurate color temperature data, thereby resulting in an undesirable white balance effect.

Disclosure of Invention

A first aspect of the present application provides an electronic device, comprising:

an image pickup device for acquiring image data;

a color temperature detecting device for acquiring color temperature distribution data corresponding to the image data;

the image data processing device is electrically connected with the image pickup device and the color temperature detection device respectively and is used for processing the image data according to the color temperature distribution data so as to obtain processed image data; and

and the display panel is electrically connected with the image data processing device and is used for outputting and displaying images according to the processed image data.

The electronic equipment comprises an image pickup device, a color temperature detection device and an image data processing device. The image pickup device is used for acquiring an original image in a certain view field, and the color temperature detection device is used for synchronously acquiring optical signals of the view field to acquire color temperature distribution data of the view field, so that the image data processing device can process the color temperature of the original image according to the color temperature distribution data acquired synchronously with the view field of the image pickup device in real time to acquire a processed image. Because the color temperature distribution data in the embodiment is obtained in real time and is synchronous with the field of view of the image pickup device, the color temperature distribution data corresponding to each frame of original image can be synchronously obtained when the image pickup device shoots each frame of original image, the electronic device in the application is favorable for improving the accuracy of the color temperature distribution data, further is favorable for improving the accuracy of color temperature processing, and is favorable for improving the white balance effect, so that the display effect of the processed image is improved.

In some embodiments, the color temperature detection device is the same as the maximum field of view of the image capturing device.

Thus, the color temperature detection device can synchronously acquire the color temperature distribution data corresponding to the original image generated by the image pickup device in real time.

In some embodiments, the field of view of the color temperature detection device is greater than a maximum field of view of the image capture device, the maximum field of view of the image capture device being within the field of view of the color temperature detection device.

The field size of the camera is adjustable to adapt to different shooting effects, for example, the camera has a long Jiao Shichang field, a wide-angle field and a super-wide-angle field, wherein the super-wide-angle field is the maximum field. In some embodiments, the field of view of the color temperature detection device is slightly larger than the maximum field of view of the image capturing device, different from the field of view of the image capturing device, and the maximum field of view of the image capturing device is within the field of view of the color temperature detection device. Because the color temperature detection device is used for synchronously acquiring the color temperature distribution data of the image shot under the same view field as the image pickup device, if the size of the view field of the color temperature detection device is the same as that of the image pickup device, the acquired color temperature distribution data at the boundary of the view field may be inaccurate due to mechanical errors. Therefore, by setting the view field of the color temperature detection device to be larger than and completely cover the maximum view field of the image pickup device, the view field boundary of the color temperature detection device is not the view field boundary of the image pickup device, and even if the obtained color temperature distribution data at the view field boundary of the color temperature detection device is inaccurate, the accuracy of the color temperature distribution data at the view field boundary of the image pickup device is not affected. Therefore, by setting the visual field of the color temperature detection device to be larger than and completely cover the maximum visual field of the image pickup device, the accuracy of the color temperature detection data is improved.

In some embodiments, the color temperature detection device includes:

the main lens is used for acquiring optical signals;

the micro lenses are used for receiving the optical signals acquired by the main lenses;

a plurality of sensor units corresponding to the plurality of micro lenses, wherein the plurality of micro lenses comprise a first micro lens, the plurality of sensor units comprise a first sensor unit for generating a first electrical signal according to an optical signal received by the first micro lens; and

and the signal processing unit is electrically connected with the plurality of sensor units and the image data processing device and is used for acquiring the color temperature distribution data according to the electric signals and outputting the color temperature distribution data to the image data processing device.

Thus, the main lens and the micro lenses can acquire optical signals in real time and guide the optical signals to the sensor unit to form electric signals, and color temperature distribution data corresponding to the original image is acquired in real time through the signal processing unit.

In some embodiments, the plurality of micro-lenses are located on a focal plane of the main lens.

In this way, it is advantageous to focus the optical signal for better imaging.

In some embodiments, the focal lengths of the plurality of micro-lenses are the same, and the plurality of sensor units are located on the focal planes of the plurality of micro-lenses.

In this way, it is advantageous that the focused light beam focused by each micro lens can be focused more onto the corresponding sensor unit.

In some embodiments, each of the sensor units includes a plurality of photosensitive elements having different photosensitive bands.

In some embodiments, each of the sensor units comprises a multispectral sensor.

In some embodiments, the plurality of micro-lenses are in one-to-one correspondence with the plurality of sensor units.

In this way, color temperature values can be acquired for the respective pixels of the original image, respectively.

In some embodiments, the image data includes image data of a plurality of pixels, the signal processing unit is configured to calculate color coordinates of each of the pixels in a color space according to the first electrical signal, and is configured to obtain the color temperature distribution data according to the color coordinates, where the color temperature distribution data includes a color temperature value of each of the pixels.

A second aspect of the present application provides a color temperature detection apparatus, including;

the main lens is used for acquiring optical signals;

the micro lenses are used for receiving at least part of the optical signals acquired by the main lenses;

a plurality of sensor units corresponding to the plurality of micro lenses and used for generating electric signals according to the optical signals acquired by the plurality of micro lenses; and

and the signal processing unit is electrically connected with the plurality of sensor units and is used for acquiring the color temperature distribution data according to the electric signals.

Thus, when the color temperature detection device is applied to the electronic equipment, the main lens and the micro lenses can acquire the optical signals in real time and guide the optical signals to the sensor unit to form the electric signals, and the color temperature distribution data corresponding to the original images are acquired in real time through the signal processing unit.

In this way, it is advantageous to focus the optical signal for better imaging.

In some embodiments, each of the sensor units comprises a multispectral sensor.

A third aspect of the present application provides an image processing method, including:

acquiring image data;

receiving color temperature distribution data when acquiring image data;

forming a plurality of image partitions based on the color temperature distribution data and the image data;

determining a target color temperature range according to the color temperature value of the image partition with the largest area among the plurality of image partitions; and

adjusting color temperature values of the rest image partitions except the image partition with the largest area in the plurality of image partitions to the target color temperature range to obtain processed image data;

and displaying the processed image according to the processed image data.

The image processing method is beneficial to unifying the overall color temperature of the images and ensures that the processed images have better display effect.

In some embodiments, after the step of adjusting the color temperature values of the remaining image partitions except the image partition with the largest area to the target color temperature range, the method further includes:

selecting a plurality of boundary pixels of the plurality of image partitions, and judging whether a gray level difference value between a maximum gray level value and a minimum gray level value in the plurality of boundary pixels is larger than a first threshold value;

and adjusting color temperature values of the rest of the plurality of image partitions except the image partition with the largest area to the target color temperature range to acquire processed image data in response to the gray level difference value between the maximum gray level value and the minimum gray level value in the plurality of boundary pixels being larger than the first threshold.

In some embodiments, in response to a gray level difference between a maximum gray level value and a minimum gray level value of the plurality of boundary pixels being less than or equal to the first threshold, determining whether the gray level difference value is greater than a second threshold;

and adjusting color temperature values of the plurality of boundary pixels to linearly change in response to the gray scale difference value being greater than the second threshold value to obtain the processed image data.

Therefore, the color temperature transition of the boundary area of each image partition in the image is natural, and the image display effect after the processing is improved.

A fourth aspect of the present application provides an image data processing apparatus storing a computer program which, when executed, implements a method as described above.

The image data processing device is beneficial to unifying the overall color temperature of the processed image, and the display effect of the processed image is better.

Drawings

Fig. 1 is a plan view of an electronic device according to an embodiment of the present application.

Fig. 2 is a schematic block diagram of the electronic device in fig. 1.

Fig. 3 is a view field contrast schematic diagram of the image capturing apparatus and the color temperature detecting apparatus in fig. 2.

Fig. 4 is a schematic block diagram of the color temperature detecting device in fig. 2.

Fig. 5 is a schematic diagram of an optical path structure in the color temperature detecting device in fig. 2.

FIG. 6 is a graph showing the variation of the electrical signal output from the sensor unit with the wavelength of light.

Fig. 7 is a schematic diagram of the CIE1931 color space.

FIG. 8 is a flow chart of an image processing method of the present application.

Fig. 9 is a schematic diagram of partitioning the original image in step S2.

Description of the main reference signs

Electronic equipment	100
		Image pickup apparatus	10
Color temperature detection device	20
		Main lens	21
Micro lens	22
		Sensor unit	23
Photosensitive element	23R、23G、23B
		Signal processing unit	24
Image data processing apparatus	30
		Display panel	40
Memory	50
		Visual field	FOV1、FOV2、FOV3、FOV4
Optical signal	L1
		Focusing a light beam	L2
Focal length	f1，f2
		Geometric center	O
Plane surface	F1，F2，F3
		Pixel arrangement	P
Image partitioning	P1、P2、P3、P4
		Step (a)	S1、S2、S3、S4、S5、S6、S7、S8、S9
Display area	AA

Detailed Description

Embodiments of the present application are described below with reference to the accompanying drawings in the embodiments of the present application.

An electronic device 100 of the present application is shown in fig. 1. The electronic device 100 may be a device such as a mobile phone, a computer, or a smart camera, which has functions of capturing and displaying images. In this embodiment, the electronic device 100 is used as a mobile phone for illustration. The electronic device 100 is used for capturing an original image, adjusting the white balance of the original image to obtain a processed image, and displaying the processed image. In this embodiment, the white balance is mainly adjusted by adjusting the color temperature of the original image.

Referring to fig. 2, in the present embodiment, an electronic apparatus 100 includes an image capturing device 10, a color temperature detecting device 20, an image data processing device 30, and a display panel 40. The image data processing device 30 is electrically connected to the image pickup device 10, the color temperature detection device 20, and the display panel 40, respectively.

The image pickup apparatus 10 includes a camera, a photosensitive element, and the like, which are necessary for achieving an image pickup function, for acquiring image data. Referring to fig. 1 again, in the present embodiment, the electronic device 100 has a display area AA for displaying an image, and the display area AA includes a plurality of pixels P. The plurality of pixels P are arranged in a pixel array including a plurality of rows and a plurality of columns. Each pixel P emits light independently, and all pixels P are used for displaying a frame of image in a matched manner when emitting light. The image data acquired by the image pickup device 10 includes a gray-scale value for each pixel P. In this embodiment, each pixel P is configured to emit light of three colors of red, green and blue. By changing the ratio of the light of the three colors of red, green, and blue emitted from the respective pixels P, the image displayed by the electronic device 100 can be changed. In this embodiment, the gray scale value of each pixel P includes a red gray scale value, a green gray scale value, and a blue gray scale value. That is, the image data includes red, green, and blue gray scale values of each pixel P.

The image pickup device 10 picks up each image with a field of view. In this embodiment, the color temperature detecting device 20 is used to synchronously acquire color temperature distribution data of the same field of view when the image capturing device 10 captures an image. The term "synchronization" in this embodiment refers to field synchronization (or field identity, or field difference within a predetermined range), and does not limit simultaneous acquisition of color temperature distribution data and acquisition of image data.

In this embodiment, the electronic device 100 further includes a driving device (not shown). The driving device is electrically connected with the image pickup device 10 and the color temperature detection device 20 respectively, and is used for controlling the image pickup device 10 and the color temperature detection device 20 to have synchronous fields of view.

Referring to fig. 3, in order to adapt to different photographing effects, the field size of the image capturing apparatus 10 is adjustable, for example, the image capturing apparatus 10 has a long Jiao Shichang FOV2, a wide-angle field FOV3, and an ultra-wide-angle field FOV4, wherein the ultra-wide-angle field FOV4 is the maximum field of view. In some embodiments, the field of view FOV1 of the color temperature detection device 20 is slightly larger than the maximum field of view FOV4 of the image capture device 10, unlike the field of view of the image capture device 10, and the maximum field of view FOV4 of the image capture device 10 is within the field of view FOV1 of the color temperature detection device 20. Since the color temperature detecting device 20 is used to synchronously acquire the color temperature distribution data of the image captured under the same view as the image capturing device 10, if the size of the view field of the color temperature detecting device 20 is the same as that of the image capturing device 10, the acquired color temperature distribution data at the view field boundary may be inaccurate due to mechanical errors. Therefore, by setting the field of view FOV1 of the color temperature detection device 20 to be larger than and completely cover the maximum field of view FOV4 of the image pickup device 10, the field of view boundary of the color temperature detection device 20 is not the field of view boundary of the image pickup device 10, and even if the obtained color temperature distribution data at the field of view boundary of the color temperature detection device 20 is inaccurate, the accuracy of the color temperature distribution data at the field of view boundary of the image pickup device 10 is not affected. Therefore, by setting the maximum field FOV4 of the image pickup device 10 to be within the field FOV1 of the color temperature detection device 20, it is advantageous to improve the accuracy of the color temperature detection data.

Referring to fig. 4, in the present embodiment, the color temperature detecting apparatus 20 includes a main lens 21, a plurality of micro-lenses 22, a plurality of sensor units 23 and a signal processing unit 24.

The main lens 21 is used for acquiring optical signals, the plurality of micro lenses 22 are used for receiving at least part of the optical signals acquired by the main lens 21, and the plurality of sensor units 23 are used for generating electrical signals according to the optical signals acquired by the plurality of micro lenses 22. Wherein the plurality of micro-lenses 22 comprises a first micro-lens and the plurality of sensor units 23 comprises a first sensor unit for generating a first electrical signal from the optical signals received by the first micro-lens.

In this embodiment, the optical signal is light from the environment in which the electronic device 100 is currently located. The main lens 21 is used for acquiring an optical signal L1 and focusing the optical signal L1 to the plurality of micro lenses 22. Each micro lens 22 is used for focusing a part of the optical signal L1, and each micro lens 22 generates a focusing light beam L2. That is, the optical signals L1 are focused by the plurality of micro lenses 22, respectively, thereby forming a plurality of focused light beams L2. The micro lenses 22 are equal in number and in one-to-one correspondence with the sensor units 23. Each micro lens 22 is used for focusing a focused light beam L2 onto a corresponding sensor unit 23. Each sensor unit 23 is configured to generate an electrical signal (including the first electrical signal) according to a focused light beam L2. The signal processing unit 24 is configured to receive the electrical signals output from the respective sensor units 23, and perform data processing according to the electrical signals to acquire color temperature distribution data under the field of view captured by the current imaging apparatus 10. In the present embodiment, the color temperature distribution data acquired by the signal processing unit 24 includes the color temperature value of each pixel P in one image captured by the current image capturing apparatus 10.

Referring to fig. 5, in the present embodiment, the main lens 21 is a lens. The main lens 21 has a focal length f1. The plurality of micro lenses 22 are arranged in a two-dimensional array of micro mirrors (only one row of micro lenses 22 in the two-dimensional array is shown in fig. 5). The micromirror array is located at the focal plane F1 of the main lens 21. That is, the main lens 21 has a geometric center O, a plane F2 passing through the geometric center O and parallel to the focal plane F1 is defined, and the perpendicular distance between the geometric center of each micro lens 22 and the plane F2 is F1. Thus, a better focusing effect is advantageously obtained. Each microlens 22 has the same focal length F2, and each sensor unit is located at the focal plane F3 of its corresponding microlens 22. That is, each sensor unit 23 is separated from its corresponding microlens 22 by a vertical distance f2.

A plurality of sensor units 23 are located on a side of the micromirror array remote from the main lens 21. The plurality of sensor units 23 are also arranged as a two-dimensional sensor array. In this embodiment, the micromirror array and the sensor array are parallel to each other, and the distance between the corresponding micro lens 22 and the sensor unit 23 is the same.

In the present embodiment, each sensor unit 23 includes three photosensitive elements, which are 23R, 23G, and 23B, respectively. Referring to fig. 6, fig. 6 shows a wavelength-dependent electrical signal generated by each photosensitive element (23R, 23G, and 23B) in each sensor unit 23. The photosensitive element 23R is configured to sense light with a wavelength in a red light band (620-750 nm) in the focused light beam L2 and generate a corresponding electrical signal; the photosensitive element 23G is configured to sense light with a wavelength in a green light band (495-570 nm) in the focused light beam L2, and generate a corresponding electrical signal; the photosensitive element 23B is used for sensing light with a wavelength in a blue light band (450-475 nm) in the focused light beam L2 and generating a corresponding electrical signal. As can be seen from fig. 6, each photosensitive element has a specific wavelength band that can be sensed, but generates an electric signal in other wavelength bands. Taking the photosensitive element 23R as an example, the photosensitive element 23R is mainly used for sensing the light with the wavelength in the red light band in the focused light beam L2, and an electric signal is generated for the light with the wavelength outside the red light band, but the amplitude of the electric signal is far smaller than that of the electric signal generated according to the light with the red light band. The photosensitive element 23G and the photosensitive element 23B are the same.

In the present embodiment, each micro lens 22 corresponds to a plurality of pixels P. That is, after the focused light beam L2 focused by each micro lens 22 is incident on the corresponding sensor unit 23, the color temperature distribution data obtained by the data processing of the electrical signal output by the sensor unit 23 includes the color temperature values of the plurality of pixels P corresponding to the micro lens 22. In the present embodiment, the number of pixels P corresponding to each microlens 22 is the same. The specific number of micro-lenses 22 may be set according to resolution requirements. The larger the number of micro lenses 22, the finer the adjustment of the color temperature can be achieved. For example, the plurality of micro-lenses 22 may be arranged in an 8×8 (8 micro-lenses 22 per row and 8 micro-lenses 22 per column) or a 16×16 two-dimensional array.

In other embodiments, each sensor unit 23 includes a multispectral sensor that can sense a focused light beam in the visible light band and generate electrical signals corresponding to the bands, respectively.

In this embodiment, the intensity of the electrical signal generated by each photosensitive element is positively correlated with the intensity of the received light. That is, the electrical signal output by each sensor unit 23 characterizes the intensity of red, green and blue light in the received focused light beam L2. Referring to fig. 4 again, the signal processing unit 24 is configured to perform data processing according to the electrical signal, and calculate color coordinates of a color space corresponding to each pixel P, so as to calculate and obtain color temperature distribution data of an original image generated by capturing the focused light beam L2 received by each sensor unit 23 by the image capturing device 10. In this embodiment, the electronic device 100 displays an image based on the CIE1931 color space (as shown in fig. 7).

Referring to fig. 2, the image data processing device 30 is electrically connected to the image capturing device 10 and the color temperature detecting device 20, and is configured to receive the image data output by the image capturing device 10 and the color temperature distribution data output by the color temperature detecting device 20, and to process the image data according to the color temperature distribution data to obtain processed image data.

The present embodiment also provides an image data processing method applied to the image data processing apparatus 30. Referring to fig. 8, the image data processing method includes:

step S1, acquiring image data and receiving color temperature distribution data when acquiring the image data;

step S2, forming a plurality of image partitions based on the color temperature distribution data and the image data;

step S3, determining a target color temperature range according to the color temperature value of the image partition with the largest area among the plurality of image partitions;

step S4, adjusting the color temperature values of the rest image partitions except the image partition with the largest area in the plurality of image partitions to the target color temperature range;

step S5, selecting a plurality of boundary pixels of the plurality of image partitions, and judging whether the gray level difference value between the maximum gray level value and the minimum gray level value in the plurality of boundary pixels is larger than a first threshold value;

if step S5 is determined to be yes (i.e., when a gray level difference value between a maximum gray level value and a minimum gray level value in the plurality of boundary pixels is greater than the first threshold value), step S6 is executed to adjust color temperature values of the rest of the plurality of image partitions except the image partition with the largest area to the target color temperature range;

if the step S5 is not (i.e. when the gray-scale difference between the maximum gray-scale value and the minimum gray-scale value in the plurality of boundary pixels is less than or equal to the first threshold value), executing a step S7 to determine whether the gray-scale difference is greater than a second threshold value;

if the step S7 determines that the color temperature value of the plurality of boundary pixels is not equal to the first threshold value (i.e., when the gray level difference value is less than the first threshold value), step S8 is performed;

if step S7 is negative (i.e., when the gray level difference value is equal to or less than the second threshold value), step S9 is performed to output the processed image data.

In this embodiment, step S9 is also performed after the color temperature is adjusted in step S6 and step S8.

The color temperature distribution data includes color temperature values of all pixels P of the original image currently acquired. In step S2, pixels P having color temperature values within the same numerical range are divided into the same image partition. For example, pixels P having color temperature values within a range of plus or minus 200K of a certain color temperature value are all divided into the same image division.

Referring to fig. 9, in the present embodiment, four image partitions, namely, image partitions P1, P2, P3 and P4, are formed after color temperature is partitioned. Each image partition comprises a plurality of pixels P. The color temperature values of the individual pixels P in the same image partition lie within the same color temperature range defined previously.

As can be seen from fig. 9, in which the area of the image partition P1 is the largest, in this embodiment, the color temperature values of the pixels P in the image partition P1 are averaged to obtain an average color temperature value. In the present embodiment, a color temperature value range including the average color temperature value is defined as a target color temperature range. For example.

In step S4, the color temperature values of the other image partitions (P2, P3, P4) than the image partition P1 are adjusted to the target color temperature range. The adjusting the color temperature value of the other image partition is specifically adjusting the average value of the color temperature of the other image partition. Taking the image partition P2 as an example, the image partition P2 includes a plurality of pixels P, and in step S4, the color temperature value of each pixel P in the image partition P2 is multiplied by a same weight value to adjust the average value of the color temperatures of the whole image partition P2 to the target color temperature range. In this way, the color temperatures of the image partitions of the whole image tend to be uniform.

As described above, the color temperature uniformity of the whole image is mainly achieved by adjusting the average value of the color temperature of each image partition, but the color temperature value difference between the pixels P at the boundary of each partition may be relatively large, so that relatively abrupt color temperature variation occurs at the boundary of each image partition in the whole image. In this embodiment, therefore, the transition of the color temperature values of the boundary areas of the respective image sections is also made natural by steps S5 to S8.

In step S5, pixels P within a preset range of the boundary center point of each image partition are defined as boundary pixels. In this embodiment, pixels within a range of 2 pixels in each direction around the boundary center point are selected to be defined as boundary pixels.

Taking the image division shown in fig. 9 as an example, a rectangular coordinate system is established in the pixel array, and the row direction (i.e., the horizontal direction in fig. 9) of the pixel array is defined as the X direction, and the column direction (i.e., the vertical direction in fig. 9) is defined as the Y direction. The coordinates of each pixel P are expressed as (X _m ，Y _n ). If the coordinates of the pixel P at the boundary center point of each image partition are (X _m ，Y _n ) In step S5, the coordinates are (X _m-2 ，Y _n )、(X _m+2 ，Y _n )、(X _m ，Y _n-2 ) (X) _m ，Y _n+2 ) Is defined as a boundary pixel, and all pixels P in the rectangle are defined as boundary pixels.

A first threshold and a second threshold are defined, wherein the first threshold is greater than the second threshold. In step S5, it is determined whether the gray level difference value of each boundary pixel is greater than the first threshold. If the gray level difference value is greater than the first threshold value in the step S5, it indicates that the color temperature difference of each pixel is too large at the boundary of the adjacent image partitions, step S6 is executed to readjust the color temperature values of the other image partitions (P2, P3, P4) to the target color temperature range. In step S4 and step S6, each pixel P of the other image partition (P2, P3, P4) is multiplied by a different weight, so that the color temperature value of each pixel P in the other image partition (P2, P3, P4) is different after the adjustment in step S4 and step S6.

If the step S5 is no, step S7 is executed to continuously determine whether the gray level difference value is greater than the second threshold. When the judgment in step S7 is yes, step S8 is executed, and the color temperature value of each boundary pixel is subjected to linear processing. For example, the color temperature value is 6500K at maximum and 6000K at minimum in all the boundary pixels P. The color temperature values of the respective boundary pixels are adjusted such that the color temperature value differences between the adjacently arranged boundary pixels are the same in the X-direction and the Y-direction, and the color temperature values of the respective boundary pixels are also maintained within the range of 6000K-6500K.

If the determination in step S7 is negative, step S9 is executed to directly output the processed image data without further adjustment of the color temperature value.

That is, in this embodiment, a first threshold value and a second threshold value are preset, and the first threshold value and the second threshold value define three numerical ranges: less than a first threshold; greater than the first threshold but less than the second threshold; greater than a second threshold. When the gray level difference value is smaller than the first threshold value, the gray level difference value is considered to be smaller, the color temperature transition between the image partitions is smooth, the color temperature value is not required to be regulated, and the processed image data can be directly output. When the gray level difference value is larger than the first threshold value but smaller than the second threshold value, the color temperature difference value between the image partitions is considered to be larger, and the color temperature values of all boundary pixels are linearly transited, so that the color temperature change between the image partitions is natural. And when the gray level difference value is larger than the second threshold value, the color temperature difference of each boundary pixel is considered to be too large, even if linear transition is performed, the requirement of transition smoothness is difficult to meet, and then the color conversion matrixes of the rest image partitions except the image partition with the largest area in the plurality of image partitions are firstly adjusted.

In some embodiments, the gray-scale difference value may be determined again after step S6 and step S8 instead of directly outputting the processed image data. And outputting the processed image data until the gray level difference value is smaller than the second threshold value. Thus, the color temperature processing accuracy is improved, and the white balance effect of the image is improved.

In this embodiment, the above-mentioned color temperature adjustment refers to adjusting the image data, that is, adjusting the red gray scale value, the green gray scale value and the blue gray scale value of each pixel P in the original image.

Referring to fig. 2 again, the display panel 40 is configured to receive the processed image data and display the processed image according to the processed image data. The processed image is the image after white balance processing is carried out on the original image. Compared with the original image, the processed image has uniform overall color temperature, and the image display effect is improved.

In this embodiment, the electronic device 100 further includes a memory 50. The memory is electrically connected between the image data processing device 30 and the display panel 40, and is used for pre-storing the processed image data, and the display panel 40 can read the data from the memory 50 when the image is to be displayed.

The electronic apparatus 100 of the present embodiment includes an image pickup device 10, a color temperature detection device 20, and an image data processing device 30. The image capturing apparatus 10 is used for acquiring an original image in a certain field of view, and the color temperature detecting apparatus 20 is used for synchronously acquiring optical signals of the field of view to acquire color temperature distribution data of the field of view, so that the image data processing apparatus 30 can process the color temperature of the original image according to the color temperature distribution data acquired synchronously with the field of view of the image capturing apparatus in real time to acquire a processed image. Because the color temperature distribution data in the embodiment is obtained in real time and is synchronous with the field of view of the image capturing device 10, when the image capturing device 10 captures each frame of original image, the color temperature distribution data corresponding to the original image can be obtained synchronously, so that the electronic device 100 in the application is beneficial to improving the accuracy of the color temperature distribution data, further the accuracy of color temperature processing, and further the white balance effect, and the display effect of the processed image is improved.

It will be appreciated by persons skilled in the art that the above embodiments have been provided for the purpose of illustrating the invention and are not to be construed as limiting the invention, and that suitable modifications and variations of the above embodiments are within the scope of the invention as claimed.

Claims

1. An electronic device, comprising:

an image pickup device for acquiring image data;

2. The electronic apparatus according to claim 1, wherein the color temperature detection means is the same as a maximum field of view of the image pickup means.

3. The electronic apparatus of claim 1, wherein a field of view of the color temperature detection device is greater than a maximum field of view of the image capture device, the maximum field of view of the image capture device being within a field of view of the color temperature detection device.

4. The electronic apparatus according to any one of claims 1 to 3, wherein the color temperature detecting means includes:

the main lens is used for acquiring optical signals;

5. The electronic device of claim 4, wherein the plurality of micro-lenses are located on a focal plane of the main lens.

6. The electronic device of claim 4 or 5, wherein focal lengths of the plurality of micro-lenses are the same, and the plurality of sensor units are located on focal planes of the plurality of micro-lenses.

7. The electronic device of any of claims 4-6, wherein each of the sensor units comprises a plurality of photosensitive elements, the plurality of photosensitive elements having different photosensitive bands.

8. The electronic device of any of claims 4-6, wherein each of the sensor units comprises a multispectral sensor.

9. The electronic device of any of claims 4-6, wherein the plurality of micro-lenses are in one-to-one correspondence with the plurality of sensor units.

10. The electronic device according to any one of claims 4-6, wherein the image data comprises image data of a plurality of pixels, the signal processing unit being configured to calculate color coordinates of each of the pixels in a color space from the first electrical signal, and to obtain the color temperature distribution data from the color coordinates, the color temperature distribution data comprising a color temperature value of each of the pixels.

11. A color temperature detection device, comprising;

the main lens is used for acquiring optical signals;

12. The color temperature detecting device according to claim 11, wherein the plurality of micro lenses are located on a focal plane of the main lens.

13. The color temperature detecting device according to claim 11 or 12, wherein focal lengths of the plurality of micro lenses are the same, and the plurality of sensor units are located on focal planes of the plurality of micro lenses.

14. The color temperature detecting device according to any one of claims 11 to 13, wherein each of the sensor units includes a plurality of photosensitive elements having different photosensitive wavelength bands.

15. The color temperature detecting device according to any one of claims 11 to 13, wherein each of the sensor units comprises a multispectral sensor.

16. The color temperature detecting device according to any one of claims 11 to 13, wherein the plurality of micro lenses are in one-to-one correspondence with the plurality of sensor units.

17. The color temperature detecting device according to any one of claims 11 to 13, wherein the image data includes image data of a plurality of pixels, the signal processing unit is configured to calculate color coordinates of each of the pixels in a color space based on the electric signals, and to acquire the color temperature distribution data including a color temperature value of each of the pixels based on the color coordinates.

18. An image processing method, comprising:

acquiring image data;

receiving color temperature distribution data when acquiring image data;

and displaying the processed image according to the processed image data.

19. The image processing method according to claim 18, further comprising, after the step of adjusting color temperature values of the remaining image partitions other than the image partition having the largest area among the plurality of image partitions to the target color temperature range:

20. The image processing method according to claim 19, wherein in response to a gray-scale difference value between a maximum gray-scale value and a minimum gray-scale value of the plurality of boundary pixels being equal to or smaller than the first threshold value, it is determined whether the gray-scale difference value is larger than a second threshold value;

21. An image data processing apparatus storing a computer program which, when executed, implements the image processing method according to any one of claims 18 to 20.