CN111486950A - Ambient light detection method, device, electronic device and storage medium - Google Patents

Abstract

The application discloses an ambient light detection method and device, an electronic device and a storage medium. The ambient light detection method includes: the method comprises the steps of obtaining a detection light intensity value detected by a light sensor, wherein the light sensor is positioned below a display screen, at least one detection value corresponding to a target area exists in the detection light intensity value, and the target area is an area where partial pixels of the display screen do not emit light in a refreshing process; performing Fourier transform on the time domain information of the detection light intensity value to obtain frequency domain information corresponding to the detection light intensity value; according to the frequency domain information, performing light intensity compensation on the detection light intensity value; and determining an environment light intensity value according to the compensated detection light intensity value. The method can realize the current ambient light detection by utilizing the light sensor under the screen.

Description

Ambient light detection method, device, electronic device and storage medium

technical field

The present application relates to the technical field of electronic devices, and more particularly, to an ambient light detection method, device, electronic device, and storage medium.

Background technique

As electronic devices move towards the era of full screen, the screen ratio of electronic devices is getting larger and larger, which brings higher requirements on hardware and structural technology. Generally, in existing electronic devices, a light sensor is arranged above the screen to detect the intensity of ambient light, so as to adjust the brightness of the display screen of the electronic device. However, as the screen-to-body ratio increases, the space outside the screen decreases. How to increase the screen-to-body ratio without affecting ambient light detection has become an urgent problem to be solved.

SUMMARY OF THE INVENTION

In view of the above problems, the present application proposes an ambient light detection method, device, electronic device and storage medium, which can not only realize the current ambient light detection, but also help realize the full-screen design of the electronic device.

In a first aspect, an embodiment of the present application provides an ambient light detection method, the method includes: acquiring a detected light intensity value detected by a light sensor, wherein the light sensor is located below a display screen, and the detected light There is a detection value corresponding to at least one target area in the intensity value, and the target area is an area where some pixels of the display screen do not emit light during the refresh process; Fourier transform is performed on the time domain information of the detected light intensity value , obtain the frequency domain information corresponding to the detected light intensity value; perform light intensity compensation on the detected light intensity value according to the frequency domain information; determine the ambient light intensity value according to the compensated detected light intensity value.

In a second aspect, an embodiment of the present application provides an ambient light detection device, the device includes: a data acquisition module configured to acquire a detected light intensity value detected by a light sensor, wherein the light sensor is located on a display screen Below, there is a detection value corresponding to at least one target area in the detection light intensity value, and the target area is the area where some pixels of the display screen do not emit light during the refresh process; the frequency domain conversion module is used for the Fourier transform is performed on the time domain information of the detected light intensity value to obtain frequency domain information corresponding to the detected light intensity value; a data compensation module is used for performing light intensity analysis on the detected light intensity value according to the frequency domain information Compensation; a result determination module, configured to determine an ambient light intensity value according to the compensated detected light intensity value.

In a third aspect, embodiments of the present application provide an electronic device, including: a display screen; a light sensor, where the light sensor is located below the display screen; one or more processors; a memory; and one or more applications A program, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, the one or more application programs configured to perform the above-mentioned first aspect provides ambient light detection method.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where a program code is stored in the computer-readable storage medium, and the program code can be invoked by a processor to execute the environment provided in the first aspect above Light detection method.

In the solution provided by the present application, when the light sensor is located below the display screen, the current ambient light intensity is determined according to the detected light intensity value by acquiring the detected light intensity value detected by the light sensor. Among them, there is a detection value corresponding to at least one target area in the detected light intensity value, and the target area is an area where some pixels of the display screen do not emit light during the refresh process. Since the detected detection light intensity value may be disturbed by the light on the screen, after the detection light intensity value is obtained, Fourier transform can be performed on the time domain information of the detection light intensity value to obtain the detection light intensity value. The frequency domain information corresponding to the intensity value, and according to the frequency domain information, light intensity compensation is performed on the detected light intensity value, so as to reduce the interference of screen light emission. Finally, according to the detected light intensity value after compensation, a more accurate ambient light intensity value is obtained. In the present application, when the light sensor is arranged under the display screen, the detection of ambient light intensity can be realized, so that a light guide column for the light sensor to receive ambient light does not need to be set in the screen, which is beneficial to the full screen design of electronic equipment . In addition, this solution performs light intensity compensation by detecting the frequency domain information corresponding to the light intensity value, which can reduce the influence of the brightness of the screen light source on the detection of ambient light, and can improve the accuracy of the detection result.

Description of drawings

In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the drawings that are used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained from these drawings without creative effort.

FIG. 1 shows a schematic cross-sectional view of ambient light detection in the prior art.

FIG. 2 shows a flowchart of an ambient light detection method according to an embodiment of the present application.

FIG. 3 shows a schematic diagram of an ambient light detection method provided by an embodiment of the present application.

FIG. 4 shows another schematic diagram of the ambient light detection method provided by an embodiment of the present application.

FIG. 5 shows another schematic diagram of an ambient light detection method provided by an embodiment of the present application.

FIG. 6 shows another schematic diagram of an ambient light detection method provided by an embodiment of the present application.

FIG. 7 shows a flowchart of an ambient light detection method according to another embodiment of the present application.

FIG. 8 shows another flowchart of an ambient light detection method according to another embodiment of the present application.

FIG. 9 shows yet another flowchart of an ambient light detection method according to another embodiment of the present application.

FIG. 10 shows yet another flowchart of an ambient light detection method according to another embodiment of the present application.

FIG. 11 shows still another flowchart of an ambient light detection method according to another embodiment of the present application.

FIG. 12 shows a flowchart of an ambient light detection method according to yet another embodiment of the present application.

FIG. 13 shows a schematic overall flow diagram of an ambient light detection method provided according to an embodiment of the present application.

FIG. 14 shows a block diagram of an ambient light detection apparatus according to an embodiment of the present application.

FIG. 15 is a block diagram of an electronic device for executing an ambient light detection method according to an embodiment of the present application according to an embodiment of the present application.

FIG. 16 is a schematic cross-sectional view of an electronic device for performing an ambient light detection method according to an embodiment of the present application according to an embodiment of the present application.

FIG. 17 is a storage unit for storing or carrying a program code for implementing the ambient light detection method according to the embodiment of the present application according to an embodiment of the present application.

Detailed ways

In order to make those skilled in the art better understand the solutions of the present application, the following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application.

In some solutions, in order to achieve a full screen and a larger screen-to-body ratio, the light sensor can be arranged below the display screen. However, since the display screen will emit light during the display process, a part of the light will leak to the light sensor at this time. Therefore, the light received by the light sensor disposed below the display screen is the sum of the external ambient light and the light leakage of the display screen, that is, the detected light intensity is the light intensity of the ambient light superimposed on the display screen. At present, the screen light leakage is usually calculated by obtaining the display screen information, and then the ambient light is obtained by subtracting the screen light leakage from the reported value of the light sensor. However, this method needs to obtain the display screen information, and currently it is mainly implemented through a screen refresh processing layer (surfaceflinger).

Although in some solutions, as shown in FIG. 1 , a light guide column 105 (usually made of transparent plastic, the top of which directly touches the cover plate 101 or the external environment) through the display screen can be used to avoid the interference of the display screen’s light emission, so that the environment After the light enters the photosensitive device 104 through the light guide column, the photosensitive device 104 can detect the accurate ambient light intensity. However, the setting of the light guide column needs to occupy a certain space of the cover plate, and the width of the black border is increased, so that the full-screen design of the display screen cannot be realized.

Therefore, after long-term research, the inventor has found and proposed the ambient light detection method, device, electronic device, and storage medium provided by the embodiments of the present application. The frequency domain information corresponding to the light intensity value can compensate the light leakage of the screen and obtain a more accurate ambient light intensity value, which can not only reduce the influence of the brightness of the screen light source on the ambient light detection, improve the accuracy of ambient light detection, but also be beneficial to electronic equipment. full-screen design. The specific ambient light detection method will be described in detail in the following embodiments.

Please refer to FIG. 2. FIG. 2 shows a schematic flowchart of an ambient light detection method provided by an embodiment of the present application. In a specific embodiment, the ambient light detection method can be applied to the ambient light detection apparatus 700 shown in FIG. 8 and the electronic equipment equipped with the ambient light detection apparatus 700 ( FIG. 10 , FIG. 11 ). The flow shown in FIG. 2 will be described in detail below, and the ambient light detection method shown may specifically include the following steps:

Step S110: Obtain the detected light intensity value detected by the light sensor, wherein the light sensor is located below the display screen, and the detected light intensity value has at least one detected value corresponding to a target area, and the target area is: The display screen is an area where some pixels do not emit light during the refresh process.

In this embodiment of the present application, the electronic device may acquire the detected light intensity value detected by the light sensor, so as to determine the current ambient light intensity according to the detected light intensity value. Wherein, there is a detection value corresponding to at least one target area in the detected light intensity value, and the target area is an area where some pixels of the display screen do not emit light during the refresh process.

In this embodiment of the present application, the light sensor may be used to collect light for light intensity detection, and may be an ambient light sensor, which may be implemented by using a device such as a phototransistor, a photoresistor, or a photodiode. Wherein, the light sensor can be arranged below the display screen of the electronic device, so as to increase the screen ratio of the electronic device. In some embodiments, the location of the light sensor may correspond to the display area of the display screen.

It should be noted that the display screen needs to be constantly refreshed when displaying the picture to ensure the updating and display quality of the picture. When a high-speed camera is used or the exposure time of the camera is shortened to take a picture of the display screen of an electronic device, it can be seen that there are some areas of pixels in the display screen that do not emit light during the refresh process (also known as black bars), and This non-luminous area moves with the refresh. The non-luminous area is the above-mentioned target area. For example, as shown in FIG. 3 , the area 141 filled with oblique lines in the display screen 140 is the area where the display screen does not emit light currently.

Since the target area is an area that does not emit light, the display screen of the target area is black, and black does not leak light. If the light-sensing sensor performs light-sensing detection on the target area, the detected light intensity value obtained by the light-sensing sensor may be non-interference data, that is, the ambient light intensity value that is basically not affected by the lighting of the display screen. However, if the light-sensing detection is performed on other areas than the target area, since other areas are light-emitting areas, there is interference with the light intensity of the display screen, and the detected light intensity value obtained by the light sensor is the display screen light leakage intensity value. and the sum of the ambient light intensity value, that is, the interference data.

In some embodiments, the integration period detected by the light sensor can be adjusted, so that there is at least one detection value corresponding to the target area in the detected light intensity value acquired by the light sensor, that is, there is at least one non-interfering light intensity value. Ambient light intensity value, so that a more accurate ambient light intensity value can be obtained according to the acquired detection light intensity value.

Step S120: Perform Fourier transform on the time domain information of the detected light intensity value to obtain frequency domain information corresponding to the detected light intensity value.

Although there is at least one non-interference data in the detected light intensity value obtained, most of the light intensity values detected by the light sensor under the screen are the interference data of ambient light superimposed on the display screen, which wastes a lot of data and reduces the accuracy of the data. not tall. Therefore, in this embodiment of the present application, the electronic device may perform Fourier transform on the time domain information of the detected light intensity value detected by the light sensor to obtain the frequency domain information corresponding to the detected light intensity value, so as to obtain the frequency domain information corresponding to the detected light intensity value. Get a more accurate ambient light intensity value. It can not only make full use of all the captured data, but also improve the accuracy of ambient light detection.

It can be understood that, since the interference data is the superposition of ambient light and the luminous intensity of the display screen, the value of the interference data is usually greater than that of the non-interference data. That is to say, because at least one piece of non-interference data exists in the acquired detected light intensity value, the time domain waveform of the detected light intensity value may have a low point, so that an effective Fourier transform can be performed.

For example, when a display screen with a refresh rate of 60 Hz displays a white image, the integrated value curve of the light sensor can be as shown in Figure 4, where the horizontal axis is time, and the vertical axis is the detected light intensity value. It can be seen that the light intensity value is large most of the time, and the light intensity value becomes small only when it is very small. The high time is about 16.57ms, and the low time is only about 90us, and the curve is periodic. Among them, the low value is the ambient light value without interference, and the high value is the sum of ambient light and display light leakage.

In some embodiments, after Fourier transform is performed on the time domain information of the detected light intensity value, the frequency point intensity of the corresponding frequency point can be obtained, and the frequency point intensity can be used to characterize the light leakage effect of the display screen under the current display screen. The intensity of different frequency points represents the influence of screen light leakage on the display screen under different display images. Among them, when the display screen is a white screen, the intensity of the frequency point is the highest, that is, the amount of light leakage of the display screen is the largest, and when the display screen is a black screen, there is no intensity of the frequency point, that is, the amount of light leakage of the display screen is 0.

For example, when the display screen displays a white picture, please refer to FIG. 5 , which shows a schematic diagram of a time-domain waveform for detecting light intensity values. It can be seen that the waveform has obvious periodic characteristics, and its cycle is the refresh cycle of the display screen. The frequency domain waveform obtained after Fourier transform is shown in Figure 6, and it can be seen that the frequency domain waveform has obvious frequency intensity. The intensity of this frequency point represents the amount of screen light leakage effect under the white picture.

Step S130: Perform light intensity compensation on the detected light intensity value according to the frequency domain information.

In the embodiment of the present application, after obtaining the above frequency domain information, the electronic device can perform light intensity compensation on the detected light intensity value detected by the light sensor, so as to remove the interference of light leakage from the screen and obtain a relatively accurate ambient light intensity.

Since the intensity of the frequency point can be used to characterize the light leakage influence amount of the display screen under the current display picture, in some embodiments, the compensation difference to be compensated can be determined according to the light leakage influence amount, so as to reduce the light leakage influence amount of the screen to the minimum . Then, the detected light intensity value is compensated according to the compensation difference, so as to obtain an effective ambient light value. As a way, the corresponding relationship between the frequency point intensity and the compensation difference value may be established in advance, so that when the current frequency point intensity is obtained, the corresponding compensation difference value can be found for compensation according to the corresponding relationship.

Step S140: Determine an ambient light intensity value according to the compensated detected light intensity value.

In the application embodiment, after obtaining the compensated detection light intensity value, the electronic device may determine the current ambient light intensity value according to the compensated detection light intensity value. In this way, all detected light intensity values captured by the photosensitive sensor are fully utilized, and a relatively accurate ambient light intensity is obtained, thereby avoiding data waste.

In some embodiments, the electronic device may use the compensated detected light intensity value as the current ambient light intensity value. The detected light intensity value obtained after performing data fusion and smoothing processing on a plurality of compensated detection light intensity values may also be used as the current ambient light intensity value. The number of data required for data fusion and smoothing processing is not limited here, and can be reasonably set according to actual needs.

In some embodiments, the electronic device may report the ambient light intensity value in real time, or may report the ambient light intensity value every specified time. As a way, the electronic device may select a specified number of values from the compensated detection light intensity values obtained within a specified time period for reporting. It may be selected randomly, or may be selected according to fluctuations in the data before and after, and the specific selection method is not limited here. Among them, the selection is made according to the fluctuation of the data before and after, it can be understood that when a compensated detection light intensity value is selected for reporting, if the subsequent compensated detection light intensity value is still the same value, it will not be reported until there is a different value. Only when the data is reported, only the useful data is reported, and the report of a large amount of meaningless data is avoided.

In some embodiments, after acquiring the current ambient light intensity value, the electronic device can adjust the brightness of the display screen according to the ambient light intensity, which improves the user's visual experience.

In the ambient light detection method provided by the embodiment of the present application, when the light sensor is located below the display screen, the detected light intensity value detected by the light sensor is obtained to perform Fourier analysis on the time domain information of the detected light intensity value. Leaf transformation, so as to obtain the frequency domain information corresponding to the detected light intensity value. Among them, there is a detection value corresponding to at least one target area in the detected light intensity value, and the target area is an area where some pixels of the display screen do not emit light during the refresh process. Then, according to the frequency domain information, light intensity compensation can be performed on the detected light intensity value to reduce the interference of screen light emission, and finally a relatively accurate ambient light intensity value can be obtained according to the compensated detected light intensity value. In this way, the light intensity compensation is performed by detecting the frequency domain information corresponding to the light intensity value, which can reduce the influence of the brightness of the screen light source on the detection of ambient light. Accurate detection of ambient light intensity is achieved.

Referring to FIG. 7 , FIG. 7 shows a schematic flowchart of an ambient light detection method provided by another embodiment of the present application. The flow shown in FIG. 7 will be described in detail below, and the ambient light detection method shown may specifically include the following steps:

Step S210: Obtain the detected light intensity value detected by the light sensor, wherein the light sensor is located below the display screen, and the detected light intensity value has at least one detected value corresponding to a target area, and the target area is The display screen is an area where some pixels do not emit light during the refresh process.

In this embodiment of the present application, for step S210, reference may be made to the content of the foregoing embodiments, and details are not repeated here.

In some embodiments, in order to ensure that there is a detection value corresponding to at least one target area in the detected light intensity values detected by the light sensor, the integration period of the light sensor may be set. The integration period of the light sensor may refer to the integration time required to obtain a light intensity value.

In some embodiments, according to the sampling theorem, the integration period of the light sensor can be set to be less than half of the time width corresponding to the target area (black bar) to ensure that the light sensor can be refreshed in the target area (black bar) Accurately captures undisturbed ambient light intensity values.

As a way, the time width corresponding to the target area (black bar) can be determined according to the refresh cycle of the display screen, so that the integration cycle of the light sensor can be determined. Specifically, referring to FIG. 8, before step S210, the ambient light detection method of the present application may further include:

Step S202a: Obtain a target area in the display screen, where the target area is an area where some pixels of the display screen do not emit light during the refresh process.

Step S204a: Determine the first time width corresponding to the target area within the refresh period of the display screen.

In some embodiments, a high-speed camera can be used or the exposure time of the camera can be shortened to take pictures and videos on the display screen, so that a target area in which some pixels in the display screen do not emit light can be obtained. Then, the screen recording time of the camera can be used for conversion, and the time corresponding to the pixel width of the target area (black bar) can be converted to obtain the first time width corresponding to the target area in one refresh cycle of the display screen. For example, when the refresh rate of the display screen is 60Hz (that is, 60 display images are refreshed in 1s), the time to refresh a display screen is about 16.6ms (that is, the refresh cycle). By calculating the pixel width of the black bar and the entire display screen The ratio of the pixel width of the black bar to obtain the first time width corresponding to the pixel width of the black bar, such as 180us. Of course, the above manner of acquiring the target area is only an example, and is not specifically limited here.

It can be understood that there are various refresh frequencies of the display screen, such as 60 Hz, 90 Hz, 120 Hz, etc., and the first time widths of the corresponding target areas of different refresh frequencies are inconsistent.

Step S206a: Based on the first time width, obtain a first integration period of the light intensity measurement, wherein the first integration period is less than half of the first time width.

Step S208a: Control the light sensor to perform light intensity detection at the first integration period.

In some embodiments, since the target area can move with the refresh, the integration period of the light intensity measurement performed by the light sensor can be set to be less than half of the first time width of the target area, so as to move to the light sensor in the target area When the detection range is within the range, the light sensing sensor can perform light sensing detection, so that the light sensing sensor can detect at least one non-interference ambient light intensity value. In this way, the sensor itself is used to realize the light detection under the screen, and the ambient light brightness is obtained by integrating the black bars refreshed by the screen. It does not depend on the screen of the display screen, and does not require screenshot calculation, which simplifies the calculation and coupling complexity of the current light sensing implementation under the screen, and solves problems such as freezing under heavy load.

For example, in the above example, the first integration period needs to be less than 90us. Therefore, in one refresh cycle, the light sensor can detect at least 16.666/0.09=185 data. Among them, 185 data have a valid data without interference, and other data are affected by screen light leakage. Therefore, the light sensor can report a detected light intensity value at the fastest 16.6ms. In some embodiments, a detected light intensity value may also be reported at the fastest 20 ms, which is not limited here.

In some embodiments, when the display screen is in the DC mode (low-brightness and no stroboscopic eye protection mode), the electronic device can control the light sensor to start detecting the light intensity with the above-mentioned first integration period.

In some embodiments, when the above-mentioned calculation and integration method is used to obtain the photosensitive value, the sensitivity (sensitivity) of the photosensitive sensor can be very high, so as to be able to output the photosensitive value in a very short integration time, and the ADC ( Analog-to-Digital Converter, analog/digital converter) output value relative to the LUX value of ambient light should be greater than 1 times to ensure the detection accuracy of ambient light.

As a way, a high-sensitivity light-sensing device can be used for light-sensing detection, which can not only analyze the brightness of the ambient light for backlight adjustment, but also identify the jitter amplitude of the ambient light, so as to obtain the stroboscopic of the ambient light, which can be used in the camera The photo is unevenly removed (there is a certain screen flicker in the indoor ambient light), because the camera exposure is progressive exposure, there will be black and white horizontal bars.

In some embodiments, when the display screen has a refresh synchronization signal, it can be synchronized to the light sensor end, so that the refresh synchronization can be used to control the start of integration. As shown in Figure 8, the photosensitive device usually includes interrupt signals, I2C, gnd, and a Sync synchronization signal can be added here. The Sync synchronization signal needs to be connected to the synchronization signal of the display screen, so that when the display screen is refreshed, a synchronization signal can be sent to the light sensor, and the light sensor integration can obtain the ambient light value. In this way, more invalid data can be avoided due to integration during the time when the black bars are not refreshed.

As another way, the time width corresponding to the target area (black bar) can be determined according to the PWM period, so that the integration period of the light sensor can be determined. Specifically, referring to FIG. 9, before step S210, the ambient light detection method of the present application may further include:

Step S202b: Acquire a second time width during which the display screen is in an off-screen state in one PWM period.

It is understandable that when the display screen is in the PWM dimming mode, in a PWM (Pulse Width Modulation) cycle, there will be a part of the time in the bright screen state, and a part of the time in the off screen state, which is achieved by brightening the screen. The switch between and off the screen realizes the function of darker brightness seen by the human eye. Since the display screen will not emit light even when the display screen is in the off-screen state, in some embodiments, when the display screen is in the PWM dimming mode, the time width corresponding to the target area (black bar) may also be one PWM period The duration of time in the off-screen state.

For example, for a display screen with a refresh rate of 60hz, the screen flash frequency in the PWM dimming mode may be 240hz, and at this time, the target area may be refreshed at a speed of 240hz. It can be obtained by calculation that the PWM period is 1000/240=4.16ms, wherein the time width of the display in the off-screen state is about 3.7ms. In the actual test, the time width of the target area is 3ms when the low brightness is 10nit, that is, in the PWM dimming mode, the width of the target area in the display screen is wider, and the light sensor can easily integrate and obtain the accurate ambient light intensity value.

In some embodiments, the second time width during which the display screen is in the off-screen state in one PWM period is related to the brightness of the display screen. The darker the current brightness of the display screen, the longer the display screen is off in a PWM cycle, that is, the longer the time width corresponding to the target area; the brighter the current brightness of the display screen, the longer the screen is off in a PWM cycle The shorter the state, the shorter the time width corresponding to the target area.

It can be understood that when the time width corresponding to the target area is longer, the light sensor detects less interference data of the light intensity value. When the time width corresponding to the target area is shorter, the light sensor detects the light intensity. The more noisy data the value is.

Step S204b: Based on the second time width, obtain a second integration period of the light intensity measurement, wherein the second integration period is less than half of the second time width.

Step S206b: Control the light-sensing sensor to perform light intensity detection at the second integration period.

In some embodiments, the integration period of the light intensity measurement performed by the light sensor can be set to be less than half of the second time width of the target area, so that when the target area moves to the detection range of the light sensor, the light sensor can The light sensing detection is performed so that the light sensing sensor can detect at least one undisturbed ambient light intensity value.

In some embodiments, the above two integration periods may be combined to select an appropriate integration period according to specific application scenarios. Specifically, referring to FIG. 10 , before step S202a, the ambient light detection method of the present application may further include:

Step S200: Determine whether it is currently in the PWM dimming mode.

Specifically, when the display screen is currently in the PWM dimming mode, the light sensor can be controlled to start detecting the light intensity with the above-mentioned second integration period, that is, steps S202b to S206b are executed. When the display screen is not currently in the PWM dimming mode, the light sensor can be controlled to start detecting the light intensity with the above-mentioned first integration period, that is, steps S202a to S208a are executed.

Since the width of the black bars in the PWM dimming mode is related to the brightness of the display screen, in some embodiments, before performing the calculation according to the PWM black bars, it can be determined whether the brightness meets the conditions. Specifically, referring to FIG. 11, before step S202b, the ambient light detection method of the present application may further include:

Step S201: Determine whether the brightness of the current display screen is greater than a preset brightness.

Under normal circumstances, the PWM dimming mode is only used when the brightness of the display screen is dark, and because the brightness of the display screen is higher, the time width corresponding to the target area is shorter until it disappears, so that the light sensor cannot effectively detect the environment. Therefore, in some embodiments, the electronic device can determine whether the brightness of the current display screen is greater than the preset brightness.

Specifically, if it is greater than the preset brightness, the current light sensor is not suitable for detection with the second integration period, and the light sensor can be controlled to start light intensity detection with the first integration period, that is, steps S202a to S202a are executed. S208a; if it is less than or equal to the preset brightness, the current photosensitive sensor is very suitable for detection in the second integration period, and the photosensitive sensor can be controlled to start the detection of light intensity in the second integration period, that is, steps S202b~ Step S206b.

Step S220: Perform Fourier transform on the time domain information of the detected light intensity value to obtain frequency domain information corresponding to the detected light intensity value.

In this embodiment of the present application, for step S220, reference may be made to the content of the foregoing embodiments, which will not be repeated here.

In some embodiments, a fast Fourier transform (fast Fourier transform, FFT) may be performed on the time domain information of the detected light intensity value, so as to improve the operation speed.

It can be understood that in FFT, using the periodicity and symmetry of WN, an N-term sequence (set N=2k, k is a positive integer) can be divided into two N/2-term subsequences, each The N/2-point DFT transform requires (N/2) 2 operations, and then uses N operations to combine two N/2-point DFT transforms into an N-point discrete Fourier transform (Discrete Fourier Transform, DFT). After this transformation, the total number of operations becomes N+2*(N/2)^2=N+N^2/2. Although FFT improves the operation speed, it also imposes restrictions on the sample sequence participating in the operation, that is, the number of samples is required to be 2^N points. That is to say, 1024=2^10 satisfies the FFT operation requirements, but not 1000 points. If 1000 points are used, the FFT algorithm will pad zeros after it, and it will automatically be less than 1024 points. However, in this way, the sample being analyzed has changed, and the error of the result is large.

Therefore, in order to ensure the accuracy of the data, in some embodiments, the light sensor may continuously report data streams, and these data streams may enter a data queue. The data queue can be set to meet the sample book requirements of FFT. For example, the queue length can be set to 1024. Following the principle of data first-in, first-out, the data in the data queue can be continuously Fourier transform to calculate the frequency information for In subsequent compensation processing, when the data is dequeued, the dequeued data can be discarded.

Step S230: Determine the compensation value corresponding to the frequency domain information according to the preset correspondence between the frequency domain information and the compensation value.

In some embodiments, a corresponding relationship between the frequency domain information and the compensation value may be established in advance, so that when the current frequency domain information is acquired, a corresponding compensation value may be found for compensation according to the corresponding relationship.

As a method, fitting and optimization can be performed in advance according to the frequency information of different display screens to obtain a fitting model. Therefore, when the current frequency domain information is acquired, a corresponding compensation value can be found for compensation according to the fitting model. Specifically, before step S230, the ambient light detection method of the present application may further include:

When the display screen is in a dark environment, obtain the screen light intensity value detected by the light sensor when the display screen displays the target image; perform Fourier transform on the time domain information of the screen light intensity value to obtain the screen light intensity The frequency domain information corresponding to the value; the frequency domain information corresponding to the screen light intensity values under different target images is fitted to obtain a fitting model, and the fitting model is used to characterize the corresponding relationship between the frequency domain information and the compensation value. .

In some embodiments, the electronic device can be placed in a dark environment. At this time, since there is no influence of ambient light, the light intensity value detected by the light sensor is only the screen light intensity value, and the time domain information of the screen light intensity value After the Fourier transform is performed, the frequency domain information corresponding to the screen light intensity value, that is, the influence amount of screen light leakage, can be obtained. Therefore, the frequency domain information corresponding to the screen light intensity value under each target picture can be obtained by controlling the display screen to display different target pictures, and the influence amount of screen light leakage under different display pictures can be obtained. For example, if it is read that the frequency domain amplitude value is close to or equal to the frequency domain amplitude value of the white picture, the compensation value corresponding to the white picture can be used for compensation.

In some embodiments, since the frequency domain information corresponding to the screen light intensity value may include the frequency point intensity of the corresponding frequency point, the electronic device can fit and optimize different screen light intensity values and their corresponding frequency point intensities. , the fitted model can be obtained. The fitting model can be used to characterize the correspondence between the frequency domain information and the compensation value. As a way, by fitting different screen light intensity values and their corresponding frequency point intensities, the linear relationship between the screen light intensity value and its corresponding frequency point intensity can be obtained, and then the fitted screen light intensity value can be obtained according to the The corresponding compensation value is estimated, and the obtained compensation value and the corresponding frequency point intensity are fitted and optimized, and the above fitting model can be obtained. Wherein, the screen light intensity value may also be directly used as the compensation value for fitting, which is not limited here, and it is only necessary to associate the frequency point intensity with the compensation value.

Step S240: Perform light intensity compensation on the detected light intensity value based on the compensation value.

Step S240: Determine an ambient light intensity value according to the compensated detected light intensity value.

In this embodiment of the present application, for step S240, reference may be made to the content of the foregoing embodiments, which will not be repeated here.

In the ambient light detection method provided by the embodiments of the present application, when the light sensor is located below the display screen, the integration period of the light sensor is set to be less than half of the time width of the target area, so as to ensure that the light sensor detected There is at least one undisturbed ambient light intensity value among the detected light intensity values. The target area is an area where some pixels of the display screen do not emit light during the refresh process. Then, Fourier transform can be performed on the detected light intensity value detected by the light sensor to obtain frequency domain information, and according to the frequency domain information, light intensity compensation can be performed on the detected light intensity value to reduce the interference of screen light emission, and finally According to the detected light intensity value after compensation, a relatively accurate ambient light intensity value is obtained. In addition, by determining the time width of the corresponding target area according to different working modes of the display screen, an optimal detection scheme for different application scenarios can be realized, and the accuracy of the ambient light intensity is improved.

Please refer to FIG. 12. FIG. 12 shows a schematic flowchart of an ambient light detection method provided by another embodiment of the present application. The flow shown in FIG. 12 will be described in detail below, and the ambient light detection method shown may specifically include the following steps:

Step S310: Acquire multiple detected light intensity values detected by the light sensor within a preset time, where the preset time is greater than the refresh period of the display screen.

In some embodiments, in order to ensure the effective execution of the Fourier transform, the minimum number of acquired detected light intensity values may be limited before the Fourier transform is performed. Specifically, it may be to acquire multiple detected light intensity values detected by the light sensor within a preset time, wherein the preset time is greater than the refresh period of the display screen. As a way, in order to reduce the data error after the Fourier transform, the preset time may be at least 2 times greater than the refresh period of the display screen.

In some embodiments, when the Fourier transform is converted to FFT, since the required data is the Nth power of 2, the preset time can be reasonably adjusted according to the Nth power of 2, so that the detection data within the preset time conforms to this identification.

Step S320: Perform Fourier transform on the time domain information of the detected light intensity value to obtain frequency domain information corresponding to the detected light intensity value.

Step S330: Perform light intensity compensation on the detected light intensity value according to the frequency domain information.

In this embodiment of the present application, for steps S320 and S330, reference may be made to the contents of the foregoing embodiments, and details are not repeated here.

Step S340: Obtain the minimum light intensity value in each refresh period from the plurality of detected light intensity values, as the first ambient light intensity value in each refresh period.

Step S350: Acquire a plurality of the compensated detected light intensity values in each refresh period as the second ambient light intensity values in each refresh period.

Step S360: Perform data smoothing processing on the first ambient light intensity value and the second ambient light intensity value to obtain a target ambient light intensity value, which is used as an ambient light detection result.

In some embodiments, since the non-interference data detected by the light sensor is usually the smallest, the minimum light intensity value in each refresh period may be obtained from the plurality of detected light intensity values, and each The first ambient light intensity value in the refresh period. Then, according to the aforementioned compensation method, the multiple detected light intensity values in each refresh period are compensated, and the compensated multiple detected light intensity values are used as the re-estimated second ambient light intensity within each refresh period. . Finally, the data of the two estimated ambient light intensities are smoothed, and a more accurate target ambient light intensity value can be obtained, which can be used as the detection result of ambient light. For example, please refer to FIG. 13 , which shows an overall flow chart of an ambient light detection method.

In the ambient light detection method provided by the embodiment of the present application, when the light sensor is located below the display screen, the detected light intensity value detected by the light sensor is obtained to perform Fourier analysis on the time domain information of the detected light intensity value. Leaf transformation, so as to obtain the frequency domain information corresponding to the detected light intensity value. Among them, there is a detection value corresponding to at least one target area in the detected light intensity value, and the target area is an area where some pixels of the display screen do not emit light during the refresh process. Then, according to the frequency domain information, light intensity compensation can be performed on the detected light intensity value to reduce the interference of screen light emission, and finally a relatively accurate ambient light intensity value can be obtained according to the compensated detected light intensity value. In this way, the light intensity compensation is performed by detecting the frequency domain information corresponding to the light intensity value, which can reduce the influence of the brightness of the screen light source on the detection of ambient light. Accurate detection of ambient light intensity is achieved.

Please refer to FIG. 14 , which shows a structural block diagram of an ambient light detection apparatus 700 provided by an embodiment of the present application. The ambient light detection apparatus 700 includes: a data acquisition module 710 , a frequency domain conversion module 720 , a data compensation module 730 and Results determination module 740 . Wherein, the data acquisition module 710 is used to acquire the detected light intensity value detected by the light sensor, wherein the light sensor is located below the display screen, and there is at least one detected value corresponding to the target area in the detected light intensity value, The target area is the area where some pixels of the display screen do not emit light during the refresh process; the frequency domain conversion module 720 is configured to perform Fourier transform on the time domain information of the detected light intensity value to obtain the detected light intensity The frequency domain information corresponding to the value; the data compensation module 730 is used to perform light intensity compensation on the detected light intensity value according to the frequency domain information; the result determination module 740 is used to determine the detected light intensity value according to the compensation. Ambient light intensity value.

In some embodiments, the data compensation module 730 may be specifically configured to: determine the compensation value corresponding to the frequency domain information according to the preset correspondence between the frequency domain information and the compensation value; The light intensity value performs light intensity compensation.

In this embodiment, the ambient light detection apparatus 700 may further include: a model fitting module. The model fitting module can be specifically used to: when the display screen is in a dark environment, obtain the screen light intensity value detected by the light sensor when the display screen displays the target image; Liye transformation to obtain the frequency domain information corresponding to the screen light intensity value; fitting the frequency domain information corresponding to the screen light intensity value under different target pictures to obtain a fitting model, and the fitting model is used for Characterize the correspondence between the frequency domain information and the compensation value.

In some embodiments, the above-mentioned data acquisition module 710 may be specifically configured to: acquire a plurality of detected light intensity values detected by the light sensor within a preset time, where the preset time is greater than the refresh period of the display screen.

In this embodiment, the above result determination module 740 may be specifically configured to: obtain the minimum light intensity value in each refresh period from the plurality of detected light intensity values, as the first ambient light intensity in each refresh period value; obtain the compensated multiple detected light intensity values in each refresh cycle as the second ambient light intensity value in each refresh cycle; combine the first ambient light intensity value and the second ambient light intensity value The data is smoothed to obtain the target ambient light intensity value, which is used as the detection result of ambient light.

In some embodiments, the ambient light detection apparatus 700 may further include: a detection module. The detection module can be specifically used to: acquire a target area in the display screen, where the target area is an area where some pixels of the display screen do not emit light during the refresh process; determine that the target area is within the refresh period of the display screen The corresponding first time width; based on the first time width, obtain the first integration period of the light intensity measurement, wherein the first integration period is less than half of the first time width; control the light sensor so that The first integration period starts to perform light intensity detection.

In some embodiments, the ambient light detection apparatus 700 may further include: a mode determination module and a first processing module. Wherein, the mode judgment module is used for judging whether it is currently in the PWM dimming mode; the first processing module is used for executing the step of acquiring the target area in the display screen if it is not in the PWM dimming mode.

In some embodiments, the ambient light detection apparatus 700 may further include: a second processing module. The second processing module may be specifically configured to: if in the PWM dimming mode, obtain a second time width in which the display screen is in an off-screen state within a PWM cycle; and obtain a second time width of light intensity measurement based on the second time width an integration period, wherein the second integration period is less than half of the second time width; the light-sensing sensor is controlled to perform light intensity detection at the second integration period.

In some embodiments, the ambient light detection apparatus 700 may further include: a brightness determination module and a third processing module. Wherein, the brightness judgment module is used to judge whether the brightness of the current display screen is greater than the preset brightness; the third processing module is used to execute the acquisition if the brightness of the display screen is less than or equal to the preset brightness, and the display screen is in an off-screen state within one PWM cycle. steps of the second time width.

In some embodiments, the ambient light detection apparatus 700 may further include: a fourth processing module, configured to execute the step of acquiring the target area in the display screen if the brightness is greater than the preset brightness.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, for the specific working process of the above-described devices and modules, reference may be made to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

In several embodiments provided in this application, the coupling between the modules may be electrical, mechanical or other forms of coupling.

In addition, each functional module in each embodiment of the present application may be integrated into one processing module, or each module may exist physically alone, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules.

To sum up, the ambient light detection device provided in the embodiments of the present application is used to implement the corresponding ambient light detection methods in the foregoing method embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be repeated here.

Please refer to FIG. 15 , which shows a structural block diagram of an electronic device provided by an embodiment of the present application. The electronic device 100 may be a terminal device capable of running an application program, such as a PC computer, a mobile terminal, or the like. The electronic device 100 in the present application may include one or more of the following components: a processor 110 , a memory 120 , a light sensor 130 , a display screen 140 and one or more applications, wherein the light sensor 130 is located below the display screen 140 , one or more application programs may be stored in the memory 120 and configured to be executed by the one or more processors 110, and the one or more application programs are configured to perform the methods described in the foregoing method embodiments.

The processor 110 may include one or more processing cores. The processor 110 uses various interfaces and lines to connect various parts of the entire electronic device 100, and executes by running or executing the instructions, programs, code sets or instruction sets stored in the memory 120, and calling the data stored in the memory 120. Various functions of the electronic device 100 and processing data. Optionally, the processor 110 may employ at least one of a digital signal processing (Digital Signal Processing, DSP), a Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and a Programmable Logic Array (Programmable Logic Array, PLA). implemented in hardware. The processor 110 may integrate one or a combination of a central processing unit (Central Processing Unit, CPU), an ambient light detector (Graphics Processing Unit, GPU), a modem, and the like. Among them, the CPU mainly handles the operating system, user interface and application programs, etc.; the GPU is used for rendering and drawing of the display content; the modem is used to handle wireless communication. It can be understood that, the above-mentioned modem may also not be integrated into the processor 110, and is implemented by a communication chip alone.

The memory 120 may include random access memory (Random Access Memory, RAM), or may include read-only memory (Read-Only Memory). Memory 120 may be used to store instructions, programs, codes, sets of codes, or sets of instructions. The memory 120 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.) , instructions for implementing the following method embodiments, and the like. The storage data area may also store data (such as phone book, audio and video data, chat record data) created by the electronic device 100 during use.

The light sensing sensor 130 may be any light sensing device used for collecting light for light intensity detection, and the specific light sensing sensor is not limited here.

The display screen 140 may be used to display information input by or provided to the user and various graphical user interfaces of the electronic device, which may be composed of images, text, icons, videos, and any combination thereof. In some embodiments, the processor 110 may acquire the detected light intensity value according to the light received by the light sensor 130 . Subsequently, the processor 110 may determine the current ambient light intensity value according to the detected light intensity value, and adjust the brightness of the display screen 140 according to the current ambient light intensity value.

In some embodiments, the display screen 140 may be an OLED display screen. Specifically, an organic light-emitting diode (Organic Light-Emitting Diode, OLED) display has good light transmittance and can pass visible light. Therefore, the OLED display screen does not affect the reception of visible light by the light sensor 130 even when the content effect is displayed. The display screen 140 can also use a MicroLED display screen, and the MicroLED display screen also has good transmittance to visible light and infrared light. Of course, these display screens are only exemplary, and embodiments of the present invention are not limited thereto.

Please refer to FIG. 16 , which is a schematic structural diagram of an electronic device. The electronic device includes a glass cover 101 , a display panel 102 , a buffer foam 103 and a light sensor 104 . Wherein, the light sensor is disposed below the display panel 102 .

Please refer to FIG. 17 , which shows a structural block diagram of a computer-readable storage medium provided by an embodiment of the present application. The computer-readable medium 800 stores program codes, and the program codes can be invoked by the processor to execute the methods described in the above method embodiments.

The computer readable storage medium 800 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium 800 includes a non-transitory computer-readable storage medium. Computer readable storage medium 800 has storage space for program code 810 to perform any of the method steps in the above-described methods. These program codes can be read from or written to one or more computer program products. Program code 810 may be compressed, for example, in a suitable form.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand: it can still be Modifications are made to the technical solutions described in the foregoing embodiments, or some technical features thereof are equivalently replaced; and these modifications or replacements do not drive the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims (12)

1. An ambient light detection method, the method comprising:

the method comprises the steps of obtaining a detection light intensity value detected by a light sensor, wherein the light sensor is positioned below a display screen, at least one detection value corresponding to a target area exists in the detection light intensity value, and the target area is an area where partial pixels of the display screen do not emit light in a refreshing process;

performing Fourier transform on the time domain information of the detection light intensity value to obtain frequency domain information corresponding to the detection light intensity value;

according to the frequency domain information, performing light intensity compensation on the detection light intensity value;

and determining an environment light intensity value according to the compensated detection light intensity value.

2. The method of claim 1, wherein the performing light intensity compensation on the detected light intensity values according to the frequency domain information comprises:

determining a compensation value corresponding to the frequency domain information according to a preset corresponding relation between the frequency domain information and the compensation value;

and performing light intensity compensation on the detection light intensity value based on the compensation value.

3. The method according to claim 2, wherein before determining the compensation value corresponding to the frequency domain information according to the preset correspondence between the frequency domain information and the compensation value, the method further comprises:

when the display screen is in a dark environment, acquiring a screen light intensity value detected by a light sensor when the display screen displays a target picture;

performing Fourier transform on the time domain information of the screen light intensity value to obtain frequency domain information corresponding to the screen light intensity value;

and fitting the frequency domain information corresponding to the screen light intensity values under different target pictures to obtain a fitting model, wherein the fitting model is used for representing the corresponding relation between the frequency domain information and the compensation values.

4. The method of claim 2, wherein the obtaining the detected light intensity value detected by the light sensor comprises:

acquiring a plurality of detection light intensity values detected by a light sensor within a preset time, wherein the preset time is longer than the refreshing period of a display screen;

determining an ambient light intensity value according to the compensated detection light intensity value, including:

obtaining a minimum light intensity value in each refreshing period from the plurality of detection light intensity values, and using the minimum light intensity value as a first environment light intensity value in each refreshing period;

obtaining a plurality of compensated detection light intensity values in each refreshing period as a second environment light intensity value in each refreshing period;

and performing data smoothing processing on the first environment light intensity value and the second environment light intensity value to obtain a target environment light intensity value, and using the target environment light intensity value as a detection result of the environment light.

5. The method according to any one of claims 1 to 4, wherein before said obtaining the detected light intensity value detected by the light-sensitive sensor, the method further comprises:

acquiring a target area in a display screen, wherein the target area is an area where partial pixels of the display screen do not emit light in a refreshing process;

determining a first time width corresponding to the target area in a refresh period of the display screen;

obtaining a first integration period of a light intensity measurement based on the first temporal width, wherein the first integration period is less than half of the first temporal width;

and controlling the light sensor to start light intensity detection in the first integration period.

6. The method of claim 5, wherein prior to said acquiring a target area in a display screen, the method further comprises:

judging whether the current is in a PWM dimming mode;

and if the target area is not in the PWM dimming mode, executing the step of acquiring the target area in the display screen.

7. The method of claim 6, wherein after the determining whether the PWM dimming mode is currently active, the method further comprises:

if the display screen is in the PWM dimming mode, acquiring a second time width of the display screen in a screen-off state in a PWM period;

obtaining a second integration period of the light intensity measurement based on a second time width, wherein the second integration period is less than half the second time width;

and controlling the light sensor to start light intensity detection in the second integration period.

8. The method of claim 7, wherein prior to said obtaining the second time width for which the display screen is in the off state within one PWM cycle, the method further comprises:

judging whether the brightness of the current display screen is greater than a preset brightness;

and if the brightness is smaller than or equal to the preset brightness, executing the step of obtaining a second time width of the display screen in the screen-off state in one PWM period.

9. The method according to claim 8, wherein after the determining whether the brightness of the current display screen is greater than the preset brightness, the method further comprises:

and if the brightness is larger than the preset brightness, executing the step of acquiring the target area in the display screen.

10. An ambient light detection device, the device comprising:

the data acquisition module is used for acquiring a detection light intensity value detected by a light sensor, wherein the light sensor is positioned below the display screen, at least one detection value corresponding to a target area exists in the detection light intensity value, and the target area is an area where partial pixels of the display screen do not emit light in the refreshing process;

the frequency domain conversion module is used for carrying out Fourier transform on the time domain information of the detection light intensity value to obtain frequency domain information corresponding to the detection light intensity value;

the data compensation module is used for performing light intensity compensation on the detection light intensity value according to the frequency domain information;

and the result determining module is used for determining the ambient light intensity value according to the compensated detection light intensity value.

11. An electronic device, comprising:

a display screen;

the light sensor is positioned below the display screen;

one or more processors;

a memory;

one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more applications configured to perform the method of any of claims 1-9.

12. A computer-readable storage medium, having stored thereon program code that can be invoked by a processor to perform the method according to any one of claims 1 to 9.

Images