CN111486950A

CN111486950A - Ambient light detection method, ambient light detection device, electronic apparatus, and storage medium

Info

Publication number: CN111486950A
Application number: CN202010313048.3A
Authority: CN
Inventors: 贾勇
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2020-04-20
Filing date: 2020-04-20
Publication date: 2020-08-04
Anticipated expiration: 2040-04-20
Also published as: CN111486950B; WO2021213016A1

Abstract

The application discloses an ambient light detection method and device, an electronic device and a storage medium. The ambient light detection method includes: the method comprises the steps of obtaining a detection light intensity value detected by a light sensor, wherein the light sensor is positioned below a display screen, at least one detection value corresponding to a target area exists in the detection light intensity value, and the target area is an area where partial pixels of the display screen do not emit light in a refreshing process; performing Fourier transform on the time domain information of the detection light intensity value to obtain frequency domain information corresponding to the detection light intensity value; according to the frequency domain information, performing light intensity compensation on the detection light intensity value; and determining an environment light intensity value according to the compensated detection light intensity value. The method can realize the current ambient light detection by utilizing the light sensor under the screen.

Description

Ambient light detection method, ambient light detection device, electronic apparatus, and storage medium

Technical Field

The present disclosure relates to the field of electronic device technologies, and in particular, to an ambient light detection method and apparatus, an electronic device, and a storage medium.

Background

With the trend of electronic equipment to the full-screen era, the screen occupation ratio of the electronic equipment is increasing, and higher requirements are brought to hardware and structural technologies. Generally, the existing electronic device arranges a light sensor above a screen to detect the intensity of ambient light, so as to adjust the brightness of the display screen of the electronic device. However, as the screen occupation ratio increases, the space outside the screen decreases, and how to increase the screen occupation ratio without affecting the ambient light detection becomes a problem to be solved urgently.

Disclosure of Invention

In view of the above problems, the present application provides an ambient light detection method, an ambient light detection device, an electronic device, and a storage medium, which can achieve current ambient light detection and facilitate implementation of a full-screen design of the electronic device.

In a first aspect, an embodiment of the present application provides an ambient light detection method, where the method includes: the method comprises the steps of obtaining a detection light intensity value detected by a light sensor, wherein the light sensor is positioned below a display screen, at least one detection value corresponding to a target area exists in the detection light intensity value, and the target area is an area where partial pixels of the display screen do not emit light in a refreshing process; performing Fourier transform on the time domain information of the detection light intensity value to obtain frequency domain information corresponding to the detection light intensity value; according to the frequency domain information, performing light intensity compensation on the detection light intensity value; and determining an environment light intensity value according to the compensated detection light intensity value.

In a second aspect, an embodiment of the present application provides an ambient light detection apparatus, including: the data acquisition module is used for acquiring a detection light intensity value detected by a light sensor, wherein the light sensor is positioned below the display screen, at least one detection value corresponding to a target area exists in the detection light intensity value, and the target area is an area where partial pixels of the display screen do not emit light in the refreshing process; the frequency domain conversion module is used for carrying out Fourier transform on the time domain information of the detection light intensity value to obtain frequency domain information corresponding to the detection light intensity value; the data compensation module is used for performing light intensity compensation on the detection light intensity value according to the frequency domain information; and the result determining module is used for determining the ambient light intensity value according to the compensated detection light intensity value.

In a third aspect, an embodiment of the present application provides an electronic device, including: a display screen; the light sensor is positioned below the display screen; one or more processors; a memory; one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more applications being configured to perform the ambient light detection method provided by the first aspect above.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where a program code is stored in the computer-readable storage medium, and the program code may be called by a processor to execute the ambient light detection method provided in the first aspect.

The scheme that this application provided, under the condition that light sense sensor is located the display screen below, through the detection light intensity value that obtains light sense sensor and detect to current ambient light intensity is confirmed according to this detection light intensity value. The detection light intensity value at least has a detection value corresponding to a target area, and the target area is an area where part of pixels of the display screen do not emit light in the refreshing process. Since the detected detection light intensity value may be interfered by the screen light emission, after the detection light intensity value is obtained, the time domain information of the detection light intensity value may be subjected to fourier transform to obtain frequency domain information corresponding to the detection light intensity value, and the light intensity compensation may be performed on the detection light intensity value according to the frequency domain information to reduce the interference of the screen light emission. And finally, obtaining a relatively accurate ambient light intensity value according to the compensated detection light intensity value. This application is when setting up the light sense sensor in the display screen below, can realize the detection to ambient light intensity to need not set up the leaded light post that is used for the light sense sensor to receive ambient light in the screen, be favorable to electronic equipment's comprehensive screen design. In addition, according to the scheme, the light intensity compensation is carried out by detecting the frequency domain information corresponding to the light intensity value, so that the influence of the brightness of the screen light source on the detection of the ambient light can be reduced, and the accuracy of the detection result can be improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 shows a cross-sectional schematic of ambient light detection in the prior art.

Fig. 2 shows a flow chart of an ambient light detection method according to an embodiment of the present application.

Fig. 3 shows a schematic diagram of an ambient light detection method according to an embodiment of the present application.

Fig. 4 shows another schematic diagram of the ambient light detection method according to an embodiment of the present application.

Fig. 5 shows another schematic diagram of an ambient light detection method according to an embodiment of the present application.

Fig. 6 shows a further schematic diagram of the ambient light detection method according to an embodiment of the present application.

Fig. 7 shows a flow chart of an ambient light detection method according to another embodiment of the present application.

FIG. 8 shows another flow diagram of an ambient light detection method according to another embodiment of the present application.

Fig. 9 shows a further flowchart of an ambient light detection method according to another embodiment of the present application.

FIG. 10 shows yet another flow chart of an ambient light detection method according to another embodiment of the present application.

FIG. 11 shows a further flowchart of an ambient light detection method according to another embodiment of the present application.

FIG. 12 shows a flow chart of an ambient light detection method according to yet another embodiment of the present application.

Fig. 13 is a schematic flowchart illustrating an overall flow of an ambient light detection method according to an embodiment of the present application.

FIG. 14 shows a block diagram of an ambient light detection arrangement according to an embodiment of the present application.

Fig. 15 is a block diagram of an electronic device for executing an ambient light detection method according to an embodiment of the present application.

Fig. 16 is a schematic cross-sectional view of an electronic device for performing an ambient light detection method according to an embodiment of the present application.

Fig. 17 is a storage unit for storing or carrying program code implementing an ambient light detection method according to an embodiment of the present application.

Detailed Description

In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.

In some aspects, to achieve full screen and greater screen fraction, the light sensor may be disposed below the display screen. However, because the display screen emits light during the display process, a part of light leaks to the light sensor. Therefore, the light received by the light sensor arranged below the display screen is the sum of the external ambient light and the light leakage of the display screen, that is, the detected light intensity is the light intensity of the ambient light superposed with the light emitted by the display screen. At present, screen light leakage is usually calculated by acquiring display screen information, and then the screen light leakage is subtracted from a report value of a light sensor to obtain ambient light. However, this method needs to acquire display screen information, and is mainly implemented by a picture refreshing layer (surfifinger), which causes picture jamming under heavy load conditions, such as playing games.

Although in some embodiments, as shown in fig. 1, the light guide 105 (usually made of transparent plastic and having its top directly abutting the cover plate 101 or the external environment) penetrating the display screen may be used to avoid the interference of the light emitted from the display screen, so that the light sensing device 104 can detect the accurate ambient light intensity after the ambient light enters the light sensing device 104 through the light guide. However, the arrangement of the light guide columns needs to occupy a certain cover plate space, the width of the black edge is increased, and the comprehensive screen design of the display screen cannot be realized.

Therefore, through long-term research, the inventor discovers and provides the ambient light detection method, the ambient light detection device, the electronic device and the storage medium provided by the embodiment of the application, and can compensate light leakage of a screen through frequency domain information corresponding to the detection light intensity value of the light sensation sensor under the condition that the light sensation sensor is positioned below the display screen to obtain a relatively accurate ambient light intensity value, so that the influence of the brightness of a screen light source on ambient light detection can be reduced, the accuracy of ambient light detection is improved, and the comprehensive screen design of the electronic device is facilitated. Specific ambient light detection methods are described in detail in the following examples.

Referring to fig. 2, fig. 2 is a schematic flowchart illustrating an ambient light detection method according to an embodiment of the present application. In a specific embodiment, the ambient light detection method may be applied to the ambient light detection apparatus 700 as shown in fig. 8 and an electronic device (fig. 10, 11) configured with the ambient light detection apparatus 700. As will be explained in detail with respect to the flow shown in fig. 2, the method for detecting ambient light specifically includes the following steps:

step S110: the method comprises the steps of obtaining a detection light intensity value detected by a light sensor, wherein the light sensor is located below a display screen, at least one detection value corresponding to a target area exists in the detection light intensity value, and the target area is an area where partial pixels of the display screen do not emit light in a refreshing process.

In the embodiment of the present application, the electronic device may obtain the detection light intensity value detected by the light sensor, so as to determine the current ambient light intensity according to the detection light intensity value. The detection light intensity value at least has a detection value corresponding to a target area, and the target area is an area where partial pixels of the display screen do not emit light in the refreshing process.

In the embodiment of the application, the light sensor can be used for collecting light to detect light intensity, can be an ambient light sensor, and can be realized by devices such as a phototransistor, a photoresistor or a photodiode. The light sensation sensor can be arranged below a display screen of the electronic equipment so as to improve the screen occupation ratio of the electronic equipment. In some embodiments, the location of the light-sensing sensor may correspond to a display area of the display screen.

It should be noted that the display screen needs to be continuously refreshed when displaying the picture to ensure the update and display quality of the picture. When the high-speed camera is used or the exposure time of the camera is shortened, and the display screen of the electronic device is photographed, it can be seen that pixels of a partial area of the display screen do not emit light (also called as black bars) in the refreshing process, and the non-light-emitting area moves along with refreshing. The non-luminous region is the target region. For example, as shown in fig. 3, the area 141 filled with diagonal lines in the display screen 140 is an area where the display screen is not currently emitting light.

Since the target region is a non-light-emitting region, the display screen of the target region is black, and black is not light-tight. If the light sensor performs light sensing detection on the target area, the obtained detection light intensity value can be interference-free data, namely an environment light intensity value basically not influenced by the light emission of the display screen. If the light sensing detection is performed on the other region except the target region, the other region is a light-emitting region, so that the interference of the light intensity of the light emitted by the display screen exists, and the detection light intensity value obtained by the light sensing sensor is the sum of the display screen light leakage intensity value and the ambient light intensity value, namely interference data.

In some embodiments, the integration period of the detection by the light sensor may be adjusted, so that at least one detection value corresponding to the target area may exist in the detection light intensity values obtained by the light sensor, that is, at least one non-interference ambient light intensity value exists, so that a more accurate ambient light intensity value may be obtained according to the obtained detection light intensity values in the following.

Step S120: and carrying out Fourier transform on the time domain information of the detection light intensity value to obtain frequency domain information corresponding to the detection light intensity value.

Although at least one non-interference data exists in the acquired detection light intensity value, most of the light intensity values detected by the light sensor under the screen are interference data of light emission of the ambient light superposition display screen, so that more data are wasted, and the data accuracy is not high. Therefore, in the embodiment of the present application, the electronic device may perform fourier transform on the time domain information of the detection light intensity value detected by the light sensor to obtain the frequency domain information corresponding to the detection light intensity value, so as to obtain a more accurate ambient light intensity value according to the frequency domain information. The method can fully utilize all captured data and improve the accuracy of ambient light detection.

It will be appreciated that the interference data is typically greater in value than the non-interference data, since the interference data is a superposition of the ambient light and the luminous intensity of the display screen. That is, since at least one non-interference data exists in the acquired detection light intensity values, a low point may exist in the time domain waveform of the detection light intensity values, so that an effective fourier transform may be performed.

For example, when a display screen with a refresh frequency of 60Hz displays a white image, the integrated value curve of the light-sensing sensor can be shown in fig. 4, wherein the horizontal axis is time and the vertical axis is the detected light intensity value. It can be seen that the light intensity value is large most of the time, only a small one of the light intensity values becomes small, the high time is about 16.57ms, the low time is about 90us, and the curve has periodicity. Wherein, the low is the value of the non-interference ambient light, and the high is the sum of the ambient light and the light leakage of the display screen.

In some embodiments, after performing fourier transform on time domain information of the detected light intensity value, frequency point intensity of a corresponding frequency point can be obtained, the frequency point intensity can be used for representing light leakage influence quantity of the display screen under a current display picture, and different frequency point intensities represent screen light leakage influence quantities of the display screen under different display pictures. When the display picture is a white picture, the intensity of the frequency point is highest, namely the light leakage influence quantity of the display screen is largest, and when the display picture is a black picture, the intensity of the frequency point is not present, namely the light leakage influence quantity of the display screen is 0.

For example, when the display screen displays a white image, please refer to fig. 5, and fig. 5 shows a time domain waveform diagram of detecting the light intensity value. It can be seen that the waveform has a distinct periodic characteristic, the period of which is the refresh period of the display screen. The frequency domain waveform obtained after fourier transform is shown in fig. 6, and it can be seen that the frequency domain waveform has obvious frequency point intensity. The intensity of the frequency point represents the amount of influence of screen leakage under a white picture.

Step S130: and performing light intensity compensation on the detection light intensity value according to the frequency domain information.

In this embodiment of the application, after obtaining the frequency domain information, the electronic device may perform light intensity compensation on the detection light intensity value detected by the light sensor to remove interference of screen light leakage and obtain more accurate ambient light intensity.

Since the frequency point intensity can be used for representing the light leakage influence quantity of the display screen under the current display picture, in some embodiments, the compensation difference value to be compensated can be determined according to the light leakage influence quantity so as to reduce the screen light leakage influence quantity to the lowest. And then, the detection light intensity value is compensated according to the compensation difference value, so that an effective ambient light value can be obtained. As a manner, a corresponding relationship between the frequency point intensity and the compensation difference may be pre-established, so that when the current frequency point intensity is obtained, the corresponding compensation difference may be found according to the corresponding relationship for compensation.

Step S140: and determining an environment light intensity value according to the compensated detection light intensity value.

In the embodiment of the application, after obtaining the compensated detection light intensity value, the electronic device may determine the current ambient light intensity value according to the compensated detection light intensity value. Therefore, all detection light intensity values captured by the light sensor are fully utilized, more accurate ambient light intensity is obtained, and data waste is avoided.

In some embodiments, the electronic device may use the compensated detected light intensity value as the current ambient light intensity value. The compensated detected light intensity values may be subjected to data fusion smoothing processing, and the obtained detected light intensity value may be used as the current ambient light intensity value. The number of data required by the data fusion smoothing processing is not limited here, and can be set reasonably according to actual requirements.

In some embodiments, the electronic device may report the ambient light intensity value in real time, or may report the ambient light intensity value at specified time intervals. As a mode, the electronic device may select a specified number of values from compensated detected light intensity values obtained within a specified time to report. The selection may be random, or may be performed according to fluctuation changes of the previous and subsequent data, and the specific selection manner is not limited herein. The selection is carried out according to the fluctuation change of the previous data and the next data, and the situation that when a compensated detection light intensity value is selected to be reported, if the subsequent compensated detection light intensity value is the same value, the reporting is not carried out, and the reporting is not carried out until a different value exists, so that only useful data is reported, and the reporting of a large amount of meaningless data is avoided.

In some embodiments, after the electronic device obtains the current ambient light intensity value, the brightness of the display screen can be adjusted according to the ambient light intensity value, so that the visual experience of a user is improved.

According to the ambient light detection method provided by the embodiment of the application, under the condition that the light sensor is located below the display screen, the detection light intensity value detected by the light sensor is obtained, so that the time domain information of the detection light intensity value is subjected to Fourier transform, and the frequency domain information corresponding to the detection light intensity value is obtained. The detection light intensity value at least has a detection value corresponding to a target area, and the target area is an area where part of pixels of the display screen do not emit light in the refreshing process. Then, according to the frequency domain information, light intensity compensation can be carried out on the detection light intensity value so as to reduce interference of screen light emission, and finally, according to the compensated detection light intensity value, a more accurate environment light intensity value can be obtained. Like this, carry out the light intensity compensation through detecting the frequency domain information that light intensity value corresponds, can reduce the luminance of screen light source to the influence that ambient light detected to when setting up the light sense sensor in the display screen below, need not to set up the leaded light post, also can realize the accurate detection to ambient light intensity.

Referring to fig. 7, fig. 7 is a flowchart illustrating an ambient light detection method according to another embodiment of the present application. As will be explained in detail with respect to the flow shown in fig. 7, the method for detecting ambient light specifically includes the following steps:

step S210: the method comprises the steps of obtaining a detection light intensity value detected by a light sensor, wherein the light sensor is located below a display screen, at least one detection value corresponding to a target area exists in the detection light intensity value, and the target area is an area where partial pixels of the display screen do not emit light in a refreshing process.

In the embodiment of the present application, step S210 may refer to the contents of the foregoing embodiments, which are not described herein again.

In some embodiments, in order to ensure that at least one detection value corresponding to the target area exists in the detection light intensity values detected by the light sensor, the integration period of the light sensor may be set. The integration period of the light sensor may refer to an integration time required to obtain a light intensity value.

In some embodiments, the integration period of the light sensor may be set to be less than half of the corresponding time width of the target region (black bar) according to the sampling theorem, so as to ensure that the light sensor can accurately capture the non-interference ambient light intensity value in the refreshed target region (black bar).

As one way, the time width corresponding to the target area (black bar) can be determined according to the refresh period of the display screen, so that the integration period of the light sensing sensor can be determined. Specifically, referring to fig. 8, before step S210, the ambient light detection method of the present application may further include:

step S202 a: and acquiring a target area in the display screen, wherein the target area is an area where partial pixels of the display screen do not emit light in the refreshing process.

Step S204 a: and determining a first time width corresponding to the target area in a refresh period of the display screen.

In some embodiments, a high-speed camera may be used or the exposure time of the camera may be shortened to take a picture and record a video on the display screen, so that a target area where some pixels in the display screen do not emit light may be acquired. Then, the screen recording time of the camera is converted, and the time corresponding to the pixel width of the target area (black bar) is converted to obtain a first time width corresponding to the target area in a refresh period of the display screen. For example, when the refresh frequency of the display screen is 60Hz (i.e. 60 display screens are refreshed in 1 s), the time for refreshing the display screen once is about 16.6ms (i.e. the refresh period), and the first time width corresponding to the pixel width of the black bar, for example 180us, can be obtained by calculating the ratio of the pixel width of the black bar to the pixel width of the whole display screen. Of course, the above-mentioned manner of acquiring the target region is only an example, and is not limited specifically here.

It is understood that there are many refresh frequencies of the display screen, such as 60Hz, 90Hz, 120Hz, etc., and the first temporal widths of the target areas corresponding to different refresh frequencies are not consistent.

Step S206 a: based on the first temporal width, a first integration period of the light intensity measurement is obtained, wherein the first integration period is less than half of the first temporal width.

Step S208 a: and controlling the light sensor to start light intensity detection in the first integration period.

In some embodiments, since the target area can move with the refresh, an integration period of the light intensity measurement performed by the light sensor can be set to be less than half of the first time width of the target area, so that the light sensor can perform the light detection when the target area moves to the detection range of the light sensor, and the light sensor can detect at least one non-interference ambient light intensity value. Therefore, the light detection under the screen is realized by using the sensor, and the integration is carried out through the refreshed black bars of the screen to obtain the ambient light brightness. The method has no dependence on the picture of the display screen, does not need screen capture calculation, simplifies the calculation and coupling complexity of light sensation realization under the current screen, and solves the problems of blocking and the like under the heavy load condition.

For example, in the above example, the first integration period needs to be less than 90 us. Therefore, in a refresh period, the light-sensitive sensor can detect at least 185 data in the range of 16.666/0.09. Among them, 185 data have one effective data without interference, and the other data are all affected by screen light leakage. Therefore, the light sensor can report a detection light intensity value in the fastest 16.6 ms. In some embodiments, a detected light intensity value may be reported at 20ms, which is not limited herein.

In some embodiments, the electronic device can control the photosensor to start the first integration period for light intensity detection when the display screen is in the DC mode (low-brightness non-strobe eye-protection mode).

In some embodiments, when the above-mentioned integration calculation method is used to obtain the light sensing value, the sensitivity (sensitivity) of the light sensing sensor can be very high to output the light sensing value in a very short integration time, and the ADC (Analog-to-Digital Converter) output value of the light sensing sensor should be greater than 1 times of the L UX value of the ambient light to ensure the detection accuracy of the ambient light.

As a mode, can use high sensitivity light sense device to carry out the light sense and detect, not only can the analysis ambient light luminance be used for backlight control, can also discern the shake range of ambient light to acquire the stroboscopic of ambient light, be used for the inhomogeneous removal of shooing of camera (there is certain screen flash at indoor ambient light), because the camera exposure is line-by-line exposure, the condition of black and white horizontal bar can appear.

In some embodiments, the light sensor terminal may be synchronized when the display screen has a refresh synchronization signal, so that the start of integration may be controlled using the refresh synchronization. As shown in fig. 8, the optical sensing device generally includes an interrupt signal, I2C, gnd, to which a Sync signal may be added. The Sync synchronization signal needs to be connected with the synchronization signal of the display screen, so that the synchronization signal can be sent to the light sensation sensor when the display screen is refreshed, and the light sensation integration obtains an ambient light value. Thereby avoiding the integration in the time of non-refresh black bars resulting in more invalid data.

Alternatively, the time width corresponding to the target area (black bar) can be determined according to the PWM period, so that the integration period of the light sensing sensor can be determined. Specifically, referring to fig. 9, before step S210, the ambient light detection method of the present application may further include:

step S202 b: and acquiring a second time width of the display screen in a screen-off state in a PWM period.

It can be understood that when the display screen is in the PWM dimming mode, in one PWM (Pulse width modulation) period, a part of the time is in the bright screen state, and a part of the time is in the off screen state, which is a function of realizing the darker brightness seen by human eyes by switching between the bright screen state and the off screen state. Since the display screen does not emit light when the display screen is in the off-screen state, in some embodiments, when the display screen is in the PWM dimming mode, the time width corresponding to the target area (black bar) may also be the time width in the off-screen state within one PWM period.

For example, a display screen with a refresh rate of 60HZ, the screen flash rate in the PWM dimming mode may be 240HZ, and the target area may be refreshed at a rate of 240 HZ. The PWM period 1000/240 ═ 4.16ms can be calculated, where the time width of the display in the off state is about 3.7 ms. In practical tests, the time width of the target area is 3ms when the brightness is low, namely, in the PWM dimming mode, the width of the target area in the display screen is wider, and the light sensor can easily integrate to obtain an accurate ambient light intensity value.

In some embodiments, the second time duration during which the display screen is in the off state within one PWM period is related to the brightness of the display screen. The darker the current brightness of the display screen is, the longer the display screen is in a screen-off state in one PWM period is, namely, the longer the time width corresponding to the target area is; the brighter the current brightness of the display screen is, the shorter the display screen is in the screen-off state in one PWM period, that is, the shorter the time width corresponding to the target area is.

It can be understood that the longer the time width corresponding to the target area is, the less the interference data of the light intensity value detected by the light sensor is, and the shorter the time width corresponding to the target area is, the more the interference data of the light intensity value detected by the light sensor is.

Step S204 b: a second integration period of the light intensity measurement is obtained based on a second time width, wherein the second integration period is less than half the second time width.

Step S206 b: and controlling the light sensor to start light intensity detection in the second integration period.

In some embodiments, the integration period of the light intensity measurement performed by the light sensor may be set to be less than half of the second time width of the target area, so that the light sensor may perform light sensing detection when the target area moves to the detection range of the light sensor, so that the light sensor may detect at least one non-interference ambient light intensity value.

In some embodiments, the above two integration periods may be combined to select a suitable integration period according to a specific application scenario. Specifically, referring to fig. 10, before step S202a, the ambient light detection method of the present application may further include:

step S200: and judging whether the current is in the PWM dimming mode.

Specifically, when the display screen is currently in the PWM dimming mode, the light sensor may be controlled to start the light intensity detection with the second integration period, i.e., step S202b to step S206b are performed. When the display screen is not currently in the PWM dimming mode, the light sensor may be controlled to start the light intensity detection with the first integration period, i.e., step S202a to step S208a are performed.

Since the width of the black bar in the PWM dimming mode is related to the brightness of the display screen, in some embodiments, before performing the calculation according to the PWM black bar, it may be determined whether the brightness meets the condition. Specifically, referring to fig. 11, before step S202b, the ambient light detection method of the present application may further include:

step S201: and judging whether the brightness of the current display screen is greater than the preset brightness.

In general, when the brightness of the display screen is relatively low, the PWM dimming mode is used, and since the brightness of the display screen is higher, the time width corresponding to the target area is shorter until the brightness disappears, and the light sensor cannot effectively detect the ambient light intensity value, in some embodiments, the electronic device may determine whether the brightness of the current display screen is greater than the preset brightness.

Specifically, if the current light sensor is not suitable for the second integration period, the light sensor may be controlled to start the light intensity detection with the first integration period, that is, to perform steps S202a to S208 a; if the current light sensor is less than or equal to the predetermined brightness, the current light sensor is suitable for detecting with the second integration period, and the light sensor can be controlled to start detecting the light intensity with the second integration period, i.e. to perform steps S202b to S206 b.

Step S220: and carrying out Fourier transform on the time domain information of the detection light intensity value to obtain frequency domain information corresponding to the detection light intensity value.

In the embodiment of the present application, the step S220 may refer to the contents of the foregoing embodiments, and is not described herein again.

In some embodiments, a Fast Fourier Transform (FFT) may be performed on the time domain information of the detected light intensity value to improve the operation speed.

It can be understood that, in the FFT, an N-term sequence (N is 2k, k is a positive integer) can be divided into two N/2-term subsequences by using the periodicity and symmetry of WN, each N/2-point DFT transform requires (N/2)2 operations, and the two N/2-point DFT transforms are combined into an N-point Discrete Fourier Transform (DFT) by using the N operations. After the conversion, the total operation number becomes N +2 (N/2) ^ 2^ N + N ^ 2/2. Although the FFT improves the operation speed, it also imposes a limitation on the sample sequence involved in the operation, i.e., it requires 2^ N samples. That is, 1024 ^ 2^10 satisfies the requirement of FFT operation, 1000 points are not satisfied, and if 1000 points are adopted, the FFT algorithm will zero-fill thereafter, and automatically less than 1024 points. However, the sample being analyzed then becomes variable, resulting in larger errors.

Therefore, to ensure data accuracy, in some embodiments, the light sensor may continuously report data streams, which may enter a data queue. The data queue may be configured to meet FFT sample book requirements, for example, the queue length may be set to 1024, following the principle of data first in first out, the data in the data queue may be continuously fourier transformed to calculate frequency information for subsequent compensation processing, and the dequeued data may be discarded after dequeuing.

Step S230: and determining a compensation value corresponding to the frequency domain information according to a preset corresponding relation between the frequency domain information and the compensation value.

In some embodiments, a corresponding relationship between the frequency domain information and the compensation value may be preset, so that when the current frequency domain information is obtained, the corresponding compensation value may be found according to the corresponding relationship for compensation.

As one mode, fitting and optimization can be performed in advance according to frequency information of different display frames to obtain a fitting model. Therefore, when the current frequency domain information is obtained, the corresponding compensation value can be found according to the fitting model for compensation. Specifically, before step S230, the ambient light detection method of the present application may further include:

when the display screen is in a dark environment, acquiring a screen light intensity value detected by a light sensor when the display screen displays a target picture; performing Fourier transform on the time domain information of the screen light intensity value to obtain frequency domain information corresponding to the screen light intensity value; and fitting the frequency domain information corresponding to the screen light intensity values under different target pictures to obtain a fitting model, wherein the fitting model is used for representing the corresponding relation between the frequency domain information and the compensation values.

In some embodiments, the electronic device may be set in a dark environment, at this time, since there is no influence of ambient light, the light intensity value detected by the light sensor is only the screen light intensity value, and after performing fourier transform on the time domain information of the screen light intensity value, frequency domain information corresponding to the screen light intensity value, that is, the screen light leakage influence amount, may be obtained. Therefore, the display screen can be controlled to display different target pictures to obtain frequency domain information corresponding to the screen light intensity value under each target picture, and the screen light leakage influence quantity under different display pictures is obtained. For example, if it is read that the frequency domain amplitude is close to or equal to the frequency domain amplitude of the white picture, compensation can be performed by a compensation value corresponding to the white picture.

In some embodiments, the frequency domain information corresponding to the screen light intensity value may include the frequency point intensity of the corresponding frequency point, so that the electronic device may fit and optimize different screen light intensity values and the corresponding frequency point intensities thereof to obtain a fitting model. The fitting model can be used for representing the corresponding relation between the frequency domain information and the compensation value. As a way, by fitting different screen light intensity values and corresponding frequency point intensities thereof, a linear relationship between the screen light intensity value and the corresponding frequency point intensity thereof can be obtained, then, a corresponding compensation value can be estimated according to the fitted screen light intensity value, and the obtained compensation value and the corresponding frequency point intensity are subjected to fitting optimization, so that the fitting model can be obtained. The screen light intensity value may also be directly used as a compensation value for fitting, and the fitting is not limited here, and only needs to associate the frequency point intensity with the compensation value.

Step S240: and performing light intensity compensation on the detection light intensity value based on the compensation value.

Step S240: and determining an environment light intensity value according to the compensated detection light intensity value.

In the embodiment of the present application, step S240 may refer to the contents of the foregoing embodiments, which are not described herein again.

In the ambient light detection method provided by the embodiment of the application, under the condition that the light sensor is located below the display screen, the integration period of the light sensor is set to be less than half of the time width of the target area, so that at least one interference-free ambient light intensity value exists in the detection light intensity values detected by the light sensor. The target area is an area where part of pixels of the display screen do not emit light in the refreshing process. Then, Fourier transform can be carried out on the detection light intensity value detected by the light sensor to obtain frequency domain information, light intensity compensation is carried out on the detection light intensity value according to the frequency domain information to reduce interference of screen luminescence, and finally, a more accurate environment light intensity value is obtained according to the compensated detection light intensity value. In addition, the time width of the corresponding target area is determined according to different working modes of the display screen, so that the optimal detection schemes of different application scenes can be realized, and the accuracy of the ambient light intensity is improved.

Referring to fig. 12, fig. 12 is a flowchart illustrating an ambient light detection method according to another embodiment of the present application. As will be explained in detail with respect to the flow shown in fig. 12, the method for detecting ambient light specifically includes the following steps:

step S310: and acquiring a plurality of detection light intensity values detected by the light sensor within a preset time, wherein the preset time is longer than the refresh period of the display screen.

In some embodiments, to ensure efficient fourier transformation, a minimum number of detected light intensity values acquired may be defined prior to fourier transformation. Specifically, a plurality of detected light intensity values detected by the light sensor within a preset time may be obtained, where the preset time is longer than a refresh period of the display screen. As one way, in order to reduce the data error after fourier transform, the preset time may be at least 2 times greater than the refresh period of the display screen.

In some embodiments, when the fourier transform is FFT, since the required data is N powers of 2, the preset time can be adjusted reasonably according to N powers of 2, so that the detection data in the preset time can meet the identification.

Step S320: and carrying out Fourier transform on the time domain information of the detection light intensity value to obtain frequency domain information corresponding to the detection light intensity value.

Step S330: and performing light intensity compensation on the detection light intensity value according to the frequency domain information.

In the embodiment of the present application, step S320 and step S330 may refer to the contents of the foregoing embodiments, and are not described herein again.

Step S340: and obtaining the minimum light intensity value in each refreshing period from the plurality of detection light intensity values as the first environment light intensity value in each refreshing period.

Step S350: and acquiring a plurality of compensated detection light intensity values in each refreshing period as a second environment light intensity value in each refreshing period.

Step S360: and performing data smoothing processing on the first environment light intensity value and the second environment light intensity value to obtain a target environment light intensity value, and using the target environment light intensity value as a detection result of the environment light.

In some embodiments, since the non-interference data detected by the light sensor is generally the smallest, the minimum light intensity value in each refresh period can be obtained from the plurality of detected light intensity values, and the first ambient light intensity value in each refresh period can be preliminarily estimated. Then, the plurality of detection light intensity values in each refresh period are compensated according to the compensation method, and the compensated plurality of detection light intensity values are used as the second environmental light intensity in each refresh period which is estimated again. And finally, performing data smoothing on the twice estimated ambient light intensities to obtain a more accurate target ambient light intensity value, and using the more accurate target ambient light intensity value as a detection result of the ambient light. For example, referring to fig. 13, fig. 13 shows an overall flowchart of an ambient light detection method.

Referring to fig. 14, a block diagram of an ambient light detection apparatus 700 according to an embodiment of the present application is shown, where the ambient light detection apparatus 700 includes: a data acquisition module 710, a frequency domain conversion module 720, a data compensation module 730, and a result determination module 740. The data obtaining module 710 is configured to obtain a detected light intensity value detected by a light sensor, where the light sensor is located below a display screen, at least one detected value corresponding to a target area exists in the detected light intensity value, and the target area is an area where some pixels of the display screen do not emit light during a refreshing process; the frequency domain conversion module 720 is configured to perform fourier transform on the time domain information of the detected light intensity value to obtain frequency domain information corresponding to the detected light intensity value; the data compensation module 730 is configured to perform light intensity compensation on the detected light intensity value according to the frequency domain information; the result determining module 740 is configured to determine an ambient light intensity value according to the compensated detected light intensity value.

In some embodiments, the data compensation module 730 may be specifically configured to: determining a compensation value corresponding to the frequency domain information according to a preset corresponding relation between the frequency domain information and the compensation value; and performing light intensity compensation on the detection light intensity value based on the compensation value.

In this embodiment, the ambient light detection apparatus 700 may further include: and a model fitting module. The model fitting module may be specifically configured to: when the display screen is in a dark environment, acquiring a screen light intensity value detected by a light sensor when the display screen displays a target picture; performing Fourier transform on the time domain information of the screen light intensity value to obtain frequency domain information corresponding to the screen light intensity value; and fitting the frequency domain information corresponding to the screen light intensity values under different target pictures to obtain a fitting model, wherein the fitting model is used for representing the corresponding relation between the frequency domain information and the compensation values.

In some embodiments, the data obtaining module 710 may be specifically configured to: and acquiring a plurality of detection light intensity values detected by the light sensor within a preset time, wherein the preset time is longer than the refresh period of the display screen.

In this embodiment, the result determining module 740 may be specifically configured to: obtaining a minimum light intensity value in each refreshing period from the plurality of detection light intensity values, and using the minimum light intensity value as a first environment light intensity value in each refreshing period; obtaining a plurality of compensated detection light intensity values in each refreshing period as a second environment light intensity value in each refreshing period; and performing data smoothing processing on the first environment light intensity value and the second environment light intensity value to obtain a target environment light intensity value, and using the target environment light intensity value as a detection result of the environment light.

In some embodiments, the ambient light detection apparatus 700 may further include: and a detection module. The detection module may be specifically configured to: acquiring a target area in a display screen, wherein the target area is an area where partial pixels of the display screen do not emit light in a refreshing process; determining a first time width corresponding to the target area in a refresh period of the display screen; obtaining a first integration period of a light intensity measurement based on the first temporal width, wherein the first integration period is less than half of the first temporal width; and controlling the light sensor to start light intensity detection in the first integration period.

In some embodiments, the ambient light detection apparatus 700 may further include: the device comprises a mode judging module and a first processing module. The mode judging module is used for judging whether the current mode is in a PWM dimming mode; the first processing module is used for executing the step of acquiring the target area in the display screen if the display screen is not in the PWM dimming mode.

In some embodiments, the ambient light detection apparatus 700 may further include: and a second processing module. The second processing module may be specifically configured to: if the display screen is in the PWM dimming mode, acquiring a second time width of the display screen in a screen-off state in a PWM period; obtaining a second integration period of the light intensity measurement based on a second time width, wherein the second integration period is less than half the second time width; and controlling the light sensor to start light intensity detection in the second integration period.

In some embodiments, the ambient light detection apparatus 700 may further include: the device comprises a brightness judging module and a third processing module. The brightness judging module is used for judging whether the brightness of the current display screen is greater than the preset brightness; and the third processing module is used for executing the step of acquiring the second time width of the screen-off state of the display screen in one PWM period if the brightness is less than or equal to the preset brightness.

In some embodiments, the ambient light detection apparatus 700 may further include: and the fourth processing module is used for executing the step of acquiring the target area in the display screen if the brightness is greater than the preset brightness.

It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and modules may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the several embodiments provided in the present application, the coupling between the modules may be electrical, mechanical or other type of coupling.

In addition, functional modules in the embodiments of the present application may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.

In summary, the ambient light detection device provided in the embodiment of the present application is used to implement the corresponding ambient light detection method in the foregoing method embodiment, and has the beneficial effects of the corresponding method embodiment, which are not described herein again.

Referring to fig. 15, a block diagram of an electronic device according to an embodiment of the present application is shown. The electronic device 100 may be a terminal device capable of running an application, such as a PC computer or a mobile terminal. The electronic device 100 in the present application may include one or more of the following components: the system comprises a processor 110, a memory 120, a light-sensitive sensor 130, a display screen 140, and one or more applications, wherein the light-sensitive sensor 130 is located below the display screen 140, the one or more applications may be stored in the memory 120 and configured to be executed by the one or more processors 110, and the one or more applications are configured to perform the method as described in the foregoing method embodiments.

The processor 110 may include one or more Processing cores, the processor 110 may connect various parts throughout the electronic device 100 using various interfaces and lines, perform various functions of the electronic device 100 and process data by running or executing instructions, programs, code sets, or instruction sets stored in the memory 120, and calling data stored in the memory 120, alternatively, the processor 110 may be implemented in at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), Programmable logic Array (Programmable L organic Array, P L a), the processor 110 may be implemented in the form of at least one of a Central Processing Unit (CPU), an environmental photo detector (Graphics Processing Unit, GPU), and a modem, etc., wherein the CPU primarily processes operating systems, user interfaces, application programs, etc., the GPU is responsible for displaying content, the modem may be implemented for rendering, the wireless modem may be implemented separately, and the wireless communication chip may be implemented.

The Memory 120 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). The memory 120 may be used to store instructions, programs, code sets, or instruction sets. The memory 120 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like. The data storage area may also store data created by the electronic device 100 during use (e.g., phone book, audio-video data, chat log data), and the like.

The light sensor 130 may be any light sensor device for collecting light to detect light intensity, and the specific light sensor is not limited herein.

The display screen 140 may be used to display information input by or provided to a user as well as various graphical user interfaces of the electronic device, which may be comprised of images, text, icons, video, and any combination thereof. In some embodiments, the processor 110 may obtain the detected light intensity value according to the light received by the light sensor 130. The processor 110 may then determine a current ambient light intensity value based on the detected light intensity values and adjust the brightness of the display screen 140 based on the current ambient light intensity value.

In some embodiments, the display screen 140 may be an O L ED display screen, specifically, an Organic light emitting diode (O L ED) display screen has good light transmittance and can pass visible light, therefore, the O L ED display screen does not affect the light sensor 130 to receive visible light when displaying content effect, the display screen 140 may also be a Micro L ED display screen, and the Micro L ED display screen also has good light transmittance for visible light and infrared light.

Referring to fig. 16, fig. 16 is a schematic structural diagram of an electronic device. The electronic device comprises a glass cover plate 101, a display panel 102, buffer foam 103 and a light sensor 104. The light sensor is disposed below the display panel 102.

Referring to fig. 17, a block diagram of a computer-readable storage medium according to an embodiment of the present application is shown. The computer-readable medium 800 has stored therein a program code that can be called by a processor to execute the method described in the above-described method embodiments.

The computer-readable storage medium 800 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Alternatively, the computer-readable storage medium 800 includes a non-volatile computer-readable storage medium. The computer readable storage medium 800 has storage space for program code 810 to perform any of the method steps of the method described above. The program code can be read from or written to one or more computer program products. The program code 810 may be compressed, for example, in a suitable form.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims

1. An ambient light detection method, the method comprising:

the method comprises the steps of obtaining a detection light intensity value detected by a light sensor, wherein the light sensor is positioned below a display screen, at least one detection value corresponding to a target area exists in the detection light intensity value, and the target area is an area where partial pixels of the display screen do not emit light in a refreshing process;

performing Fourier transform on the time domain information of the detection light intensity value to obtain frequency domain information corresponding to the detection light intensity value;

according to the frequency domain information, performing light intensity compensation on the detection light intensity value;

and determining an environment light intensity value according to the compensated detection light intensity value.

2. The method of claim 1, wherein the performing light intensity compensation on the detected light intensity values according to the frequency domain information comprises:

determining a compensation value corresponding to the frequency domain information according to a preset corresponding relation between the frequency domain information and the compensation value;

and performing light intensity compensation on the detection light intensity value based on the compensation value.

3. The method according to claim 2, wherein before determining the compensation value corresponding to the frequency domain information according to the preset correspondence between the frequency domain information and the compensation value, the method further comprises:

when the display screen is in a dark environment, acquiring a screen light intensity value detected by a light sensor when the display screen displays a target picture;

performing Fourier transform on the time domain information of the screen light intensity value to obtain frequency domain information corresponding to the screen light intensity value;

and fitting the frequency domain information corresponding to the screen light intensity values under different target pictures to obtain a fitting model, wherein the fitting model is used for representing the corresponding relation between the frequency domain information and the compensation values.

4. The method of claim 2, wherein the obtaining the detected light intensity value detected by the light sensor comprises:

acquiring a plurality of detection light intensity values detected by a light sensor within a preset time, wherein the preset time is longer than the refreshing period of a display screen;

determining an ambient light intensity value according to the compensated detection light intensity value, including:

obtaining a minimum light intensity value in each refreshing period from the plurality of detection light intensity values, and using the minimum light intensity value as a first environment light intensity value in each refreshing period;

obtaining a plurality of compensated detection light intensity values in each refreshing period as a second environment light intensity value in each refreshing period;

and performing data smoothing processing on the first environment light intensity value and the second environment light intensity value to obtain a target environment light intensity value, and using the target environment light intensity value as a detection result of the environment light.

5. The method according to any one of claims 1 to 4, wherein before said obtaining the detected light intensity value detected by the light-sensitive sensor, the method further comprises:

acquiring a target area in a display screen, wherein the target area is an area where partial pixels of the display screen do not emit light in a refreshing process;

determining a first time width corresponding to the target area in a refresh period of the display screen;

obtaining a first integration period of a light intensity measurement based on the first temporal width, wherein the first integration period is less than half of the first temporal width;

and controlling the light sensor to start light intensity detection in the first integration period.

6. The method of claim 5, wherein prior to said acquiring a target area in a display screen, the method further comprises:

judging whether the current is in a PWM dimming mode;

and if the target area is not in the PWM dimming mode, executing the step of acquiring the target area in the display screen.

7. The method of claim 6, wherein after the determining whether the PWM dimming mode is currently active, the method further comprises:

if the display screen is in the PWM dimming mode, acquiring a second time width of the display screen in a screen-off state in a PWM period;

obtaining a second integration period of the light intensity measurement based on a second time width, wherein the second integration period is less than half the second time width;

and controlling the light sensor to start light intensity detection in the second integration period.

8. The method of claim 7, wherein prior to said obtaining the second time width for which the display screen is in the off state within one PWM cycle, the method further comprises:

judging whether the brightness of the current display screen is greater than a preset brightness;

and if the brightness is smaller than or equal to the preset brightness, executing the step of obtaining a second time width of the display screen in the screen-off state in one PWM period.

9. The method according to claim 8, wherein after the determining whether the brightness of the current display screen is greater than the preset brightness, the method further comprises:

and if the brightness is larger than the preset brightness, executing the step of acquiring the target area in the display screen.

10. An ambient light detection device, the device comprising:

the data acquisition module is used for acquiring a detection light intensity value detected by a light sensor, wherein the light sensor is positioned below the display screen, at least one detection value corresponding to a target area exists in the detection light intensity value, and the target area is an area where partial pixels of the display screen do not emit light in the refreshing process;

the frequency domain conversion module is used for carrying out Fourier transform on the time domain information of the detection light intensity value to obtain frequency domain information corresponding to the detection light intensity value;

the data compensation module is used for performing light intensity compensation on the detection light intensity value according to the frequency domain information;

and the result determining module is used for determining the ambient light intensity value according to the compensated detection light intensity value.

11. An electronic device, comprising:

a display screen;

the light sensor is positioned below the display screen;

one or more processors;

a memory;

one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more applications configured to perform the method of any of claims 1-9.

12. A computer-readable storage medium, having stored thereon program code that can be invoked by a processor to perform the method according to any one of claims 1 to 9.