CN111638756B

CN111638756B - Control method, control device, electronic terminal, and computer-readable storage medium

Info

Publication number: CN111638756B
Application number: CN202010479678.8A
Authority: CN
Inventors: 阮庆华
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2020-05-29
Filing date: 2020-05-29
Publication date: 2022-03-22
Anticipated expiration: 2040-05-29
Also published as: CN111638756A

Abstract

The application discloses a control method, a control device, an electronic terminal and a computer readable storage medium. The control method comprises the steps of reading the size and the refreshing frequency of the screen, the size of the dark stripes, the size of the opening of the sensing assembly and coordinates relative to the screen; calculating the integration starting time and the integration time of the integrator according to the size and the refreshing frequency of the screen, the size of the dark stripe, the opening size of the sensing assembly and the coordinate relative to the screen; and controlling the integrator to perform charge integration processing on the photoelectric conversion generated by the sensing assembly according to the integration starting time and the integration time. The control method controls the integrator to be started on time according to the size of the screen, the opening size and the position of the sensing assembly and the refreshing characteristic of the screen, performs integral sampling according to the process that the dark stripes roll over the sensing assembly to obtain the ambient brightness, does not need periodic integral sampling, does not need to compare sampling results to find the minimum value, does not need average denoising, reduces the operation amount, and reduces the power consumption and the heat productivity of the electronic terminal.

Description

Control method, control device, electronic terminal, and computer-readable storage medium

Technical Field

The present application relates to the field of consumer electronics technologies, and in particular, to a control method, a control device, an electronic terminal, and a computer-readable storage medium.

Background

The related art ambient light detecting device generally includes a light sensor and an integrator connected to the light sensor. The related art control method controls an integrator to periodically and continuously output a plurality of luminance values in a short-time integration manner, selects a plurality of minimum values from the plurality of output luminance values, and averages the plurality of minimum values to obtain an environment luminance value. It will be appreciated that the use of short integration times allows integration to occur over the time of the passage of a dark fringe, and therefore the minimum value found can be considered to be integrated when the dark fringe overlies the light sensor, closest to the ambient brightness value. And denoising can be performed by selecting a plurality of minimum values and then averaging the minimum values.

However, the control method of the related art needs to control the integrator to perform periodic integration, compare and select the minimum value, and take the mean value to perform denoising, so that the amount of calculation is large, which causes the environmental light detection device of the related art to have large power consumption and large heat productivity.

Disclosure of Invention

The embodiment of the application provides a control method, a control device, an electronic terminal and a computer readable storage medium.

The embodiment of the application provides a control method for controlling an electronic terminal to detect ambient light. The electronic terminal comprises a screen, a sensing assembly arranged below the screen and an integrator connected with the sensing assembly, wherein the screen is dimmed in a pulse width frequency modulation mode to form dark stripes rolling at high frequency on the screen. The control method comprises the following steps: reading the size and refresh frequency of the screen, the size of the dark stripe, the opening size of the sensing assembly and coordinates relative to the screen; calculating the start integration moment and the integration time of the integrator according to the size and the refresh frequency of the screen, the size of the dark stripe, the opening size of the sensing assembly and the coordinate relative to the screen; and controlling the integrator to perform charge integration processing on the photoelectric conversion generated by the sensing assembly according to the integration starting time and the integration time.

The embodiment of the application also provides a control device for detecting the ambient light by the electronic terminal. The electronic terminal comprises a screen, a sensing assembly arranged below the screen and an integrator connected with the sensing assembly, wherein the screen is dimmed in a pulse width frequency modulation mode to form dark stripes rolling at high frequency on the screen. The control device comprises a reading module, a calculating module and a control module, wherein the reading module is used for reading the size and the refreshing frequency of the screen, the size of the dark stripes, the opening size of the sensing assembly and coordinates relative to the screen; the calculating module is used for calculating the integration starting time and the integration time of the integrator according to the size and the refreshing frequency of the screen, the size of the dark stripe, the opening size of the sensing assembly and the coordinate relative to the screen; the control module is used for controlling the integrator to perform charge integration processing on the photoelectric conversion generated by the sensing assembly according to the integration starting time and the integration time.

The embodiment of the application also provides the electronic terminal. The electronic terminal comprises a screen, a sensing assembly arranged below the screen, an integrator connected with the sensing assembly and a control device. The control device comprises a reading module, a calculating module and a control module, wherein the reading module is used for reading the size and the refreshing frequency of the screen, the size of the dark stripes, the opening size of the sensing assembly and coordinates relative to the screen; the calculating module is used for calculating the integration starting time and the integration time of the integrator according to the size and the refreshing frequency of the screen, the size of the dark stripe, the opening size of the sensing assembly and the coordinate relative to the screen; the control module is used for controlling the integrator to perform charge integration processing on the photoelectric conversion generated by the sensing assembly according to the integration starting time and the integration time.

Embodiments of the present application also provide a computer-readable storage medium having a computer program stored thereon. The computer program, when executed by a processor, enables reading of the size and refresh frequency of the screen, the size of the dark stripe, the size of the opening of the sensing assembly and the coordinates relative to the screen; calculating the start integration moment and the integration time of the integrator according to the size and the refresh frequency of the screen, the size of the dark stripe, the opening size of the sensing assembly and the coordinate relative to the screen; and controlling the integrator to perform charge integration processing on the photoelectric conversion generated by the sensing assembly according to the integration starting time and the integration time.

The control method, the control device, the electronic terminal and the computer readable storage medium can calculate and control the integrator to perform charge integration processing on the photoelectric conversion of the sensing assembly according to the size of the screen, the opening size and the position of the sensing assembly and the refreshing characteristic of the screen. That is, the integrator can be started on time, and the process that the dark stripes roll over the sensing assembly is accurately captured and sampled to obtain the ambient brightness, so that the integrator does not need to perform periodic integral sampling, does not need to compare sampling results to find a minimum value, does not need to perform average denoising, reduces the operation amount, can reduce the power consumption of the electronic terminal, and avoids or improves the problem of overhigh heat productivity.

Additional aspects and advantages of embodiments of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.

Drawings

The above and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

fig. 1 is a schematic view of a related art electronic terminal;

fig. 2 is a schematic view of a screen of a related art electronic terminal;

FIG. 3 is a schematic view of an electronic terminal according to some embodiments of the present application;

FIG. 4 is a schematic flow chart diagram of a control method according to certain embodiments of the present application;

FIG. 5 is a schematic view of a control device according to certain embodiments of the present application;

FIG. 6 is a schematic illustration of a computer-readable medium of certain embodiments of the present application;

FIG. 7 is a schematic flow chart diagram of a control method according to certain embodiments of the present application;

FIG. 8 is a schematic view of a scenario of an electronic terminal according to some embodiments of the present application;

FIG. 9 is a schematic view of a scenario of an electronic terminal according to some embodiments of the present application;

FIG. 10 is a schematic flow chart diagram of a control method according to certain embodiments of the present application;

FIG. 11 is a schematic diagram of a simulated ambient light detection circuit according to some embodiments of the present application;

FIG. 12 is a schematic flow chart diagram of a control method according to certain embodiments of the present application;

FIG. 13 is a schematic diagram of an analog accumulation circuit according to some embodiments of the present application;

FIG. 14 is a schematic structural view of a sensing assembly according to some embodiments of the present application;

FIG. 15 is a schematic plan view of an electronic terminal according to some embodiments of the present application;

fig. 16 is a schematic structural diagram of an electronic terminal according to some embodiments of the present application.

Detailed Description

Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below by referring to the drawings are exemplary only for the purpose of explaining the embodiments of the present application, and are not to be construed as limiting the embodiments of the present application.

With the development of technology, full-screen mobile phones (i.e., increasing the screen occupation ratio as much as possible) gradually become the mainstream of the market. However, increasing the screen fraction may cause the screen to interfere with optical elements originally placed on the front of the handset.

To this end, referring to fig. 1, a related art full-screen mobile phone 100a uses a light-transmissive organic light-emitting diode (OLED) panel as a screen, and an optical element is disposed below the screen 20 a. For example, the light sensor 30a originally provided with an opening in the front face of the cellular phone is instead provided below the screen 20 a. However, in this way, the ambient light sensed by the light sensor 30a may be doped with screen light, resulting in an inaccurate detected ambient light brightness value.

On the other hand, referring to fig. 2, the OLED panel generally employs Pulse Width Modulation (PWM), so that the screen 20a generates bright stripes B and dark stripes V rolling in the height direction or the diagonal direction and alternating in light and dark. When the dark stripe V rolls over the light sensor 30a, the screen light has the least influence on the light sensor 30a, and it can be considered that the light sensor 30a senses only the ambient light at this time.

However, the control method of the related art needs to control the integrator to perform periodic integration, compare and select the minimum value, and take the mean value to perform denoising, so that the amount of calculation is large, which causes the environmental light detection device of the related art to have large power consumption and large heat productivity. Therefore, how to detect the ambient light brightness value is an urgent problem to be solved to avoid the problems of the integrator that the integrator periodically integrates, the calculation amount is large, and the ambient light detection device has large power consumption and large heat generation amount.

Referring to fig. 3 and 4, an embodiment of the present application provides a control method for controlling the electronic terminal 100 to detect the ambient light. The electronic terminal 100 includes a screen 20, a sensing component 30 disposed below the screen 20, and an integrator 40 connected to the sensing component 30, wherein the screen 20 is dimmed in a pulse width modulation manner to form dark stripes that scroll at a high frequency on the screen 20. The control method comprises the following steps:

s12: reading the size and refresh frequency of the screen 20, the size of the dark stripes, the size of the opening of the sensing assembly 30 and the coordinates relative to the screen 20;

s14: calculating the integration start time and the integration time of the integrator 40 according to the size and the refresh frequency of the screen 20, the size of the dark stripe, the opening size of the sensing assembly 30 and the coordinates relative to the screen 20;

s16: the integrator 40 is controlled to integrate the charge generated by photoelectric conversion of the sensing element according to the integration start time and the integration time.

Referring to fig. 5, the present embodiment further provides a control device 10 for controlling an electronic terminal 100 to detect ambient light, where the electronic terminal 100 includes a screen 20, a sensing element 30 disposed below the screen 20, and an integrator 40 connected to the sensing element 30, and the screen 20 is dimmed by a pulse width modulation method to form dark stripes that scroll at a high frequency on the screen 20. The control device 10 includes a reading module 12, a calculation module 14 and a control module 16.

The step S12 may be implemented by the reading module 12, the step S14 may be implemented by the calculating module 14, and the step S16 may be implemented by the control module 16. That is, the reading module 12 may be used to read the size and refresh frequency of the screen 20, the size of the dark stripes, the size of the opening of the sensing assembly 30, and the coordinates relative to the screen 20. The calculation module 14 may be used to calculate the integration start time and integration time of the integrator 40 based on the size and refresh frequency of the screen 20, the size of the dark stripes, the size of the opening of the sensing assembly 30, and the coordinates relative to the screen 20. The control module 16 may be configured to control the integrator 40 to integrate the charge generated by the photoelectric conversion of the sensing assembly 30 according to the integration start time and the integration time.

Referring to fig. 3, the present embodiment further provides an electronic terminal 100, which includes a screen 20, a sensing element 30 disposed below the screen 20, an integrator 40 connected to the sensing element 30, and a control device 10, where the control device 10 includes a reading module 12, a calculating module 14, and a control module 16. The reading module 12 may be used to read the size and refresh frequency of the screen 20, the size of the dark stripes, the size of the openings of the sensing assembly 30, and the coordinates relative to the screen 20. The calculation module 14 may be used to calculate the integration start time and integration time of the integrator 40 based on the size and refresh frequency of the screen 20, the size of the dark stripes, the size of the opening of the sensing assembly 30, and the coordinates relative to the screen 20. The control module 16 may be configured to control the integrator 40 to integrate the charge generated by the photoelectric conversion of the sensing assembly 30 according to the integration start time and the integration time.

Specifically, the electronic terminal 100 may be a mobile phone, a tablet computer, a notebook computer, an intelligent bracelet, an intelligent watch, and the like. In the embodiment of the present application, the electronic terminal 100 is a mobile phone as an example, and it is understood that the specific form of the electronic terminal 100 may be other, and is not limited herein.

Referring to fig. 6, the present embodiment further provides a computer-readable storage medium 50, on which a computer program 51 is stored, and when the computer program is executed by a processor 60, the steps of the control method according to any of the above embodiments are implemented.

For example, in the case where the program is executed by the processor 60, the steps of the following control method are implemented:

s12, reading the size and refresh frequency of the screen 20, the size of the dark stripes, the size of the opening of the sensing assembly 30 and the coordinates relative to the screen 20;

s14, calculating the start integration time and the integration time of the integrator according to the size and the refresh frequency of the screen 20, the size of the opening of the sensing assembly 30 and the coordinates relative to the screen 20;

s16, the integrator 40 is controlled to integrate the charges generated by the photoelectric conversion of the sensing element 30 according to the integration start time and the integration time.

The computer-readable storage medium 50 may be disposed in the processor 60 or the electronic terminal 100, or may be disposed in the cloud server, and at this time, the processor 60 or the electronic terminal 100 can communicate with the cloud server to obtain the corresponding computer program 51.

It will be appreciated that the computer program 51 comprises computer program code. The computer program code may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable storage medium may include: any entity or device capable of carrying computer program code, recording medium, U-disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), software distribution medium, and the like.

The control method, the control device 10, the electronic terminal 100 and the computer readable storage medium 50 of the present application can calculate and control the charge integration process of the integrator 40 on the photoelectric conversion of the sensing assembly 30 according to the size of the screen 20, the opening size and the position of the sensing assembly 30 and the refresh characteristics of the screen 20, and according to the integration start time and the integration time. That is, the integrator 40 can be started on time, and performs integral sampling in the process of accurately capturing the dark stripes to roll over the sensing assembly 30 to obtain the ambient brightness, so that the integrator 40 does not need to perform periodic integral sampling, does not need to compare sampling results to find a minimum value, does not need to perform average denoising, and reduces the operation amount, thereby reducing the power consumption of the electronic terminal 100 and avoiding or improving the problem of overhigh heat generation amount.

In the present embodiment, the electronic terminal 100 is a mobile phone, that is, the control method and the control device 10 are applied to, but not limited to, a mobile phone. The control device 10 may be hardware or software preinstalled in the handset and may perform the control method when the operation is started on the handset. For example, the control device 10 may be an underlying software code segment of a mobile phone or a part of an operating system.

In some embodiments, the control device 10 may be a discrete component assembled in such a way as to have the aforementioned functions, or a chip having the aforementioned functions in the form of an integrated circuit, or a piece of computer software code that causes a computer to have the aforementioned functions when run on the computer.

In some embodiments, the control device 10 may be a stand-alone or add-on peripheral component to a computer or computer system as hardware. The control device 10 may also be integrated into a computer or computer system, for example, where the control device 10 is part of an electronic terminal 100, the control device 10 may be integrated into a processor.

In some embodiments, the computer-readable storage medium 50 may be a storage medium built in the electronic terminal 100, for example, the storage 50, or a storage medium that can be plugged into the electronic terminal 100 in a pluggable manner, for example, an SD card.

Referring to fig. 7, in some embodiments, S14 includes the steps of:

s141: the integration start time is calculated according to the following conditional expression:

Tdelay＝((1/f)*h)/H；

s142: the integration time is calculated according to the following conditional expression:

Tintegrate＝(1/f*(W-D))/H；

where, Tdelay is the integration start time, f is the refresh frequency, H is the height coordinate of the sensing element 30 relative to the screen 20, H is the height of the screen 20, Tintegrate is the integration time, W is the size of the dark stripe, and D is the opening size of the sensing element 30.

Referring to fig. 5, in some embodiments, the calculating module 14 is configured to calculate the integration start time according to the following conditional expression: tdelay ═ ((1/f) × H)/H, and the integration time was calculated according to the following conditional expression: tintegrite ═ 1/f (W-D))/H, where Tdelay is the start integration time, f is the refresh frequency, H is the height coordinate of the sensing element 30 relative to the screen 20, H is the height of the screen 20, tintegrite is the integration time, W is the size of the dark stripes, and D is the opening size of the sensing element 30.

Steps S141 and S142 may be implemented by the calculation module 14. That is, the calculation module 14 is configured to calculate the integration start time according to the following conditional expression: tdelay ═ (1/f) × H)/H, and the integration time was calculated according to the following conditional expression: tintegrite ═ 1/f (W-D))/H, where Tdelay is the start integration time, f is the refresh frequency, H is the height coordinate of the sensing element 30 relative to the screen 20, H is the height of the screen 20, tintegrite is the integration time, W is the size of the dark stripes, and D is the opening size of the sensing element 30. It should be noted that the execution order of step 141 and step 142 may be that step 141 is executed first, step 142 is executed first, or step 141 and step 142 are executed simultaneously.

In some embodiments, processor 60 is configured to calculate the integration start time according to the following conditional expression: tdelay ═ (1/f × H)/H, and the integration time was calculated according to the following conditional expression: tintegrite ═ 1/f (W-D))/H, where Tdelay is the start integration time, f is the refresh frequency, H is the height coordinate of the sensing element 30 relative to the screen 20, H is the height of the screen 20, tintegrite is the integration time, W is the size of the dark stripes, and D is the opening size of the sensing element 30.

The OLED screen refresh principle is as follows as shown in fig. 8 and 9. The Vsync signal is a screen refresh signal, for example, the screen refresh frequency is 60Hz, the period of the Vsync signal is 1/60Hz (16.667 ms), when the screen display is continuously refreshed, the Vsync will sequentially scan and update all the rows of pixels from top to bottom, so that the whole screen can be updated, the number of rows of updating can be set, for example, 30 pixels, and therefore, the width of the Vsync dark stripe is 30 pixels. The diameter of the opening of the sensing assembly 30 is set to be smaller than 30 pixel points, so that a Vsync dark stripe can be ensured to appear once in the whole picture refreshing process, and the integrated light sensing value of the sensing assembly 30 is only an ambient light part.

Specifically, referring to fig. 8, 9 and 10, since the Vsync signal is periodically refreshed from top to bottom, when the position of the opening of the under-screen sensing element 30 is fixed, the time for refreshing the Vsync dark stripe to the display area directly above the sensing element 30 can also be calculated by the coordinates of the position of the opening. For example, if the resolution of the screen 20 is 1080 × 2340 at a refresh frequency of 60Hz, the coordinates of the center of the opening of the sensing element 30 are (700, 200), i.e., f is 60Hz, H is 200mm, and H is 2340mm, then the Vsync black stripe appears above the sensing element 30 with a delay time Tdelay ((1/f) × H)/H (1/60 × 200)/2340 ═ 1.425ms relative to the hardware Vsync signal. The calculating module 14 of the present application uses the Vsync signal and the delay time Tdelay introduced by the opening position coordinate of the sensing element 30 as the sampling trigger condition of the sensing element 30, that is, as the integration start time of the integrator 40, so as to ensure that each light sensing value obtained by sampling the sensing element 30 is the real environment brightness information.

In addition, the sampling time interval (i.e. the integration time) of the sensing element 30 is determined by the width of Vsync dark stripe, if the width of dark stripe is 30 pixels, and the opening width of the sensing element 30 is 20 pixels, the duration of dark stripe above the sensing element 30 is as follows, i.e. the integration time of the integrator 40 is: tintegrate ═ (1/f ═ W-D))/H ═ ((1/60) × (30-20))/2340 ═ 72 us.

The calculating module 14 of the present application enables the integrator 40 to start on time by calculating the integration starting time Tdelay and the integration time Tintegrate required by sampling, and accurately captures the process of the dark fringe rolling over the sensing component 30 to perform integration sampling to obtain the ambient brightness, so that the integrator 40 does not need to perform periodic integration sampling, and does not need to compare sampling results to find the minimum value, and also does not need to perform average denoising, thereby reducing the amount of computation, thereby reducing the power consumption of the electronic terminal 100, and avoiding or improving the problem of excessively high heat generation.

Referring to fig. 10 and 11, in some embodiments, the sensing assembly 30 includes a plurality of light sensors 31, and S14 includes the steps of:

s143: calculating a plurality of integration start times and integration times corresponding to the plurality of light sensors 31, respectively;

s16 includes the steps of:

s161: the integrator 40 is controlled to integrate respectively according to a plurality of start integration moments and integration time respectively to obtain a plurality of simulated ambient light detection values.

Step S143 may be implemented by the calculation module 14 and step S161 may be implemented by the control module 16. That is, the calculation module 14 is configured to calculate a plurality of integration start timings and integration times corresponding to the plurality of light sensors 31. The control module 16 is configured to control the integrator 40 to integrate respectively according to a plurality of integration start times and integration times to obtain a plurality of simulated ambient light detection values.

In certain embodiments, processor 60 is configured to: calculating a plurality of integration start times and integration times corresponding to the plurality of light sensors 31, respectively; the integrator 40 is controlled to integrate respectively according to a plurality of start integration moments and integration time respectively to obtain a plurality of simulated ambient light detection values.

It is understood that, assuming that the analog ambient light detection value of the output of a light sensor is 0.1, and when the analog ambient light detection value is converted into a digital value, the analog ambient light detection value needs to be greater than 1 to output a digital signal, so that the single short integral output of a light sensor will always be 0. If the analog ambient light detection values output by the 20 light sensors are added and then are 2, the analog ambient light detection values become 2 after analog-to-digital conversion, and then the signals can be converted into digitally-processed signals. Therefore, the sensitivity of the sensing assembly 30 can be improved by providing a plurality of light sensors 31.

The sensing assembly 30 converts the optical signal into an electrical signal by the photoelectric effect of the photodiode. The sensing assembly 30 includes a plurality of light sensors 31, and the plurality of light sensors 31 collect the external ambient light to obtain a plurality of simulated ambient light detection values.

Specifically, referring to fig. 11, in some embodiments, comparing the detected values of the plurality of simulated ambient light values can be used to distinguish whether the external ambient light is cool (e.g., gray, cyan, blue, etc.) or warm (e.g., red, orange, yellow, etc.). The sensing assembly 30 comprises 3 light sensors 31, wherein a first light sensor 32 can be used for receiving full spectrum visible light respectively. The second light sensor 33 may be adapted to receive 550 bands of visible light (cyan), i.e. the second light sensor 33 is adapted to receive ambient light values of a cool tone. In addition, the third light sensor 34 may be configured to receive visible light (red) in the 700 wavelength band, i.e., the third light sensor 34 is configured to receive ambient light values of warm tones.

In one example, if the second simulated ambient light detection value V2 of the second light sensor 33 of the sensing assembly 30 is greater than the third simulated ambient light detection value V3 of the third light sensor 34, it is determined that the ambient light is mainly cool, i.e., under warm ambient light, the electronic terminal 100 can adjust the brightness of the screen 20 to be brighter, so that the human eyes can more conveniently and comfortably view the characters or patterns on the screen 20 under the condition that the external light is darker. In another example, if the second simulated ambient light detection value V2 of the second light sensor 33 of the sensing assembly 30 is smaller than the third simulated ambient light detection value V3 of the fourth light sensor 34, it is determined that the ambient light is mainly warm-tone light, i.e., under the warm-tone ambient light, the electronic terminal 100 can adjust the brightness of the screen 20 to be darker, so that the user can feel more comfortable when watching the screen 20, the electronic terminal 100 is more power-saving, i.e., the power consumption of the electronic terminal 100 can be reduced, and the heat generation phenomenon during the use of the electronic terminal 100 can also be reduced.

In another embodiment, the plurality of simulated ambient light detection values may be averaged, for example, if the first simulated ambient light detection value of the first light sensor 32 is V1, the second simulated ambient light detection value of the second light sensor 33 is V2, and the third simulated ambient light detection value of the third light sensor 34 is V3, the three simulated ambient light detection values are averaged to obtain a final simulated ambient light detection value output by the sensing assembly 30 as (V1+ V2+ V3)/3, so as to obtain a more accurate and real ambient light detection value, which is beneficial to better adjusting the brightness of the screen 20 to achieve the best visual effect of the human eyes watching the screen 20, and improve the comfort of the human eyes.

In yet another embodiment, the plurality of simulated ambient light detection values may also be accumulated, that is, if the first simulated ambient light detection value of the first light sensor 32 is V1, the second simulated ambient light detection value of the second light sensor 33 is V2, and the third simulated ambient light detection value of the third light sensor 34 is V3, the three simulated ambient light detection values are averaged to obtain the final simulated ambient light detection value output by the sensing assembly 30 as (V1+ V2+ V3), so as to obtain a more accurate and real ambient light detection value, which is beneficial to better adjusting the brightness of the screen 20 to achieve the best visual effect of the human eyes watching the screen 20, and improve the comfort of the human eyes.

To sum up, the sensing assembly 30 includes a plurality of light sensors 31, the sampling amount of the sensing assembly 30 is increased by increasing the number of the sensing assembly 30 so as to improve the sensitivity of the sensing assembly 30, the integrator 40 is accurately controlled to integrate to obtain a plurality of ambient light detection values according to a plurality of integration starting moments and a plurality of integration time outputted by the sensing assembly 30, the plurality of ambient light detection values are compared, or the average value is obtained by comparing the plurality of ambient light detection values, or more accurate and real ambient light detection values can be obtained by accumulating the plurality of ambient light detection values.

Referring to fig. 11 and 12, in some embodiments, integrator 40 includes a delay unit 41, a summing control switch 43 coupled to delay unit 41 and to sensing assembly 30, and an analog summing unit 45 coupled to summing control switch 43. S161 includes the steps of:

s1611: sending a plurality of integration starting moments and integration time to the delay unit 41 to control the accumulation control switch 43 to be switched on and off for a plurality of times corresponding to the plurality of integration starting moments and integration time through the delay unit 41;

s1612: when the accumulation control switch 43 is closed, the plurality of simulated ambient light detection values are accumulated by the simulated accumulation unit 45 to obtain a simulated accumulated ambient light detection value.

Step S1611 and step 1612 may be implemented by the control module 16, that is, the control module 16 is configured to calculate a plurality of integration start times and integration times corresponding to the plurality of light sensors 31. The control module 16 is configured to send a plurality of integration starting times and integration times to the delay unit 41 so as to control the accumulation control switch 43 to be switched on and off for a plurality of times corresponding to the plurality of integration starting times and integration times through the delay unit 41; when the accumulation control switch 43 is closed, the plurality of simulated ambient light detection values are accumulated by the simulated accumulation unit 45 to obtain a simulated accumulated ambient light detection value.

In certain embodiments, processor 60 is configured to: sending a plurality of integration starting moments and integration time to the delay unit 41 to control the accumulation control switch 43 to be switched on and off for a plurality of times corresponding to the plurality of integration starting moments and integration time through the delay unit 41; when the accumulation control switch 43 is closed, the plurality of simulated ambient light detection values are accumulated by the simulated accumulation unit 45 to obtain a simulated accumulated ambient light detection value.

It should be noted that, here, the plurality of integration start times and the integration time may be generated by the number of times the screen 20 is refreshed by the dark stripes. It will be appreciated that the purpose of this is to accumulate the analog electrical signals sensed and converted by the light sensor 31 during each dark stripe refresh of the screen 20, which requires a controller (accumulation control switch 43) for precise control. When the dark stripe is above the light sensor 31, the analog electrical signal sensed by the light sensor 31 is sent to the analog signal accumulator, and the analog signal at other times is cut off by the switch. In this way, the simulated accumulated ambient light detection values (simulated signals) entering the simulated accumulation unit 45 are all in the dark fringe refreshing process, and the simulated accumulated ambient light detection values are guaranteed to be closest to the real ambient light values.

Specifically, referring to fig. 13, the analog accumulation unit 45 is internally composed of an analog operational amplifier adder circuit 47 and an analog holding circuit 49, the analog holding circuit 49 stores n-1 times of analog accumulation signals, in the nth accumulation calculation, the analog operational amplifier adder circuit 47 adds the last photosensitive unit integration value and the previous n-1 times of accumulation signals in the analog holding circuit, and finally the analog accumulation signals are output to the analog amplification and AD conversion circuit, so as to finally obtain the analog accumulation ambient light brightness value. In one embodiment, assuming that the dark fringe width is 46 pixels and the opening width is 30 pixels, the integration time Tintegrate ═(1/f × W-D))/H ═(1/60) × (46-30))/2340 ═ 113us, the integration effect of 1ms can be achieved by accumulating 10 analog accumulation signals, and 1ms of analog accumulation can be converted into an output digital signal.

In one embodiment, referring to fig. 3 and 11, the electronic terminal 100 includes the analog ambient light detecting circuit 70, and the control method further includes controlling the electrical signal of the analog ambient light detecting circuit 70 to adjust the duty ratio of the pulse width modulation to increase the width of the dark stripe.

It is understood that the pulse width t is the time occupied by the high level in one period, and the duty ratio is the proportion of the high level in one period, that is, the duty ratio is the proportion of the time occupied by the dark fringe flash in one pulse cycle relative to the total time. Since the screen refresh frequency f is equal to the duty ratio δ/the pulse width t, under the condition that the output frequency f of the circuit for controlling the pulse width dimming is not changed, the duty ratio is adjusted through an electric signal (for example, a voltage), and then the width of the dark stripe is adjusted, so that the time that the dark stripe passes through the sensing assembly 30 when the screen 20 is refreshed is effectively increased, the integration time detected by the sensing assembly 30 is increased, and the purpose of improving the light sensitivity of the sensing assembly 30 is achieved.

Specifically, for example, if the width of the dark stripe is 30 pixels and the opening width of the sensing element 30 is 20 pixels, the duration of the dark stripe above the sensing element 30, i.e. the integration time of the integrator 40, is: tintegrate ═ (1/f ═ W-D))/H ═ ((1/60) × (30-20))/2340 ═ 72 us. If the diameter of the opening of the sensing element 30 is still 20 pixels, because in a Pulse Width Modulation (PWM) mode, the screen refresh frequency f is equal to the duty ratio δ/the pulse width t, where the pulse width t is the width of the dark stripe, and under the condition that the screen refresh frequency f is not changed, the duty ratio of the pulse in the pulse width modulation is adjusted to be twice of the original duty ratio by controlling the magnitude of the electrical signal (e.g., voltage and current), the width of the dark stripe is widened to 60 pixels at this time, the integration time Tintegrate is equal to (16.667ms (60-20))/2340 is equal to 284.904us, that is, the duration of the dark stripe above the sensing element 30 can be extended to 284us at this time, that is, the light sensitivity of the sensing element 30 can be increased by 4 times, and the sensitivity can be further increased by continuously increasing the width of the dark stripe. It should be noted that the upper limit of the dark stripe width is a predetermined value, for example, the maximum value of the dark stripe width may be 100 pixels, and the upper limit value of the dark stripe width is to ensure that the detected ambient light value is closest to the real ambient light when the human eye views the screen and the screen has the maximum display brightness and the optimal power consumption.

In another embodiment, the control method further comprises controlling the electrical signal of the simulated ambient light detection circuit 70 to adjust the period of the pulses, thereby adjusting the refresh frequency of the screen 20 to increase the width of the dark stripes. It can be understood that the pulse width T is the time occupied by the high level in one period, the duty ratio is the proportion occupied by the high level in one period, and the screen refresh frequency f is the duty ratio δ/pulse width T, so that the period T of the pulse can be adjusted by adjusting the magnitude of the electrical signal (voltage, current) of the analog ambient light detection circuit under the condition that the duty ratio δ of the pulse is not changed, thereby adjusting the screen refresh frequency f and further increasing the width T of the dark stripe.

Specifically, for example, if the dark stripe width is 30 pixels, the opening width of the sensing element 30 is 20 pixels, and if the period T1 of the pulse train is 1/60us, the output frequency f1 of the electrical signal of the electronic terminal 100 is 60Hz, and the integration time of the integrator 40 is: tintegrate ═ (1/f ═ W-D))/H ═ ((1/60) × (30-20))/2340 ═ 72 us. If the aperture diameter of the sensing element 30 is still 20 pixels, under the condition that the duty ratio δ of the control pulse is not changed, the duty cycle T2 of the electrical signal (voltage, current) of the analog ambient light detection circuit is adjusted to be 1/30, that is, the screen refresh frequency is f2 is 30Hz, because the screen refresh frequency f is the duty ratio δ/pulse width T, the width T2 (i.e., the pulse width) of the dark stripe is widened to be 60 pixels, the integration time tintegrite (33.333ms (60-20))/2340 is 311.997us, that is, the duration of the stripe which is hidden above the sensing element 30 can be prolonged to be 311.997us, that is, the light sensitivity of the sensing element 30 can be increased by 4 times, and the sensitivity can be further increased by continuously increasing the dark stripe width. It should be noted that the upper limit of the dark stripe width is a predetermined value, for example, the maximum value of the dark stripe width may be 100 pixels, and the upper limit value of the dark stripe width is to ensure that the detected ambient light value is closest to the real ambient light when the human eye views the screen and the screen has the maximum display brightness and the optimal power consumption.

Referring to fig. 14, in some embodiments, the sensing element 30 includes a photosensitive surface 35 and a backlight surface 36, wherein a photosensitive area of the photosensitive surface 35 has a predetermined shape, and the photosensitive area corresponds to and is parallel to a corresponding area of a dark stripe (Vsync) on the screen 20.

Specifically, the preset shape may be a rectangle, a square, or a trapezoid, etc., when the photosensitive area is a rectangle, as shown in fig. 15, the photosensitive area of the sensing component 30 is increased, the photosensitive area of the sensing component 30 is designed to be a strip, the photosensitive area is parallel to the dark stripe, so that when the dark stripe is above the photosensitive area, the duration of the dark stripe above the photosensitive area is longer, the time that the dark stripe passes over the sensing component 30 when the screen 20 is refreshed is increased, that is, the integration time of the sensing component 30 is increased, the photosensitive sensitivity of the sensing component 30 is improved, and the detected ambient light detection value is more real and accurate. The light-sensing area of the sensing element 30 is configured as a rectangle, and the sensing element 30 is assembled inside the electronic terminal 100, as shown in fig. 16. The sensing assembly 30 can be stuck below the screen 20 through an OCA optical Adhesive 80 (OCA) and then connected to a main board through a Flexible Printed Circuit 90 (FPC), so that the internal layout of the electronic terminal 100 is more compact, and it is ensured that other devices of the electronic terminal 100 can be still arranged inside the electronic terminal 100 under the condition of increasing the volume of the sensing assembly 30, and the ambient light brightness value detected by the sensing assembly 30 is more real and accurate under the condition of ensuring the normal function of the electronic terminal 100.

In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.

Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.

Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and the scope of the preferred embodiments of the present application includes other implementations in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.

Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations of the above embodiments may be made by those of ordinary skill in the art within the scope of the present application, which is defined by the claims and their equivalents.

Claims

1. A control method for controlling an electronic terminal to detect ambient light, the electronic terminal including a screen, a sensing element disposed below the screen, and an integrator coupled to the sensing element, the screen being dimmed in a pulse width modulation manner to form dark stripes that scroll at a high frequency on the screen, the control method comprising:

reading the size and refresh frequency of the screen, the size of the dark stripe, the opening size of the sensing assembly and coordinates relative to the screen;

calculating the start integration moment and the integration time of the integrator according to the size and the refresh frequency of the screen, the size of the dark stripe, the opening size of the sensing assembly and the coordinate relative to the screen; and

controlling the integrator to perform charge integration processing on the photoelectric conversion generated by the sensing assembly according to the integration starting time and the integration time;

wherein the step of calculating the integration start time and the integration time of the integrator according to the size and the refresh frequency of the screen, the size of the dark stripe, the size of the opening of the sensing assembly and the coordinates relative to the screen comprises:

calculating the integration start time according to the following conditional expression:

T_delay＝(1/f)*h)/H，

calculating the integration time according to the following conditional expression:

T_integrate＝(1/f*(W-D))/H，

wherein T _ delay is the integration start time, f is the refresh frequency, H is the height coordinate of the sensing element relative to the screen, H is the height of the screen, T _ integration is the integration time, W is the size of the dark stripe, and D is the opening size of the sensing element.

2. The control method of claim 1, wherein the sensing assembly comprises a plurality of light sensors, and the step of calculating the integration start time and the integration time of the integrator based on the size and refresh frequency of the screen, the size of the dark stripe, the size of the opening of the sensing assembly, and the coordinates relative to the screen comprises:

calculating a plurality of integration starting moments and integration times respectively corresponding to the plurality of light sensors;

the step of controlling the integrator to perform the charge integration processing on the sensing component generated by photoelectric conversion according to the integration starting time and the integration time comprises the following steps:

and controlling the integrator to integrate respectively according to the plurality of integration starting moments and the integration time respectively to obtain a plurality of simulated environment light detection values.

3. The control method of claim 2, wherein the integrator comprises a delay unit, a accumulation control switch connected to the delay unit and the sensing assembly, and an analog accumulation unit connected to the accumulation control switch, and the step of controlling the integrator to integrate respectively according to the plurality of integration start times and integration times to obtain a plurality of analog ambient light detection values comprises:

sending a plurality of integration starting moments and integration time to the delay unit so as to control the accumulation control switch to be switched on and off for a plurality of times corresponding to the plurality of integration starting moments and integration time through the delay unit;

when the accumulation control switch is closed, the plurality of simulated ambient light detection values are accumulated according to the simulated accumulation unit to obtain the simulated accumulation ambient light detection value.

4. The control method of claim 1, wherein the electronic terminal includes a simulated ambient light detection circuit, the control method further comprising:

and controlling the electric signal of the simulated environment light detection circuit to adjust the duty ratio of pulse width frequency modulation, and increasing the width of the dark stripe.

5. The control method of claim 1, wherein the electronic terminal includes a simulated ambient light detection circuit, the control method further comprising:

and controlling the electric signal of the simulated environment light detection circuit to adjust the period of the pulse, thereby adjusting the refreshing frequency of the screen and increasing the width of the dark stripe.

6. A control device for an electronic terminal to detect ambient light, the electronic terminal including a screen, a sensing element disposed below the screen, and an integrator coupled to the sensing element, the screen being dimmed in a pulse width modulation manner to form dark stripes that scroll at a high frequency on the screen, the control device comprising:

a reading module for reading the size and refresh frequency of the screen, the size of the dark stripe, the size of the opening of the sensing assembly and the coordinates relative to the screen;

the calculating module is used for calculating the integration starting time and the integration time of the integrator according to the size and the refreshing frequency of the screen, the size of the dark stripe, the opening size of the sensing assembly and the coordinate relative to the screen; wherein the integration start time is calculated according to the following conditional expression: t _ delay ═ (1/f) × H)/H, the integration time is calculated according to the following conditional expression: t _ integration ═ 1/f (W-D))/H, where T _ delay is the integration start time, f is the refresh frequency, H is the height coordinate of the sensing element relative to the screen, H is the height of the screen, T _ integration is the integration time, W is the size of the dark stripes, D is the opening size of the sensing element; and

and the control module is used for controlling the integrator to perform charge integration processing on the photoelectric conversion generated by the sensing assembly according to the integration starting time and the integration time.

7. The control device of claim 6, wherein the sensing assembly comprises a plurality of light sensors, and the calculating module is configured to calculate a plurality of integration start times and integration times corresponding to the plurality of light sensors; the control module is used for controlling the integrator to integrate respectively according to the plurality of integration starting moments and the integration time to obtain a plurality of simulated environment light detection values.

8. The control device of claim 7, wherein the integrator comprises a delay unit, a summation control switch, and an analog summation unit, and wherein the control module is further configured to:

inputting the integration starting time points into a delay unit, and respectively controlling the opening and closing conditions of the accumulation control switch for multiple times according to the integration starting time points;

9. The control device of claim 6, wherein the sensing element comprises a photosensitive surface and a backlight surface, a photosensitive area of the photosensitive surface has a predetermined shape, and the photosensitive area corresponds to and is parallel to a corresponding area of the dark stripe on the screen.

10. An electronic terminal, comprising:

the screen adjusts light in a pulse width frequency modulation mode to enable the screen to form a high-frequency rolling dark stripe;

a sensing assembly disposed below the screen;

an integrator connected to the sensing assembly; and

a control device, the control device comprising:

11. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the control method of any one of claims 1 to 5.