CN115482757A

CN115482757A - Optical signal compensation method and device, mobile terminal and storage medium

Info

Publication number: CN115482757A
Application number: CN202110604524.1A
Authority: CN
Inventors: 郝宁
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2021-05-31
Filing date: 2021-05-31
Publication date: 2022-12-16

Abstract

The present disclosure relates to an optical signal compensation method, the method comprising: acquiring current display content of a screen display area corresponding to an off-screen sensor; determining a display compensation value according to the current display content; wherein the display compensation value indicates an influence on the under-screen sensor to receive ambient light when the current display content is displayed in the screen display area; and determining an ambient light signal received by the under-screen sensor according to the actual light signal received by the under-screen sensor and the display compensation value. In the embodiment of the present disclosure, since the ambient light is determined according to the actual light signal received by the off-screen sensor and the display compensation value, the influence of reflected light in a screen display area on the ambient light signal can be reduced, so that the ambient light signal acquired by the off-screen sensor is more accurate.

Description

Optical signal compensation method and device, mobile terminal and storage medium

Technical Field

The present disclosure relates to the field of mobile terminal technologies, and in particular, to an optical signal compensation method and apparatus, a mobile terminal, and a storage medium.

Background

The optical sensor under the screen of the mobile terminal is arranged below the screen, and ambient light outside the mobile phone can reach the optical sensor through the screen through gaps among display pixels of the screen. Under ideal state, optical sensor only receives the ambient light signal under the screen, however, actual conditions is that not only has the ambient light to incide, and the luminous light that produces of screen above optical sensor under the screen can produce partial reflection light behind the surface protection glass of screen, and this reflection light part can be received by optical sensor under the screen, leads to the ambient light signal that optical sensor gathered under the screen inaccurate to mobile terminal can not accurate compensation ambient light is to showing the influence that brings, makes the demonstration of screen inaccurate.

Disclosure of Invention

According to a first aspect of the embodiments of the present disclosure, there is provided an optical signal compensation method, the method including:

acquiring current display content of a screen display area corresponding to an off-screen sensor;

determining a display compensation value according to the current display content; wherein the display compensation value indicates an influence on the under-screen sensor to receive ambient light when the current display content is displayed in the screen display area;

and determining an ambient light signal received by the under-screen sensor according to the actual light signal received by the under-screen sensor and the display compensation value.

In one embodiment, the determining the ambient light signal received by the off-screen sensor according to the light signal actually received by the off-screen sensor and the display compensation value includes:

acquiring a device noise compensation value and/or a crosstalk noise compensation value; wherein the device noise compensation value indicates an effect of the off-screen sensor on the off-screen sensor receiving ambient light; the crosstalk noise compensation value represents the influence of mutual crosstalk among pixels in the screen display area on the ambient light received by the under-screen sensor;

and determining the ambient light signal received by the under-screen sensor according to the actual light signal received by the under-screen sensor, the display compensation value, the device noise compensation value and/or the crosstalk noise compensation value.

In one embodiment, the determining a display compensation value according to the current display content includes:

according to the current display content, determining the proportion of different primary colors in the screen display area when the current display content is displayed in the screen display area;

determining the display compensation value according to the proportion and the primary color display compensation values corresponding to different primary colors under the current display brightness of the screen; the primary color display compensation value is used for indicating the influence on the under-screen sensor to receive the ambient light when the display content of the screen display area is primary color.

In one embodiment, the method further comprises:

for any primary color, when the screen displays the primary color in a dark environment, determining a light signal received by the sensor under the screen under different display brightness of the screen as a first test light signal;

and determining the acquired value of the first test light signal corresponding to different display brightness as a primary color display compensation value corresponding to any primary color under different display brightness of the screen.

In one embodiment, the method further comprises:

when the screen displays black in a dark environment, determining that the light signal received by the sensor under the screen is a second test light signal;

and determining the value of the second test optical signal as the noise compensation value.

In one embodiment, the method further comprises:

when the screen displays white in a dark environment, determining that the light signal received by the sensor under the screen is a third test light signal;

and determining the value of the third test optical signal as the noise compensation value.

In one embodiment, the screen display area at least includes an area where light rays emitted from the screen directly enter or are reflected to enter pixel points of the under-screen sensor.

According to a second aspect of the embodiments of the present disclosure, there is provided an optical signal compensation apparatus, comprising an obtaining module and a determining module, wherein,

the acquisition module is used for acquiring the current display content of the screen display area corresponding to the off-screen sensor;

the determining module is used for determining a display compensation value according to the current display content; wherein the display compensation value indicates an influence on the under-screen sensor to receive ambient light when the current display content is displayed in the screen display area;

According to a third aspect of the embodiments of the present disclosure, there is provided a mobile terminal including:

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to, when executed, implement the steps of any of the above-mentioned optical signal compensation methods.

According to a fourth aspect of the embodiments of the present disclosure, there is provided a non-transitory computer-readable storage medium having stored thereon a computer program, the program being executed by a processor to perform the steps of any of the optical signal compensation methods described above.

The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:

in the embodiment of the disclosure, the current display content of a screen display area corresponding to an off-screen sensor is acquired; determining a display compensation value according to the current display content; wherein the display compensation value indicates an influence on the under-screen sensor to receive ambient light when the current display content is displayed in the screen display area; and determining an ambient light signal received by the under-screen sensor according to the actual light signal received by the under-screen sensor and the display compensation value. Here, the current display content of the screen display area corresponding to the off-screen sensor may be acquired; and determining a display compensation value according to the current display content. Therefore, the ambient light signal received by the under-screen sensor can be determined according to the actual light signal received by the under-screen sensor and the display compensation value, and the ambient light is determined according to the actual light signal received by the under-screen sensor and the display compensation value, so that the influence of reflected light of a screen display area on the ambient light signal can be reduced, and the ambient light signal acquired by the under-screen sensor is more accurate.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.

FIG. 1 is a schematic diagram of a screen configuration shown in accordance with an exemplary embodiment;

FIG. 2 is a flow diagram illustrating a method of optical signal compensation according to an exemplary embodiment;

FIG. 3 is a schematic diagram illustrating an underscreen optical sensor in accordance with an exemplary embodiment;

FIG. 4 is a schematic diagram illustrating the brightness of an emitted light according to an exemplary embodiment;

FIG. 5 is a flow diagram illustrating a method of optical signal compensation according to an exemplary embodiment;

FIG. 6 is a flow diagram illustrating a method of optical signal compensation according to an exemplary embodiment;

FIG. 7 is a flow diagram illustrating a method of optical signal compensation in accordance with an exemplary embodiment;

FIG. 8 is a flow diagram illustrating a method of optical signal compensation in accordance with an exemplary embodiment;

FIG. 9 is a flow diagram illustrating a method of optical signal compensation in accordance with an exemplary embodiment;

FIG. 10 is a flow chart illustrating a method of optical signal compensation according to an exemplary embodiment

FIG. 11 is a block diagram illustrating an optical signal compensation arrangement according to an exemplary embodiment;

fig. 12 is a block diagram illustrating a mobile terminal according to an example embodiment.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. The following description refers to the accompanying drawings in which the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of methods and apparatus consistent with certain aspects of the invention, as detailed in the appended claims.

In order to facilitate understanding of those skilled in the art, the embodiments of the present disclosure set forth a plurality of implementations for clearly illustrating the technical solutions of the embodiments of the present disclosure. Of course, it can be understood by those skilled in the art that the embodiments provided in the present disclosure can be implemented alone, or in combination with other embodiments of the methods in the present disclosure, or in combination with some methods in other related technologies; the disclosed embodiments are not limited thereto.

For better understanding of the embodiments of the present disclosure, first, an application scenario of a screen display is explained:

in one embodiment, the screen includes a display device for displaying, for example, an OLED screen in which the display device is an Organic Light Emitting Diode (OLED), when the number of turned-on LEDs is larger, the display luminance of the LEDs is reduced due to the resistance characteristic of the circuit; when the number of LEDs turned on is reduced, the brightness of the part of the LEDs is higher than that when all the LEDs are turned on. This is a voltage drop problem caused by the current-voltage characteristic of the OLED screen, i.e. the screen brightness varies slightly with the content displayed on the screen. These variations can result in the under-screen optical sensor not being able to remove screen disturbances using a fixed compensation value. Therefore, after the content displayed on the screen needs to be automatically judged, the display brightness change of the LED at the position is judged, and then the interference compensation of the sensor is carried out. It should be noted that the off-screen optical sensor is used to acquire the brightness of the ambient light on the screen. Here, the display parameter may be adjusted based on the luminance value of the screen ambient light acquired by the off-screen optical sensor.

Referring to fig. 1, a cross-sectional view of an off-screen optical sensor and a screen is shown, where light emitted from the screen is reflected by a surface reflection glass, and the reflected light is received by the off-screen optical sensor together with ambient light. Here, since the under-screen optical sensor can simultaneously receive reflected light and ambient light. Therefore, the off-screen optical sensor receives not only the ambient light, which may cause an error in the brightness value of the ambient light obtained by the off-screen optical sensor and may not truly reflect the brightness condition of the ambient light, thereby finally causing the display parameters to be not accurately compensated and not bringing a good display effect.

Fig. 2 is a diagram illustrating a method of optical signal compensation, according to an example embodiment, the method comprising:

step 21, acquiring the current display content of a screen display area corresponding to the off-screen sensor;

step 22, determining a display compensation value according to the current display content; wherein the display compensation value indicates an influence on the under-screen sensor to receive ambient light when the current display content is displayed in the screen display area;

and step 23, determining an ambient light signal received by the under-screen sensor according to the actual light signal received by the under-screen sensor and the display compensation value.

In one embodiment, the method may be applied to an off-screen sensor. It should be noted that the off-screen sensor has a processing function for implementing the method according to any embodiment of the present disclosure.

In one embodiment, the method may be applied to a terminal provided with the off-screen sensor. Here, the terminal and/or the under-screen sensor have processing functions to implement the method according to any embodiment of the present disclosure. Here, the terminal may be, but is not limited to, a mobile phone, a wearable device, a vehicle-mounted terminal, a Road Side Unit (RSU), a smart home terminal, an industrial sensing device, and/or a medical device.

In one embodiment, the off-screen sensor may be an off-screen optical sensor.

Here, the under-screen optical sensor may be disposed under the screen. Referring to fig. 3, an area directly above the off-screen optical sensor is a screen display area corresponding to the off-screen optical sensor. And the area outside the area right above the off-screen optical sensor is not the screen display area corresponding to the off-screen optical sensor. Here, it should be noted that the off-screen optical sensor may be disposed at any position below the screen. The number of the optical sensors under the screen can be determined according to the precision requirement for obtaining the ambient light brightness. For example, when the precision requirement for acquiring the ambient light signal is greater than the precision threshold, the number of the optical sensors under the screen is greater than the number threshold; or when the precision requirement for acquiring the ambient light signal is smaller than the precision threshold, the number of the optical sensors under the screen is smaller than the number threshold. Here, when the number of the off-screen optical sensors is plural, the value of the ambient signal may be an average value of values of a plurality of ambient signals collected by the plural off-screen optical sensors.

In one embodiment, the screen display area at least comprises an area where light rays emitted from the screen directly enter or are reflected to enter pixel points of the under-screen sensor.

In some embodiments, the display content may include a background color and/or display objects, etc. of the screen display area. Here, it should be noted that the display content may be characterized by the display parameter. In one embodiment, the display parameters include one or more of: the color and brightness values are displayed. Here, the display color and/or brightness value may be different at different times.

In one embodiment, the light signal actually received by the off-screen sensor may be indicated at least by a brightness value. Here, the luminance value may include: the sum of the luminance values provided by any light source of the environment in which the terminal is located. In fact, the brightness value here can be understood as the sum of the brightness values provided by any light source that the under-screen optical sensor can receive. Light sources herein include, but are not limited to: a light source of external ambient light of an environment where the terminal (or the off-screen sensor) is located, and a light source emitted by a screen of the terminal itself. Here, the external light source of the environment in which the terminal is located may include various kinds. For example, sunlight or light; the light source emitted by the terminal itself may include: backlight sources for the display screen of the terminal, etc.

Here, it should be noted that, when the current display content is displayed in the screen display area, the influence on the under-screen sensor to receive the ambient light may be an influence on the ambient light received by the under-screen sensor by reflected light of a light source corresponding to the display content.

In one embodiment, the display parameter indicative of the display content may be a display parameter of a display screen. The display parameters may include at least one of: display color and brightness. Here, the display color and/or brightness of the screen display area corresponding to the off-screen optical sensor at different times may be different. For example, at a first time, the display color of the screen display area is a first color, and the display brightness of the screen display area is a first brightness. At the second moment, the display color of the screen display area is the second color, and the display brightness of the screen display area is the second brightness. The color difference displayed at different positions of the screen display area can be different at the same time, but the brightness of the whole screen is the same at the same time.

In one embodiment, referring again to fig. 1, when the display content is displayed in the screen display area, the light emitted from the screen is reflected by the surface reflection glass, and the reflected light is received by the off-screen optical sensor together with the ambient light. Therefore, the actual light signal acquired by the under-screen optical sensor is a signal of the light obtained by mixing the reflected light and the ambient light, and is not just an ambient light signal. In one embodiment, the actual received light signal acquired by the off-screen optical sensor may be adjusted by using the display compensation value to obtain the compensated ambient light signal, so as to reduce the influence of the light reflected by the screen on the ambient signal. Here, the size of the display compensation value may be determined according to the display contents. In one embodiment, this may be determined based on the brightness of the light reflected by the screen.

In one embodiment, the display compensation value of the off-screen optical sensor is determined according to the current display content and a predetermined mapping relationship, wherein the predetermined mapping relationship comprises a relationship between the display content and the display compensation value. Here, it should be noted that the display content may be indicated by a display parameter.

In one embodiment, the predetermined mapping relationship is pre-stored in the target storage area, and after the display parameter of the current display content in the screen display area corresponding to the off-screen optical sensor is obtained, the display compensation value of the off-screen optical sensor can be determined according to the display parameter and the relationship between the display parameter and the display compensation value indicated by the mapping relationship.

In one embodiment, the display parameters of the display content in the screen display area corresponding to the off-screen optical sensor may be periodically acquired, and the display compensation value of the off-screen optical sensor may be determined according to the display parameters and the predetermined mapping relationship.

In one embodiment, the acquisition period for acquiring the display content of the screen display area corresponding to the off-screen optical sensor may be determined according to the change rate of the ambient light. In one embodiment, in response to the rate of change of the ambient light being greater than a rate of change threshold, determining that the acquisition period is less than a period threshold. Alternatively, in response to the rate of change of the ambient light being less than a rate of change threshold, determining that the acquisition period is greater than a period threshold. In this way, the acquisition period may be adapted to the rate of change of the ambient light.

In one embodiment, referring to fig. 1 again, the brightness values of the reflected light beams of the screens corresponding to different display contents are different. Here, the display compensation value may be a positive correlation with a brightness value of the reflected light corresponding to the display content. Therefore, the actually received optical signal acquired by the off-screen optical sensor is adjusted by using the display compensation value, so that the influence of the reflected light on the environmental signal acquired by the off-screen optical sensor can be reduced.

In one embodiment, referring to fig. 1 again, when the content is displayed in the display area of the screen, since the off-screen optical sensor is located below the screen, light emitted by the screen LED in the display area corresponding to the off-screen optical sensor is reflected by the surface reflection glass, so that the collection of ambient light by the off-screen optical sensor is affected. Here, although there is also reflected light outside the display area corresponding to the off-screen optical sensor, the reflected light cannot be reflected to the off-screen optical sensor, and therefore, does not affect the ambient light brightness. The brightness values for the light reflected into the display area corresponding to the off-screen optical sensor may also be different. In one embodiment, when the color displayed by the OLED screen is different, the brightness of the LEDs in the same area can be different. In one embodiment, when displayed with a white background, the brightness of the corresponding display area is lowest. When the black background is used for displaying, the brightness of the corresponding display area is the highest. Therefore, referring to fig. 4, when the display parameters (display color and corresponding brightness) of the display content are different, the brightness value of the light reflected into the display area corresponding to the off-screen optical sensor is also different.

In the embodiment of the disclosure, the current display content of the screen display area corresponding to the off-screen sensor can be acquired; and determining a display compensation value according to the current display content. Therefore, the ambient light signal received by the under-screen sensor can be determined according to the actual light signal received by the under-screen sensor and the display compensation value, and the ambient light is determined according to the actual light signal received by the under-screen sensor and the display compensation value, so that the influence of reflected light of a screen display area on the ambient light signal can be reduced, and the ambient light signal acquired by the under-screen sensor is more accurate.

It should be noted that, as can be understood by those skilled in the art, the methods provided in the embodiments of the present disclosure can be executed alone or together with some methods in the embodiments of the present disclosure or some methods in the related art.

Fig. 5 is a diagram illustrating a method of optical signal compensation, the method comprising:

step 51, obtaining a device noise compensation value and/or a crosstalk noise compensation value; wherein the device noise compensation value is indicative of an effect of the off-screen sensor on the reception of ambient light by the off-screen sensor; the crosstalk noise compensation value represents the influence of mutual crosstalk among pixels in the screen display area on the ambient light received by the under-screen sensor;

and step 52, determining the ambient light signal received by the under-screen sensor according to the light signal actually received by the under-screen sensor, the display compensation value, and the device noise compensation value and/or the crosstalk noise compensation value.

Here, it should be noted that the device noise compensation value is a value for compensating for a collection error of light collected by the off-screen sensor, which is generated by the off-screen sensor itself. After the device noise compensation value is used for compensation, the acquisition error of the light acquired by the sensor under the screen is smaller than the error threshold value. For example, when the ambient light is collected by the off-screen sensor, the influence of the off-screen sensor on the ambient light received by the evaluation sensor can be reduced after the compensation is performed by the device noise compensation value.

In one embodiment, the under-screen sensor itself has device noise, so it is necessary to separately test the noise of the under-screen sensor itself in a completely dark environment, which is caused by the under-screen sensor itself and is a characteristic of the under-screen sensor itself in the production process, and this part of the noise should be removed as noise. Here, the value of the noise may be a constant.

In one embodiment, continuous crosstalk exists between RGB pixels of the screen, crosstalk between pixels is the largest when RGB adjacent pixels are simultaneously turned on, the calibration parameter of the portion is also used as crosstalk noise of the pixels of the screen itself, the noise is also the characteristics of the screen itself, and the crosstalk noise between the pixels corresponds to a constant and can be used as noise removal.

In one embodiment, the actual light signal received by the off-screen sensor, the display compensation value, and the relationship between the device noise compensation value and/or the crosstalk noise compensation value are pre-stored in a target storage area, and after the actual received light signal is obtained, the ambient light signal received by the off-screen optical sensor can be determined according to the actual light signal received by the off-screen sensor, the display compensation value, and the relationship between the device noise compensation value and/or the crosstalk noise compensation value.

In one embodiment, after determining the ambient light signal received by the off-screen sensor, the display parameters of the currently displayed content may be adjusted based on the value of the received ambient light signal.

In one embodiment, the display color and/or brightness value of the current display content of the display area is adjusted according to the received environment signal brightness value.

In one embodiment, the magnitude of the brightness of the display region is adjusted to be greater than a magnitude threshold in response to the display color value being greater than or equal to a display color threshold. Or, in response to the display color value being less than or equal to a brightness threshold, adjusting a magnitude of the brightness of the display region to be less than a magnitude threshold.

In one embodiment, in response to the brightness value being greater than or equal to a brightness threshold, adjusting a magnitude of the brightness of the display area to be greater than a magnitude threshold. Or adjusting the amplitude of the brightness of the display area to be smaller than an amplitude threshold value in response to the adjusted brightness value being smaller than or equal to a brightness threshold value.

Here, adjusting the brightness of the display area may be changing the emission power of the LEDs.

Fig. 6 is a diagram illustrating a method of optical signal compensation, the method including:

step 61, according to the current display content, determining the proportion of different primary colors in the screen display area when the current display content is displayed in the screen display area;

step 62, determining the display compensation value according to the proportion and the primary color display compensation values corresponding to different primary colors under the current display brightness of the screen; the primary color display compensation value is used for indicating the influence on the under-screen sensor to receive the ambient light when the display content of the screen display area is primary color.

In one embodiment, the current display content is displayed based on different primary colors, where the different primary colors may be red, yellow and blue. In one embodiment, the display content is different, and may be primary colors. Here, the primary colors may be different in proportion to the primary colors. It should be noted that any color can be made up of different proportions of the primary colors.

In one embodiment, the ratio of different primary colors in the screen display area when the current display content is displayed in the screen display area may be determined according to the current display content acquired multiple times within a predetermined period. The proportion is an average value of proportions determined by the current display content acquired for multiple times. In this way, a display compensation value more suitable for the current display content is determined according to the ratio.

In one embodiment, the ratio and the relationship between the primary color display compensation values corresponding to the different primary colors at the current display brightness of the screen are stored in the target storage area in advance, and after the ratio is obtained, the display compensation value can be determined according to the ratio and the relationship between the primary color display compensation values corresponding to the different primary colors at the current display brightness of the screen.

Fig. 7 illustrates a method of optical signal compensation, according to an example embodiment, the method comprising:

step 71, for any primary color, when the screen displays the primary color in a dark environment, determining that the light signal received by the sensor under the screen is a first test light signal under different display brightness of the screen;

and step 72, determining a primary color display compensation value corresponding to any primary color under different display brightness of the screen according to the acquired first test light signal corresponding to different display brightness.

In one embodiment, when the screen is caused to display any one of the primary colors in a dark environment (e.g., in a darkroom), acquiring the light signal received by the off-screen sensor when the display area is set to a different brightness value takes the light signal as the first test light signal. And determining a primary color display compensation value corresponding to any primary color under different display brightness of the screen according to the acquired first test light signal corresponding to different display brightness.

Specifically, a mapping relationship may be established between the value of the light parameter (e.g., light intensity, light brightness, etc.) determined based on the first test light signal and the display brightness for each primary color. For example, the mapping relationship may include a variation of the luminance of the first test light signal with the display luminance. Then the luminance corresponding to different display luminances in the mapping relationship is the primary color display compensation value corresponding to different display luminances.

In one embodiment, the mobile terminal may be placed in a non-light-irradiation environment, a certain primary color of a display area is kept unchanged, and a first test light signal of light of the display area when the display area is set to different brightness values is acquired by using an off-screen optical sensor. In one embodiment, the brightness values of the display regions may be set according to a predetermined gradient, where different brightness values correspond to a different one of the first test light signals.

Here, after the primary color, the luminance value of the display region, and the first test light signal are acquired, the mapping relationship among the primary color, the luminance value of the display region, and the primary color display compensation value may be determined.

For example, please refer to table one, which shows a schematic diagram of a mapping relationship. The primary color, the brightness value of the display area and the display compensation value are in a direct proportional relation, and the proportionality coefficient between the brightness value of the reflected light and the display compensation value is K.

Table I, a schematic diagram of a mapping relationship

Primary color	Brightness value of the display area	The display compensation value
			Yellow colour	A1	K*B1
Yellow colour	A2	K*B2

In one embodiment, after the mapping relationship is determined, when the primary color of the display area is yellow and the luminance value of the display area is A1, it may be determined according to the mapping relationship that the display compensation value is K × B1, and therefore, the ambient light signal collected by the off-screen optical sensor may be compensated by using K × B1. Here, the compensation of the collected ambient light signal may be to increase or decrease the collected ambient light signal by K × B1.

In one embodiment, after the mapping relationship is determined, when the primary color of the display area is yellow and the brightness value of the display area is A2, it may be determined according to the mapping relationship that the display compensation value is K × B2, and therefore, the ambient light signal collected by the off-screen optical sensor may be compensated by using K × B2. Here, the compensation of the collected ambient light signal may be to increase or decrease the collected ambient light signal by K × B2.

Fig. 8 is a diagram illustrating a method of optical signal compensation, the method comprising:

step 81, when the screen displays black in a dark environment, determining that the optical signal received by the sensor under the screen is a second test optical signal;

step 82, determining the noise compensation value according to the second test optical signal.

In one embodiment, when the screen displays black in a black environment, the light signal received by the off-screen sensor is determined to be a second test light signal; the device noise compensation value may be determined based on a value of the optical parameter (e.g., light intensity, light brightness, etc.) determined by the second test light signal, e.g., an average value of light intensities of the second test light signal measured a plurality of times may be determined as the device noise compensation value.

In one embodiment, after determining the device noise compensation value based on the second test light signal, the device noise compensation value may be stored in a target storage area, and after obtaining the actual received light signal, the ambient light signal received by the off-screen optical sensor may be determined based on a relationship between the display compensation value and the device noise compensation value.

Here, it should be noted that the noise compensation value determined according to the second test light signal is a value for compensating for a collection error of light collected by the off-screen sensor, which is generated by the off-screen sensor itself. After the device noise compensation value is used for compensation, the acquisition error of the light acquired by the sensor under the screen is smaller than the error threshold value. For example, when ambient light is collected by the off-screen sensor, the influence of the off-screen sensor on the ambient light received by the evaluation sensor can be reduced after compensation is performed by the device noise compensation value. It should be noted that, as can be understood by those skilled in the art, the methods provided in the embodiments of the present disclosure can be executed alone or together with some methods in the embodiments of the present disclosure or some methods in the related art.

Fig. 9 is a diagram illustrating a method of optical signal compensation, the method comprising:

step 91, when the screen displays white in a dark environment, determining that the optical signal received by the sensor under the screen is a third test optical signal;

and step 92, determining the crosstalk noise compensation value according to the second test optical signal.

In one embodiment, when the screen displays white in a black environment, the light signal received by the off-screen sensor is determined to be a third test light signal; the crosstalk noise compensation value may be determined based on a value of an optical parameter (e.g., light intensity, light brightness, etc.) determined by the third test light signal, e.g., an average value of light intensities of the third test light signal measured multiple times may be determined as the crosstalk device noise compensation value.

In one embodiment, after determining the crosstalk noise compensation value according to the value of the third test optical signal, the display compensation value and the device noise compensation value may be stored in a target storage area, and after acquiring the actually received optical signal, the ambient optical signal received by the off-screen optical sensor may be determined according to the actually received optical signal of the off-screen sensor, the display compensation value, the device noise compensation value, and the crosstalk noise compensation value.

Here, it should be noted that, in the color background calibration, continuous crosstalk between RGB pixels of the screen is mainly considered for white, crosstalk between pixels when RGB adjacent pixels are simultaneously lit is the largest, and the calibration parameter of this part is also used as crosstalk noise of the pixel of the screen itself, this noise is also the self characteristic of the screen, and this crosstalk between pixels is also a constant, and is removed as noise in the subsequent algorithm. And after the crosstalk noise compensation value is used for compensation, the acquisition error of the light acquired by the sensor under the screen is smaller than an error threshold value. For example, when the ambient light is collected by the off-screen sensor, the influence of the off-screen sensor on the ambient light received by the evaluation sensor can be reduced after the compensation is performed by the device noise compensation value.

It should be noted that, as can be understood by those skilled in the art, the methods provided in the embodiments of the present disclosure can be executed alone or together with some methods in the embodiments of the present disclosure or some methods in the related art. In one embodiment, the screen display area at least includes an area where light rays emitted from the screen directly enter or are reflected to enter pixel points of the under-screen sensor.

Wherein, according to the light signal actually received by the off-screen sensor and the display compensation value, determining the ambient light signal received by the off-screen sensor comprises:

the value of the optical parameter (for example, light intensity) determined by the optical signal actually received by the off-screen sensor is subtracted by the display compensation value (when the optical parameter is light intensity, the display compensation value is light intensity of the first test optical signal), so as to obtain the light intensity of the ambient optical signal received by the off-screen sensor.

Wherein, according to the actual light signal received by the off-screen sensor, the display compensation value, the device noise compensation value and the crosstalk noise compensation value, determining the ambient light signal received by the off-screen sensor includes:

subtracting a display compensation value (when the optical parameter is the light intensity, the display compensation value is the light intensity of the first test optical signal), a device noise compensation value and a crosstalk noise compensation value from a value of an optical parameter (for example, the light intensity) determined by the optical signal actually received by the off-screen sensor to obtain the light intensity of the ambient optical signal received by the off-screen sensor.

Referring to fig. 10, for a better understanding of any embodiment of the present disclosure, the disclosure is further illustrated below by an exemplary embodiment:

examples 1, 1,

Step 101, starting an optical sensor under a screen;

102, controlling a screen to display based on the display parameters;

103, acquiring display parameters of current display contents of a screen display area corresponding to the off-screen optical sensor, wherein the off-screen optical sensor is used for acquiring an environment brightness value of the terminal;

104, determining a brightness compensation value of the optical sensor under the screen according to the display parameter and a preset mapping relation, wherein the preset mapping relation comprises a relation between the display parameter and the brightness compensation value;

step 105, determining a received ambient light signal according to the determined brightness compensation value;

and 106, adjusting the display parameters of the current display content by using the value of the received ambient light signal.

Fig. 11 is an optical signal compensation apparatus according to an exemplary embodiment, the apparatus including an obtaining module 111 and a determining module 112: wherein the content of the first and second substances,

the acquiring module 111 is configured to acquire current display content of a screen display area corresponding to the off-screen sensor;

the determining module 112 is configured to determine a display compensation value according to the current display content; wherein the display compensation value indicates an influence on the under-screen sensor to receive ambient light when the current display content is displayed in the screen display area;

In one embodiment, the obtaining module 111 is further configured to obtain a device noise compensation value and/or a crosstalk noise compensation value; wherein the device noise compensation value indicates an effect of the off-screen sensor on the off-screen sensor receiving ambient light; the crosstalk noise compensation value represents the influence of mutual crosstalk among pixels in the screen display area on the ambient light received by the under-screen sensor;

the determining module 112 is further configured to determine the ambient light signal received by the off-screen sensor according to the light signal actually received by the off-screen sensor, the display compensation value, and the device noise compensation value and/or the crosstalk noise compensation value.

In one embodiment, the determining module 112 is further configured to determine, according to the current display content, a ratio of different primary colors in the screen display area when the current display content is displayed in the screen display area;

determining the display compensation value according to the proportion and the primary color display compensation values corresponding to different primary colors under the current display brightness of the screen; the primary color display compensation value is used for representing the influence of the display content of the screen display area on the receiving of the ambient light by the screen down sensor when the display content is the primary color.

In one embodiment, the determining module 112 is further configured to:

and determining a primary color display compensation value corresponding to any primary color under different display brightness of the screen according to the acquired first test light signal corresponding to different display brightness.

In one embodiment, the determining module 112 is further configured to:

and determining the crosstalk noise compensation value according to the second test optical signal.

In one embodiment, the determining module 112 is further configured to:

and determining the device noise compensation value according to the third test optical signal.

With regard to the apparatus in the above embodiments, the specific manner in which each module performs operations has been described in detail in the embodiments, and will not be described in detail here.

An embodiment of the present disclosure further provides a mobile terminal, including:

a processor and a memory for storing a computer program capable of running on the processor, wherein the processor is configured to perform the method steps of any of the embodiments of the present disclosure when the computer program is run.

Embodiments of the present disclosure also provide a non-transitory computer readable storage medium, on which a computer program is stored, where the program is executed by a processor to implement the method steps described in any embodiment of the present disclosure.

With regard to the apparatus in the above embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be described in detail here.

It will be understood that the invention is not limited to the precise arrangements that have been described above and shown in the drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

Fig. 12 is a block diagram illustrating a mobile terminal 700 according to an example embodiment. For example, the mobile terminal 700 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, and the like.

Referring to fig. 12, a mobile terminal 700 may include one or more of the following components: a processing component 702, a storage component 704, a power component 706, a multimedia component 708, an audio component 710, an input/output (I/O) interface 712, a sensor component 714, and a communication component 716.

Processing component 702 generally controls overall operation of mobile terminal 700, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 702 may include one or more processors 720 to execute instructions to perform all or a portion of the steps of the methods described above. Further, processing component 702 may include one or more modules that facilitate interaction between processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate interaction between the multimedia component 708 and the processing component 702.

The memory 704 is configured to store various types of data to support operation at the mobile terminal 700. Examples of such data include instructions for any application or method operating on mobile terminal 700, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 704 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

Power component 706 provides power to various components of mobile terminal 700. The power components 706 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the mobile terminal 700.

The multimedia component 708 includes a screen that provides an output interface between the mobile terminal 700 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the mobile terminal 700 is in an operation mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 710 is configured to output and/or input audio signals. For example, the audio component 710 may include a Microphone (MIC) configured to receive external audio signals when the mobile terminal 700 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 704 or transmitted via the communication component 716. In some embodiments, audio component 710 further includes a speaker for outputting audio signals.

The I/O interface 712 provides an interface between the processing component 702 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor component 714 includes one or more sensors for providing various aspects of state assessment for the mobile terminal 700. For example, sensor assembly 714 may detect an open/closed state of mobile terminal 700, a relative positioning of components, such as a display and keypad of mobile terminal 700, a change in position of mobile terminal 700 or a component of mobile terminal 700, the presence or absence of user contact with mobile terminal 700, orientation or acceleration/deceleration of mobile terminal 700, and a change in temperature of mobile terminal 700. The sensor assembly 714 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 714 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 716 is configured to facilitate wired or wireless communication between the mobile terminal 700 and other devices in question. The mobile terminal 700 may access a wireless network based on a communication standard, such as WiFi,2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 716 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the mobile terminal 700 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer readable storage medium including instructions, such as the memory 704 including instructions, executable by the processor 720 of the mobile terminal 700 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

A non-transitory computer readable storage medium, wherein instructions of the storage medium, when executed by a processor of a terminal, enable the terminal to perform the fingerprint identification method according to the above embodiments.

Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.

Claims

1. A method for optical signal compensation, the method comprising:

2. The method of claim 1, wherein the determining the ambient light signal received by the off-screen sensor based on the actual light signal received by the off-screen sensor and the display compensation value comprises:

and determining an ambient light signal received by the under-screen sensor according to the light signal actually received by the under-screen sensor, the display compensation value, and the device noise compensation value and/or the crosstalk noise compensation value.

3. The method of claim 1, wherein the determining a display compensation value according to the current display content comprises:

4. The method of claim 3, further comprising:

5. The method of compensating an optical signal according to claim 2, further comprising:

6. The method of compensating an optical signal according to claim 2, further comprising:

7. The optical signal compensation method of claim 1, wherein the screen display area at least includes an area where light emitted from the screen directly enters or is reflected to enter the pixel points of the under-screen sensor.

8. An optical signal compensation apparatus, comprising an obtaining module and a determining module, wherein,

the acquisition module is used for acquiring the current display content of a screen display area corresponding to the off-screen sensor;

9. A mobile terminal, comprising:

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to: when executed, implement the steps in the optical signal compensation method of any of the above claims 1 to 7.

10. A non-transitory computer-readable storage medium, on which a computer program is stored, characterized in that the program is executed by a processor to implement the method steps of any of claims 1 to 7.