CN116110351B

CN116110351B - Backlight control method, device, chip, electronic equipment and medium

Info

Publication number: CN116110351B
Application number: CN202310390470.2A
Authority: CN
Inventors: 刘曼
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2023-04-13
Filing date: 2023-04-13
Publication date: 2023-09-19
Anticipated expiration: 2043-04-13
Also published as: CN116110351A

Abstract

The embodiment of the application provides a backlight control method, a device, a chip, electronic equipment and a medium, wherein the method comprises the following steps: under the condition that a screen of the electronic equipment is in a full-screen display image state, acquiring first brightness issued by a first module of the electronic equipment, wherein the first module is used for issuing backlight brightness to the screen of the electronic equipment; and executing a first operation to enable the backlight brightness sent to the screen of the electronic equipment to be the threshold brightness under the condition that the first brightness is smaller than the preset threshold brightness corresponding to the screen of the electronic equipment. The embodiment of the application can improve the experience of the user when watching the video and the picture in a full screen under the dim light environment.

Description

Backlight control method, device, chip, electronic equipment and medium

Technical Field

The present application relates to the field of electronic devices, and in particular, to a backlight control method, apparatus, chip, electronic device, and medium.

Background

In a dim light environment, the backlight brightness of the electronic device can be adjusted to a lower value. But at this time, it is difficult for the user to see the low-contrast, dark-colored image, affecting the user experience.

Disclosure of Invention

The embodiment of the application provides a backlight control method, a backlight control device, a backlight control chip, electronic equipment and a backlight control medium, which can improve the experience of a user when watching videos and pictures in a full screen manner in a dim light environment.

In a first aspect, an embodiment of the present application provides a backlight control method, including: under the condition that a screen of the electronic equipment is in a full-screen display image state, acquiring first brightness issued by a first module of the electronic equipment, wherein the first module is used for issuing backlight brightness to the screen of the electronic equipment; and executing a first operation to enable the backlight brightness sent to the screen of the electronic equipment to be the threshold brightness under the condition that the first brightness is smaller than the preset threshold brightness corresponding to the screen of the electronic equipment.

In the embodiment of the application, the first brightness issued by the first module of the electronic equipment is acquired when the screen of the electronic equipment is in the full-screen display image state, the first module is used for issuing backlight brightness to the screen of the electronic equipment, and if the first brightness is smaller than the preset threshold brightness corresponding to the screen of the electronic equipment, the first operation is executed to enable the backlight brightness issued to the screen of the electronic equipment to be the threshold brightness, so that the situation that a user can not easily see the image with low contrast and dark tone when watching the video and the image in the full screen in the dark environment is avoided, and the experience of the user when watching the video and the image in the full screen in the dark environment is improved.

Optionally, in a case where the screen of the electronic device is in a full screen display image state, the method further includes: acquiring an image displayed on a screen of the electronic equipment; acquiring the gray level and brightness of the obtained image; and executing the step of acquiring the first brightness issued by the first module of the electronic equipment under the condition that at least one of the gray level of the obtained image is smaller than a preset gray level threshold value and the brightness of the obtained image is smaller than a preset brightness threshold value.

By performing picture detection first and then performing backlight brightness control according to the picture detection result as required, the backlight brightness can be controlled according to the requirement for displaying low-contrast or dark-color image scenes in a full screen, and the backlight brightness is not controlled according to the requirement for displaying high-contrast or bright-color image scenes in a full screen, so that the selective execution of the backlight brightness on-demand control is realized, unnecessary backlight brightness on-demand control is avoided, and the problem of high power consumption caused by always performing the backlight brightness on-demand control can be avoided.

Optionally, in a case where the screen of the electronic device is in a full screen display image state, the method further includes: executing a step of acquiring an image displayed on a screen of the electronic device when the screen of the electronic device starts displaying the image in a full screen; when the screen of the electronic device is refreshed, a step of acquiring an image displayed on the screen of the electronic device is performed.

By performing image detection at the beginning of full screen display of an image and at each screen refresh, on-demand accurate execution of image detection can be achieved, thereby facilitating on-demand accurate execution of backlight control.

Optionally, the preset gray threshold is obtained according to the gray level of at least one preset image, and the preset brightness threshold is obtained according to the brightness of at least one preset image; wherein the step for acquiring the image gray level includes: acquiring gray values of all pixel points in the image according to the multiple channel values of all pixel points in the image, and acquiring gray of the image according to the gray values of all pixel points in the image; the step for acquiring the brightness of the image comprises: according to the channel values of each pixel point in the image, the brightness of each pixel point in the image is obtained through color space conversion processing, and according to the brightness of each pixel point in the image, the brightness of the image is obtained.

The preset image may be a preset low contrast or dark image, and the brightness threshold and the gray threshold are obtained accordingly. When the picture detection is carried out based on the method, the scene of the low-contrast or dark-color image displayed in the full screen and the scene of the high-contrast or bright-color image displayed in the full screen can be accurately distinguished, so that the accurate execution of backlight control can be realized as required.

Optionally, the backlight control method further includes: monitoring whether the electronic equipment is in a full-screen video playing scene; monitoring whether the electronic equipment is in a full-screen picture display scene; the condition that the screen of the electronic device is in a full-screen display image state comprises the following steps: the electronic device is in either one of a full-screen video playing scene and a full-screen picture displaying scene.

By monitoring the full-screen video playing scene and the full-screen picture displaying scene together, the on-demand accurate monitoring of the full-screen display image scene can be realized, and thus the on-demand accurate execution of backlight control can be realized.

Optionally, monitoring whether the electronic device is in a full-screen video playing scene includes: monitoring whether the electronic equipment is in a bullet screen-free full-screen video playing scene; the situation that the electronic device is in a full-screen video playing scene comprises the following steps: the electronic equipment is in the condition of no-bullet screen full-screen video playing scene.

By monitoring the full-screen video playing scene without the bullet screen, the influence of the existence of the bullet screen on the image detection can be avoided, the accurate acquisition of the brightness and the gray level of the image is guaranteed, and accordingly the scene of the full-screen low-contrast or dark image in the dark light environment is accurately identified, and the on-demand accurate execution of backlight brightness optimization based on the threshold brightness is guaranteed.

Optionally, the threshold brightness is a minimum backlight brightness of the test device such that the sharpness of the first image corresponds to an expected; wherein the screen of the test device and the screen of the electronic device have the same kind of structure; the first image is a part corresponding to the preset image in the image obtained by the camera shooting the screen of the test equipment under the condition that the test equipment and the camera are in the same dark environment and the preset image is displayed on the screen of the test equipment in a full screen mode.

Therefore, the threshold brightness of different types of equipment can be correspondingly different, the threshold brightness has pertinence and applicability to the electronic equipment, and the appropriate backlight brightness can be issued when backlight control is performed, so that the situation that the dark video/picture is difficult to see when the dark video/picture is watched in a full screen mode in a dark environment is avoided, and the experience of a user when the video/picture is watched in the full screen mode in the dark environment can be improved.

Optionally, the first brightness is obtained based on at least one of backlight brightness obtained by a three-party application in the electronic device, a backlight brightness adjustment instruction received by the electronic device, and backlight brightness corresponding to ambient illuminance of an environment in which the electronic device is located.

The proper backlight brightness is obtained based on at least one dimming method, and then the backlight brightness sent to the equipment screen is optimized according to the need based on the comparison of the obtained backlight brightness and the threshold brightness, so that the more proper backlight brightness can be sent.

In a second aspect, an embodiment of the present application provides a backlight control apparatus, including: the acquisition module is used for acquiring first brightness issued by the first module of the electronic equipment when the screen of the electronic equipment is in a full-screen display image state, and the first module is used for issuing backlight brightness to the screen of the electronic equipment; and the control module is used for executing a first operation to enable the backlight brightness sent to the screen of the electronic equipment to be the threshold brightness under the condition that the first brightness is smaller than the preset threshold brightness corresponding to the screen of the electronic equipment.

In a third aspect, an embodiment of the present application provides an electronic chip, including: a processor for executing computer program instructions stored on a memory, wherein the computer program instructions, when executed by the processor, trigger the electronic chip to perform the method according to any of the first aspects.

In a fourth aspect, an embodiment of the application provides an electronic device comprising a memory for storing computer program instructions, a processor for executing the computer program instructions and communication means, wherein the computer program instructions, when executed by the processor, trigger the electronic device to perform a method as in any of the first aspects.

In a fifth aspect, embodiments of the present application provide a computer-readable storage medium having a computer program stored therein, which when run on a computer, causes the computer to perform the method as in any of the first aspects.

In a sixth aspect, embodiments of the present application provide a computer program product comprising a computer program which, when run on a computer, causes the computer to perform the method as in any of the first aspects.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

FIG. 2 is a schematic diagram of a backlight control flow according to an embodiment of the present application;

FIG. 3 is a schematic diagram of another backlight control flow according to an embodiment of the present application;

FIG. 4 is a flowchart of a backlight control method according to an embodiment of the present application;

FIG. 5 is a schematic diagram of a backlight control flow according to another embodiment of the present application;

FIG. 6 is a flow chart of another backlight control method according to an embodiment of the present application;

FIG. 7 is a timing diagram of a scene recognition according to an embodiment of the present application;

FIG. 8 is a timing diagram of a wake-up and end image detection module according to an embodiment of the present application;

FIG. 9 is a schematic diagram of a test threshold brightness implementation according to an embodiment of the present application;

fig. 10 is a flowchart of another backlight control method according to an embodiment of the application.

Detailed Description

For a better understanding of the technical solution of the present application, the following detailed description of the embodiments of the present application refers to the accompanying drawings.

It should be understood that the described embodiments are merely some, but not all, embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.

The terminology used in the embodiments of the application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.

It should be understood that the term "at least one" as used herein means one or more, and "a plurality" means two or more. The term "and/or" as used herein is merely one association relationship describing the associated object, meaning that there may be three relationships, e.g., a and/or B, may represent: a exists alone, A and B exist together, and B exists alone. Wherein A, B may be singular or plural. In addition, the character "/" herein generally indicates that the front and rear associated objects are an "or" relationship. "at least one of the following" and the like means any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c may represent: a, b, c, a-b, a-c, b-c, or a-b-c, wherein a, b, c may be single or plural.

It should be understood that although the terms first, second, etc. may be used in embodiments of the present application to describe the set threshold values, these set threshold values should not be limited to these terms. These terms are only used to distinguish the set thresholds from each other. For example, a first set threshold may also be referred to as a second set threshold, and similarly, a second set threshold may also be referred to as a first set threshold, without departing from the scope of embodiments of the present application.

The terminology used in the description of the embodiments of the application herein is for the purpose of describing particular embodiments of the application only and is not intended to be limiting of the application.

The backlight control method provided in any of the embodiments of the present application may be applied to the electronic device 100 shown in fig. 1. Fig. 1 shows a schematic configuration of an electronic device 100.

The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, keys 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identity module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It should be understood that the illustrated structure of the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the application, electronic device 100 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others.

The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. It should be understood that the interfacing relationship between the modules illustrated in the embodiments of the present application is only illustrative, and is not meant to limit the structure of the electronic device 100. In other embodiments of the present application, the electronic device 100 may also employ different interfacing manners in the above embodiments, or a combination of multiple interfacing manners.

The charge management module 140 is configured to receive a charge input from a charger. The power management module 141 is used for connecting the battery 142, and the charge management module 140 and the processor 110. The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution for wireless communication including 2G/3G/4G/5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 150 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be provided in the same device as at least some of the modules of the processor 110.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs sound signals through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays images or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional module, independent of the processor 110.

The wireless communication module 160 may provide solutions for wireless communication including wireless local area network (wireless local area networks, WLAN) (e.g., wireless fidelity (wireless fidelity, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), etc., as applied to the electronic device 100. The wireless communication module 160 may be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.

In some embodiments, antenna 1 and mobile communication module 150 of electronic device 100 are coupled, and antenna 2 and wireless communication module 160 are coupled, such that electronic device 100 may communicate with a network and other devices through wireless communication techniques. The wireless communication techniques may include the Global System for Mobile communications (global system for mobile communications, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC, FM, and/or IR techniques, among others. The GNSS may include a global satellite positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellitesystem, GLONASS), a beidou satellite navigation system (beidou navigation satellite system, BDS), a quasi zenith satellite system (quasi-zenith satellite system, QZSS) and/or a satellite based augmentation system (satellite based augmentation systems, SBAS).

The electronic device 100 implements display functions through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, and the like. The display 194 includes a display panel. The display panel may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED) or an active-matrix organic light-emitting diode (matrix organic light emitting diode), a flexible light-emitting diode (FLED), a mini, a Micro led, a Micro-OLED, a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like. In some embodiments, the electronic device 100 may include 1 or N display screens 194, N being a positive integer greater than 1.

The electronic device 100 may implement photographing functions through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The ISP is used to process data fed back by the camera 193. The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element.

The digital signal processor is used for processing digital signals, and can process other digital signals besides digital image signals. For example, when the electronic device 100 selects a frequency bin, the digital signal processor is used to fourier transform the frequency bin energy, or the like.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record video in a variety of encoding formats, such as: dynamic picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

The NPU is a neural-network (NN) computing processor, and can rapidly process input information by referencing a biological neural network structure, for example, referencing a transmission mode between human brain neurons, and can also continuously perform self-learning.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to enable expansion of the memory capabilities of the electronic device 100. The external memory card communicates with the processor 110 through an external memory interface 120 to implement data storage functions. For example, files such as music, video, etc. are stored in an external memory card.

The internal memory 121 may be used to store computer executable program code including instructions. The internal memory 121 may include a storage program area and a storage data area. The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data created during use of the electronic device 100 (e.g., audio data, phonebook, etc.), and so on. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like. The processor 110 performs various functional applications of the electronic device 100 and data processing by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.

The electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playing, recording, etc.

The pressure sensor 180A is used to sense a pressure signal, and may convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. The pressure sensor 180A is of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a capacitive pressure sensor comprising at least two parallel plates with conductive material. The capacitance between the electrodes changes when a force is applied to the pressure sensor 180A. The electronic device 100 determines the strength of the pressure from the change in capacitance. When a touch operation is applied to the display screen 194, the electronic apparatus 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 may also calculate the location of the touch based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations that act on the same touch location, but at different touch operation strengths, may correspond to different operation instructions. For example: and executing an instruction for checking the short message when the touch operation with the touch operation intensity smaller than the first pressure threshold acts on the short message application icon. And executing an instruction for newly creating the short message when the touch operation with the touch operation intensity being greater than or equal to the first pressure threshold acts on the short message application icon.

The gyro sensor 180B may be used to determine a motion gesture of the electronic device 100. The air pressure sensor 180C is used to measure air pressure. In some embodiments, electronic device 100 calculates altitude from barometric pressure values measured by barometric pressure sensor 180C, aiding in positioning and navigation. The magnetic sensor 180D includes a hall sensor. The acceleration sensor 180E may detect the magnitude of acceleration of the electronic device 100 in various directions (typically three axes). A distance sensor 180F for measuring a distance. The electronic device 100 may measure the distance by infrared or laser. In some embodiments, the electronic device 100 may range using the distance sensor 180F to achieve quick focus. The proximity light sensor 180G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The ambient light sensor 180L is used to sense ambient light level. The fingerprint sensor 180H is used to collect a fingerprint. The electronic device 100 may utilize the collected fingerprint feature to unlock the fingerprint, access the application lock, photograph the fingerprint, answer the incoming call, etc. The temperature sensor 180J is for detecting temperature.

The touch sensor 180K, also referred to as a "touch device". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is for detecting a touch operation acting thereon or thereabout. The touch sensor may communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to touch operations may be provided through the display 194. In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100 at a different location than the display 194.

The SIM card interface 195 is used to connect a SIM card. The SIM card may be inserted into the SIM card interface 195, or removed from the SIM card interface 195 to enable contact and separation with the electronic device 100. The electronic device 100 may support 1 or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface 195 may support Nano SIM cards, micro SIM cards, and the like. The same SIM card interface 195 may be used to insert multiple cards simultaneously. The types of the plurality of cards may be the same or different. The SIM card interface 195 may also be compatible with different types of SIM cards. The SIM card interface 195 may also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as communication and data communication. In some embodiments, the electronic device 100 employs esims, i.e.: an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100. The software system of the electronic device 100 may employ a layered architecture, an event driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.

To avoid discomfort and damage to the eyes of the user caused by too bright screen in a dark environment (such as a darker, or completely darker environment), the backlight brightness of the electronic device may be adjusted to a lower value in a dark environment. It is possible that the backlight brightness of the electronic device can be adjusted to a lower value by means of an automatic or manual way when the electronic device is in a dim light environment.

In one possible implementation, a three-way application may be installed in the electronic device, such as video software, a camera light-supplementing application, etc., and the backlight brightness of the screen of the electronic device may be automatically adjusted by the installed three-way application.

In another possible implementation, when the electronic device is in a dim light environment, the electronic device may adjust the backlight brightness of the electronic device screen in response to a backlight brightness adjustment instruction issued by the user by performing the backlight brightness adjustment operation.

In still another possible implementation manner, the ambient light sensor in the electronic device may collect ambient light in real time, and the display management service module of the electronic device may map corresponding backlight brightness according to the ambient light, and automatically adjust the backlight brightness of the screen of the electronic device according to the ambient light.

In yet another possible implementation, the backlight brightness of the electronic device screen may be automatically adjusted in conjunction with any two or all of three-way application adjustment, user manual adjustment, ambient light adjustment (i.e., ambient light dimming). In one embodiment, when there is more than one adjustment mode, the adjustment priority may be preset, and the backlight brightness issued to the screen of the electronic device may be determined according to the adjustment priority and the backlight brightness generated by the various adjustment modes.

In one possible implementation, the backlight control may be performed using a backlight control flow as shown in fig. 2. Referring to fig. 2, the electronic device may include an Application (APP) layer 21, an Application Framework (FWK) layer 22, a local service (Native) layer 23, a hardware abstraction (Hal, hardware abstraction layer) layer 24, a kernel (kernel) layer 25, and a hardware (hardware) layer 26.

The three-party application 211 in the application layer 21 may send the generated backlight brightness to the display management service (DMS, display Manager Service) module 223 in the application framework layer 22 through the power management service (PMS, power Manager Service) module 221 and the window management service (WMS, window Manager Service) module 222 in the application framework layer 22 in sequence.

In one embodiment, settingsProvider in application framework layer 22 may be connected to a three-way application 211 and a display management service module 223, respectively. The settingsProvider can store default initial values of android for a process of providing data storage in the android system, and can be used for acquiring values of specified settings.

The backlight brightness setting module 212 in the application layer 21 may be used to set the manual adjustment brightness and transmit the set brightness to the display management service module 223.

The Sensor service (Sensor service) module 224 in the application framework layer 22 can sense the intensity of the ambient light of the environment where the electronic device is located, and send the corresponding backlight intensity mapped according to the intensity to the display management service module 223.

The display management service module 223 may determine the backlight brightness delivered to the screen of the electronic device according to the backlight brightness sent from the three-party application 211, the backlight brightness setting module 212 and the sensor service module 224 in combination with the preset adjustment priority, and send the determined backlight brightness to the backlight control module 231 in the local service layer 23.

Such as a backlight control module 231 in a Surface Flinger service module that may be sent to the local service layer 23. After the brightness values obtained by the three dimming modes are issued to the display management service module 223, the brightness values are issued to the Surface Flinger service module through the display management service module 223. Among them, the Surface Flinger service may be used for UI (User Interface) responsible for drawing an android application.

The backlight control module 231 may send the received backlight brightness to a brightness issuing module 241 in a hardware combined abstraction layer (HWC) module 240 of the hardware abstraction layer 24.

The brightness issuing module 241 may send the received backlight brightness to the display engine driver 251 in the kernel layer 25.

In one embodiment, the display engine driver 251 may be an SDE driver (high-pass display engine driver). Wherein, the complete spelling of the SDE is Snapdragon display engine.

In one possible implementation, the backlight brightness may be issued to a backlight driver (BL driver) in the SDE driver. The full spelling of the BL may be backlight.

The display engine driver 251 may send the received backlight brightness to the liquid crystal display (LCD, liquid Crystal Display) 262 in the hardware layer 26 via the display processing unit (DPU, display Processing Unit) 261 in the hardware layer 26, thereby achieving the purpose of issuing backlight brightness to the electronic device screen.

Referring to fig. 2, the ambient light sensor 263 in the hardware layer 26 can collect the information of the ambient light in real time.

In one embodiment, when the ambient light sensor is off (i.e., senses a change in ambient light), the ambient light illumination (in lux) may be calculated using the noise-scraped RGBC channel value. Where R (red) may represent a red channel, G (green) may represent a green channel, B (blue) may represent a blue channel, and C (clear) may represent transparent light.

The ambient light driver 252 in the kernel layer 25 may report the ambient illuminance to a sensor hardware abstraction layer service (e.g., sensor his/dl service) module 248 on the AP (application process, application processor) side in the hardware abstraction layer 24, and the sensor hardware abstraction layer service module 248 reports the ambient illuminance to the sensor service module 224, and the sensor service module 224 distributes the value of the ambient illuminance to the display management service module 223. The display management service module 223 may derive whether dimming is required according to the change of the ambient light. Wherein the display management service may be a snoop thread. The full spelling of hidl is HAL Interface Definition Language (HAL interface definition language).

In a dark light environment, the backlight brightness of the electronic device can be adjusted to a lower value, but at this time, a user is difficult to see an image with low contrast and dark tone, and the user experience is affected. The image may be a picture or a photo, or may be any frame of picture in a video.

For example, in a usage scenario in which the main current dimming mode is ambient light dimming and a user views a video/picture by using a mobile phone in a dim light environment, the ambient light dimming module of the mobile phone can follow the environment in the dim light environment to adjust the backlight brightness of the mobile phone screen to a lower gear, so that the user is difficult to see the mobile phone picture clearly when viewing the video/picture with lower contrast or darker main tone in full screen, thereby causing poor viewing experience.

In one embodiment of the present application, the backlight control may be performed using a backlight control flow as shown in fig. 3. Referring to fig. 3, in addition to the modules shown in fig. 2, the hardware combination abstraction layer module 240 of the hardware abstraction layer 24 of the electronic device may further include a video scene monitoring module 245 and a brightness detection module 247, and the kernel layer 25 of the electronic device may further include a threshold brightness storage module 253.

In one embodiment, the video scene monitoring module 245 may monitor whether the electronic device is in a full-screen video playing scene (e.g., may be a non-bullet full-screen video playing scene), and if so, wake up the brightness detection module 247. If the electronic device is in a video play scene that is not full-screen playing video, the brightness detection module 247 is not awakened.

In another embodiment, the video scene monitoring module 245 can also monitor whether the electronic device is in a full screen (or large screen) picture display scene, and if so, wake up the brightness detection module 247. If the electronic device is in a picture display scene that is not a full screen display picture, the brightness detection module 247 is not awakened.

The brightness detection module 247 may obtain the backlight brightness issued by the display management service module 223 after being awakened, and obtain the threshold brightness stored in the threshold brightness storage module 253. In one embodiment, the threshold brightness storage module 253 may partition dtbo (Device Tree Blob Overlay, device tree block overlay) in the electronic device.

The threshold brightness stored in the threshold brightness storage module 253 may correspond to the lcd 262 of the electronic device, so that the user can see the picture displayed by the device clearly when the lcd 262 displays the video/picture with lower contrast or darker dominant color at the threshold brightness.

If the issued backlight brightness is lower than the threshold brightness, the brightness detection module 247 may change the issued backlight brightness to the threshold brightness, i.e. issue the threshold brightness to the lcd 262. If the delivered backlight brightness is not lower than the threshold brightness, the brightness detection module 247 may not process the delivered backlight brightness so as not to change the delivered backlight brightness.

When the electronic device is in a full-screen video playing/picture displaying scene, the possibility exists that a user views a video/picture with lower contrast or darker main tone in a full-screen manner in a dim light environment. By the operation, the situation that a user is difficult to see the display picture clearly when watching the video/picture with lower contrast or darker main tone in a full screen under the dark light environment can be avoided, and the user watching experience is good.

Referring to fig. 4, taking an example of optimizing a viewing experience of a user when viewing a video in a full screen in a dark environment, one embodiment of the present application provides a backlight control method, which may include the following steps 401 to 408:

in step 401, when the scene recognition engine monitors that the electronic device enters a video scene, the full-screen video event monitoring is started.

In one possible implementation, the changes in the scene in which the electronic device is located may be monitored in real-time by a scene recognition engine (APS) in the application framework layer of the electronic device.

In one embodiment, the scene recognition engine may be an APS (Adaptive Power Saving, adaptive power saving module, or adaptive power saving module).

In one embodiment, APS may be used to control application frame rate and resolution, and may also be used to identify special scenarios to support performance of corresponding power saving processes.

In one possible implementation manner, the electronic device may be provided with a video application, and when a user issues a play instruction for any video in the video application, the electronic device may start playing a corresponding video, and the scene recognition engine may monitor that the electronic device enters a viewing video scene at this time, so that full-screen video event monitoring may be started. By starting full-screen video event monitoring, whether the electronic equipment plays the video in full screen or not (namely, whether the electronic equipment is in a full-screen playing video scene or not) can be monitored in real time, and a monitoring result is obtained.

Correspondingly, when the electronic device is monitored to exit from watching the video scene, the full-screen video event monitoring can be turned off. In this way, full-screen video event listening may be performed only during the time when the electronic device is in a viewing video scene to enable efficient listening to full-screen video events.

In one embodiment, when the electronic device is monitored to play the video in a full screen manner, the obtained monitoring result may be id=1, and when the electronic device is monitored to not play the video in a full screen manner, the obtained monitoring result may be id=0, so that the moment when the electronic device starts/ends playing the video in a full screen manner can be obtained according to the change of id (Identity document, identification).

In one embodiment, the monitored full-screen video event may specifically be a non-bullet full-screen video event. For example, if the user executes the operation of watching the video in a full screen manner and closing the bullet screen, the non-bullet screen full screen video event can be monitored, and the electronic device is currently in the non-bullet screen full screen video playing scene; if the user executes the operation of watching the video in a full screen mode under the condition that the video software closes the bullet screen by default, the non-bullet screen full screen video event can be monitored, and the electronic equipment is currently in a non-bullet screen full screen video playing scene.

In step 402, the video scene monitoring module determines whether the electronic device starts playing the video in full screen according to the monitoring result, if yes, step 403 is executed, otherwise step 402 is executed (i.e. step 403 is not executed).

In one embodiment, based on the real-time generated listening results, the scene recognition engine may actively send notifications (i.e., send listening results) to the video scene monitoring module. And the video scene monitoring module can determine the moment when the electronic equipment starts/ends full-screen video playing according to the monitoring result.

In other embodiments of the present application, the video scene monitoring module may periodically (e.g., at 5s intervals) poll whether the video decoding process is started, and further determine whether the current scene of the electronic device is a full-screen video playing scene after determining that the video decoding process is started, so as to determine the moment when the electronic device starts to play the video in full screen.

In step 403, the brightness detection module obtains the first brightness (i.e. the backlight brightness currently issued by the display management service module, but not yet issued to the screen of the electronic device) issued by the display management service module of the electronic device.

In one embodiment, the video scene monitoring module may wake up the brightness detection module to pull up the brightness listening when it is determined that the electronic device starts playing the video full screen.

In one embodiment, the brightness detection module may periodically perform step 403 after being awakened.

In one embodiment, the video scene monitoring module may turn off the brightness detection module to turn off the brightness monitoring when it is determined that the electronic device ends full-screen video playing.

In step 404, the luminance detection module determines whether the issued first luminance is less than a threshold luminance corresponding to the screen of the electronic device, if yes, step 405 is executed, otherwise step 407 is executed, so as to issue the first luminance to the screen of the electronic device.

In one embodiment, the luminance detection module may obtain the threshold luminance corresponding to the screen of the electronic device after being awakened for the first time, and directly use the obtained threshold luminance when being awakened for the subsequent time.

If the issued backlight brightness is not less than the threshold brightness, no operation can be performed so as not to change the issued backlight brightness, so that the issued backlight brightness is issued to the screen of the electronic device.

In step 405, the brightness detection module changes the backlight brightness delivered by the display management service module from the first brightness to the threshold brightness, and executes step 406 to deliver the threshold brightness to the screen of the electronic device.

If the issued backlight brightness is smaller than the threshold brightness, the issued backlight brightness can be changed into the threshold brightness, so that the threshold brightness is issued to the screen of the electronic equipment.

In step 406, the brightness issuing module issues the threshold brightness to the screen of the electronic device, and performs step 408.

And under the condition that the brightness detection module changes the backlight brightness issued by the display management service module, the brightness issuing module issues the changed backlight brightness to a screen of the electronic equipment.

In step 407, the luminance distribution module distributes the first luminance distributed by the display management service module to the screen of the electronic device, and executes step 408.

And under the condition that the brightness detection module does not change the backlight brightness issued by the display management service module, the brightness issuing module issues the backlight brightness issued by the display management service module (namely the original backlight brightness) to a screen of the electronic equipment.

In step 408, the scene recognition engine turns off full-screen video event listening when the monitoring electronic device exits viewing the video scene.

In one embodiment, the scene recognition engine in the electronic device may monitor changes in the scene in which the electronic device is located in real-time. In one possible implementation manner, a video application may be installed on the electronic device, and when a user issues a closing instruction for a video played in the video application, the electronic device may end playing a corresponding video, and the scene recognition engine may monitor that the electronic device exits from watching a video scene at this time, so that full-screen video event monitoring may be closed.

In one embodiment, after turning off full-screen video event listening, the video scene monitoring module may turn off the brightness detection module to turn off the brightness listening.

The embodiment shown in fig. 4 changes the backlight brightness according to the threshold brightness when the electronic device is in the full-screen video playing scene, so as to avoid the situation that the backlight brightness sent to the screen of the electronic device is lower than the threshold brightness corresponding to the screen of the electronic device, and thus the situation that the user is difficult to see the display screen clearly when watching the video with lower contrast or darker main tone in full screen in the dim light environment is avoided, and the user watching experience is good.

In another embodiment of the present application, the backlight control flow shown in fig. 5 may also be used for backlight control. Referring to fig. 5, in addition to the modules shown in fig. 2, the application framework layer 22 of the electronic device may further include a scene recognition engine 225, the hardware combination abstraction layer module 240 of the hardware abstraction layer 24 of the electronic device may further include a video scene monitoring module 245, an image detection module 246 and a brightness detection module 247, and the kernel layer 25 of the electronic device may further include a threshold brightness storage module 253.

In one embodiment, the scene recognition engine 225 may send the scene recognition result to the video scene monitoring module 245, and the video scene monitoring module 245 may monitor whether the electronic device is in a full-screen video playing scene (for example, may be a no-bullet screen full-screen video playing scene) according to the received scene recognition result, and if so, wake the image detection module 246. The barrage in the image is usually bright (such as white), and the influence of the barrage in the image on image detection can be removed by defining the image detection module to wake up under the non-barrage full-screen video playing scene, so that the accurate detection of the gray level and brightness of the image is realized.

In another embodiment, the video scene monitoring module 245 may further monitor whether the electronic device is in a full-screen picture display scene according to the received scene recognition result, and if so, wake the image detection module 246.

In one embodiment, if the electronic device is not in a full-screen video play scene or a full-screen picture display scene, the image detection module 246 is not awakened.

It can be seen that the video scene monitoring module 245 can limit the applicable scene for backlight control based on the threshold brightness, for example, the applicable scene can be limited to a full-screen video playing scene without a bullet screen or a full-screen picture displaying scene.

After the image detection module 246 is awakened, the gray level and the brightness of the image displayed on the screen of the electronic device can be calculated, and the calculated gray level and brightness are respectively compared with the corresponding threshold values. The image detection module 246 wakes up the brightness detection module 247 whenever at least one of the calculated gray scale and brightness is less than the corresponding threshold. If neither the calculated gray level nor the calculated brightness is less than the corresponding threshold, the image detection module 246 may not wake up the brightness detection module 247. On-demand wake-up of the brightness detection module 247 by the image detection module 246 can avoid that the brightness detection module 247 always works so that the power consumption is high.

Wherein, brightness can represent the brightness distribution of the picture, and the higher the brightness is, the brighter the picture is.

Wherein the gray scale can use black hues to represent objects, namely black with black as a reference color and black with different saturation levels to display images. The gray value may represent the brightness of a single pixel point, with a larger gray value representing brighter pictures. The larger the average gray level, the brighter the picture color can be represented.

The brightness detection module 247 may obtain the backlight brightness issued by the display management service module 223 after being awakened. The luminance detection module 247 may obtain the threshold luminance stored in the threshold luminance storage module 253 after being awakened for the first time. The threshold brightness stored in the threshold brightness storage module 253 may correspond to the lcd 262 of the electronic device, so that the user can see the displayed picture clearly when the lcd 262 displays the video/picture with lower contrast or darker dominant color at the threshold brightness.

Referring to fig. 2, the display management service module 223 may obtain the backlight brightness issued to the screen of the electronic device according to the dimming result of at least one dimming mode of three-party application adjustment, manual adjustment by the user, and dimming by ambient light.

In one embodiment, taking the example of obtaining the sent backlight brightness according to the adjustment of the three-party application, if the backlight brightness generated by the three-party application in the dark environment is higher, the sent backlight brightness is higher. During full-screen video playing without a bullet screen in a dim light environment, when the electronic device plays a video picture with lower contrast or darker dominant hue, the image detection module 246 may detect that at least one of the gray level and brightness of the current video picture is less than the corresponding threshold, so that the brightness detection module 247 may be awakened. The brightness detection module 247 may detect that the issued backlight brightness is not less than the threshold brightness after being awakened, and may not operate to change the issued backlight brightness, and the higher backlight brightness generated by the three-party application is further issued to the liquid crystal display 262 of the electronic device. Since the liquid crystal display 262 displays a video picture with a low contrast or a dark dominant color at a high backlight luminance issued, the user can see the video picture clearly.

In one embodiment, referring to fig. 5, the hardware combining abstraction layer module 240 may further include an atomic commit interface (atomic_commit) 242, a matting module 243, and a noise processing module 244, so as to perform an existing matting procedure. The atomic submitting interface 242 may notify the (notify) matting module 243, so that the matting module 243 obtains, in real time, an image displayed on a screen of the electronic device, so as to achieve the real-time matting purpose. Possibly, the matting module 243 may also send the obtained image to the noise processing module 244, and the noise processing module 244 may perform noise processing on the received image to obtain a noise-removed image. The noise-removed image may be used in an existing subsequent processing flow associated with the matting flow.

In one possible implementation manner, after the image detection module 246 is awakened, the latest matting result of the matting module 243 (that is, the last matting result of the matting module 243 before the current time) can be obtained, so as to obtain the image currently displayed on the screen of the electronic device, and further calculate the gray level and brightness of the obtained image.

In another possible implementation manner, after the image detection module 246 is awakened, the channel value of each pixel point in the latest matting result provided by the matting module 243 can be obtained, and then the gray level and brightness of the latest matting result are calculated according to the obtained channel value.

When the electronic device is in a full-screen video playing/picture displaying scene, the possibility exists that a user views a video/picture with lower contrast or darker main tone in a full-screen manner in a dark light environment, on one hand, whether the electronic device is in a scene of viewing the video/picture with lower contrast or darker main tone in a full-screen manner is judged through the gray level and brightness of a displayed image compared with the corresponding threshold value, so that the backlight control can be performed based on threshold brightness only when the user views the video/picture with lower contrast or darker main tone in a full-screen manner, and on the other hand, when the electronic device is in a scene of viewing the video/picture with lower contrast or darker main tone in a full-screen manner, the issued backlight brightness is changed according to the threshold brightness as required, so that the backlight brightness issued to the liquid crystal display 262 is prevented from being lower than the threshold brightness. By the operation, the backlight control method and the device not only can realize the on-demand execution of backlight control based on the threshold brightness (namely, the execution is carried out when the device plays the video/picture with lower contrast or darker main tone in a full screen mode, but also is not carried out when the device plays the video/picture with higher contrast or lighter main tone in a full screen mode), but also can avoid the situation that a user is difficult to see the display picture clearly when watching the video/picture with lower contrast or darker main tone in a full screen mode in a dim light environment, so that the user watching experience is good.

Referring to fig. 6, taking an example of optimizing a viewing experience of a user when viewing a video in a full screen in a dark environment, one embodiment of the present application provides another backlight control method, and the method may further include the following steps 601 to 611:

in step 601, when the scene recognition engine monitors that the electronic device enters a video scene, the full-screen video event monitoring is started.

Step 601 is the same as step 401 described above, and the description of this embodiment is omitted here.

In step 602, the video scene monitoring module determines whether the electronic device starts playing the video in full screen according to the monitoring result, if yes, step 603 is executed, otherwise step 602 is executed (i.e. step 603 is not executed).

Step 602 is the same as step 402, and is not described herein.

In step 603, the picture detection module obtains the image displayed on the screen of the electronic device when the screen of the electronic device starts displaying the image in full screen and when the screen of the electronic device is refreshed.

In one embodiment, the image displayed by the electronic device may be a picture, such as a photograph that may be taken and stored by the electronic device. In another embodiment, the image displayed by the electronic device may be any frame of video.

In one embodiment, hwc callback (hardware combining abstraction layer callback function) may be registered, and the screen display image may be reacquired for detection whenever a screen refresh is detected after the screen of the electronic device begins to display the image in full screen. The images displayed before and after the screen refresh may be different, as applicable.

In one embodiment, the video scene monitoring module may wake up the picture detection module to pull up the picture check when it is determined that the electronic device starts playing the video full screen. The picture detection module can perform picture verification when being awakened and when refreshing a screen every time after being awakened. For picture verification, an image currently displayed on the screen may be acquired as a verified picture.

When the electronic equipment starts to play the video in a full screen mode, the brightness detection module is not directly awakened, the picture detection module is awakened first, and the recognition of the scene of the dark picture in the full screen mode is realized through the picture detection module. The picture detection module detects whether the current playing picture is a picture with lower contrast or darker main tone, if yes, the brightness detection module is woken up again, and if the current playing picture is a picture with higher contrast or lighter main tone, the brightness detection module is not woken up, so that the brightness detection module can be woken up effectively as required.

In one embodiment, the video scene monitoring module may close the picture detection module to end the picture verification when it is determined that the electronic device ends playing the video full screen.

In step 604, the picture detection module obtains the gray level and brightness of the obtained image.

In one embodiment, the monitored full-screen video event may be a non-bullet full-screen video event, so that the influence of bullet screen on the image gray level and brightness calculation can be avoided.

In another embodiment, the monitored full-screen video event may not distinguish whether there is a bullet screen, and when acquiring the gray level and brightness of the picture, the gray level and brightness of the non-bullet screen display area in the image is directly acquired no matter whether there is a bullet screen. The bullet screen display area and the non-bullet screen display area of the image may be preset.

In still another embodiment, the monitored full-screen video event may not distinguish whether there is a bullet screen, and detect whether there is a bullet screen when acquiring the gray level and brightness of the picture, if there is no bullet screen, the gray level and brightness of the image may be acquired, and if there is a bullet screen, the gray level and brightness of the non-bullet screen display area in the image may be acquired.

In step 605, the picture detection module determines whether at least one of the gray level of the obtained image is less than the preset gray level threshold and the brightness of the obtained image is less than the preset brightness threshold is satisfied, if yes, step 606 is performed, otherwise step 610 is performed (i.e., step 606 is not performed).

If the calculated gray level is less than the corresponding threshold value and/or the brightness is less than the corresponding threshold value, the obtained image can be considered as the image of the picture with lower contrast or darker dominant hue, and the brightness detection module can be awakened to perform on-demand control of the backlight brightness.

If the calculated gray and brightness are not less than the corresponding threshold, the obtained image can be considered to be the image of the picture with higher contrast or brighter main tone, and the brightness detection module can not be awakened in the case, namely, the on-demand control of the backlight brightness is not performed.

In one implementation, detection of image saturation may be achieved by calculating the brightness of an image, which may be inversely proportional to the saturation of the image. In one implementation, detection of image contrast may be achieved by calculating the gray level of the image, which may be inversely proportional to the contrast of the image.

In step 606, the brightness detection module obtains a first brightness (i.e., the backlight brightness currently issued by the display management service module, but not yet issued to the screen of the electronic device) issued by the display management service module of the electronic device.

In one embodiment, the threshold brightness may be 20.

In one embodiment, if at least one of the calculated gray level and brightness is less than the corresponding threshold, the picture detection module may wake up the brightness detection module, and the brightness detection module may perform step 606 once after being woken up.

In step 607, the luminance detection module determines whether the issued first luminance is less than a threshold luminance corresponding to the screen of the electronic device, if yes, step 608 is executed, otherwise step 610 is executed to issue the first luminance to the screen of the electronic device.

In step 608, the brightness detection module changes the backlight brightness delivered by the display management service module from the first brightness to the threshold brightness, and performs step 609 to deliver the threshold brightness to the screen of the electronic device.

In step 609, the brightness issuing module issues the threshold brightness to the screen of the electronic device, and performs step 611.

In step 610, the luminance distribution module distributes the first luminance distributed by the display management service module to the screen of the electronic device, and performs step 611.

Steps 607 to 610 are the same as steps 404 to 407, and are not described here.

In step 611, the scene recognition engine turns off full-screen video event listening when the monitoring electronic device exits viewing the video scene.

In one embodiment, after turning off full-screen video event listening, the video scene monitoring module may turn off the picture detection module to end picture detection.

The embodiment shown in fig. 6 judges whether the electronic device is in a scene of watching video with lower contrast or darker dominant hue in full screen by comparing the gray level and brightness of the displayed image with the corresponding threshold value during the full screen video playing of the electronic device, so that the backlight control can be performed based on the threshold brightness only when the user watches video with lower contrast or darker dominant hue in full screen, so as to realize the on-demand execution of the backlight control based on the threshold brightness.

In the embodiment shown in fig. 6, when the electronic device is in a scene of watching a video with low contrast or darker dominant color in a full screen manner, the transmitted backlight brightness is changed according to the threshold brightness as required, so as to avoid that the backlight brightness transmitted to the screen of the electronic device is lower than the threshold brightness, so that the situation that the user is difficult to see the display screen clearly when watching the video with low contrast or darker dominant color in a full screen manner in a dim light environment is avoided, and the user watching experience is good.

Referring to fig. 7, an embodiment of the present application provides a timing chart for scene recognition, and the implementation process of scene recognition may include the following steps 701 to 708:

In step 701, the scene recognition engine 225 recognizes whether the electronic device enters a no-bullet full-screen video play scene.

In step 702, the scene recognition engine 225 recognizes that the electronic device enters the non-bullet screen full-screen video playing scene according to the operation of full-screen video playing and bullet screen closing, and sends a notification to the video scene monitoring module 245: id=1.

In one possible implementation, a user may operate a touch screen of an electronic device to perform operations of playing a video full screen and closing a bullet screen.

In step 703, the video scene monitoring module 245 determines whether the id issued by the scene recognition engine 225 is 1.

In step 704, the video scene monitoring module 245 wakes up the image detection module 246 when it determines that the id issued by the scene recognition engine 225 is 1.

When the video scene monitoring module 245 determines that the issued id is 1, it may determine that the electronic device enters a non-bullet screen full-screen video playing scene, so that the image detecting module 246 may be awakened to pull up the picture verification.

In step 705, the scene recognition engine 225 recognizes whether the electronic device exits the no-bullet full-screen video play scene.

In step 706, the scene recognition engine 225 recognizes that the electronic device exits the non-bullet screen full-screen video playing scene according to the operation of exiting the full-screen video playing or opening the bullet screen, and sends a notification to the video scene monitoring module 245: id=0.

In one possible implementation, a user may operate a touch screen of the electronic device to perform operations of exiting full-screen playing of the video and opening the bullet screen.

In step 707, the video scene monitoring module 245 determines whether the id issued by the scene recognition engine 225 is 0.

In step 708, the video scene monitoring module 245 turns off the image detection module 246 when it determines that the id issued by the scene recognition engine 225 is 0.

When the video scene monitoring module 245 determines that the issued id is 0, it may determine that the electronic device exits the non-bullet screen full-screen video playing scene, so that the image detecting module 246 may be turned off to end the picture verification.

In one possible implementation, the code program for implementing scene recognition may include the following:

enum class VIDEO_MODE :int32_t{

ENTER_VIDEO = 1,

EXIT_VIDEO = 0

};

static int videoholding_prepare(VIDEO_MODE cur_mode) {

int res;

switch (cur_mode) {

case VIDEO_MODE:: ENTER_VIDEO:

res = 1;

break;

case VIDEO_MODE:: EXIT_VIDEO:

res = 0;

break;

default:

/* -1: invalid*/

res = -1;

break;

}

return res;

}

referring to fig. 8, an embodiment of the present application provides a timing diagram of a wake-up and end image detection module, and the wake-up and end image detection module may include the following steps 801 to 804:

in step 801, when the video scene monitoring module 245 receives a signal from the scene recognition engine 225 indicating that the electronic device is entering a full-screen video playback scene without a bullet screen, the video hold ready thread (video hold_hold) 2451 sends a first identification to the video hold check thread (video hold_check) 2452.

The video scene monitoring module 245 may include a video hold preparation thread 2451 and a video hold check thread 2452.

In one embodiment, the first identifier may be res=1, for example. res may represent an event.

At step 802, the video hold check thread 2452, upon receiving the first identification, pulls up the video image check thread (video_check) 2461.

The image detection module 246 may include a video image inspection thread 2461, and the video image inspection thread 2461 may be pulled up by the video hold inspection thread 2452 to wake up the image detection module 246.

In step 803, the video hold ready thread 2451 sends a second identification to the video hold check thread 2452 when the video scene monitoring module 245 receives a signal from the scene recognition engine 225 indicating that the electronic device is entering a non-bullet full-screen video play scene.

In one embodiment, the second identifier may be res=0, for example.

At step 804, the video hold inspection thread 2452 ends the video image inspection thread 2461 upon receiving the second identification.

In the embodiment shown in fig. 8, the video scene monitoring module 245 starts a thread video_check when receiving a signal sent by the scene recognition engine 225 and indicating that the electronic device enters a full-screen video playing scene without a bullet screen, so that the purpose of waking up the image detection module 246 can be achieved, and ends the thread video_check when receiving a signal sent by the scene recognition engine 225 and indicating that the electronic device exits the full-screen video playing scene without a bullet screen, so that the purpose of ending the image detection module 246 can be achieved.

In a possible implementation, the code program for implementing the wake-up, end-of-image detection module may include the following:

static int videoholding_thread(int cur_res) {

if(cur_res == 1){

int ret = pthread_create(&mThread, nullptr, videoimage_check , static_cast<void*>(this));

if (ret) {

is_thread_running_ = false;

LOGE("pthread_create failed, return %d", ret);

}

else {

LOGI("Create thread success.");

}

else if (cur_res == 0){

int ret = pthread_cancel(mThread);

if (ret) {

LOGE("pthread_cancel failed, return %d", ret);

}

else {

LOGI("cancel thread success.");

}

else{

LOGI("Error status %d.",cur_res)

}

return ret;

}

in one embodiment of the present application, referring to fig. 5 and 8, the implementation process of the image detection module 246 for image detection may include:

when the video image inspection thread 2461 in the image detection module 246 is started, the latest matting result (for example, the image currently displayed by the electronic device) of the matting module 243 can be obtained, and the brightness and the gray level of the latest matting result are calculated. The calculated brightness and gray scale can be recorded as res array: res [0], res [1]. Wherein res [0] may correspond to brightness, may be used to record calculated brightness, res [1] may correspond to gray scale, may be used to record calculated gray scale.

After obtaining the res array, the res array may be compared with a preset brightness threshold (e.g., denoted as standard_brightness, i.e., brightness standard value), and a gray threshold (e.g., denoted as standard_gray, i.e., gray standard value).

In one embodiment, the standard values of brightness and gray scale (i.e., brightness threshold and gray scale threshold) may be stored in an array in a standard array, where standard [0] represents the standard value of brightness and standard [1] represents the standard value of gray scale.

If any value in the res array is smaller than the corresponding threshold, it may indicate that the image currently displayed by the electronic device is a low-contrast or darker-dominant-color image, so that the brightness detection module 247 may be pulled up. If each value in the res array is not less than the corresponding threshold, it may indicate that the image currently displayed by the electronic device is not an image with low contrast or darker dominant color, so that the brightness detection module 247 may not be pulled up.

In a possible implementation, the code program for implementing image detection may include the following:

input/output method

const float Standard_brightness ;

const float Standard_gray;

static int videoimage_check ( ) {

uint8_t *cur_cwb_buffer=(uint8_t*)builtin_display.output_buffer_bases[index];

auto data = GenerateUint32PixelData(cur_cwb_buffer);

}

In one embodiment of the present application, the implementation for calculating the brightness of an image may be: and respectively acquiring a plurality of channel values (such as RGB three-channel values) of each pixel point in the image, calculating the brightness of each pixel point in the image according to the plurality of channel values of each pixel point in the image, and then calculating a brightness average value according to the brightness of each pixel point in the image, wherein the obtained brightness average value is used as the brightness of the image. Or the brightness of each pixel point in the image can be processed to exclude blank data, and then the brightness average value is calculated to obtain the brightness average value as the brightness of the image.

In image processing, the HSV color space used may be closer to human perception of color than the RGB color space, which may represent hues, vividness, and darkness of colors very intuitively. Where H (Hue) may represent Hue, S (Saturation) may represent Saturation, and V (Value) may represent brightness (or brightness).

In one embodiment, the implementation manner of obtaining the brightness of the pixel point according to the RGB three-channel value of the pixel point may be: according to RGB three-channel values of the pixel points, a preset color space conversion rule or a color space conversion tool is combined, a V value of the pixel points is obtained through conversion, and the V value of the pixel points obtained through conversion is used as the brightness of the obtained pixel points. According to the RGB three-channel values of the pixel points and in combination with a preset conversion rule or conversion tool, HSV values (H values, S values and V values) of the pixel points can be obtained through conversion.

In one embodiment of the present application, the implementation manner for calculating the gray scale of the image may be: and respectively acquiring a plurality of channel values (such as RGB three-channel values) of each pixel point in the image, calculating the gray scale of each pixel point in the image according to the plurality of channel values of each pixel point in the image, and then calculating the gray scale average value according to the gray scale of each pixel point in the image to obtain the gray scale average value as the gray scale of the image.

In one embodiment, a calculation formula for calculating the gray scale of the pixel point according to the RGB three-channel values of the pixel point may be: gray scale=0.2126×r+0.7152×g+0.0722×b. Wherein Gray scale may represent Gray scale, R may represent R channel value, G may represent G channel value, and B may represent B channel value.

In one embodiment of the present application, referring to fig. 5 and 8, the implementation process of waking up and turning off the brightness detection module by the image detection module may include:

the image detection module 246 may compare the brightness and the grayscale of the currently displayed image of the electronic device screen with the corresponding threshold values when the video image inspection thread 2461 is pulled up, and if at least one of the brightness and the grayscale of the currently displayed image of the electronic device screen is less than the corresponding threshold value, pull up the brightness detection thread in the brightness detection module 247 to wake up the brightness detection module 247.

The brightness detection module 247 may perform brightness detection based on the threshold brightness after the brightness detection thread is pulled up, and may block the brightness detection thread after each brightness detection is completed, and wait for the brightness detection to be performed again after the next pull up.

The image detection module 246 may detect the presence of a brightness detection thread when the video image inspection thread 2461 ends, and if so, end the brightness detection thread to turn off the brightness detection module 247.

In a possible implementation manner, the code program for implementing the image detection module to wake up and turn off the brightness detection module may include the following contents:

static int lightcheck_thread(int cur_res) {

if(cur_res == 1){

int ret = pthread_create(&mThread, nullptr, lightcheck , static_cast<void*>(this));

if (ret) {

is_thread_running_ = false;

LOGE("pthread_create failed, return %d", ret);

}

else {

LOGI("Createthread success.");

}

else if (cur_res == 0){

int ret = pthread_cancel(mThread);

if (ret) {

LOGE("pthread_cancel failed, return %d", ret);

}

else {

LOGI("cancel thread success.");

}

else{

LOGI("Error status %d.",cur_res)

}

return ret;

}

in one embodiment of the present application, referring to fig. 5, the implementation process of the brightness detection module for brightness detection may include:

the brightness detection module 247 may obtain the threshold brightness stored in the threshold brightness storage module 253 after being awakened. For example, in one embodiment, qcom, mds-dsi-bl-video-min-level= <20> (indicating a threshold brightness of 20) may be stored, and "qcom, mds-dsi-bl-video-min-level" may indicate a custom identification of the threshold brightness.

In one embodiment, the threshold brightness data stored in threshold brightness storage module 253 may be read by lcd drive.

If the backlight brightness delivered by the display management service module 223 is lower than the threshold brightness, the brightness detection module 247 may change the delivered backlight brightness to the threshold brightness, that is, deliver the threshold brightness to the lcd 262. If the backlight brightness delivered by the display management service module 223 is not lower than the threshold brightness, the brightness detection module 247 may not perform processing so as not to change the delivered backlight brightness.

In one embodiment, a listener may be registered to listen to the setDisplayBrightness function, and obtain the backlight brightness delivered by the display management service module 223 by listening to the setDisplayBrightness function. In one embodiment, referring to fig. 5, the backlight brightness entering the brightness issuing module 241 may be obtained by registering a listener.

When the issued backlight brightness is smaller than the threshold brightness, changing the issued backlight brightness into the threshold brightness so as to realize the purpose of re-issuing the backlight brightness; when the issued backlight brightness is larger than the threshold brightness, no operation is performed, and the backlight brightness is not required to be issued again.

static int dsi_panel_parse_bl_config(struct dsi_panel *panel)

{

int rc = 0;

struct dsi_parser_utils *utils =&panel->utils;

rc = utils->read_u32(utils->data, "qcom,mdss-dsi-bl-video-min-level",&val);

if (rc) {

DSI_DEBUG("[%s]video-bl-min-level unspecified, defaulting to zero\n",

panel->name);

panel->video_bl_config.bl_min_level = 0;

} else {

panel->video_config.bl_min_level = val;

} }

referring to fig. 9, an implementation manner of the test threshold brightness according to an embodiment of the present application may include the following steps 901 to 906:

step 901, placing the test device and camera in a laboratory no light environment.

In one embodiment, the test device and the camera may be automatically placed with respective values preset to the designated positions by an automated placement device. In another embodiment, the test equipment and camera may also be manually placed.

In one embodiment, the device type of the test device may be a cell phone.

In one embodiment, the test camera may be a high speed camera.

Step 902, adjusting the backlight brightness of the test device to the lowest backlight brightness, wherein the test device is in a state of displaying the preset image in a full screen.

The preset image may be a low contrast or a darker dominant color image. When the backlight brightness of the test device is the lowest backlight brightness and the preset image is displayed in a full screen mode, a user cannot see the preset image displayed by the test device clearly.

In one embodiment, the initial setting of the backlight brightness of the test device may be the lowest backlight brightness.

Step 903, a photograph of the camera taken through the screen of the test device is obtained.

After each adjustment of the backlight brightness of the test device, the screen of the test device may be photographed by a camera.

Step 904, determining whether the sharpness of the shot picture meets the expectations, if so, executing step 905, otherwise, executing step 906.

In one embodiment, the automatic identification device can automatically confirm whether the part of the photo related to the display content of the screen of the testing device is clearly visible, if so, the part is expected, otherwise, the part is not expected. For example, the definition of the photo may be calculated and compared with a preset definition threshold to determine whether the definition of the photo meets the expectations.

In another embodiment, it may also be manually confirmed whether the photo content is clearly visible.

In step 905, the current backlight brightness of the test device is recorded as the threshold brightness corresponding to the test device.

For other electronic devices having the same screen configuration (e.g., the same LCD module) as the test device, the threshold brightness corresponding to the other electronic devices may be the threshold brightness corresponding to the test device.

In one embodiment, the devices with different LCD modules may be used as test devices to test the threshold brightness, so as to obtain the threshold brightness corresponding to the devices with various LCD modules. In one possible implementation, the obtained threshold brightness may be saved in dtsi file (device tree source include file, or device header file) of the corresponding LCD module.

Step 906, increasing the backlight brightness of the test device according to the set step, and executing step 903.

In one embodiment, the step size may be 10, so that the backlight brightness after the increase is greater than the backlight brightness before the increase, and the difference between the two is 10.

Referring to fig. 10, an embodiment of the present application provides a backlight control method, which may further include the following steps 1001 to 1002:

in step 1001, under the condition that the screen of the electronic device is in a full-screen display image state, a first luminance issued by a first module of the electronic device (the first luminance is not yet issued to the screen of the electronic device yet) is acquired, and the first module is used for issuing backlight luminance to the screen of the electronic device.

In one embodiment, the first module may be the display management service module 223 shown in FIG. 5.

In one embodiment of the present application, the first luminance is obtained based on at least one of a backlight luminance obtained by a three-party application in the electronic device, a backlight luminance adjustment instruction received by the electronic device, and a backlight luminance corresponding to an ambient illuminance of an environment in which the electronic device is located.

For example, when the electronic device displays an image in a full screen, even if the ambient light is dimmed or the backlight brightness is manually adjusted to the lowest backlight brightness, the backlight brightness actually issued to the screen may be a threshold brightness higher than the lowest backlight brightness, so that the situation that the user is difficult to see the image content when the device displays a low-contrast or dim-light image in a full screen under the lowest backlight brightness can be avoided. And when the electronic equipment exits from the full-screen display image, restoring the lowest backlight brightness.

In one embodiment of the present application, the backlight control method may further include: monitoring whether the electronic equipment is in a full-screen video playing scene; monitoring whether the electronic equipment is in a full-screen picture display scene; the condition that the screen of the electronic device is in a full-screen display image state comprises the following steps: the electronic device is in either one of a full-screen video playing scene and a full-screen picture displaying scene.

If the electronic equipment is in a video playing scene of non-full-screen playing video, the screen of the electronic equipment is not in a full-screen image displaying state. If the electronic device is in a picture display scene (for example, a scene of displaying a picture thumbnail after the electronic device opens a gallery application) of a non-full-screen display picture, the screen of the electronic device is not in a full-screen display image state.

In one embodiment, after determining that the electronic device enters a video playback scene (e.g., opens a video application), it may be monitored whether the electronic device is in a full-screen video playback scene. Therefore, the on-demand accurate monitoring of the full-screen video playing scene can be realized.

In one embodiment, after determining that the electronic device enters a picture display scene (e.g., opening a gallery application), it may be monitored whether the electronic device is in a full screen picture display scene. Therefore, the on-demand accurate monitoring of the full-screen picture display scene can be realized.

In step 1002, when the first luminance is less than a preset threshold luminance corresponding to a screen of the electronic device, a first operation is performed such that the backlight luminance issued to the screen of the electronic device is the threshold luminance.

The first operation may be an operation of changing the first brightness to a threshold brightness to control the brightness of the backlight delivered to the screen of the electronic device. In one embodiment, the first operation may be a backlight brightness changing operation of changing the first brightness sent by the display management service module to the brightness sending module to the threshold brightness, so that the brightness sending module sends the changed backlight brightness, that is, the threshold brightness, to the screen of the electronic device.

In one embodiment, when the first luminance is not less than the threshold luminance, the current process may be ended so as not to control the backlight luminance of the first module sent to the screen of the electronic device, so that the backlight luminance of the first module sent to the screen of the electronic device is the first luminance. That is, under the condition that the backlight brightness issued by the first module is changed, the changed backlight brightness is issued to the screen of the electronic device, and under the condition that the backlight brightness issued by the first module is not changed, the backlight brightness issued by the first module is issued to the screen of the electronic device.

In one embodiment of the application, the threshold brightness is a minimum backlight brightness of the test device that allows the sharpness of the first image to meet expectations; wherein the screen of the test device and the screen of the electronic device have the same type of construction (e.g., have the same type of LCD module); the first image is a part corresponding to the preset image in the image obtained by the camera shooting the screen of the test equipment under the condition that the test equipment and the camera are in the same dark environment and the preset image is displayed on the screen of the test equipment in a full screen mode.

Based on the implementation of the embodiment shown in fig. 10, the electronic device can intelligently increase the backlight brightness when the video/picture with low contrast or dark main tone is displayed in a full screen manner in a dark light environment, so as to optimize the issuing of the backlight brightness when the video/picture is displayed in the full screen manner in the dark light environment of the electronic device, ensure that the backlight brightness is kept optimal when the video is watched in the full screen manner in the dark light scene, and thus improve the experience of watching the video/picture in the full screen manner in the dark light scene of a user.

In one embodiment of the present application, in a case where the screen of the electronic device is in a full-screen display image state, the backlight control method may further include: acquiring an image displayed on a screen of the electronic equipment; acquiring the gray level and brightness of the obtained image; and executing the step of acquiring the first brightness issued by the first module of the electronic equipment under the condition that at least one of the gray level of the obtained image is smaller than a preset gray level threshold value and the brightness of the obtained image is smaller than a preset brightness threshold value.

In one embodiment, the image detection can be performed in a dark video scene to optimize the backlight brightness, so that the user experience can be greatly improved on the use experience of the user, and the power consumption of the image detection module can be reduced.

In one embodiment, the gray level of the image may be obtained, if the gray level of the image is less than the preset gray level threshold, the step of obtaining the first brightness is performed, otherwise the step of obtaining the first brightness is not performed.

In another embodiment, the brightness of the image may be obtained, if the brightness of the image is less than a preset brightness threshold, the step of obtaining the first brightness is performed, otherwise the step of obtaining the first brightness is not performed.

In still another embodiment, the step of obtaining the first luminance may be performed if either or both of the gray level of the image is less than a preset gray level threshold and the brightness of the image is less than a preset brightness threshold, and the step of obtaining the first luminance may not be performed if both of the gray level of the image is less than the preset gray level threshold and the brightness of the image is less than the preset brightness threshold.

In one embodiment of the present application, in a case where the screen of the electronic device is in a full-screen display image state, the method further includes: executing a step of acquiring an image displayed on a screen of the electronic device when the screen of the electronic device starts displaying the image in a full screen; when the screen of the electronic device is refreshed, a step of acquiring an image displayed on the screen of the electronic device is performed.

In one embodiment of the present application, the preset gray threshold is obtained according to the gray level of at least one preset image, and the preset brightness threshold is obtained according to the brightness of at least one preset image; wherein the step for acquiring the image gray level includes: acquiring gray values of all pixel points in the image according to the multiple channel values of all pixel points in the image, and acquiring gray of the image according to the gray values of all pixel points in the image; the step for acquiring the brightness of the image comprises: according to the channel values of each pixel point in the image, the brightness of each pixel point in the image is obtained through color space conversion processing, and according to the brightness of each pixel point in the image, the brightness of the image is obtained.

In one embodiment, the brightness of the preset image may be lower than the required brightness (e.g., < 35, < 40, etc.), the gray level of the preset image may be lower than the required gray level (e.g., < 25, < 30, etc.), so that the preset image is a low contrast or dark image.

In one embodiment, the preset image may be a low contrast, low saturation picture.

Under the condition that picture detection is firstly carried out and backlight brightness control is carried out according to picture detection results as required, in one embodiment of the application, monitoring whether the electronic equipment is in a full-screen video playing scene comprises the following steps: monitoring whether the electronic equipment is in a bullet screen-free full-screen video playing scene; the situation that the electronic device is in a full-screen video playing scene comprises the following steps: the electronic equipment is in the condition of no-bullet screen full-screen video playing scene.

In one embodiment, if the electronic device is in a bullet screen full-screen video playing scene, the screen of the electronic device is not in a full-screen image display state; if the electronic equipment is in a video playing scene without a bullet screen and without full screen playing, the screen of the electronic equipment is not in a full screen image displaying state.

In one embodiment, if the electronic device is in a live full-screen video playing scene, the step of acquiring the image displayed on the screen of the electronic device is not performed. In another embodiment, if the electronic device is in the live full-screen video playing scene, the step of obtaining the first brightness issued by the first module of the electronic device is not performed.

An embodiment of the present application also provides a backlight control apparatus, including: the acquisition module is used for acquiring first brightness issued by the first module of the electronic equipment when the screen of the electronic equipment is in a full-screen display image state, and the first module is used for issuing backlight brightness to the screen of the electronic equipment; and the control module is used for executing a first operation to enable the backlight brightness sent to the screen of the electronic equipment to be the threshold brightness under the condition that the first brightness is smaller than the preset threshold brightness corresponding to the screen of the electronic equipment.

One embodiment of the present application also provides an electronic chip mounted in an electronic device (UE), the electronic chip including: a processor for executing computer program instructions stored on a memory, wherein the computer program instructions, when executed by the processor, trigger an electronic chip to perform the method steps provided by any of the method embodiments of the present application.

An embodiment of the present application further proposes a terminal device, which includes a communication module, a memory for storing computer program instructions and a processor for executing the program instructions, wherein the computer program instructions, when executed by the processor, trigger the terminal device to execute the method steps provided by any of the method embodiments of the present application.

An embodiment of the application also proposes a server device comprising a communication module, a memory for storing computer program instructions and a processor for executing the program instructions, wherein the computer program instructions, when executed by the processor, trigger the server device to perform the method steps provided by any of the method embodiments of the application.

An embodiment of the present application also provides an electronic device comprising a plurality of antennas, a memory for storing computer program instructions, a processor for executing the computer program instructions and communication means, such as a communication module enabling 5G communication based on the NR protocol, wherein the computer program instructions, when executed by the processor, trigger the electronic device to perform the method steps provided by any of the method embodiments of the present application.

In particular, in one embodiment of the present application, one or more computer programs are stored in the memory, the one or more computer programs comprising instructions which, when executed by the apparatus, cause the apparatus to perform the method steps described in the embodiments of the present application.

Specifically, in an embodiment of the present application, the processor of the electronic device may be a System On Chip (SOC), and the processor may include a central processing unit (Central Processing Unit, CPU) and may further include other types of processors. Specifically, in an embodiment of the present application, the processor of the electronic device may be a PWM control chip.

In particular, in an embodiment of the present application, the processor may include, for example, a CPU, DSP (digital signal processor ) or microcontroller, GPU (graphics processing unit, graphics processor), embedded Neural network processor (Neural-network Process Units, NPU) and image signal processor (Image Signal Processing, ISP), and the processor may further include necessary hardware accelerator or logic processing hardware circuit, such as ASIC, or one or more integrated circuits for controlling the execution of the program according to the present application. Further, the processor may have a function of operating one or more software programs, which may be stored in a storage medium.

In particular, in one embodiment of the application, the memory of the electronic device may be a read-only memory (ROM), other type of static storage device that can store static information and instructions, a random access memory (random access memory, RAM) or other type of dynamic storage device that can store information and instructions, an electrically erasable programmable read-only memory (electrically erasable programmable read-only memory, EEPROM), a compact disc read-only memory (compact disc read-only memory, CD-ROM) or other optical disc storage, optical disc storage (including compact disc, laser disc, optical disc, digital versatile disc, blu-ray disc, etc.), magnetic disk storage media or other magnetic storage devices, or any computer readable medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer.

In particular, in an embodiment of the present application, the processor and the memory may be combined into a processing device, more commonly separate components, and the processor is configured to execute the program code stored in the memory to implement the method according to the embodiment of the present application. In particular, the memory may also be integrated into the processor or may be separate from the processor.

Further, the devices, apparatuses, modules illustrated in the embodiments of the present application may be implemented by a computer chip or entity, or by a product having a certain function.

It will be apparent to those skilled in the art that embodiments of the present application may be provided as a method, apparatus, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media having computer-usable program code embodied therein.

In several embodiments provided by the present application, any of the functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present application.

In particular, in one embodiment of the present application, there is also provided a computer-readable storage medium having a computer program stored therein, which when run on a computer, causes the computer to perform the method steps provided by the embodiments of the present application.

An embodiment of the application also provides a computer program product comprising a computer program which, when run on a computer, causes the computer to perform the method steps provided by the embodiments of the application.

The description of embodiments of the present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (means) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In the several embodiments provided by the present application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the elements is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple elements or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices, or units, which may be in electrical, mechanical, or other forms.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in hardware plus software functional units.

The integrated units, implemented in the form of software functional units, may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium, and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a Processor (Processor) to perform part of the steps of the methods according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

In embodiments of the present application, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises the element.

The application may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The application may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.

The embodiments of the present application are described in a progressive manner, and the same and similar parts of the embodiments are all referred to each other, and each embodiment is mainly described in the differences from the other embodiments. In particular, for the device embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments in part.

Those of ordinary skill in the art will appreciate that the various elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as a combination of electronic hardware, computer software, and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.

The foregoing description of the preferred embodiments of the application is not intended to be limiting, but rather to enable any modification, equivalent replacement, improvement or the like to be made within the spirit and principles of the application.

Claims

1. A backlight control method, comprising:

acquiring first brightness issued by a first module of electronic equipment under the condition that a screen of the electronic equipment is in a full-screen display image state, wherein the first module is used for issuing backlight brightness to the screen of the electronic equipment;

executing a first operation to enable the backlight brightness sent to the screen of the electronic equipment to be the threshold brightness under the condition that the first brightness is smaller than the preset threshold brightness corresponding to the screen of the electronic equipment;

in the case where the screen of the electronic device is in a full screen display image state, the method further includes:

acquiring an image displayed on a screen of the electronic equipment;

acquiring the gray level of the obtained image, and executing the step of acquiring the first brightness issued by the first module of the electronic equipment if the gray level of the obtained image is smaller than a preset gray level threshold; or,

Acquiring the brightness of the obtained image, and executing the step of acquiring the first brightness issued by the first module of the electronic equipment if the brightness of the obtained image is smaller than a preset brightness threshold; or,

and acquiring the gray level and the brightness of the obtained image, and executing the step of acquiring the first brightness issued by the first module of the electronic equipment under the condition that at least one of the gray level of the obtained image is smaller than a preset gray level threshold value and the brightness of the obtained image is smaller than a preset brightness threshold value.

2. The method of claim 1, wherein in the case where the screen of the electronic device is in a full screen display image state, the method further comprises:

executing the step of acquiring the image displayed on the screen of the electronic equipment when the screen of the electronic equipment starts to display the image in a full screen mode;

and executing the step of acquiring the image displayed on the screen of the electronic equipment when the screen of the electronic equipment is refreshed.

3. The method according to claim 1, wherein the preset gray threshold is derived from the gray level of at least one preset image, and the preset brightness threshold is derived from the brightness of the at least one preset image;

Wherein the step for acquiring the image gray level includes: acquiring gray values of all pixel points in the image according to the multiple channel values of all pixel points in the image, and acquiring gray of the image according to the gray values of all pixel points in the image;

the step for acquiring the brightness of the image comprises: according to the channel values of each pixel point in the image, the brightness of each pixel point in the image is obtained through color space conversion processing, and according to the brightness of each pixel point in the image, the brightness of the image is obtained.

4. A method according to any one of claims 1-3, characterized in that the method further comprises:

monitoring whether the electronic equipment is in a full-screen video playing scene;

monitoring whether the electronic equipment is in a full-screen picture display scene;

the condition that the screen of the electronic equipment is in a full-screen display image state comprises the following steps: and the electronic equipment is in a full-screen video playing scene and any scene in a full-screen picture displaying scene.

5. The method of claim 4, wherein the monitoring whether the electronic device is in a full-screen video playback scenario comprises:

Monitoring whether the electronic equipment is in a bullet screen-free full-screen video playing scene or not;

the situation that the electronic equipment is in a full-screen video playing scene comprises the following steps: the electronic equipment is in the condition of no bullet screen full screen video playing scene.

6. A method according to any of claims 1-3, wherein the threshold brightness is a minimum backlight brightness of the test device such that the sharpness of the first image corresponds to an expected;

wherein the screen of the test device and the screen of the electronic device have the same structure;

the first image is a part corresponding to a preset image in an image obtained by shooting the screen of the test equipment by the camera under the condition that the test equipment and the camera are in the same dark environment and the preset image is displayed on the screen of the test equipment in a full screen mode.

7. The method of any of claims 1-3, wherein the first brightness is derived based on at least one of a backlight brightness derived from a three-party application in the electronic device, a backlight brightness adjustment instruction received by the electronic device, and a backlight brightness corresponding to an ambient illuminance of an environment in which the electronic device is located.

8. A backlight control apparatus, comprising:

the electronic equipment comprises an acquisition module, a first display module and a second display module, wherein the acquisition module is used for acquiring first brightness issued by the first module of the electronic equipment when a screen of the electronic equipment is in a full-screen display image state, and the first module is used for issuing backlight brightness to the screen of the electronic equipment;

the control module is used for executing a first operation to enable the backlight brightness sent to the screen of the electronic equipment to be the threshold brightness under the condition that the first brightness is smaller than the preset threshold brightness corresponding to the screen of the electronic equipment;

the backlight control device obtains an image displayed on the screen of the electronic equipment under the condition that the screen of the electronic equipment is in a full-screen display image state;

9. An electronic chip, comprising:

a processor for executing computer program instructions stored on a memory, wherein the computer program instructions, when executed by the processor, trigger the electronic chip to perform the method of any of claims 1-7.

10. An electronic device comprising a memory for storing computer program instructions, a processor for executing the computer program instructions, and communication means, wherein the computer program instructions, when executed by the processor, trigger the electronic device to perform the method of any of claims 1-7.

11. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program which, when run on a computer, causes the computer to perform the method according to any of claims 1-7.