WO2018161586A1

WO2018161586A1 - Method and apparatus for recognizing display scenario of mobile terminal, storage medium, and electronic device

Info

Publication number: WO2018161586A1
Application number: PCT/CN2017/106942
Authority: WO
Inventors: 彭德良; 苟生俊; 易永鹏; 袁晓日; 甘高亭; 郑志勇; 杨海
Original assignee: 广东欧珀移动通信有限公司
Priority date: 2017-03-10
Filing date: 2017-10-19
Publication date: 2018-09-13
Also published as: CN106874017A; CN106874017B

Abstract

A method and apparatus for recognizing a display scenario of a mobile terminal, a storage medium, an electronic device. The method comprises: obtaining a process identifier of an application running in a mobile terminal (101); obtaining layer attributes of each layer in a layer set drawn by the application (102); and recognizing a display scenario of the mobile terminal according to the process identifier and the layer attributes (103). According to the method, a display scenario of a mobile terminal can be accurately recognized according to a process identifier of a run application and layer attributes.

Description

Display scene recognition method, device, storage medium and electronic device of mobile terminal

This application claims the priority of the Chinese patent application filed on March 10, 2017, the Chinese Patent Office, the application number is 201710142061.5, and the invention name is "a display scene identification method, device and mobile terminal for a mobile terminal". This is incorporated herein by reference.

Technical field

Embodiments of the present invention relate to the field of display technologies, and in particular, to a display scene identification method, apparatus, storage medium, and electronic device for a mobile terminal.

Background technique

At present, the display screen size of the mobile terminal is getting larger and larger, the loaded application and the functions that can be implemented are more and more abundant, and the user spends a lot of time every day to use the mobile terminal, so the display efficiency and consumption of the mobile terminal are Electrical conditions have become an important indicator to consider the performance of mobile terminals.

The content displayed by the mobile terminal during the running process is ever-changing, and there are many corresponding display scenes.

technical problem

The embodiment of the invention provides a display scene recognition method and device for a mobile terminal, a storage medium and an electronic device, which can identify a display scene of the mobile terminal.

Technical solution

In a first aspect, an embodiment of the present invention provides a display scene identification method for a mobile terminal, including:

Obtaining a process identifier of an application running in the mobile terminal;

Obtaining layer properties of each layer in the layer set drawn by the application;

And identifying a display scenario of the mobile terminal according to the process identifier and the layer attribute.

In a second aspect, an embodiment of the present invention provides a display scene recognition apparatus for a mobile terminal, including:

a process identifier obtaining module, configured to acquire a process identifier of an application running in the mobile terminal;

a layer attribute obtaining module, configured to acquire a layer attribute of each layer in the layer set drawn by the application;

And displaying a scene recognition module, configured to identify a display scenario of the mobile terminal according to the process identifier and the layer attribute.

In a third aspect, an embodiment of the present invention provides a storage medium on which a computer program is stored, and when the computer program is executed on a computer, the computer is configured to perform a display scene identification method of the mobile terminal provided by the embodiment of the present invention. .

In a fourth aspect, an embodiment of the present invention provides an electronic device, including a memory, and a processor, by using a computer program stored in the memory, to perform steps:

Obtaining the process ID of the application running in the electronic device;

And identifying a display scenario of the electronic device according to the process identifier and the layer attribute.

Beneficial effect

DRAWINGS

FIG. 1 is a first schematic flowchart of a method for identifying a display scene of a mobile terminal according to an embodiment of the present disclosure;

2 is a second schematic flowchart of a method for identifying a display scene of a mobile terminal according to an embodiment of the present disclosure;

FIG. 3 is a schematic diagram of a display process according to an embodiment of the present invention; FIG.

4 is a schematic diagram of a Vsync display refresh mechanism according to an embodiment of the present invention;

FIG. 5 is a third schematic flowchart of a method for identifying a display scene of a mobile terminal according to an embodiment of the present disclosure;

FIG. 6 is a structural block diagram of a display scene recognition apparatus for a mobile terminal according to an embodiment of the present invention;

FIG. 7 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention.

FIG. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

FIG. 9 is another schematic structural diagram of an electronic device according to an embodiment of the present invention.

BEST MODE FOR CARRYING OUT THE INVENTION

The technical solution of the present invention will be further described below with reference to the accompanying drawings and specific embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. It should also be noted that, for ease of description, only some, but not all, of the structures related to the present invention are shown in the drawings.

Before discussing the exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as a process or method depicted as a flowchart. Although the flowcharts describe the various steps as a sequential process, many of the steps can be implemented in parallel, concurrently, or concurrently. In addition, the order of the steps can be rearranged. The process may be terminated when its operation is completed, but may also have additional steps not included in the figures. The processing may correspond to methods, functions, procedures, subroutines, subroutines, and the like.

In the actual application process, the content displayed by the mobile terminal during the running process is ever-changing, and there are many corresponding display scenarios. In order to facilitate the improvement of the mobile terminal, the display scene needs to be identified.

The embodiment of the invention provides a display scene recognition method for a mobile terminal, which includes the following steps:

In an embodiment, the method for identifying a display scene of the mobile terminal provided by the embodiment of the present invention may further include the following steps: acquiring touch data;

Then, the identifying the display scenario of the mobile terminal according to the process identifier and the layer attribute may include: identifying a display scenario of the mobile terminal according to the process identifier, the layer attribute, and the touch data.

In an embodiment, the method for identifying a display scene of the mobile terminal provided by the embodiment of the present invention may further include the following steps: acquiring sensing data by using a preset type of sensor;

Then, the identifying the display scenario of the mobile terminal according to the process identifier, the layer attribute, and the touch data may include: determining, according to the process identifier, the layer attribute, the touch data, and the The sense data identifies the display scene of the mobile terminal.

In an embodiment, the layer attribute may include whether the cached data is empty, a horizontal or vertical screen mode, an attribute of a visible area, an attribute of a transparent area, whether an update area exists, an attribute of an update area, and image information. At least one of them.

In an embodiment, the attribute of the visible area may include at least one of: whether the visible area is empty, the number, shape, size, and location of the visible area;

The attribute of the transparent area may include at least one of the following: the number, shape, size, position of the transparent area, and the relative position of the visible area of the other layer;

The attribute of the update area may include at least one of the following: the number, location, shape, size, and ratio of area to screen area of the update area;

The image information may include at least one of the following: whether the image is at least one of a solid color, a gradation, a grayscale, a hue, a contrast, a brightness, a saturation, a transparency, and a blur.

In an embodiment, after the step of identifying the display scenario of the mobile terminal according to the process identifier, the layer attribute, the touch data, and the sensing data, the method may further include the following steps: The display scene determines at least one of a corresponding target drawing frame rate, a target composite frame rate, a target refresh rate, a target display brightness, and a target resolution; and the frame rate, the target composite frame rate, and the target refresh rate are drawn according to the determined target. At least one of the target display brightness and the target resolution performs at least one of a corresponding layer drawing, a layer composition, a display picture refresh, and a display brightness adjustment.

In an embodiment, after the step of acquiring the touch data, the method further includes the following steps: performing statistical analysis on the touch data, and determining a corresponding touch event according to the statistical analysis result, where the touch data includes at least a touch Position, touch area, and touch duration, the touch event includes at least no event, a click event, a leaving event, a slow sliding event, and a fast sliding event;

Then, the identifying the display scenario of the mobile terminal according to the process identifier, the layer attribute, and the touch data may include: identifying, according to the process identifier, the layer attribute, and the touch event, the mobile terminal Show the scene.

FIG. 1 is a first schematic flowchart of a method for identifying a display scene of a mobile terminal according to an embodiment of the present invention. The method can be performed by a display scene recognition device of the mobile terminal, wherein the device can be implemented by software and/or hardware, and can generally be integrated in the mobile terminal. As shown in Figure 1, the method includes:

Step 101: Obtain a process identifier of an application running in the mobile terminal.

In some embodiments, the mobile terminal in the embodiment of the present invention may be a device including a display screen such as a mobile phone, a smart watch, a tablet computer, a game machine, a personal digital assistant, and a digital multimedia player.

The embodiment of the present invention does not limit the operating system loaded in the mobile terminal, and may be an Android (Android) system or a mobile phone window (Windows). Phone, WP) operating system, Linux and IOS systems, etc. In some embodiments, for ease of explanation, embodiments of the present invention are described in the following with a common Android system.

Many applications (APPs) are usually loaded in mobile terminals, and running applications, especially those running in the foreground, are important factors for distinguishing display scenarios. You can use the name of the application or the name of the package to identify the display scene, but there are some problems with this. Take the Android system as an example. Although each application has a unique package name as the identifier, it cannot reflect the specific display scene, and the recognition result is not accurate enough. Because an application often needs to implement multiple functions, the implementation of these functions may be independent of each other. For example, WeChat has multiple functions such as chat, photo album, video call and public number, each function can be regarded as an independent function. The application is implemented, so different functions should correspond to different display scenarios. If the currently running application is only identified by the package name, the specific display scenario cannot be accurately determined. The package name is a concept in the Android system. Other operating systems may not have this concept, but if you use the same concept as the package name, such as the name of the application, the same problem will exist.

In some embodiments, a function in the application may be implemented by one or more processes, and the process identifier (such as the process name) can identify which function the application is currently implementing, that is, can identify This function corresponds to the display scene. Therefore, in this step, the process identifier of the application running in the mobile terminal is obtained, and is used for subsequent display scene identification.

Step 102: Acquire a layer attribute of each layer in the layer set drawn by the application.

In some embodiments, the layer attributes include a layer identifier (such as a layer name or number), whether the cached data is empty, a horizontal or vertical screen mode, an attribute of the visible area, an attribute of the transparent area, whether an update area exists, Update at least one of the attributes of the area and the image information.

In some embodiments, for a layer, its corresponding cache data is stored in its corresponding cache area. If the cache data is all 0s, it means that the cache data is empty. In this case, the layer can be understood as one. Blank layer. For a layer with the same name or number, the application draws at a certain drawing frame rate. For the current layer received, the current layer and the previously drawn layer (the layer received within the preset duration) A comparison is made (for example, whether the gray value corresponding to each coordinate position is changed) to determine whether the current layer has an update area. The specific value of the preset duration is not limited in the embodiment of the present invention.

In some embodiments, the attribute of the visible area includes at least one of the following: whether the visible area is empty (after the application draws a layer, the corresponding cached data of the layer includes the visible area in the layer) Coordinate information, generally the visible area is a rectangle. When the coordinates of the four vertices of the rectangle are the same, the visible area is considered to be empty, the number, shape, size and position of the visible area; the attributes of the transparent area include At least one of the following: the number, shape, size, location, and relative position of the transparent area relative to the visible area of the other layer; the attributes of the updated area include at least one of the following: the number, location, shape, size, and size of the updated area The ratio of the area to the screen area; the image information includes at least one of the following: whether the image is a solid color (including color data is all 0), color gradation, grayscale, hue, contrast, brightness, saturation, transparency, and blur. At least one of them.

A variety of layer attributes are listed above, and when used to identify a display scene, it can be used to identify a display scene according to any one or more of them. Of course, there are other layer properties that can be combined with the items listed above.

Step 103: Identify a display scenario of the mobile terminal according to the process identifier and the layer attribute.

In some embodiments, when multiple layer attributes need to be acquired, the corresponding layer scene category may be determined according to the set of layer attributes, and then the display scene of the mobile terminal is identified according to the process identifier and the layer scene category.

In some embodiments, different process identifiers and different layer scene categories may be arranged and combined in advance to obtain different scene description sets, and corresponding relationship between different scene description items and different display scenes is established in advance, and preset scene correspondings are obtained. relationship. In this step, the current scene description item is determined according to the process identifier and the layer scene type, and the preset scene correspondence relationship is queried according to the current scene description item, thereby obtaining the current display scene of the mobile terminal, so as to achieve the purpose of identifying the display scene of the mobile terminal.

In some embodiments, the application is a video playback application, which generally includes three layers: a layer for displaying video content, which can be defined as U1; two layers of SurfaceView type, and one for displaying a barrage Content can be defined as U2 and the other is used to display the user interface (User Interface, UI) controls (such as playback progress bar, volume control bar, and various control buttons) and advertisements can be defined as U3. The layer identifiers are U1, U2, and U3 described above. When the layer set includes U1 and U2, it corresponds to the first layer scene, and when the layer set includes U1 and U3, it corresponds to the second layer scene. In some embodiments, in order to determine the layer scene more accurately, more layer attributes may be introduced, such as U1 and U3 in the layer set, and only a single rectangular update area in U3, corresponding to the third Layer scene.

The display scene identification scheme of the mobile terminal provided by the embodiment of the present invention acquires the process identifier of the application running in the mobile terminal, and acquires the layer attribute of each layer in the layer set drawn by the application, according to the process identifier and the layer. The attribute identifies the display scene of the mobile terminal. By adopting the above technical solution, the display scenario of the mobile terminal can be accurately identified according to the process identifier and the layer attribute of the application running by the mobile terminal.

On the basis of the foregoing technical solutions, the display scene recognition method of the mobile terminal provided by the embodiment of the present invention may further include: acquiring touch data. Correspondingly, the identifying the display scenario of the mobile terminal according to the process identifier and the layer attribute may include: identifying a display scenario of the mobile terminal according to the process identifier, the layer attribute, and the touch data.

In some embodiments, the touch data may include data such as a touch location, a touch area, and a touch duration. In an embodiment, the touch data may be statistically analyzed, the corresponding touch event is determined according to the statistical analysis result, and the display scene of the mobile terminal is identified according to the process identifier, the layer attribute, and the touch event. For example, the touch event may include no event (eg, no touch screen is detected to be touched within a preset time period), a click event, a leaving event (eg, from a touch to a release touch), a slow sliding event, a fast sliding event, and the like.

In an embodiment, after the step of acquiring the touch data, the method further includes the following steps:

Performing statistical analysis on the touch data, and determining a corresponding touch event according to the statistical analysis result, the touch data includes at least a touch position, a touch area, and a touch duration, and the touch event includes at least an eventless, a click event, a leaving event, and a slow sliding event. And fast sliding events;

Then, the step of identifying the display scene of the mobile terminal according to the process identifier, the layer attribute, and the touch data may include: identifying a display scene of the mobile terminal according to the process identifier, the layer attribute, and the touch event.

The recognition of the display scene is performed according to three factors: process identification, layer attributes, and touch data, which can further improve the accuracy of display scene recognition.

On the basis of the foregoing technical solutions, the display scene recognition method of the mobile terminal provided by the embodiment of the present invention may further include: acquiring the sensing data by using a preset type of sensor. Correspondingly, the identifying a display scenario of the mobile terminal according to the process identifier, the layer attribute, and the touch data, including: according to the process identifier, the layer attribute, the touch data, and the The sense data identifies the display scene of the mobile terminal.

In some embodiments, the preset type of sensor includes: a distance sensor, a light sensor, a magnetic field sensor, a weight sensor, an acceleration sensor, a direction sensor, a gyro sensor, a rotation vector sensor, a barometric pressure sensor, a temperature sensor, and a humidity sensor. At least one of them. In some embodiments, the preset type of sensor comprises at least two of the above sensors. The specific sensor type may be determined according to the type of the sensor integrated by the mobile terminal, and the number of the same type of sensor is not limited in the embodiment of the present invention.

In some embodiments, it is possible to detect which sensors are currently in operation, from which some or all of the sensors can be selected for acquiring sensory data through the selected sensors. The selection strategy of the sensor may be preset, or may be determined according to a preset correspondence between the sensor and the application, and the running application is used to query the preset correspondence to obtain a corresponding sensor type.

In some embodiments, the acquired sensing data may be the sensing data of the current time, or may be the sensing data in the preset time period before the current time, which is not limited in the embodiment of the present invention.

In some embodiments, the sensor data may be statistically analyzed, the corresponding sensor event is determined according to the statistical analysis result, and the display scene of the mobile terminal is identified according to the process identifier, the layer attribute, the touch time, and the sensor event. In some embodiments, taking the acceleration sensor as an example, statistical analysis of the sensing data corresponding to the acceleration sensor can be performed to obtain that the mobile terminal is currently in a stationary state (first sensor event) and a slow forward state (second sensor event). Still a fast forward state (a third sensor event. Assuming that the determined sensor event is a second sensor event, the second sensor event is combined with the currently acquired process identifier, layer attributes, and touch events to obtain a current scene description item, Further, the display scene of the mobile terminal is identified.

It should be noted that, in the embodiment of the present invention, the process name, the sensing data, the touch data, and the layer attribute may be used as the identification elements of the display scene, and the order of obtaining the elements is not limited in the embodiment of the present invention, and the types of the elements are identified. The more the displayed display scene, the more accurate it is.

On the basis of the foregoing technical solution, a whitelist may be pre-established. When part or all of the acquired identification elements or the designated identification elements are in the preset whitelist, the display scene is identified. Otherwise, the display scene is not required to be identified. In some embodiments, the “displaying the display scenario of the mobile terminal according to the process identifier and the layer attribute” may be: determining whether the process identifier is in a preset process whitelist. If yes, the display scenario of the mobile terminal is identified according to the process identifier and the layer attribute. For the same reason, other steps can be similarly optimized. The advantage of optimization here is that the display scene can be selectively identified and the system resources consumed by unnecessary scene recognition can be reduced. In some embodiments, it is assumed that the identification element includes a process name, a layer attribute, and touch data, and when the touch data corresponding to the touch data is in the preset touch event white list, the display scene is determined according to the process name, the layer attribute, and the touch data. . When the touch data corresponding to the touch data is not in the preset touch event white list, the display scene is determined according to the process name and the layer attribute, and the two methods are equivalent to the relationship between the local variable and the global variable, and the local variable is preferentially used when the local variable exists. Display scene recognition, otherwise use global variables to display scene recognition.

2 is a second schematic flowchart of a method for identifying a display scene of a mobile terminal according to an embodiment of the present disclosure, where the method includes the following steps:

Step 201: Obtain a process identifier of an application running in the mobile terminal.

Step 202: Obtain a layer attribute of each layer in the layer set drawn by the application.

Step 203: Identify a display scenario of the mobile terminal according to the process identifier and the layer attribute.

Step 204: Determine at least one of a corresponding target drawing frame rate, a target composite frame rate, a target refresh rate, a target display brightness, and a target resolution according to the identified display scene.

In order to facilitate understanding, the Android system is taken as an example to briefly describe the process from the generation to the display of the display screen in the Android system. FIG. 3 is a schematic diagram of a display process according to an embodiment of the present invention.

First, in the Application layer, each application (hereinafter referred to as an application or APP) contains one or more layers, and each application APP1, APP2...APPN is designed according to its own application (generally by the corresponding installation package APK) Decided to perform a layer rendering operation (that is, drawing an image on the layer), and after the drawing operation is completed, each application sends all the layers drawn to the layer composition that performs the layer composition operation. Module (Surface Flinger).

Then, in the Framework layer, all layers (including visible and invisible layers) form a list of layers, defined as ListAll. The layer composition module selects the visible layer from ListAll to form a visible layer list, which is defined as DisplayList. Subsequently, the layer synthesis module from the system three recyclable frame buffers (Frame Buffer, referred to as BF or buffer, finds an idle FB, and on the free FB, according to the application configuration information, for example, which layer should be bottomed, which layer should be topped, which area is visible, and which The area is a transparent area, etc., and the layers contained in the DisplayList are superimposed by a Compose operation to obtain a final picture to be displayed.

Finally, at the Kernel layer, the picture to be displayed can be transferred to the display hardware (including the display controller and display) so that the picture to be displayed is finally displayed on the display. Here, the type of the display screen is not limited, and may be, for example, a liquid crystal display (Liquid). Crystal Display, LCD).

In addition, the Android system introduced a synchronization (Vsync) refresh mechanism during the display refresh process. FIG. 4 is a schematic diagram of a Vsync display refresh mechanism according to an embodiment of the present invention. Specifically, the Vsync refresh mechanism actually inserts a "heartbeat" or system synchronization (Vsync) signal in the entire display process, and is sent by the display controller to the CPU for generating a Vsync interrupt to control each layer drawing operation and graph. Layer synthesis operations need to be done in accordance with the heartbeat, so that the key steps in the entire display process are incorporated into the unified management mechanism of Vsync. The frequency of the Vsync signal is currently commonly 60 Hz. As shown in FIG. 4, assuming that the Vsync signal period is T, regardless of the signal transmission delay, after the first Vsync signal Vsync1 reaches the CPU, the CPU forwards the first Vsync signal Vsync1 to each application, and each application responds to the user on the display screen. On the touch and other operations, the drawing operation is started; after each application completes the drawing operation, multiple layers drawn by each application are obtained. After the second Vsync signal Vsync2 reaches the CPU, the CPU forwards the second Vsync signal Vsync2 to the layer synthesizing module, and the layer synthesizing module starts performing a layer synthesizing operation, and synthesizes the multiple layers drawn by each application to generate The screen to be displayed. After the third Vsync signal Vsync3 reaches the CPU, the system starts to perform display refresh and finally displays the to-be-displayed screen on the display. As can be seen from the above description, the frequency of the Vsync signal received by the application, the layer synthesis module, and the display screen is consistent, and is a fixed value set in advance.

In the process of drawing, synthesizing, and refreshing the display of the mobile terminal layer, there are three kinds of frame rates: the drawing frame rate, the composite frame rate, and the refresh rate.

The drawing frame rate is a frame rate that triggers the layer synthesis module to perform layer composition after the drawing of the layer is completed, and can be understood as the number of layer frames drawn per unit time (for example, 1 second). The drawing frame rate includes a drawing frame rate of the application and a drawing frame rate of the layer. There may be multiple applications running in the system, and each application may include multiple layers. For example, the video player application in the above example generally includes three layers U1, U2, and U3. The drawing frame rate of the application is the number of times the drawing operation is performed in the application unit time, and one or more layers may be drawn when performing a drawing operation. The drawing frame rate of the layer is the number of times the layer is triggered to be drawn in the unit time of the same number or name (such as U1, U2, or U3 in the previous section).

The composite frame rate is a frame rate in which the layers drawn by each application are combined into one picture to be displayed, which can be understood as the number of picture frames synthesized per unit time.

The refresh rate is the frame rate at which the display screen of the mobile terminal is refreshed. Typically, the display will refresh at a 60Hz refresh rate.

In some embodiments, for ease of illustration, the target rendering frame rate, the target composite frame rate, the target refresh rate, the target display luminance, and the target resolution are collectively referred to as target parameter values.

Step 205: Perform corresponding layer drawing, layer composition, display screen refresh, and display according to at least one of the determined target drawing frame rate, the target composite frame rate, the target refresh rate, the target display brightness, and the target resolution. At least one of brightness adjustments.

The target drawing frame rate may be the maximum drawing frame rate when the application draws the layer. Performing a layer drawing operation according to the target drawing frame rate may be changing the frequency of the reference signal (such as the Vsync signal sent to the application described above) sent to the application to the target drawing frame rate, or changing the drawing of the application. The layer rendering operation responds to the reference signal to limit the maximum rendering frame rate when the application draws the layer to within the target rendering frame rate. For example, the received 2n+1th signal response, the received 2nth signal does not respond; for example, a set of n (such as 5) signals, the first type of preset number in each group ( For signals such as 1, 2, 4, 5), the signal of the second type of preset number (such as 4) does not respond.

The target composite frame rate may be a layer synthesis module (such as Surface) Flinger) The maximum composite frame rate when synthesizing layers. Performing the layer synthesis operation according to the target composite frame rate may change the frequency of the reference signal (such as the Vsync signal) sent to the layer synthesis module to the target composite frame rate, or change the layer synthesis operation of the layer synthesis module to the reference. The response mechanism of the signal is to limit the maximum rendering frame rate when the application draws the layer to within the target rendering frame rate (as in the example above).

Performing a display refresh operation according to the target refresh rate can adjust the frequency of the reference signal (such as the Vsync signal) sent to the display screen to the target refresh rate, and can also change the response mechanism of the display screen refresh operation of the display screen to the reference signal to achieve The frequency of picture refresh is equal to the target refresh rate (as in the above example).

It can be seen from the above description that the frequencies of the Vsync signals received by the application, the layer synthesizing module and the display screen in the embodiment of the present invention are independent, and may be the same or different. The advantage of the setting is that according to different display scenarios. Select a combination of different signal frequencies to optimize display control.

Performing the display brightness adjustment according to the target display brightness can be to adjust the display brightness to the value corresponding to the target display brightness, including setting the brightness value of the display to the lowest (extinguished screen) or highest.

The target resolution may include a target resolution of the layer and a target resolution of the display screen. Performing a layer drawing operation based on the target resolution of the layer can be performed by the application to draw the corresponding layer based on the target resolution of the layer. Performing the layer compositing operation according to the target resolution of the display screen may be performed by the layer compositing module to adjust the resolution of each layer to the target resolution of the display screen before the composite layer according to the target resolution of the display screen; The resolution of the picture to be displayed is adjusted by the layer synthesis module to the target resolution of the display picture during the execution of the layer composition operation. Among them, the adjustment of the resolution can be achieved by means of image processing related means.

The method for identifying a display scene of a mobile terminal provided by the embodiment of the present invention determines a corresponding target parameter value according to the identified display scene after identifying the current display scene, and then performs a corresponding operation according to the target parameter value, which may be moved. The display of the terminal is more reasonably controlled.

Based on the above technical solution, more operations can be performed according to the identified display scene. In some embodiments, this can be achieved by adding marker bits, with different values on the marker bits corresponding to different operations.

FIG. 5 is a third schematic flowchart of a method for identifying a display scene of a mobile terminal according to an embodiment of the present invention. As shown in FIG. 5, the method includes:

Step 501: Obtain a process identifier of an application running in the mobile terminal.

Step 502: Acquire a layer attribute of each layer in the layer set drawn by the application, and determine a layer scene category according to the layer attribute.

Step 503: Acquire sensor data by using a preset type of sensor, and determine a sensor event according to the sensor data.

Step 504: Acquire touch data, and determine a touch event according to the touch data.

Step 505: Identify a display scenario of the mobile terminal according to the process identifier, the layer scene category, the sensor event, and the touch event.

In some embodiments, a correspondence between a process identification, a layer scene category, a sensor event, and a touch event and a display scene is given in Table 1 below. The sensor uses an acceleration sensor as an example, and the layer attribute is used in a video playback application. For example, the three layer identifiers (U1, U2, and U3):

Table 1 Correspondence between process ID, layer scene category, sensor event, and touch event and display scene

进程标识 Process ID	图层场景类别 Layer scene category	传感器事件 Sensor event	触摸事件 Touch event	显示场景 Display scene
进程 A Process A	U1 和 U2 U1 and U2	静止 still	点击 Click	场景 1 scene 1
进程 A Process A	U1 和 U2 U1 and U2	运动 motion	点击 Click	场景 2 Scene 2
进程 A Process A	U1 和 U2 U1 and U2	静止 still	慢速滑动 Slow sliding	场景 3 Scene 3
进程 A Process A	U1 和 U2 U1 and U2	运动 motion	慢速滑动 Slow sliding	场景 4 Scene 4
进程 A Process A	U1 和 U2 U1 and U2	静止 still	快速滑动 Quick sliding	场景 5 Scene 5
进程 A Process A	U1 和 U2 U1 and U2	运动 motion	快速滑动 Quick sliding	场景 6 Scene 6
进程 B Process B	U1 和 U2 U1 and U2	静止 still	点击 Click	场景 7 Scene 7
… ...	… ...	… ...	… ...	… ...
进程 A Process A	U1 和 U3 U1 and U3	静止 still	点击 Click	场景 13 Scene 13
… ...		… ...	… ...	… ...

Step 506: Determine a corresponding target drawing frame rate, a target composite frame rate, and a target refresh rate according to the identified display scene.

It should be noted that, for ease of understanding, the target drawing frame rate in the embodiment of the present invention is described by taking the target drawing frame rate of the application as an example, and the target drawing frame rate can also be detailed to the target drawing frame rate of the layer.

In some embodiments, the correspondence between the display scene and the target rendering frame rate, the target composite frame rate, and the target refresh rate is given in Table 2 below:

Table 2 shows the correspondence between the scene and the target drawing frame rate, the target composite frame rate, and the target refresh rate.

显示场景 Display scene	目标绘制帧率（ Hz ） Target drawing frame rate (Hz)	目标合成帧率（ Hz ） Target composite frame rate (Hz)	目标刷新率（ Hz ） Target refresh rate ( Hz )
场景 1 scene 1	50 50	50 50	50 50
场景 2 Scene 2	48 48	48 48	48 48
场景 3 Scene 3	53 53	53 53	53 53
场景 4 Scene 4	51 51	51 51	51 51
场景 5 Scene 5	58 58	58 58	58 58
场景 6 Scene 6	55 55	55 55	58 58
场景 7 Scene 7	58 58	58 58	58 58
… ...	… ...	… ...	… ...
场景 13 Scene 13	52 52	52 52	52 52
… ...	… ...	… ...	… ...

Step 507: Perform corresponding layer drawing, layer composition, and display screen refresh operation according to the determined target drawing frame rate, the target composite frame rate, and the target refresh rate.

The display scene recognition method of the mobile terminal provided by the embodiment of the present invention identifies the display scene of the mobile terminal according to the process identifier, the layer scene category, the sensor event, and the touch event, and then performs personalized layer drawing and layer synthesis according to the display scene. And the display screen refresh operation can more reasonably control the display of the mobile terminal. When the target drawing frame rate, the target composite frame rate, and the target refresh rate are lower than the normal frequency, the effect of reducing the system power consumption can also be achieved.

The embodiment of the invention provides a display scene recognition device for a mobile terminal, which may include:

In an embodiment, the display scene recognition apparatus of the mobile terminal provided by the embodiment of the present invention may further include:

Touch data acquisition module for acquiring touch data.

Then, the display scene recognition module is configured to: identify a display scene of the mobile terminal according to the process identifier, the layer attribute, and the touch data.

The sensing data acquisition module is configured to acquire sensing data by using a preset type of sensor.

Then, the display scene recognition module is configured to: identify a display scene of the mobile terminal according to the process identifier, the layer attribute, the touch data, and the sensing data.

The target parameter value determining module is configured to determine at least one of a corresponding target drawing frame rate, a target composite frame rate, a target refresh rate, a target display brightness, and a target resolution according to the identified display scene.

The operation execution module is configured to perform corresponding layer drawing, layer composition, and display screen refresh according to at least one of the determined target drawing frame rate, the target composite frame rate, the target refresh rate, the target display brightness, and the target resolution. And at least one of the display brightness adjustments.

In an embodiment, the touch data acquiring module may be further configured to: perform statistical analysis on the touch data, and determine a corresponding touch event according to a statistical analysis result, where the touch data includes at least a touch position, a touch area, and The touch duration includes at least an eventless, a click event, a leaving event, a slow sliding event, and a fast sliding event.

Then, the display scene recognition module may be configured to: identify a display scene of the mobile terminal according to the process identifier, the layer attribute, and the touch event.

FIG. 6 is a structural block diagram of a display scene recognizing apparatus of a mobile terminal according to an embodiment of the present invention. The apparatus may be implemented by software and/or hardware, and is generally integrated in a mobile terminal, and may perform a display scene recognizing method of the mobile terminal. Perform display scene recognition. As shown in Figure 6, the device includes:

a process identifier obtaining module 601, configured to acquire a process identifier of an application running in the mobile terminal;

a layer attribute obtaining module 602, configured to acquire a layer attribute of each layer in the layer set drawn by the application;

The display scene identification module 603 is configured to identify a display scene of the mobile terminal according to the process identifier and the layer attribute.

The display scene recognizing device of the mobile terminal provided by the embodiment of the present invention can accurately identify the display scenario of the mobile terminal according to the process identifier and the layer attribute of the application running by the mobile terminal.

In an embodiment, the device further comprises:

Touch data acquisition module for acquiring touch data.

The display scene recognition module is configured to:

And identifying a display scenario of the mobile terminal according to the process identifier, the layer attribute, and the touch data.

In an embodiment, the device further comprises:

The display scene recognition module is configured to:

And identifying a display scenario of the mobile terminal according to the process identifier, the layer attribute, the touch data, and the sensing data.

In an embodiment, the layer attribute includes whether the cache data is empty, a horizontal or vertical screen mode, an attribute of a visible area, an attribute of a transparent area, whether an update area exists, an attribute of an update area, and an image information. at least one.

In an embodiment, the attribute of the visible area comprises at least one of the following:

Whether the visible area is empty, the number, shape, size and position of the visible area.

The attributes of the transparent area include at least one of the following:

The number, shape, size, location, and relative position of transparent areas to the visible areas of other layers.

The attributes of the update area include at least one of the following:

Updates the number, location, shape, size, and ratio of area to screen area.

The image information includes at least one of the following:

Whether the image is at least one of a solid color, a color scale, a gray scale, a hue, a contrast, a brightness, a saturation, a transparency, and a blur.

In an embodiment, the device further comprises:

a target parameter value determining module, configured to determine a corresponding target according to the identified display scene after identifying a display scene of the mobile terminal according to the process identifier, the layer attribute, the touch data, and the sensing data At least one of a frame rate, a target composite frame rate, a target refresh rate, a target display brightness, and a target resolution is drawn.

The display scene identification module may be configured to: identify a display scenario of the mobile terminal according to the process identifier, the layer attribute, and the touch event.

The embodiment of the present invention further provides a computer readable storage medium, on which a computer program is stored, and when the computer program is executed on a computer, the computer is configured to perform display scene recognition of the mobile terminal provided by the embodiment of the present invention. The steps in the method.

The embodiment of the invention provides a mobile terminal, in which the display scene recognition device of the mobile terminal provided by the embodiment of the invention can be integrated. FIG. 7 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention. As shown in FIG. 7, the mobile terminal may include: a casing (not shown), a memory 701, and a central processing unit (Central). Processing Unit, CPU) 702 (also referred to as a processor, hereinafter referred to as CPU), a circuit board (not shown), and a power supply circuit (not shown). The circuit board is disposed inside a space enclosed by the casing; the CPU 702 and the memory 701 are disposed on the circuit board; and the power circuit is configured to supply power to each circuit or device of the mobile terminal The memory 701 is configured to store executable program code; the CPU 702 runs a computer program corresponding to the executable program code by reading executable program code stored in the memory 701 to implement the following steps:

The mobile terminal further includes: a peripheral interface 703, RF (Radio) Frequency, RF circuit 705, audio circuit 706, speaker 711, power management chip 708, input/output (I/O) subsystem 709, touch screen 712, other input/control devices 710, and external port 704, these components are passed through one or A plurality of communication buses or signal lines 707 are in communication.

It should be understood that the illustrated mobile terminal 700 is merely one example of a mobile terminal, and that the mobile terminal 700 may have more or fewer components than those shown in the figures, and two or more components may be combined. Or it can have different component configurations. The various components shown in the figures can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

The mobile terminal for displaying scene recognition provided in this embodiment is described in detail below. The mobile terminal takes a mobile phone as an example.

The memory 701 can be accessed by the CPU 702, the peripheral interface 703, etc., and the memory 701 can include a high speed random access memory, and can also include a non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices. Or other volatile solid-state storage devices.

Peripheral interface 703, which can connect the input and output peripherals of the device to CPU 702 and memory 701.

I/O subsystem 709, which can connect input and output peripherals on the device, such as touch screen 712 and other input/control devices 710, to peripheral interface 703. The I/O subsystem 709 can include a display controller 7091 and one or more input controllers 7092 for controlling other input/control devices 710. Wherein, one or more input controllers 7092 receive electrical signals from other input/control devices 710 or transmit electrical signals to other input/control devices 710, and other input/control devices 710 may include physical buttons (press buttons, rocker buttons, etc.) ), dial, slide switch, joystick, click wheel. It is worth noting that the input controller 7092 can be connected to any of the following: a keyboard, an infrared port, a USB interface, and a pointing device such as a mouse.

The touch screen 712 is an input interface and an output interface between the user mobile terminal and the user, and displays the visual output to the user. The visual output may include graphics, text, icons, videos, and the like.

Display controller 7091 in I/O subsystem 709 receives an electrical signal from touch screen 712 or an electrical signal to touch screen 712. Touch screen 712 detects contact on the touch screen, display controller 7091 converts the detected contact into interaction with a user interface object displayed on touch screen 712, ie, implements human-computer interaction, and the user interface object displayed on touch screen 712 can be operational The icon of the game, the icon of the network to the corresponding network, and the like. It is worth noting that the device may also include a light mouse, which is a touch sensitive surface that does not display a visual output, or an extension of a touch sensitive surface formed by the touch screen.

The RF circuit 705 is mainly used for establishing communication between the mobile phone and the wireless network (ie, the network side), and realizing data reception and transmission between the mobile phone and the wireless network. For example, sending and receiving short messages, emails, and the like. Specifically, the RF circuit 705 receives and transmits an RF signal, which is also referred to as an electromagnetic signal, and the RF circuit 705 converts the electrical signal into an electromagnetic signal or converts the electromagnetic signal into an electrical signal, and through the electromagnetic signal and communication network and other devices Communicate. RF circuitry 705 may include known circuitry for performing these functions including, but not limited to, an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC ( COder-DECoder, codec) chipset, user identification module (Subscriber Identity Module, SIM) and more.

The audio circuit 706 is mainly used to receive audio data from the peripheral interface 703, convert the audio data into an electrical signal, and transmit the electrical signal to the speaker 711.

The speaker 711 is configured to restore the voice signal received by the mobile phone from the wireless network through the RF circuit 705 to sound and play the sound to the user.

The power management chip 708 is used for power supply and power management of the hardware connected to the CPU 702, the I/O subsystem, and the peripheral interface.

The mobile terminal provided by the embodiment of the present invention can accurately identify the display scenario of the mobile terminal according to the process identifier and the layer attribute of the application running by the mobile terminal.

The display scene recognizing device and the mobile terminal of the mobile terminal provided in the above embodiments may perform the display scene recognizing method of the mobile terminal provided by any embodiment of the present invention, and have the corresponding functional modules and beneficial effects of executing the method. For a technical detail that is not described in detail in the above embodiments, reference may be made to a display scene identification method for a mobile terminal provided by any embodiment of the present invention.

An embodiment of the present invention provides an electronic device, including a memory, and a processor, by using a computer program stored in the memory, to perform a step in a display scene identification method of a mobile terminal provided by an embodiment of the present invention. step.

For example, the electronic device can be a mobile terminal device such as a smartphone or tablet. Please refer to FIG. 8. FIG. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present invention. The electronic device 800 can include components such as a memory 801, a processor 802, and a sensor 803.

Memory 801 can be used to store applications and data. The application stored in the memory 801 contains executable code. Applications can form various functional modules. The processor 802 executes various functional applications and data processing by running an application stored in the memory 801.

The processor 802 is a control center of the electronic device, and connects various parts of the entire electronic device using various interfaces and lines, executes the electronic device by running or executing an application stored in the memory 801, and calling data stored in the memory 801. The various functions and processing of data to provide overall monitoring of the electronic device.

The electronic device can include sensors 803 such as light sensors, motion sensors, and other sensors. The light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel according to the brightness of the ambient light, and the proximity sensor may turn off the display panel and/or the backlight when the electronic device moves to the ear. As a kind of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the posture of electronic devices (such as horizontal and vertical screen switching, Related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping). Other sensors such as gyroscopes, barometers, hygrometers, thermometers, and infrared sensors that can be configured in electronic devices are not described here.

In this embodiment, the processor 802 in the electronic device loads the executable code corresponding to the process of one or more applications into the memory 801 according to the following instructions, and is executed by the processor 802 to be stored in the memory. The application in 801, thus implementing the steps:

Obtaining the process ID of the application running in the electronic device;

In an embodiment, the processor 802 can also be used to perform the step of acquiring touch data by calling a computer program stored in the memory.

Then, the processor 802, when performing the step of identifying a display scenario of the electronic device according to the process identifier and the layer attribute, may include: identifying an electronic according to the process identifier, the layer attribute, and the touch data The display scene of the device.

In one embodiment, the processor 802 can also be configured to perform the step of acquiring sensor data by a preset type of sensor by calling a computer program stored in the memory.

Then, the processor 802, when performing the step of identifying a display scenario of the electronic device according to the process identifier, the layer attribute, and the touch data, may include: determining, according to the process identifier, the layer attribute, The touch data and the sensor data identify a display scene of the electronic device.

In an embodiment, the attributes of the visible region may include at least one of the following: whether the visible region is empty, the number, shape, size, and location of the visible regions.

The properties of the transparent region may include at least one of the following: the number, shape, size, location, and relative position of the transparent regions to the visible regions of the other layers.

The attributes of the update area may include at least one of the following: the number, location, shape, size, and ratio of area to screen area of the update area.

In an embodiment, after the processor 802 performs the display of the display scenario of the electronic device according to the process identifier, the layer attribute, the touch data, and the sensing data, the processor 802 may further be configured to perform the steps:

And determining at least one of a corresponding target drawing frame rate, a target composite frame rate, a target refresh rate, a target display brightness, and a target resolution according to the identified display scene.

Performing corresponding layer drawing, layer composition, display picture refresh, and display brightness adjustment according to at least one of the determined target drawing frame rate, target composite frame rate, target refresh rate, target display brightness, and target resolution At least one operation.

In an embodiment, after the step of acquiring the touch data, the processor 802 may further be configured to perform the steps:

Performing statistical analysis on the touch data, and determining a corresponding touch event according to the statistical analysis result, where the touch data includes at least a touch position, a touch area, and a touch duration, and the touch event includes at least no event, a click event, a leaving event, Slow swipe events and fast swipe events.

Then, the processor 802, when performing the step of identifying a display scenario of the electronic device according to the process identifier, the layer attribute, and the touch data, may include: according to the process identifier, the layer attribute, and the The touch event identifies a display scene of the electronic device.

It will be understood by those skilled in the art that the electronic device structure illustrated in FIG. 8 does not constitute a limitation to the electronic device, and may include more or less components than those illustrated, or a combination of certain components, or different component arrangements. In another embodiment, referring to FIG. 9, the electronic device 800 may further include an input unit 804, an output unit 805, and the like.

The input unit 804 can be configured to receive input digits, character information, or user characteristic information (such as fingerprints), and to generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function controls. In an embodiment, input unit 804 can include a touch-sensitive surface as well as other input devices. Touch-sensitive surfaces, also known as touch screens or trackpads.

The output unit 805 can be used to display information input by the user or information provided to the user and various graphical user interfaces of the mobile terminal, which can be composed of graphics, text, icons, video, and any combination thereof. For example, the output unit 805 can be a display panel.

A person skilled in the art may understand that all or part of the various steps of the foregoing embodiments may be performed by a program to instruct related hardware. The program may be stored in a computer readable storage medium, and the storage medium may include: Read only memory (ROM, Read Only Memory), Random Access Memory (RAM), disk or CD.

Note that the above are only the preferred embodiments of the present invention and the technical principles applied thereto. Those skilled in the art will appreciate that the present invention is not limited to the specific embodiments described herein, and that various modifications, changes and substitutions may be made without departing from the scope of the invention. Therefore, the present invention has been described in detail by the above embodiments, but the present invention is not limited to the above embodiments, and other equivalent embodiments may be included without departing from the inventive concept. The scope is determined by the scope of the appended claims.

Claims

A display scene recognition method for a mobile terminal, comprising:

Obtaining a process identifier of an application running in the mobile terminal;

Obtaining layer properties of each layer in the layer set drawn by the application;

And identifying a display scenario of the mobile terminal according to the process identifier and the layer attribute.
The method of claim 1 further comprising:

Get touch data;

The identifying a display scenario of the mobile terminal according to the process identifier and the layer attribute includes:

And identifying a display scenario of the mobile terminal according to the process identifier, the layer attribute, and the touch data.
The method of claim 2, further comprising:

Acquiring sensor data by a preset type of sensor;

The identifying a display scenario of the mobile terminal according to the process identifier, the layer attribute, and the touch data includes:

And identifying a display scenario of the mobile terminal according to the process identifier, the layer attribute, the touch data, and the sensing data.
The method of claim 1, wherein the layer attribute comprises whether the cached data is empty, a landscape or portrait mode, an attribute of a visible area, an attribute of a transparent area, whether an update area exists, an attribute of an update area, and At least one of the image information.
The method of claim 4, wherein

The attributes of the visible area include at least one of the following:

Whether the visible area is empty, the number, shape, size and position of the visible area;

The attributes of the transparent area include at least one of the following:

The number, shape, size, location, and relative position of the transparent areas to the visible areas of other layers;

The attributes of the update area include at least one of the following:

The number, location, shape, size, and ratio of area to screen area of the update area;

The image information includes at least one of the following:

Whether the image is at least one of a solid color, a color scale, a gray scale, a hue, a contrast, a brightness, a saturation, a transparency, and a blur.
The method of claim 3, further comprising: after identifying the display scenario of the mobile terminal according to the process identifier, the layer attribute, the touch data, and the sensing data, further comprising:

Determining at least one of a corresponding target rendering frame rate, a target composite frame rate, a target refresh rate, a target display brightness, and a target resolution according to the identified display scene;

Performing corresponding layer drawing, layer composition, display picture refresh, and display brightness adjustment according to at least one of the determined target drawing frame rate, target composite frame rate, target refresh rate, target display brightness, and target resolution At least one operation.
The method according to claim 2, wherein after the step of acquiring the touch data, the method further comprises: performing statistical analysis on the touch data, and determining a corresponding touch event according to the statistical analysis result, the touch data including at least a touch location, a touch area, and a touch duration, the touch event including at least an eventless, a click event, a leaving event, a slow sliding event, and a fast sliding event;

The identifying a display scenario of the mobile terminal according to the process identifier, the layer attribute, and the touch data includes: identifying a display scenario of the mobile terminal according to the process identifier, the layer attribute, and the touch event.
A display scene recognition device for a mobile terminal, comprising:

a process identifier obtaining module, configured to acquire a process identifier of an application running in the mobile terminal;

a layer attribute obtaining module, configured to acquire a layer attribute of each layer in the layer set drawn by the application;

And displaying a scene recognition module, configured to identify a display scenario of the mobile terminal according to the process identifier and the layer attribute.
The apparatus of claim 8 further comprising:

Touch data acquisition module, configured to acquire touch data;

The display scene recognition module is configured to:

And identifying a display scenario of the mobile terminal according to the process identifier, the layer attribute, and the touch data.
The apparatus according to claim 9, further comprising:

a sensing data acquiring module, configured to acquire sensing data by using a preset type of sensor;

The display scene recognition module is configured to:

And identifying a display scenario of the mobile terminal according to the process identifier, the layer attribute, the touch data, and the sensing data.
The apparatus of claim 10, further comprising:

a target parameter value determining module, configured to determine at least one of a corresponding target drawing frame rate, a target composite frame rate, a target refresh rate, a target display brightness, and a target resolution according to the identified display scene;

The operation execution module is configured to perform corresponding layer drawing, layer composition, and display screen refresh according to at least one of the determined target drawing frame rate, the target composite frame rate, the target refresh rate, the target display brightness, and the target resolution. And at least one of the display brightness adjustments.
The device according to claim 9, wherein the touch data acquisition module is further configured to: perform statistical analysis on the touch data, and determine a corresponding touch event according to a statistical analysis result, where the touch data includes at least a touch location, a touch area and a touch duration, the touch event including at least an eventless, a click event, a leaving event, a slow sliding event, and a fast sliding event;

The display scene identification module is configured to: identify a display scenario of the mobile terminal according to the process identifier, the layer attribute, and the touch event.
A storage medium having stored thereon a computer program, wherein when the computer program is executed on a computer, the computer is caused to perform the method of any one of claims 1 to 7.
An electronic device includes a memory, a processor, wherein the processor is configured to perform the steps by calling a computer program stored in the memory:

Obtaining the process ID of the application running in the electronic device;

Obtaining layer properties of each layer in the layer set drawn by the application;

And identifying a display scenario of the electronic device according to the process identifier and the layer attribute.
The electronic device of claim 14, wherein said processor is operative to perform the steps by invoking a computer program stored in said memory:

Get touch data;

A display scene of the electronic device is identified according to the process identifier, the layer attribute, and the touch data.
The electronic device of claim 15 wherein said processor is operative to perform the steps by invoking a computer program stored in said memory:

Acquiring sensor data by a preset type of sensor;

A display scene of the electronic device is identified according to the process identifier, the layer attribute, the touch data, and the sensing data.
The electronic device according to claim 14, wherein the layer attribute comprises whether the cache data is empty, a landscape or portrait mode, an attribute of a visible area, an attribute of a transparent area, whether an update area exists, an attribute of an update area And at least one of the image information.
The electronic device of claim 17, wherein the attributes of the visible area comprise at least one of the following:

Whether the visible area is empty, the number, shape, size and position of the visible area;

The attributes of the transparent area include at least one of the following:

The number, shape, size, location, and relative position of the transparent areas to the visible areas of other layers;

The attributes of the update area include at least one of the following:

The number, location, shape, size, and ratio of area to screen area of the update area;

The image information includes at least one of the following:

Whether the image is at least one of a solid color, a color scale, a gray scale, a hue, a contrast, a brightness, a saturation, a transparency, and a blur.
The electronic device of claim 16 wherein said processor is operative to perform the steps by invoking a computer program stored in said memory:

Determining at least one of a corresponding target rendering frame rate, a target composite frame rate, a target refresh rate, a target display brightness, and a target resolution according to the identified display scene;

Performing corresponding layer drawing, layer composition, display picture refresh, and display brightness adjustment according to at least one of the determined target drawing frame rate, target composite frame rate, target refresh rate, target display brightness, and target resolution At least one operation.
The electronic device of claim 15 wherein said processor is operative to perform the steps by invoking a computer program stored in said memory:

Performing statistical analysis on the touch data, and determining a corresponding touch event according to the statistical analysis result, where the touch data includes at least a touch position, a touch area, and a touch duration, and the touch event includes at least no event, a click event, a leaving event, Slow sliding events and fast sliding events;

A display scene of the electronic device is identified according to the process identifier, the layer attribute, and the touch event.