WO2023216146A1

WO2023216146A1 - Display image updating method and apparatus and storage medium

Info

Publication number: WO2023216146A1
Application number: PCT/CN2022/092232
Authority: WO
Inventors: 李丽; 刘正亮; 许英枫
Original assignee: 北京小米移动软件有限公司
Priority date: 2022-05-11
Filing date: 2022-05-11
Publication date: 2023-11-16
Also published as: CN117396835A

Abstract

Embodiments of the present disclosure relate to a display image updating method and apparatus and a storage medium. The method is applied to a terminal device, and the method comprises: when a touch event for a display interface is detected and the terminal device is in a first application state, performing, on the basis of the type of the touch event and a target triggering moment of application drawing processing corresponding to the type, the application drawing processing on at least one first type of layer corresponding to the touch event; after the application drawing processing for the at least one first type of layer is completed, triggering layer synthesis processing for the at least one first type of layer to obtain a target image frame; and updating a display image on the display interface on the basis of the target image frame.

Description

Display image update method, device and storage medium

Technical field

The present disclosure relates to the field of image processing technology but is not limited to the field of wireless communication technology, and in particular, to an update method, device and storage medium for displaying images.

Background technique

With the rapid development of terminal equipment technology, more and more terminal equipment are equipped with touch screens and display systems; the processing of data to be displayed in the display system mainly includes: application drawing processing, layer synthesis processing and hardware Refresh display processing; in order to avoid display freezes and improve display effects, the display system synchronizes various processes through the system vertical synchronization signal.

For one frame of image, the process from the beginning of application drawing processing to the final screen display requires about 3 signal cycles of the system vertical synchronization signal. Even in terminal devices with high refresh rates (such as 120Hz), the delay of one frame of image Also about 24ms. For some application scenarios with high requirements on fluency and chirality (such as stylus application scenarios), obvious lags will occur and the user experience will be poor.

Contents of the invention

Embodiments of the present disclosure provide a display image updating method, device, and storage medium.

A first aspect of an embodiment of the present disclosure provides a method for updating a display image, which is applied to a terminal device, wherein the method includes:

When a touch event for the display interface is detected and the terminal device is in the first application state, based on the type of the touch event and the target trigger time of the application drawing process corresponding to the type, the touch event is At least one first-type layer corresponding to the event is applied for drawing processing;

After the application drawing process of the at least one first type layer is completed, trigger the layer synthesis process of the at least one first type layer to obtain the target image frame;

Based on the target image frame, the display image of the display interface is updated.

In the above solution, based on the type of the touch event and the target triggering moment of the application drawing process corresponding to the type, application drawing processing is performed on at least one first type layer corresponding to the touch event, including :

If the type of the touch event indicates that the touch event is a click event, based on the detection time when the click event is detected, an application drawing process is performed on at least one first type layer corresponding to the click event.

In the above solution, the at least one first type layer corresponding to the touch event is applied based on the type of the touch event and the target trigger time of the application drawing process corresponding to the type of the touch event. Drawing processing, including:

If the type of the touch event indicates that the touch event is a sliding event, at a preset time before generating the next first synchronization signal, apply drawing processing to at least one first type layer corresponding to the sliding event. ; Wherein, the first synchronization signal is a system vertical synchronization signal that triggers application drawing processing.

In the above solution, the method further includes:

Obtain the maximum time required to apply drawing processing and layer composition processing to the first type of layer;

The preset time is determined based on the difference between the maximum duration and the signal period of the first synchronization signal.

In the above solution, after the application drawing process of the at least one first type layer is completed, the layer synthesis process of the at least one first type layer is triggered to obtain the target image frame, including:

After the application drawing process of the at least one first type layer is completed, writing the at least one first type layer after the application drawing process into the layer composition cache;

Based on the triggering of the first write operation of the first type layer, layer synthesis processing is performed on the at least one first type layer in the layer synthesis cache to obtain the target image frame.

In the above solution, the method further includes:

Based on the triggering of the first synchronization signal, apply drawing processing to the acquired at least one second type layer, and write the at least one second type layer after applying the drawing process into the layer synthesis cache; wherein, the The second type of layer is generated by application event triggering of the application currently running on the terminal device;

Based on the signal period of a second synchronization signal before the second writing operation of the second type image, determine whether there is layer synthesis for the first type of layer within the signal period of the second synchronization signal. Processing; the second synchronization signal is a system vertical synchronization signal that triggers layer synthesis processing;

performing layer synthesis processing on the at least one first type layer in the layer synthesis cache based on the triggering of the first write operation of the first type layer to obtain the target image frame, include:

If there is layer synthesis processing for the first type of layer, within a signal period of the second synchronization signal after the second writing operation, based on the triggering of the first writing operation, the The at least one first-type layer and the at least one second-type layer in the layer composition cache are subjected to layer composition processing to obtain the target image frame.

In the above solution, the method further includes:

If there is no layer synthesis processing for the first type of layer, based on the trigger of the next second synchronization signal, layer synthesis processing is performed on at least one second type of layer in the layer synthesis cache to obtain The target image frame.

In the above solution, before applying the drawing process to at least one first type layer corresponding to the touch event based on the type of the touch event and the target triggering moment of the application drawing process corresponding to the type, the The above methods also include:

In response to a startup operation for any application program on the display interface, obtain the window identifier corresponding to the application program;

Determine whether the window identifier corresponding to the application program includes a preset identifier;

If the window identifier corresponding to the application program includes a preset identifier, it is determined that the terminal device is in the first application state, and at least one first type layer generated by the touch event is obtained.

In the above solution, the method further includes:

If the window identifier corresponding to the application program does not include the preset identifier, it is determined that the terminal device is in the second application state;

When a touch event for the display interface is detected and the terminal device is in the second application state, based on the triggering of the first synchronization signal, at least one first type layer corresponding to the touch event is Perform application drawing processing;

Based on the triggering of the second synchronization signal, a layer synthesis process is performed on at least one first type layer after applying the drawing process.

A second aspect of the embodiment of the present disclosure provides a device for updating a display image, which is applied to a terminal device, wherein the device includes:

A first processing module configured to detect a touch event for the display interface, and when the terminal device is in the first application state, draw a processing target based on the type of the touch event and the application corresponding to the type. At the triggering moment, apply drawing processing to at least one first-type layer corresponding to the touch event;

The second processing module is configured to trigger layer synthesis processing on the at least one first-type layer after the application drawing process of the at least one first-type layer is completed to obtain a target image frame;

An update module configured to update the display image of the display interface based on the target image frame.

In the above solution, the first processing module is configured as:

In the above solution, the second processing module is configured as:

In the above solution, the first processing module is configured as:

The second processing module is configured as:

In the above solution, the second processing module is configured as:

In the above solution, the first processing module is configured as:

The second processing module is configured as:

A third aspect of the embodiment of the present disclosure provides an updating device for displaying images, including:

processor;

memory configured to store executable instructions;

Wherein, when the processor runs the executable instructions, the processor performs the method for updating the display image provided in the first aspect.

A fourth aspect of an embodiment of the present disclosure provides a non-transitory computer-readable storage medium, which when the instructions in the storage medium are executed by a processor of an updating device for displaying an image, enables the updating device for displaying an image to execute the foregoing. The first aspect provides an update method for displaying images.

In the embodiment of the present disclosure, when a touch event on the display interface is detected and the terminal device is in the first application state, the target triggering moment corresponding to the type of the touch event is determined according to the type of the touch event. The target triggering moment triggers the application drawing processing of at least one first-type layer generated by the touch event; thereby performing application drawing in a timely manner based on different types of touch events generated during the touch process of the display interface. Processing, there is no need to wait for the trigger of the first synchronization signal, reducing the delay in the application drawing process;

Moreover, after the application drawing process of the at least one first type layer is completed, the layer synthesis process of the at least one first type layer after the application drawing process is directly triggered to obtain the target image frame; there is no need to wait for the second time. The synchronization signal reduces the delay in the layer synthesis process, thereby reducing the time it takes from detecting a touch event to displaying the image frame generated by the touch event on the display interface, significantly reducing the touch delay of the terminal device. , improve the user experience.

It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and do not limit the embodiments of the present disclosure.

Description of the drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description serve to explain the principles of the embodiments of the invention.

Figure 1 is a schematic flowchart 1 of a method for updating a display image according to an exemplary embodiment;

Figure 2 is a schematic flowchart 2 of a method for updating a display image according to an exemplary embodiment;

Figure 3 is a schematic diagram of the processing of image frames corresponding to the Down event shown in the related art;

Figure 4 is a schematic diagram of processing an image frame corresponding to a Down event according to an exemplary embodiment;

Figure 5 is a schematic diagram of the processing of image frames corresponding to the Move event shown in the related art;

Figure 6 is a schematic diagram of processing an image frame corresponding to a Down event according to an exemplary embodiment;

Figure 7 is a schematic structural diagram of an updating device for displaying images according to an exemplary embodiment;

Figure 8 is a block diagram of a terminal device according to an exemplary embodiment.

Detailed ways

Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with embodiments of the invention. Rather, they are merely examples of apparatus and methods consistent with some aspects of embodiments of the invention.

The terminology used in the embodiments of the present disclosure is for the purpose of describing specific embodiments only and is not intended to limit the embodiments of the present disclosure. As used in this disclosure, the singular forms "a," "the" and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It will also be understood that the term "and/or" as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.

It should be understood that although the terms first, second, third, etc. may be used to describe various information in the embodiments of the present disclosure, the information should not be limited to these terms. These terms are only used to distinguish information of the same type from each other. For example, without departing from the scope of the embodiments of the present disclosure, the first information may also be called second information, and similarly, the second information may also be called first information. Depending on the context, the word "if" as used herein may be interpreted as "when" or "when" or "in response to determining."

An embodiment of the present disclosure provides a method for updating a display image, as shown in Figure 1 . Figure 1 is a schematic flowchart 1 of a method for updating a display image according to an exemplary embodiment. The method includes:

Step S101: When a touch event for the display interface is detected and the terminal device is in the first application state, based on the type of the touch event and the target trigger time of the application drawing process corresponding to the type, the touch event is detected. Perform application drawing processing on at least one first-type layer corresponding to the touch event;

Step S102: After the application drawing process of the at least one first type layer is completed, trigger the layer synthesis process of the at least one first type layer to obtain the target image frame;

Step S103: Update the display image of the display interface based on the target image frame.

The display image updating method provided by the embodiments of the present disclosure can be applied to a terminal device including a touch screen. Here, the terminal device may include a smart phone, a tablet computer, a notebook computer, etc.

In step S101, during the use of the terminal device, after detecting a touch event generated by a touch operation on the display interface of the terminal device, it may be determined whether the current terminal device is in the first application state. If the current The terminal device is in the first application state, determines the target trigger time of the application drawing process corresponding to the type of the touch event according to the type of the touch event, and at the target trigger time, performs the processing based on the touch event. At least one first-type layer is generated for application drawing processing.

Here, the first application state may be: the application program currently running in the foreground of the terminal device is the target application program. The target application is a preset application with high chirality requirements, such as a drawing application, a document application, etc.

It can be determined whether the terminal device is in the first application state based on the operating information by obtaining the operating information of the terminal device. Wherein, the running information of the terminal device at least includes: currently running application information.

The types of touch events may include: click (Down) events, slide (Move) events, and lift (Up) events. It can be understood that a user's touch operation on the display interface will generate an event sequence. The event sequence refers to the moment when the touch object touches the display interface until the touch object leaves the display. The moment the interface ends, a series of events occur during this process. That is, an event sequence starts with a Down event, contains an indefinite number of Move events, and finally ends with an Up event.

After detecting a touch event, the embodiment of the present disclosure determines the type of the touch event; and obtains the target trigger time corresponding to the type of the touch event that triggers the application drawing process; here, different types of touch events correspond to The target trigger time is different.

It should be noted that in the Android platform, usually after detecting a touch event, it is necessary to wait for the next first synchronization signal, and the first synchronization signal triggers multiple first-type images generated for the touch event. layer to perform application drawing processing; and after the application drawing processing is completed, it is necessary to wait for the next second synchronization signal, and the second synchronization signal triggers layer synthesis processing on multiple first-type layers after application drawing processing, The image frame is obtained; finally, under the trigger of the third synchronization signal, the image currently displayed on the display interface is refreshed based on the image frame.

Here, the first synchronization signal is a system vertical synchronization signal that triggers application drawing processing, that is, Vsync-app signal; the second synchronization signal is a system vertical synchronization signal that triggers layer synthesis processing, that is, Vsync-sf signal; so The third synchronization signal is a system vertical synchronization signal that triggers hardware refresh processing, that is, the Vsync-hw signal.

It should be noted that the first synchronization signal and the second synchronization signal are generated based on the third synchronization signal, that is, the third synchronization signal may be the signal source of the first synchronization signal and the second synchronization signal. ; Or, the first synchronization signal, the second synchronization signal and the third synchronization signal are synchronized. Therefore, the signal periods of the first synchronization signal and the second synchronization signal are the same as the signal period of the third synchronization signal, and the phases are consistent. However, in actual application, due to various factors (for example, different processing performance of different components in the terminal equipment), there is a deviation between the first synchronization signal, the second synchronization signal and the third synchronization signal. If moved, they won't be perfectly aligned.

That is to say, the process from detecting a touch event to displaying the image frame generated by the touch event on the display interface requires three signal periods of the system's vertical synchronization signal; resulting in serious touch delays. For some devices with chirality Application scenarios with higher requirements (for example, drawing scenarios) have poor user experience.

In the related technology, in order to reduce the touch delay, after detecting the Down event, the application drawing process is directly performed on at least one first-type layer generated by the Down event without waiting for the triggering of the first synchronization signal; however, this method does not Processing the subsequently generated first synchronization signal will cause a frame of image drawn in advance to be the same as a frame of image drawn by processing the subsequently generated first synchronization signal, causing the display interface to freeze for one frame; and this This method also does not handle the Move event, and has limited effect on improving the touch delay of the display interface.

Embodiments of the present disclosure set different target triggering moments for triggering application drawing processing according to different types of touch events; when a touch event is detected, at least one first-type layer generated by the touch event is passed to the currently running A target application, which performs application drawing processing on at least one first type layer generated by the touch event based on the triggering of the target triggering moment, without waiting for the triggering of the first synchronization signal, thereby reducing Touch delay throughout the touch process.

In step S102, after the application drawing process of the at least one first-type layer is completed, the application program passes the at least one first-type layer after the application drawing process to Surface Flinger, and triggers the Surface Flinger to apply At least one first-type layer after rendering processing is subjected to layer synthesis processing to obtain a target image frame.

It should be noted that in the related technology, after the application completes the application drawing process of the at least one first-type layer, it will pass the at least one first-type layer after the application drawing process to Surface Flinger, but so The Surface Flinger needs to wait for the next second synchronization signal, and when triggered by the second synchronization signal, perform layer synthesis processing on at least one first-type layer after applying the drawing process.

In order to reduce the touch delay, the embodiment of the present disclosure directly triggers the Surface Flinger to perform layer synthesis processing on at least one first-type layer after applying the drawing process after completing the application drawing process. , no need to wait for the second synchronization signal.

In step S103, after obtaining the target image frame, the terminal device refreshes the display interface under the trigger of the next third synchronization signal to display the target image frame on the display interface.

Here, the third synchronization signal is a hardware signal triggered by the display screen driver of the terminal device, and the signal period of the third synchronization signal is determined according to the screen refresh rate of the display screen of the terminal device. Specifically, the signal period of the third synchronization signal is the reciprocal of the screen refresh rate of the display screen of the terminal device.

For example, the screen refresh rate of the display screen of the terminal device is any value such as 60Hz, 70Hz, 75Hz or 80Hz. Taking the screen refresh rate as 60Hz as an example, the signal period of the third synchronization signal is 16.667ms. It should be noted that the terminal device may support multiple different screen refresh rates, and the signal period of the third synchronization signal is determined by the screen refresh rate currently used by the terminal device.

In some embodiments, in step S101, based on the type of the touch event and the target trigger time of the application drawing process corresponding to the type, at least one first type layer corresponding to the touch event is processed. Apply drawing processing, including:

In an embodiment of the present disclosure, if the currently detected touch event is a Down event, it can be determined that the target trigger time corresponding to the Down event is the detection time when the Down event is detected.

Therefore, when the Down event is detected and the terminal device is in the first application state, at least one first-type layer generated by the Down event is transferred to the currently running target application, and the target application is triggered. The program performs application drawing processing on the at least one first type layer.

It should be noted that in the related technology, when the terminal device detects the Down event, it will pass at least one first-type layer generated by the Down event to the target application, and the target application receives the at least one The first type layer needs to wait for the first synchronization signal, and when triggered by the first synchronization signal, apply drawing processing to at least one first type layer.

In the embodiment of the present disclosure, after detecting the Down event, at least one first-type layer corresponding to the Down event is transferred to the target application, and based on the transfer operation, triggers the target application to process the at least one first-type layer. When performing application drawing processing, there is no need to wait for the first synchronization signal, thereby reducing the delay in the application drawing processing process corresponding to the Down event.

In the embodiment of the present disclosure, if the currently detected touch event is a Move event, it can be determined that the target trigger time corresponding to the Move event is the preset before the next first synchronization signal is generated after the Move event is detected. time.

Here, the preset time can be set according to actual needs. For example, the target triggering time of the Move event can be: 2 ms before the next first synchronization signal is generated.

It should be noted that in related technologies, when a terminal device detects a Move event, it will not directly pass at least one first-type layer generated by the Move event to the target application. Instead, after detecting the Move event, it needs to wait for the next step. A first synchronization signal, triggered by the first synchronization signal, transmits at least one first-type layer generated by the Move event to the target application, so that the target application receives at least one layer generated by the Move event. A first-type layer, applying drawing processing to the at least one first-type layer.

Even if the embodiment of the present disclosure directly triggers the Surface Flinger to perform layer synthesis processing on at least one first-type layer after the application drawing process without waiting for the second synchronization signal after the target application completes the application drawing process, it is difficult to ensure that The application drawing processing and layer synthesis processing of at least one first-type layer generated by the Move event is completed within a signal period of a first synchronization signal.

Therefore, for the Move event, the embodiment of the present disclosure can advance the processing timing of the application drawing processing of at least one first-type layer generated by the Move event, that is, the next first synchronization signal after the Move event is detected. At a preset time before generation, at least one first-type layer generated by the Move event is transferred to the target application, and the target application is triggered to perform application drawing processing on the at least one first-type layer generated by the Move event;

And after the target application completes the application drawing process, the Surface Flinger is directly triggered to perform layer synthesis processing on at least one first type layer after the application drawing process, so that the synthesis is completed within the signal period of a first synchronization signal. The application drawing processing and layer composition processing of at least one first-type layer generated by the Move event reduces the touch delay of the terminal device.

In some embodiments, the method further includes:

In this embodiment of the present disclosure, the first duration required for application drawing processing on the first type of layer and the second duration required for layer synthesis processing on the first type of layer are respectively obtained, and The maximum duration is determined based on the first duration and the second duration.

Here, based on experimental testing, the first time duration required for applying drawing processing to the first type of layer and the second time duration required for layer synthesis processing can be obtained respectively.

Specific experimental testing methods can be set according to actual conditions, and this disclosure does not limit this. For example, the robot hand can be used to touch the display interface, and the Android system trace (System Trace, Systrace) tool can be used to capture the first timing information of the terminal device applying drawing processing to at least one layer, and to perform layer processing on at least one layer. Synthesize the second timing information of the processing; and determine the first duration required to apply drawing processing to the first type of layer based on the plurality of first timing information; determine the first duration required for the first type of layer based on the plurality of second timing information. The second amount of time required for layer compositing processing for a type of layer, thereby determining the maximum time.

Here, the Systrace is a tool for performance analysis of the Android operating system of the terminal device. The functions of Systrace include tracking the input/output operations of the system, the kernel work queue, the central processor load, and the operating status of each subsystem of the Android operating system.

In some embodiments, the processing time of applying drawing processing and layer synthesis processing can also be obtained by obtaining multiple historical image frames, and determining the processing time of the first type of image based on the processing time of the multiple historical image frames. The maximum amount of time it takes for a layer to undergo application drawing and layer compositing processing.

After determining the maximum duration required to apply the drawing process and the layer synthesis process, determine the difference between the maximum duration and the signal period of the first synchronization signal, and determine the preset based on the difference. time; thus at the preset time before the next first synchronization signal is generated after the Move event is detected, the application drawing process is performed on at least one first type layer generated by the Move event, and the application drawing process is completed Afterwards, directly trigger the layer composition processing of the at least one first type layer, so that the application drawing processing and layer composition processing of the at least one first type layer generated by the Move event can be executed in a first synchronization signal. Completed within the signal cycle, reducing the touch delay of the terminal device.

In some embodiments, in step S102, after the application drawing process of the at least one first-type layer is completed, the layer synthesis process of the at least one first-type layer is triggered to obtain the target image frame. ,include:

In this embodiment of the present disclosure, after the target application completes the application drawing process of at least one first type layer generated by the touch event, it will write the at least one first type layer after the application drawing process into the graph. Within the layer composition cache; after Surface Flinger detects the first write operation to the layer composition cache, based on the triggering of the first write operation, the Surface Flinger reads the first write operation from the layer composition cache. Enter the first type of layer written by the operation, perform layer synthesis processing on the first type of layer, and obtain the target image frame.

It should be noted that in related technologies, Surface Flinger usually reads the first type of layer from the layer composition cache and performs layer composition on the first type of layer when triggered by the second synchronization signal. deal with. If Surface Flinger detects the first write operation to the layer synthesis cache only after the last second synchronization signal is generated, at this time, Surface Flinger needs to wait for about one signal period of the second synchronization signal before it can perform all operations on it. The first type of layer written by the first writing operation is subjected to layer synthesis processing.

In order to reduce the waiting time during the layer composition process, the embodiment of the present disclosure will use the writing time of the first write operation of the layer composition cache as the trigger time to trigger the layer composition process, so that the Surface Flinger detects After the first write operation to the layer composition cache, layer composition processing is directly performed on the first type of layer written by the first write operation without waiting for the next second synchronization signal. The generation of the layer greatly reduces the processing delay in the layer composition process.

In some embodiments, the method further includes:

In this embodiment of the present disclosure, the layers to be subjected to application drawing processing and layer synthesis processing include: first type layers and/or second type layers.

It should be noted that the second type of layer is triggered by an application event of the application currently running on the terminal device; for example, when the terminal device is in the first application state, the stylus establishes a connection with the terminal device. , a connection establishment prompt window will pop up on the display interface; the connection establishment prompt window image includes at least one second type layer triggered by a connection establishment event.

When an application event is detected and the terminal device is in the first application state, obtain at least one second type layer generated by the application event and wait for the generation of the next first synchronization signal; and based on the When the next synchronization signal is triggered, apply drawing processing to the at least one second type layer, and write the at least one second type layer after applying the drawing process into the layer synthesis cache.

It should be noted that since the second type of layer is triggered by application events, there is some delay in the application drawing processing and layer synthesis processing of the second type of layer, which affects the image display of the display interface. The effect will not be affected, so the application drawing processing of the second type of layer can be triggered based on the first synchronization signal; the image synthesis processing can be triggered based on the second synchronization signal. That is, the processing timing of the terminal device's application drawing processing and image synthesis processing for the first type of layer is different from the processing timing of the application drawing processing and image synthesis processing for the second type of layer.

After Surface Flinger detects the second write operation to the layer synthesis cache, based on the signal period of a second synchronization signal before the second write operation, it determines whether there is a request for the first type of data within the signal period. Layer composition processing of layers;

If it is determined that there is layer synthesis processing for the first type of layer within the signal period, within the signal period of the next second synchronization signal after the second write operation to the layer synthesis cache is detected, Detecting a first write operation to the layer composition cache, and when detecting the first write operation, triggering the execution of at least one first type layer and at least one second type layer stored in the layer composition cache. Layer synthesis is processed to obtain the target image frame.

It should be noted that when the terminal device is in the first application state, that is, when the target application is running on the terminal device, there will be times when both the first type of layer and the second type of layer need to perform image synthesis processing. , for example, when using a stylus to draw on the display interface, prompt information from other applications pops up; at this time, the first type of layer generated by the stylus drawing and the second type of image generated by the prompt information All layers need to be layered.

In order to ensure that the layer composition processing of the first type of layer is given priority when the terminal device is in the first application state, at least one second type of layer after application drawing processing can be written into the layer composition cache. , determine whether there is layer synthesis processing for the first type of layer within the signal period of a second synchronization signal before the second writing operation;

If there is layer composition processing for the first type of layer, Surface Flinger can delay the layer composition processing for the second type of layer, and after detecting the first write operation, based on the first write operation Enter the operation to trigger Surface Flinger to perform image synthesis processing on the first type of layer and the second type of layer in the layer synthesis cache to obtain the target image frame.

It can be understood that, within the signal period of a second synchronization signal after Surface Flinger completes the image synthesis processing of at least one first-type layer corresponding to the n-th touch event and obtains the n-th frame target image, Surface Flinger A second write operation of writing at least one second-type layer to the layer composition cache is detected; at this time, if Surface Flinger performs processing on the second-type layer based on the processing timing of the second-type layer's layer composition processing, Layer synthesis processing, that is, performing layer synthesis processing on the second type of layer based on the triggering of the second synchronization signal, may result in the layer synthesis of at least one first type layer corresponding to the n+1th touch event. The processed target image frame will be refreshed and displayed on the display interface after delaying the signal cycle of the third synchronization signal, causing touch delay and display screen freezes.

Therefore, in this disclosed embodiment, after Surface Flinger detects the second write operation, it needs to first determine whether there is a response to the nth touch event within the signal period of a second synchronization signal before the second write operation. Image synthesis processing of at least one first type layer. If there is image synthesis processing of at least one first type layer corresponding to the n-th touch event, layer synthesis of the second type layer can be delayed. Processing; and within the signal period of a second synchronization signal after the second writing operation, triggering the first writing operation of at least one first type layer corresponding to the n+1th touch event, Perform layer composition processing on at least one first type layer and the at least one second type layer corresponding to the n+1th touch event in the layer composition cache to obtain the target image frame, thereby When both the first type of layer and the second type of layer need to undergo image synthesis processing, the touch delay and display screen freeze caused by the layer synthesis processing are reduced, and the user experience is improved.

In some embodiments, the method further includes:

In the embodiment of the present disclosure, after Surface Flinger detects the second write operation to the layer composition cache, it determines the signal period based on the signal period of a second synchronization signal before the second write operation. Whether there is layer synthesis processing for the first type of layer;

If there is no layer synthesis processing for the first type of layer within the signal period, the layer synthesis cache can be based on the trigger of the next second synchronization signal after the second write operation. Perform layer synthesis processing on at least one second type layer to obtain a target image frame.

It can be understood that if Surface Flinger does not detect the layer synthesis processing of the first type of layer within the signal period of a second synchronization signal before the second writing operation, it means that the second During the signal period of the second synchronization signal before the writing operation, the touch body does not contact the display interface; therefore, the first writing will not occur during the signal period of the second synchronization signal after the second writing operation. In the input operation, there is no need to perform layer composition processing on the first type of layer.

At this time, based on the triggering of the next second synchronization signal after the second writing operation, layer synthesis processing can be performed on at least one second type layer in the layer synthesis cache to obtain a target image frame; And under the trigger of the third synchronization signal, the target image frame is refreshed and displayed on the display interface.

In some embodiments, before applying the drawing process to at least one first type layer corresponding to the touch event based on the type of the touch event and the target triggering moment of the application drawing process corresponding to the type, The method also includes:

In an embodiment of the present disclosure, the terminal device receives the user's selection operation for the application icon of any application program displayed on the display interface, starts the application program corresponding to the application icon; and responds to the startup of the application program Operation to obtain the window identifier corresponding to the application;

Here, the window identification may include: the number, name, etc. of the application window. It can be understood that all open application windows on the display interface have corresponding window identifiers, and the window identifiers can indicate the applications currently running in the foreground of the terminal device.

The preset identification may be a preset window identification of a target application; here, the target application may include: a drawing application, a document application, etc.

By comparing the window identifier of the application program with the preset identifier, it is determined whether the window identifier of the application program contains the preset identifier; if the window identifier of the application program contains the preset identifier, it means that the terminal device is in The application running in the foreground is the target application, that is, the terminal device is in the first application state.

It can be understood that after detecting a touch event in the embodiment of the present disclosure, the window identifier corresponding to the application program can be obtained, and based on the window identifier, it can be determined whether the application program currently running in the foreground of the terminal device is the target application program, and When the application program currently running in the foreground of the terminal device is the target application program, that is, when the terminal device is in the first application state, at least one first-type layer generated by the touch event is obtained, so as to facilitate processing based on the touch event. type and the target triggering moment of the application drawing processing corresponding to the type, perform application drawing processing on at least one first type layer corresponding to the touch event, and after the application drawing processing is completed, trigger the application drawing processing on the at least one first type layer corresponding to the touch event. The layer synthesis process of a type of layer is used to obtain the target image frame.

The embodiment of the present disclosure determines whether the terminal device is in the first application state with higher chirality requirements by obtaining the window identifier. If the terminal device is in the first application state, at least one first type image generated by the touch event is When performing application drawing processing and layer synthesis processing, there is no need to wait for the triggering of the first synchronization signal and the second synchronization signal, thereby effectively reducing the touch delay in the entire process and improving the user experience.

In some embodiments, the method further includes:

In this embodiment of the present disclosure, by comparing the window identifier of the application program with the preset identifier, it is determined whether the window identifier of the application program contains a preset identifier; if the window identifier corresponding to the application program does not Containing the preset identification indicates that the application program running in the foreground of the terminal device is not the target application program, that is, the terminal device is in the second application state.

It can be understood that, considering that when the terminal device is in the second application state, even if a touch delay occurs on the terminal device, since the chirality requirements of the second application state are lower, the touch delay will not affect the display effect of the terminal device. Therefore, when the terminal device is in the second application state, the application drawing processing and layer synthesis processing of at least one first type layer corresponding to the touch event can be started respectively according to the triggering of the first synchronization signal and the second synchronization signal.

An embodiment of the present disclosure also provides a method for updating a display image, as shown in Figure 2. Figure 2 is a flowchart 2 of a method for updating a display image according to an exemplary embodiment. The method includes:

Step S201: In response to the startup operation of any application program on the display interface, obtain the window identifier corresponding to the application program; determine whether the window identifier corresponding to the application program includes a preset identifier; if the application program The corresponding window identifier includes a preset identifier, confirming that the terminal device is in the first application state;

In this example, the terminal device being in the first application state may be: the terminal device is in a stylus application scenario.

By obtaining the window identification of the application program, it can be determined whether the window identification of the application program includes the window identification corresponding to the stylus application. If the window identification of the application program includes the window identification corresponding to the stylus application, it is determined that the terminal device is in the first Application status.

It is understandable that due to the high chirality requirements of the stylus application scenario, in the Android operating system, displaying a frame of images from the stylus drawing to the screen display on the display interface requires about 3 vertical synchronization signals. Signal cycle, even if the frequency refresh rate of the display screen of the terminal device is 120Hz, the delay of the next frame of image in the stylus application scenario is about 24ms, seriously reducing the user experience.

Step S202: A touch event for the display interface is detected. If the type of the touch event indicates that the touch event is a Down event, based on the detection time when the Down event is detected, the corresponding value of the Down event is At least one first-type layer performs application drawing processing;

In this example, when a touch event is detected and the terminal device is in a stylus application scenario, the type of the touch event can be determined first. If the type of the touch event indicates that the touch event is a Down event, the touch event can be At the detection moment when the Down event is detected, application drawing processing is performed on at least one first type layer generated by the Down event.

It can be understood that a touch event sequence refers to a series of events generated in the process starting from the moment the touch object touches the screen and ending at the moment the touch object leaves the screen; a touch event sequence is It starts with the Down event, contains at least one Move event in the middle, and finally ends with the Up event.

As shown in FIG. 3 , FIG. 3 is a schematic diagram of processing of image frames corresponding to the Down event shown in the related art. In the related technology, after detecting the Down event, the terminal device will transfer at least one first-type layer generated by the Down event to the application for application drawing processing when triggered by the next first synchronization signal. That is, the application drawing processing of the Down event needs to wait for the first synchronization signal to be triggered. Here, the first synchronization signal is a Vsync-app signal.

As shown in FIG. 4 , FIG. 4 is a schematic diagram of processing an image frame corresponding to a Down event according to an exemplary embodiment. In this example, after detecting the Down event, the application drawing processing of at least one first-type layer corresponding to the Down event is immediately started without waiting for the first synchronization signal to be triggered, thereby reducing the delay in the application drawing processing stage.

Step S203: If the type of the touch event indicates that the touch event is a Move event, at a preset time before generating the next first synchronization signal, perform a step on at least one first type layer corresponding to the Move event. Application rendering processing; wherein the first synchronization signal is a system vertical synchronization signal that triggers application rendering processing;

In this example, when a touch event is detected and the terminal device is in a stylus application scenario, if the type of the touch event indicates that the touch event is a Move event, the preset time before generating the next first synchronization signal can be Assume that at a time, apply drawing processing is performed on at least one first-type layer generated by the Move event.

As shown in FIG. 5 , FIG. 5 is a schematic diagram of processing of image frames corresponding to the Move event shown in the related art. In the related technology, after detecting the Move event, the terminal device will, under the trigger of the next first synchronization signal, pass at least one first-type layer generated by the Move event to the application for application drawing processing; thus causing the Move event to generate The application drawing process and layer composition process of at least one first-type layer cannot be completed within a signal period of the first synchronization signal.

As shown in FIG. 6 , FIG. 6 is a schematic diagram of processing an image frame corresponding to a Down event according to an exemplary embodiment. After detecting the Move event, this example will apply drawing processing to at least one first-type layer generated by the Move event at the preset time before the next first synchronization signal is generated, that is, start at least one layer generated by the Move event in advance. The first type of layer applies drawing processing.

Here, the preset time may be 2ms.

In some embodiments, the maximum duration required to perform application drawing processing and layer synthesis processing on the first type of layer can be obtained; based on the difference between the maximum duration and the signal period of the first synchronization signal value to determine the preset time.

It can be understood that, based on the difference between the maximum duration and the signal period of the first synchronization signal, the processing time for applying drawing processing to at least one first type layer generated by the Move event is determined in advance, so that The application drawing processing and layer synthesis processing of at least one first-type layer generated by the Move event can be completed within a signal period of the first synchronization signal.

Step S204: After the application drawing process of the at least one first type layer is completed, the at least one first type layer after the application drawing process is written into the layer composition cache; based on the first type layer When the first write operation is triggered, perform layer synthesis processing on the at least one first type layer in the layer synthesis cache to obtain the target image frame;

As shown in Figure 4 and Figure 6, in this example, after completing the application drawing process on the first type layer, at least one first type layer after applying the drawing process is passed to Surface Flinger, so that Surface Flinger receives Immediately after the first type of layer, layer synthesis processing is performed on the first type of layer to obtain the target image frame.

It should be noted that, as shown in Figure 3 and Figure 5, in the related technology, Surface Flinger needs to start the layer synthesis process under the trigger of the second synchronization signal (ie, Vsync-sf signal); in this example, according to the layer synthesis The first write operation of the cache triggers layer synthesis processing on the first type of layer written by the first write operation, so that after completing the application drawing processing of the first type of layer, the first type of layer can be processed immediately. The image undergoes layer composition processing to reduce delays in the layer composition processing stage.

As can be seen from Figures 3 and 4, in the related art, the processing of the image frame corresponding to the Down event requires approximately 3-4 signal periods of the vertical synchronization signal, while in this example, the processing of the image frame corresponding to the Down event requires approximately 2- 3 signal periods of the vertical synchronization signal, reducing the delay by approximately one signal period of the vertical synchronization signal.

As can be seen from Figures 5 and 6, in the related art, the processing of the image frame corresponding to the Move event requires approximately two signal periods of the vertical synchronization signal, while in this example, the processing of the image frame corresponding to the Down event can be processed in one vertical synchronization signal. It is completed within the signal period, and also reduces the delay of about one signal period of the vertical synchronization signal.

In some embodiments, based on the triggering of the first synchronization signal, apply drawing processing to the acquired at least one second type layer, and write the at least one second type layer after applying the drawing process into the layer composition. Caching; wherein the second type of layer is generated by an application event trigger of an application currently running on the terminal device;

In this example, the terminal device contains two different vertical synchronization signal triggering mechanisms; one is for the first type of layer generated by the terminal device in the first application state; the other is for the first type of layer generated by the terminal device. The second type of layer.

When the terminal device is in the first application state, and there are first-type layers and second-type layers for layer synthesis, the system vertical synchronization signal triggering mechanism corresponding to the first-type layer is the main one, and the first-type layer is processed first. Layer composition processing of class layers.

After the second type of layer completes the application drawing process, the second type of layer is written into the layer synthesis cache, and it is determined whether there is a request for the first type of layer in the last signal period of the second synchronization signal. Layer synthesis processing, if there is layer synthesis processing for the first type of layer in the last signal period of the second synchronization signal, it means that within a second synchronization signal period of layer synthesis processing for the second type of layer , a new first-type layer will be written into the layer composition cache.

Based on this, in order to reduce screen freezes, within a second synchronization signal period after the second writing operation, even if the second synchronization signal arrives, the layer synthesis process of the second type of layer will not be performed first. Instead, it waits until the first writing operation is detected, and then performs layer synthesis processing on the first type of layer and the second type of layer together under the trigger of the first writing operation.

In other embodiments, if there is no layer synthesis processing for the first type of layer, based on the triggering of the next second synchronization signal, at least one second type of layer in the layer buffer is synthesized. Perform layer synthesis processing to obtain the target image frame.

In this example, if there is layer synthesis processing for the first type of layer within the last signal period of the second synchronization signal, it means that within a second synchronization signal period of layer synthesis processing for the second type of layer , no new first-type layer will be written into the layer synthesis cache, so the triggering mechanism of the system vertical synchronization signal corresponding to the second-type layer can be directly used, that is, under the trigger of the second synchronization signal, the third-type layer is The second type of layer is used for layer synthesis processing.

Step S205: If the window identifier corresponding to the application program does not include the preset identifier, it is determined that the terminal device is in the second application state; a touch event for the display interface is detected, and the terminal device is in In the second application state, based on the triggering of the first synchronization signal, application drawing processing is performed on at least one first type layer corresponding to the touch event; based on the triggering of the second synchronization signal, application drawing processing is performed on the At least one first-type layer performs layer synthesis processing to obtain the target image frame;

In this example, the terminal device being in the second application state may be: the terminal device is not in a stylus application scenario.

It is understandable that in the Android operating system, although it takes about 3 signal cycles of the vertical synchronization signal to display a frame of image from stylus drawing to screen display on the display interface, the application scenario of the terminal device is different from that of the handheld device. The performance requirements are not high, and even if there is a delay, it will not affect the display effect of the terminal device; therefore, when the terminal device is in the second application state, the application drawing processing can be executed respectively based on the triggering of the first synchronization signal and the second synchronization signal. and layer compositing.

Step S206: Update the display image of the display interface based on the target image frame.

In this example, after the synthesized target image frame is obtained, the target image frame is refreshed and displayed on the display interface of the terminal device under the trigger of the third synchronization signal.

An embodiment of the present disclosure also provides an updating device for displaying images. Figure 7 is a schematic structural diagram of a device for updating a display image according to an exemplary embodiment. As shown in Figure 7, the device is applied to a terminal device. The device 100 includes:

The first processing module 101 is configured to detect a touch event for the display interface, and when the terminal device is in the first application state, draw the processing based on the type of the touch event and the application corresponding to the type. At the target trigger moment, apply drawing processing to at least one first-type layer corresponding to the touch event;

The second processing module 102 is configured to trigger layer synthesis processing on the at least one first-type layer after the application drawing process of the at least one first-type layer is completed to obtain a target image frame;

The update module 103 is configured to update the display image of the display interface based on the target image frame.

In some embodiments, the first processing module 101 is configured as:

In some embodiments, the second processing module 102 is configured to:

In some embodiments, the first processing module 101 is configured as:

The second processing module 102 is configured as:

In some embodiments, the second processing module 102 is configured to:

In some embodiments, the first processing module 101 is configured as:

The second processing module 102 is configured as:

Figure 8 is a block diagram of a terminal device according to an exemplary embodiment. For example, the terminal device 800 may be a mobile phone, a mobile computer, etc.

Referring to FIG. 8 , the terminal device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power supply component 806 , a multimedia component 808 , an audio component 810 , an input/output (I/O) interface 812 , and a sensor component 814 , and communication component 816.

The processing component 802 generally controls the overall operations of the terminal device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above method. Additionally, processing component 802 may include one or more modules that facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.

Memory 804 is configured to store various types of data to support operations at device 800 . Examples of such data include instructions for any application or method operating on the terminal device 800, contact data, phonebook data, messages, pictures, videos, etc. Memory 804 may be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EEPROM), Programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

Power supply component 806 provides power to various components of terminal device 800 . Power supply components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to end device 800 .

Multimedia component 808 includes a screen providing an output interface between the terminal device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide action. In some embodiments, multimedia component 808 includes a front-facing camera and/or a rear-facing camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front-facing camera and rear-facing camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.

Audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a microphone (MIC) configured to receive external audio signals when the terminal device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may be further stored in memory 804 or sent via communication component 816 . In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

The I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module, which may be a keyboard, a click wheel, a button, etc. These buttons may include, but are not limited to: Home button, Volume buttons, Start button, and Lock button.

Sensor component 814 includes one or more sensors for providing various aspects of status assessment for terminal device 800 . For example, the sensor component 814 can detect the open/closed state of the device 800 and the relative positioning of components, such as the display and keypad of the terminal device 800. The sensor component 814 can also detect the terminal device 800 or a component of the terminal device 800. position changes, presence or absence of user contact with the terminal device 800 , orientation or acceleration/deceleration of the terminal device 800 and temperature changes of the terminal device 800 . Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 816 is configured to facilitate wired or wireless communication between the terminal device 800 and other devices. The terminal device 800 can access a wireless network based on a communication standard, such as Wi-Fi, 4G or 5G, or a combination thereof. In one exemplary embodiment, the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communications component 816 also includes a near field communications (NFC) module to facilitate short-range communications. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

In an exemplary embodiment, the terminal device 800 may be configured by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A programmable gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation is used to perform the above method.

In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions, such as a memory 804 including instructions, which can be executed by the processor 820 of the terminal device 800 to complete the above method is also provided. For example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

Other embodiments of the invention will be readily apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. The present disclosure is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common common sense or customary technical means in the technical field that are not disclosed in the present disclosure. . It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.

It is to be understood that the present invention is not limited to the precise construction described above and illustrated in the accompanying drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

Claims

A method for updating display images, applied to terminal equipment, wherein the method includes:

When a touch event for the display interface is detected and the terminal device is in the first application state, based on the type of the touch event and the target trigger time of the application drawing process corresponding to the type, the touch event is At least one first-type layer corresponding to the event is applied for drawing processing;

After the application drawing process of the at least one first type layer is completed, trigger the layer synthesis process of the at least one first type layer to obtain the target image frame;

Based on the target image frame, the display image of the display interface is updated.
The method according to claim 1, wherein, based on the type of the touch event and the target trigger time of the application drawing process corresponding to the type, at least one first type layer corresponding to the touch event is Perform application drawing processing, including:

If the type of the touch event indicates that the touch event is a click event, based on the detection time when the click event is detected, an application drawing process is performed on at least one first type layer corresponding to the click event.
The method of claim 1 , wherein the at least one first trigger moment corresponding to the touch event is determined based on the type of the touch event and the target triggering moment of the application drawing process corresponding to the type of the touch event. A type of layer performs application drawing processing, including:

If the type of the touch event indicates that the touch event is a sliding event, at a preset time before generating the next first synchronization signal, apply drawing processing to at least one first type layer corresponding to the sliding event. ; Wherein, the first synchronization signal is a system vertical synchronization signal that triggers application drawing processing.
The method of claim 3, further comprising:

Obtain the maximum time required to apply drawing processing and layer composition processing to the first type of layer;

The preset time is determined based on the difference between the maximum duration and the signal period of the first synchronization signal.
The method according to claim 1, wherein after the application drawing process of the at least one first type layer is completed, the layer synthesis process of the at least one first type layer is triggered to obtain the target image. frames, including:

After the application drawing process of the at least one first type layer is completed, writing the at least one first type layer after the application drawing process into the layer composition cache;

Based on the triggering of the first write operation of the first type layer, layer synthesis processing is performed on the at least one first type layer in the layer synthesis cache to obtain the target image frame.
The method of claim 5, further comprising:

Based on the triggering of the first synchronization signal, apply drawing processing to the acquired at least one second type layer, and write the at least one second type layer after applying the drawing process into the layer synthesis cache; wherein, the The second type of layer is generated by application event triggering of the application currently running on the terminal device;

Based on the signal period of a second synchronization signal before the second writing operation of the second type image, determine whether there is layer synthesis for the first type of layer within the signal period of the second synchronization signal. Processing; the second synchronization signal is a system vertical synchronization signal that triggers layer synthesis processing;

performing layer synthesis processing on the at least one first type layer in the layer synthesis cache based on the triggering of the first write operation of the first type layer to obtain the target image frame, include:

If there is layer synthesis processing for the first type of layer, within a signal period of the second synchronization signal after the second writing operation, based on the triggering of the first writing operation, the The at least one first-type layer and the at least one second-type layer in the layer composition cache are subjected to layer composition processing to obtain the target image frame.
The method of claim 6, further comprising:

If there is no layer synthesis processing for the first type of layer, based on the trigger of the next second synchronization signal, layer synthesis processing is performed on at least one second type of layer in the layer synthesis cache to obtain The target image frame.
The method of claim 1, wherein at least one first type layer corresponding to the touch event is processed at a target triggering moment based on the type of the touch event and the application drawing process corresponding to the type. Before applying the drawing process, the method further includes:

In response to a startup operation for any application program on the display interface, obtain the window identifier corresponding to the application program;

Determine whether the window identifier corresponding to the application program includes a preset identifier;

If the window identifier corresponding to the application program includes a preset identifier, it is determined that the terminal device is in the first application state, and at least one first type layer generated by the touch event is obtained.
The method of claim 8, further comprising:

If the window identifier corresponding to the application program does not include the preset identifier, it is determined that the terminal device is in the second application state;

When a touch event for the display interface is detected and the terminal device is in the second application state, based on the triggering of the first synchronization signal, at least one first type layer corresponding to the touch event is Perform application drawing processing;

Based on the triggering of the second synchronization signal, a layer synthesis process is performed on at least one first type layer after applying the drawing process.
An update device for displaying images, applied to terminal equipment, including:

A first processing module configured to detect a touch event for the display interface, and when the terminal device is in the first application state, draw a processing target based on the type of the touch event and the application corresponding to the type. At the triggering moment, apply drawing processing to at least one first-type layer corresponding to the touch event;

The second processing module is configured to trigger layer synthesis processing on the at least one first-type layer after the application drawing process of the at least one first-type layer is completed to obtain a target image frame;

An update module configured to update the display image of the display interface based on the target image frame.
An update device for displaying images, which includes:

processor;

memory configured to store executable instructions;

Wherein, the processor is configured to implement the display image updating method according to any one of claims 1 to 9 when executing executable instructions stored in the memory.
A non-transitory computer-readable storage medium that, when instructions in the storage medium are executed by a processor of an update device that displays an image, enables the update device that displays an image to perform any one of claims 1 to 9 The method for updating display images.