CN117058291A

CN117058291A - Video memory switching method and electronic equipment

Info

Publication number: CN117058291A
Application number: CN202310857407.5A
Authority: CN
Inventors: 王剑
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2023-07-12
Filing date: 2023-07-12
Publication date: 2023-11-14

Abstract

A video memory switching method and an electronic device, wherein the electronic device is provided with a first application, and the video memory of the electronic device at least comprises a first frame buffer area and a second frame buffer area, and the method comprises the following steps: the electronic equipment copies the rendering data in the first frame buffer area to the second frame buffer area, and sends the rendering data in the second frame buffer area to the display screen to display the first user interface; the electronic equipment responds to the first operation, and directly sends the rendering data in the first frame buffer area to the display screen to display a second user interface; the second user interface is an interface of the first application, and the first operation is used for starting the first application. The embodiment of the application is used for saving the memory space, optimizing the memory resource scheduling and improving the processing speed.

Description

Video memory switching method and electronic equipment

Technical Field

The scheme relates to the technical field of terminals, in particular to a video memory switching method and electronic equipment.

Background

To provide a better quality refresh experience to the user, the electronic device may use multiple frame buffers to store data for display to the screen. However, the frame buffer area used for display is in the memory space, the total memory space is smaller, the resource scheduling is tense, the processing speed is high, the more the electronic equipment uses the frame buffer area for display, the less the memory space can be scheduled by other threads, and the processing speed is slower.

Disclosure of Invention

The application provides a video memory switching method and electronic equipment, which can save memory space, optimize memory resource scheduling and improve processing speed.

In a first aspect, the present application provides a video memory switching method, where the method is applied to an electronic device, where the electronic device is installed with a first application, and a video memory of the electronic device includes at least a first frame buffer area and a second frame buffer area, and the method includes: the electronic equipment copies the rendering data in the first frame buffer area to the second frame buffer area, sends the rendering data in the second frame buffer area to a display screen, and displays a first user interface; the electronic equipment responds to a first operation, directly sends the rendering data in the first frame buffer area to the display screen, and displays a second user interface; wherein the second user interface is an interface of the first application, and the first operation is used for starting the first application.

The first frame buffer may refer to a first FB of the present application, and the second frame buffer may refer to a second FB of the present application. First user interface referring to fig. 4A, second user interface may refer to fig. 4B.

In the embodiment of the application, the first application does not need to pursue a high refresh rate, and the electronic device can switch the video memory from the second FB to the first FB and mark the video memory state as being switched under the condition of starting the first application. When the switching of the electronic device is completed, the memory state may be changed to the non-switching state. At this time, the number of display and storage used by the electronic device is reduced, the high refresh rate is not required to be maintained, the memory space of the second FB can be released for other uses of the first application, resources are effectively scheduled, the shortage of processing resources and storage resources is relieved, the processing speed is higher due to coordination of the resources, and the performance of the electronic device is better.

In one possible implementation, the electronic device, in response to a first operation, directly sends the rendering data in the first frame buffer to the display screen, and displays a second user interface, including: and the electronic equipment responds to the first operation, switches the sending and displaying frame buffer area from the second frame buffer area to the first frame buffer area, and sends the rendering data in the first frame buffer area to the display screen to display the second user interface under the condition that the switching is completed. Therefore, under the condition that the switching is completed, the display of the first frame buffer area is performed, so that the screen display is not influenced in the switching process, and the occurrence of the condition of flower frames is avoided. In addition, the switching time is extreme, so that the user experience is not affected. The display frame sending buffer area is a frame buffer area for sending rendering data to a display screen in a display memory.

In one possible implementation manner, before the first operation, responding to a first TE interrupt signal, judging that the display quantity is a second quantity, sending the rendering data in the second frame buffer to the display screen, and displaying the first user interface; the method further comprises the steps of: setting the number of the video memories from the second number to the first number in response to the first operation; the step of directly sending the rendering data in the first frame buffer to the display screen to display a second user interface, and the step of further comprising: after the first operation, in response to a second TE interrupt signal, determining that the display number is a first number, rendering image data, and storing the rendering data in the first frame buffer. Therefore, the electronic equipment can switch the number of the video memories from double to single, and TE interruption is changed from direct display sending to rendering data, so that the reliability and the safety of a switching result are ensured.

The number of the display memories is the second number, and the number of the display memories in the corresponding instruction is double. The number of the video memories is a first number, and the number of the video memories in the corresponding instruction is a single number. After the display quantity is judged to be the second quantity in response to the first TE interrupt signal, the electronic sum also needs to judge whether the second frame buffer area is valid or not, the second frame buffer area is valid before the first operation, rendering data in the second frame buffer area is sent to the display screen, and the first user interface is displayed.

In one possible implementation, the electronic device copies the rendering data in the first frame buffer to the second frame buffer, sends the rendering data in the second frame buffer to a display screen, and displays a first user interface, including: before the first operation, responding to a first ER interrupt signal, judging that the display quantity is a second quantity, and if the state of the first frame buffer area is available, copying the rendering data in the first frame buffer area to the second frame buffer area; rendering image data and storing the rendered data into the first frame buffer if the state of the first buffer is unavailable; the method further comprises the steps of: setting the number of the video memories from a second number to a first number in response to the first operation; the step of directly sending the rendering data in the first frame buffer to the display screen to display a second user interface, including: after the first operation, responding to a second ER interrupt signal, judging that the display quantity is a first quantity, directly sending the rendering data in the first frame buffer area to the display screen, and displaying the second user interface. Therefore, the electronic equipment can switch the number of the video memories from double to single, ER interrupt triggers maintenance, if the number of the video memories is double, whether the first FB is available or not is judged, copy processing can be performed immediately, and rendering and storage are performed immediately after the first FB is unavailable, so that copying of effective data is ensured. If the number of the display is switched to be single, the display is directly sent and displayed, so that the reliability and the safety of the switching result are ensured.

If the state of the first buffer area is unavailable, the electronic device further needs to determine whether the current video memory state is in switching, and determine that the current video memory state is not in switching at this time, that is, execute rendering image data, and store the rendering data in the first frame buffer area.

In one possible embodiment, the method further comprises: the electronic equipment responds to a second operation, copies the rendering data in the first frame buffer area to the second frame buffer area, sends the rendering data in the second frame buffer area to the display screen, and displays a third user interface; wherein the first operation is to exit the first application.

Wherein the third user interface may be described with reference to fig. 4C.

In the embodiment of the application, under the condition that the first application exits, the electronic device can copy the data of the first FB to the second FB and then send and display the data by using the second FB. After that, the number of display memories used by the electronic equipment is increased, and the condition of high refresh rate is recovered, so that the high refresh requirements of other applications and displays are ensured, and the refresh experience of a user is ensured.

In a possible implementation manner, the directly sending the rendering data in the first frame buffer to the display screen, displaying a second user interface, includes: before the second user interface is displayed and the second operation is acquired, responding to a third TE interrupt signal, judging the display quantity as a first quantity, rendering image data, storing the rendering data into the first frame buffer area, sending the rendering data in the first frame buffer area to the display screen, and displaying the second user interface; the method further comprises the steps of: setting the number of the video memories from a first number to a second number in response to the second operation; copying the rendering data in the first frame buffer area to the second frame buffer area, and sending the rendering data in the second frame buffer area to the display screen to display a third user interface, including: after the second operation, in response to a fourth TE interrupt signal, if the display number is the second number, determining whether a state of a second frame buffer is valid, and if the state of the second frame buffer is valid, sending rendering data in the second frame buffer to the display screen, and displaying the third user interface. Therefore, the electronic equipment can switch the number of the video memories from single to double, and the TE interruption is directly sent and displayed under the condition that the rendering data change is judged to be effective in the state of the second frame buffer area, so that the reliability and the safety of the switching result are ensured.

In one possible implementation manner, in response to a second operation, the electronic device copies the rendering data in the first frame buffer to the second frame buffer, sends the rendering data in the second frame buffer to the display screen, and displays a third user interface, and further includes: in response to the second operation, marking the state of the second frame buffer area as invalid, judging the state of the second frame buffer area as invalid, and suspending sending the rendering data in the second frame buffer area to the display screen; copying the rendering data in the first frame buffer area to the second frame buffer area, and marking the state of the second frame buffer area as valid under the condition that copying is completed. Thus, along with the change of the copying process, the state mark of the second frame buffer area of the electronic equipment changes, copying is completed, and the mark is effective, so that the display can be sent and displayed, the reliability of the display data is ensured, and the screen display is avoided.

The state of the second frame buffer frame is invalid, and the next frame TE signal may be that the state of the second frame buffer frame is valid, and the sending and displaying are performed.

In a possible implementation manner, the directly sending the rendering data in the first frame buffer to the display screen, displaying a second user interface, includes: before the second user interface is displayed and the second operation is acquired, responding to a third ER interrupt signal, judging that the display quantity is the first quantity, directly sending the rendering data in the first frame buffer area to a display screen, and displaying the second user interface; the method further comprises the steps of: setting the number of the video memories from a first number to a second number in response to the second operation; copying the rendering data in the first frame buffer area to the second frame buffer area, and sending the rendering data in the second frame buffer area to the display screen to display a third user interface, including: after the second operation, responding to a fourth ER interrupt signal, judging that the display quantity is a second quantity, judging whether a video memory state is in switching or not, copying the rendering data in the first frame buffer area to the second frame buffer area under the condition that the video memory state is in non-switching, and sending the rendering data in the second frame buffer area to the display screen based on the video memory state to display the third user interface. Thus, the electronic equipment can switch the number of the display memories from single to double, ER interrupt triggers maintenance, and if the number of the display memories is switched to single, the display memories are directly sent to display. If the number of the display memories is double, judging whether the display memory state is in switching or not, and executing copy processing in non-switching. Therefore, the switching from single to double can ensure the reliability of display before and after switching and the safety of the scheme.

In a possible implementation manner, the copying the rendering data in the first frame buffer to the second frame buffer, and sending the rendering data in the second frame buffer to the display screen, and displaying a third user interface, further includes: in response to the second operation, marking the video memory state as being switched; judging that the video memory state is in switching, rendering image data, storing the rendering data into the first frame buffer area, copying the rendering data in the first frame buffer area into the second frame buffer area, and sending the rendering data in the second frame buffer area to the display screen to display the third user interface; and switching the display sending frame buffer area from the first frame buffer area to the second frame buffer area, and marking the display memory state as non-switching under the condition that the switching is completed, and judging that the display memory state is non-switching. Therefore, under the condition that switching is completed, the copying process is executed, the copied data is ensured to be reliable, and the problems of screen display and the like are avoided.

Wherein, in the switching period of the single-cut double, the fifth ER is interrupted, the trigger judgment is that the copying process is not executed in the switching, and the rendering is continued; and after that, when the switching is completed and marked as non-switching, acquiring a sixth ER interrupt, triggering and judging that the switching is non-switching, and executing the copying process. Reference is made to the description of the relevant T3 to T5 periods in fig. 5, and this is not repeated.

In a second aspect, the present application provides an electronic device, where a first application is installed on the electronic device, and a video memory of the electronic device includes at least a first frame buffer area and a second frame buffer area, where the method includes: one or more processors and one or more memories, the one or more memories for storing computer program code comprising computer instructions that, when executed by the one or more processors, cause the electronic device to perform:

copying the rendering data in the first frame buffer area to the second frame buffer area, sending the rendering data in the second frame buffer area to a display screen, and displaying a first user interface; responding to a first operation, directly transmitting the rendering data in the first frame buffer to the display screen, and displaying a second user interface; wherein the second user interface is an interface of the first application, and the first operation is used for starting the first application.

In one possible implementation manner, in response to the first operation, the rendering data in the first frame buffer is directly sent to the display screen, and a second user interface is displayed, specifically: and responding to the first operation, switching the sending and displaying frame buffer area from the second frame buffer area to the first frame buffer area, and sending the rendering data in the first frame buffer area to the display screen to display the second user interface under the condition that the switching is completed. Therefore, under the condition that the switching is completed, the display of the first frame buffer area is performed, so that the screen display is not influenced in the switching process, and the occurrence of the condition of flower frames is avoided. In addition, the switching time is extreme, so that the user experience is not affected. The display frame sending buffer area is a frame buffer area for sending rendering data to a display screen in a display memory.

In one possible implementation manner, before the first operation, responding to a first TE interrupt signal, judging that the display quantity is a second quantity, sending the rendering data in the second frame buffer to the display screen, and displaying the first user interface; the electronic device also performs: setting the number of the video memories from the second number to the first number in response to the first operation; the rendering data in the first frame buffer is directly sent to the display screen, a second user interface is displayed, and further execution is performed: after the first operation, in response to a second TE interrupt signal, determining that the display number is a first number, rendering image data, and storing the rendering data in the first frame buffer. Therefore, the electronic equipment can switch the number of the video memories from double to single, and TE interruption is changed from direct display sending to rendering data, so that the reliability and the safety of a switching result are ensured.

In a possible implementation manner, the copying the rendering data in the first frame buffer to the second frame buffer, sending the rendering data in the second frame buffer to a display screen, and displaying a first user interface specifically performs: before the first operation, responding to a first ER interrupt signal, judging that the display quantity is a second quantity, and if the state of the first frame buffer area is available, copying the rendering data in the first frame buffer area to the second frame buffer area; rendering image data and storing the rendered data into the first frame buffer if the state of the first buffer is unavailable; the electronic device also performs: setting the number of the video memories from a second number to a first number in response to the first operation; the method comprises the steps of directly sending the rendering data in the first frame buffer area to the display screen to display a second user interface, and specifically executing: after the first operation, responding to a second ER interrupt signal, judging that the display quantity is a first quantity, directly sending the rendering data in the first frame buffer area to the display screen, and displaying the second user interface. Therefore, the electronic equipment can switch the number of the video memories from double to single, ER interrupt triggers maintenance, if the number of the video memories is double, whether the first FB is available or not is judged, copy processing can be performed immediately, and rendering and storage are performed immediately after the first FB is unavailable, so that copying of effective data is ensured. If the number of the display is switched to be single, the display is directly sent and displayed, so that the reliability and the safety of the switching result are ensured.

In one possible implementation, the electronic device further performs: in response to a second operation, copying the rendering data in the first frame buffer area to the second frame buffer area, and sending the rendering data in the second frame buffer area to the display screen to display a third user interface; wherein the first operation is to exit the first application.

Wherein the third user interface may be described with reference to fig. 4C.

In a possible implementation manner, the rendering data in the first frame buffer is directly sent to the display screen to display a second user interface, and specifically performs: before the second user interface is displayed and the second operation is acquired, responding to a third TE interrupt signal, judging the display quantity as a first quantity, rendering image data, storing the rendering data into the first frame buffer area, sending the rendering data in the first frame buffer area to the display screen, and displaying the second user interface; the electronic device also performs: setting the number of the video memories from a first number to a second number in response to the second operation; copying the rendering data in the first frame buffer area to the second frame buffer area, sending the rendering data in the second frame buffer area to the display screen, displaying a third user interface, and specifically executing: after the second operation, in response to a fourth TE interrupt signal, if the display number is the second number, determining whether a state of a second frame buffer is valid, and if the state of the second frame buffer is valid, sending rendering data in the second frame buffer to the display screen, and displaying the third user interface. Therefore, the electronic equipment can switch the number of the video memories from single to double, and the TE interruption is directly sent and displayed under the condition that the rendering data change is judged to be effective in the state of the second frame buffer area, so that the reliability and the safety of the switching result are ensured.

In one possible implementation, in response to a second operation, the electronic device copies the rendering data in the first frame buffer to the second frame buffer, sends the rendering data in the second frame buffer to the display screen, displays a third user interface, and further performs: in response to the second operation, marking the state of the second frame buffer area as invalid, judging the state of the second frame buffer area as invalid, and suspending sending the rendering data in the second frame buffer area to the display screen; copying the rendering data in the first frame buffer area to the second frame buffer area, and marking the state of the second frame buffer area as valid under the condition that copying is completed. Thus, along with the change of the copying process, the state mark of the second frame buffer area of the electronic equipment changes, copying is completed, and the mark is effective, so that the display can be sent and displayed, the reliability of the display data is ensured, and the screen display is avoided.

In a possible implementation manner, the rendering data in the first frame buffer is directly sent to the display screen to display a second user interface, and specifically performs: before the second user interface is displayed and the second operation is acquired, responding to a third ER interrupt signal, judging that the display quantity is the first quantity, directly sending the rendering data in the first frame buffer area to a display screen, and displaying the second user interface; the electronic device also performs: setting the number of the video memories from a first number to a second number in response to the second operation; copying the rendering data in the first frame buffer area to the second frame buffer area, sending the rendering data in the second frame buffer area to the display screen, displaying a third user interface, and specifically executing: after the second operation, responding to a fourth ER interrupt signal, judging that the display quantity is a second quantity, judging whether a video memory state is in switching or not, copying the rendering data in the first frame buffer area to the second frame buffer area under the condition that the video memory state is in non-switching, and sending the rendering data in the second frame buffer area to the display screen based on the video memory state to display the third user interface. Thus, the electronic equipment can switch the number of the display memories from single to double, ER interrupt triggers maintenance, and if the number of the display memories is switched to single, the display memories are directly sent to display. If the number of the display memories is double, judging whether the display memory state is in switching or not, and executing copy processing in non-switching. Therefore, the switching from single to double can ensure the reliability of display before and after switching and the safety of the scheme.

In a possible implementation manner, the copying the rendering data in the first frame buffer to the second frame buffer, sending the rendering data in the second frame buffer to the display screen, displaying a third user interface, and further performing: in response to the second operation, marking the video memory state as being switched; judging that the video memory state is in switching, rendering image data, storing the rendering data into the first frame buffer area, copying the rendering data in the first frame buffer area into the second frame buffer area, and sending the rendering data in the second frame buffer area to the display screen to display the third user interface; and switching the display sending frame buffer area from the first frame buffer area to the second frame buffer area, and marking the display memory state as non-switching under the condition that the switching is completed, and judging that the display memory state is non-switching. Therefore, under the condition that switching is completed, the copying process is executed, the copied data is ensured to be reliable, and the problems of screen display and the like are avoided.

In a third aspect, an embodiment of the present application provides a computer storage medium, including computer instructions, which when executed on an electronic device, cause the apparatus to perform a video memory switching method in any one of the possible implementation manners of the first aspect.

In a fourth aspect, embodiments of the present application provide a computer program product, which when run on a computer causes the computer to perform the video memory switching method in any one of the possible implementation manners of the first aspect.

In a fifth aspect, an embodiment of the present application provides a chip system, where the chip system is applied to an electronic device, and the chip system includes one or more processors, where the processors are configured to invoke computer instructions to cause the electronic device to perform a video memory switching method according to the first aspect or any possible implementation manner of the first aspect.

Drawings

The drawings to which embodiments of the present application are applied are described below.

Fig. 1 is a schematic diagram of a software system of an electronic device according to an embodiment of the present application;

FIG. 2 is a schematic flow chart of a video memory switching method according to an embodiment of the present application;

FIG. 3 is a flow chart of a method for switching video memories according to an embodiment of the present application;

FIGS. 4A-4C are a set of user interface diagrams provided by embodiments of the present application;

FIG. 5 is a schematic flow chart of a method for display maintenance according to an embodiment of the present application;

FIG. 6 is a schematic flow chart of a display maintenance method according to an embodiment of the present application;

FIG. 7 is a flowchart of another method for display maintenance according to an embodiment of the present application;

FIG. 8A is a flow chart of a data processing using a dual frame buffer display according to an embodiment of the present application;

FIG. 8B is a flow chart of a data processing using a single frame buffer display according to an embodiment of the present application;

fig. 9 is a schematic hardware structure of an electronic device 100 according to an embodiment of the present application.

Detailed Description

The terminology used in the following embodiments of the application is for the purpose of describing particular embodiments only and is not intended to be limiting of embodiments of the application. As used in the specification of embodiments of the application and the appended claims, the singular forms "a," "an," "the," "said," and "said" are intended to include the plural forms as well, unless the context clearly indicates to the contrary. It should also be understood that the term "and/or" as used in embodiments of the present application refers to and encompasses any or all possible combinations of one or more of the listed items.

When a user uses the electronic equipment, the refresh rate of the display screen is required to be higher in some applications, so that the use experience of the user is ensured. For example, when a user plays a game, the refresh rate may cause problems such as slow user response speed, so maintaining a higher refresh rate for the display is a way to ensure a better game experience.

The display driver of the electronic device may display an image of the frame buffer on the screen, and in order to pursue a high refresh rate, for a better refresh experience, the electronic device may use multiple memories (frame buffers) for the screen display. For example, the electronic device may use two framebuffers for display, where a faster refresh rate can be provided for use by the application.

The memory of an electronic device can be divided into two types, an internal memory and an external memory. The internal memory has a very fast read/write speed and does not require an additional circuit, but has a limited capacity of memory space. The read-write speed of the external memory is relatively slow, requiring longer bus time and additional controller circuitry, but the capacity of the memory space is large.

For example, in wearable products, if the UI display frame rate needs to be reached to 60 frames, a common approach is to use two frame buffers to increase the display frame rate, and these two frame buffers use RAM (memory) in a chip, the total size of RAM in a chip is typically on the order of several M, and the whole is smaller, so RAM in a chip is at a premium.

Higher refresh rates mean higher power consumption, and more memory resources and processing resources are occupied. In practical use, some applications need to pursue high refresh rates, e.g., games (fast screen updates), video-like applications (better screen fluency), etc. However, other applications do not require pursuing high refresh rates, more internal computing. For example, some applications with large performance consumption, especially when the memory access is high frequency and the memory access efficiency is a performance bottleneck, the high frame rate cannot bring about the improvement of smoothness and occupies the memory space.

Therefore, for the part of application which does not need to pursue high refresh rate and needs internal calculation, too high video memory is configured, a plurality of more internal memory resources are occupied, and meanwhile, processing resources are also occupied, so that the situation of shortage of memory resources and processing resources is aggravated while the user experience is not improved due to high refresh, and the coordination of resource configuration is poor. Therefore, in the above embodiment, the excessive configuration of the part of application video memory causes the waste of the storage resources, so that the storage resources with faster processing and priority in quantity are occupied, and the screen refreshing requirement is not high, but the storage resource configuration of the application with internal consumption is not coordinated, so that the storage scheduling of the electronic device is poor, the memory resources are tense, the processing performance is poor, and the like.

In the embodiment of the present application, the terminal device may be a mobile phone (mobile phone), a smart tv, a wearable device, a tablet computer (Pad), a computer with a wireless transceiving function, a Virtual Reality (VR) terminal device, an augmented reality (augmented reality, AR) terminal device, a wireless terminal in industrial control (industrial control), a wireless terminal in unmanned (self-driving), a wireless terminal in teleoperation (remote medical surgery), a wireless terminal in smart grid (smart grid), a wireless terminal in transportation security (transportation safety), a wireless terminal in smart city (smart city), a wireless terminal in smart home (smart home), and so on. The wearable device can also be called as a wearable intelligent device, and is a generic name for intelligently designing daily wearing and developing wearable devices by applying a wearable technology, such as glasses, gloves, watches, clothes, shoes and the like. The wearable device is a portable device that is worn directly on the body or integrated into the clothing or accessories of the user.

Fig. 1 is a schematic diagram of a software system of an electronic device according to an embodiment of the present application.

As shown in fig. 1, the software framework of the electronic device to which the present application relates may include an application layer, an application framework layer (FWK), a Hardware Abstraction Layer (HAL), a kernel layer (kernel), and a hardware layer.

The application layer may include a series of application packages, such as weather, calendar, phone, bluetooth, and social software applications, among others.

In the embodiment of the application, some applications have low requirements on refresh rate, but the data processing inside the applications occupies more storage resources and the memory requirement is larger. Such as bluetooth, social software, etc.

The application framework layer provides an application programming interface (application programming interface, API) and programming framework for application programs of the application layer. The application framework layer includes a number of predefined functions.

As shown in fig. 1, the application framework layer may include a rendering processing module, a communication service module, and the like, without limitation.

The rendering processing module can provide a rendering function and an image rendering function, and store the rendered image into the frame buffer, and the display driver can display the rendered image in the frame buffer on the display screen. The rendering processing module can call a rendering engine of the electronic equipment to conduct rendering processing.

The hardware abstraction layer is an interface layer between the application framework layer and the kernel layer, and provides a virtual hardware platform for the operating system.

In the embodiment of the application, the hardware abstraction layer may include a video memory switching module and the like, which is not limited.

The video memory switching module may be used to switch the display memory from a single frame buffer to a dual frame buffer, or from a dual frame buffer to a single frame buffer. The video memory switching module maintains a switching result based on a maintenance flow of display-driven TE interrupt and ER interrupt trigger execution.

Optionally, the video memory switching module may be configured to switch the display memory from a single frame buffer to a triple frame buffer, or from the triple frame buffer to the single frame buffer.

Optionally, the video memory switching module may be configured to switch the display memory from dual-frame buffer to tri-frame buffer, and may also switch from tri-frame buffer to dual-frame buffer.

The above-mentioned video memory switching may be performed from a large number of frame buffers to a small number of frame buffers, or from a small number of frame buffers to a large number of frame buffers, and the number of frame buffers before and after the switching is not limited.

The kernel layer is the basis of the system, and the final functions of the system are all completed through the kernel layer. The kernel layer contains at least a display driver, a bluetooth driver, and the like.

Wherein the display driver may display the image information of the frame buffer on the display screen.

The hardware layers may include memory, touch sensors, display screens, graphics processors (graphics processing unit, GPUs), and the like.

The touch sensor is capable of detecting various types of touch operations of a user. For example, the electronic device clicks on an icon of the first application, and in response to an operation to launch the first application, the electronic device launches the first application. The electronic equipment clicks to close the first application, and responds to the operation of closing the first application, the electronic equipment closes the first application.

The memory of the storage may include a frame buffer, which is an abstraction of the display buffer of the hardware device, and color values may be written in the region corresponding to the display point in the frame buffer, and displayed on the screen, that is, the rendering data is sent to the display screen, where the display screen may display the interface. In the embodiment of the application, the electronic device at least comprises an abstraction of the physical storage space corresponding to the first frame buffer area and the second frame buffer area, and the storage addresses of the first frame buffer area and the second frame buffer area are generally fixed.

The GPU may perform image rendering processing, and the rendered image is stored in a frame buffer.

The display screen (screen) may display image frames of the frame buffer.

It should be noted that, the software structure schematic diagram of the electronic device shown in fig. 1 provided in the present application is only used as an example, and is not limited to specific module division in different layers of the system, and reference may be made to description of the system software structure in the conventional technology. In addition, the shooting method provided by the application can be realized based on other operating systems, and the application is not limited to one by one.

An embodiment of the application provides a video memory switching method and an electronic device, and fig. 2 is a schematic flow chart of a video memory switching method in an exemplary embodiment of the application. As shown in fig. 2, the electronic device may include at least a first FB and a second FB two frame buffer. Typically, the electronic device uses two FBs by default for the display process. The first FB can store rendering data from the rendering processing module, and the electronic device copies the first FB data to the second FB and uses the data of the second FB for transmission and display.

In the embodiment of the present application, the second FB includes both active and inactive states. The second FB is in an active state, which means that there is no dirty data in the second FB currently, and the dirty data can be used for sending and displaying. The second FB is in an invalid state, which means that dirty data exists in the second FB and cannot be used for sending and displaying.

The memory state may include both a switching state and a non-switching state. When the video memory state is in the switching state, the electronic device is in the state of switching the video memory from the second FB to the first FB or switching the first FB to the second FB. When the video memory state is not being switched, the first FB or the second FB may be used for transmission and display. The number of memories may include both single and double. The electronic device determines that a switch from double to single is required and may mark the number of displays as single. The electronic device determines that a switch from single to double is required and may mark the number of displays as double.

Before time T, the electronic device displays using the second FB and the first FB. And the number of the video memories is double, and the data of the second FB are transmitted and displayed.

At the time T1, the electronic equipment receives a first operation, responds to the first operation, starts a first application, and the video memory switching module can acquire a first video memory switching instruction, can make the number of the video memories of the equipment single, and marks the video memory state as being switched. At this time, the frame buffer of the data transmission needs to be switched from the second FB to the first FB. And responding to the first video memory switching instruction, starting to switch the video memory by the display driver, and marking the video memory state as non-switching under the condition of switching completion. At time T2, a TE and/or ER interrupt signal sent by the display driver may trigger the start of display via the first FB data. In the above process, the storage space of the second FB is already released.

At time T3, the electronic device receives a second operation, responds to the second operation, closes the first application, and the video memory switching module can acquire a second video memory switching instruction, the number of the video memories of the device is double, and marks the display state as being switched. At this point, the frame buffer for the data presentation needs to be switched from the first FB back to the second FB. And responding to a second video memory switching instruction, starting to switch the video memory by the display driver, and marking the second FB as an invalid state. When the display driving switching is completed, the marked memory state is in the non-switching state. Thereafter, at time T4, the display driver may begin copying the first FB data to the second FB, and in the event that copying is complete, the second FB may be marked valid. At the time T5, the TE and/or ER interrupt signal sent by the display driver triggers the second FB data to send and display.

In the above embodiment, the first application does not need to pursue a high refresh rate, and in the case of starting the first application, the electronic device may switch the video memory from the second FB to the first FB, and mark the video memory state as being switched. When the switching of the electronic device is completed, the memory state may be changed to the non-switching state. At this time, the number of display and storage used by the electronic device is reduced, the high refresh rate is not required to be maintained, the memory space of the second FB can be released for other uses of the first application, resources are effectively scheduled, the shortage of processing resources and storage resources is relieved, the processing speed is higher due to coordination of the resources, and the performance of the electronic device is better. Under the condition that the first application exits, the electronic device can copy the data of the first FB to the second FB and then send and display the data by using the second FB. After that, the number of display memories used by the electronic equipment is increased, and the condition of high refresh rate is recovered, so that the high refresh requirements of other applications and displays are ensured, and the refresh experience of a user is ensured.

FIG. 3 is a flow chart of a method for switching video memories according to an embodiment of the present application. As shown in fig. 3, the finger joint identification method may include, but is not limited to, the following steps:

in the embodiment of the present application, the video memory may include a first frame buffer (abbreviated as "first FB" in the present application) and a second frame buffer (abbreviated as "second FB" in the present application). The rendering processing module stores the rendered image to the first FB. In the process of S301 to S304, the electronic device uses two FBs. The second FB copies data from the first FB and sends and displays the data.

S301: the application program obtains a first operation.

The first operation may be performed in a case where the electronic device displays a desktop interface or an application switching interface. The second operation may be for opening the first application.

Fig. 4A-4C are exemplary diagrams of a set of user interfaces that are exemplary illustrations of embodiments of the present application. As shown in fig. 4A, the user opens his electronic device such that the display of the electronic device displays the desktop of the electronic device, i.e., the user interface 410. As shown in fig. 4A, the user interface 410 may include icons for at least one application (e.g., sports health, weather, browser, clock, music, gallery, camera, phone and social software 411, etc.). The location of the icon of the application program and the name of the corresponding application program may be adjusted according to the preference of the user, which is not limited in the present application. In a case where the electronic device displays the user interface 410, the user may click on an icon (first operation) of the social software 411, and in response to the click operation by the user, the electronic device may display the user interface 420. As shown in fig. 4B, the electronic device displays an application of social software. Specific display procedures can be described with reference to S302 to S309, and are not limited. At this time, the first application is a social software application.

The first application may be social software, bluetooth, or other applications, and in executing the process corresponding to fig. 3, the electronic device may set the determined application to execute the process of fig. 3 in the process of starting and exiting, which is not limited to one or more applications.

The first operation may be a touch operation, a voice operation, a space operation, or the like, which is not limited in the present application.

S302: the application program starts a first application in response to the first operation.

The process of the application program starting the first application may include the flows of S303 to S310, and is not limited thereto. The electronic device may initiate other data processing procedures of the first application.

S303: the application program sends a first rendering instruction to the rendering processing module.

In the case where the application program acquires the first operation, a first rendering instruction may be sent to the rendering processing module. Correspondingly, the rendering processing module may receive a first rendering instruction from the application. The first rendering instruction may indicate that rendering is started for data of the first application, i.e. switching data that needs to be rendered.

S304: the rendering processing module starts image rendering on the first application data based on the first rendering instruction, obtains first rendering data, and stores the first rendering data to the first FB.

And under the condition that the rendering processing module receives the first rendering instruction, starting to perform image rendering processing on the data of the first application, wherein the rendering processing module can call a rendering engine to render images, and the rendering engine specifically performs processing through a GPU in the rendering process.

S305: the application program sends a first video memory switching instruction to the video memory switching module.

And under the condition that the application program acquires the first operation, a first video memory switching instruction can be sent to the video memory switching module. Correspondingly, the video memory switching module can receive a first video memory switching instruction from the application program.

The first video memory switching instruction may be configured to instruct a frame buffer currently used for sending a display to switch from the second FB to the first FB. And the current electronic equipment uses the data of the second FB for display.

S306: the video memory switching module marks the video memory state as being switched, and marks the number of the video memories as a single.

And under the condition that the video memory switching module receives the first video memory switching instruction, the video memory state can be marked as being switched. Wherein, the video memory state includes switching and non-switching. Before the video memory switching module receives the first video memory switching instruction, the video memory state is marked as non-switching, and the number of the video memories is marked as single from double.

Wherein S301, S305 and S306 may refer to the switching procedure at time T1 in fig. 2.

S307: the video memory switching module sends a first display switching instruction to the video memory driver.

And under the condition that the video memory switching module receives the first video memory switching instruction, the video memory switching module can send the first display switching instruction to the video memory driver. Correspondingly, the video memory driver receives a first display switching instruction from the video memory switching module. The first display switching instruction may instruct the video memory driver to switch the video memory from the second FB to the first FB, i.e., execute S308 to S309.

S308: the video memory driver switches the video frame buffer from the second FB to the first FB.

Under the condition that the video memory driver receives the first display switching instruction, the video frame transmission buffer area can be switched from the second FB to the first FB. Specifically, the video memory driver may switch the data to be displayed from the second FB to the first FB, and release the storage space of the second FB. The storage space corresponding to the second FB can be called by other tasks of the first application, so that memory resources are saved for more needed task processing, and the processing resource scheduling of the first application is optimized.

Wherein S308 may refer to the switching process of the T1 to T2 time periods in fig. 2.

S309: and when the switch from the second FB to the first FB is completed, marking the display memory state as non-switching.

Under the condition that the video memory driver finishes switching the video frame transmission buffer zone from the second FB to the first FB, the video memory state can be marked as in the non-switching state, namely the video memory state is switched. S309 may correspond to the case where the switching is completed at the time of T1 to T2 in fig. 2.

S310: the video memory driver uses the data of the first FB to send and display.

Under the condition that the switching is completed, under the condition that the electronic equipment acquires the maintenance interrupt signal, the interrupt signal can trigger the data transmission display using the first FB.

In particular, the maintenance interrupt signal includes a TE interrupt signal, which may be periodically triggered, and an ER interrupt signal, which may be triggered in case a screen needs to be refreshed. The TE interrupt signal can trigger the TE to display the maintenance flow, and the ER interrupt signal can trigger the ER to display the maintenance flow. After the number of the video memories is changed and the video memories are switched, the TE interrupt signal and/or the ER interrupt signal can select the switched video frame sending buffer area to send and display. Specific cases can refer to the related descriptions of fig. 5 to fig. 7, and are not repeated.

S311: the application program obtains a second operation.

And under the condition that the electronic equipment displays the user interface of the first application, the user executes a second operation of closing the first application, and the electronic equipment can receive the second operation.

In a possible implementation manner, the electronic device displays a user interface of the first application, the user can click on the exit control, or exit the sliding operation, and the electronic device can acquire the second operation.

It should be noted that the second operation may be a touch operation, a voice operation, a space operation, or the like, which is not limited in the present application.

S312: the application program responds to the second operation to close the first application.

After the application program receives the second operation, the first application may be closed in response to the second operation.

For example, as shown in fig. 4B, the electronic device may exit the application of the social software with the second operation of the user while the social software is displayed. In the case where the electronic device displays the user interface 420, the user may swipe inward from the edge of the screen, and in response to the user's swipe operation, the electronic device may display the user interface 430. As shown in fig. 4C, the electronic device exits the display interface of the social software. The specific display process may refer to the related descriptions of S312 to S321, and is not limited. At this time, the first application is a social software application.

In the embodiment of the application, the second operation may be a touch operation, a voice operation, a space operation, or the like, which is not limited.

S313: the application program sends a second rendering instruction to the rendering processing module.

After the application program obtains the second operation, a second rendering instruction may be sent to the rendering processing module. Correspondingly, the rendering processing module may receive a second rendering instruction from the application. The second rendering instruction may stop rendering the first application display data.

S314: the rendering processing module stops image rendering of the first application data based on the second rendering instruction.

After receiving the second rendering instruction from the application program, the rendering processing module may stop image rendering of the first application data based on the second rendering instruction. I.e. the picture indicating that the electronic device needs to switch the display, i.e. the rendered data needs to be switched.

S315: the application program sends a second video memory switching instruction to the video memory switching module.

After the application program receives the second operation, a second video memory switching instruction can be sent to the video memory switching module. Correspondingly, the video memory switching module can receive a second video memory switching instruction from the application program. The second video memory switching instruction may be configured to switch the frame buffer from the first FB to the second FB.

The first video memory switching instruction is used for indicating that the current video memory is switched from single-frame buffer to double-frame buffer. The current electronic device displays for a single frame buffer.

S316: the video memory switching module marks the video memory state as in switching, marks the second FB as invalid state, and marks the number of the video memories as double.

And under the condition that the video memory switching module receives the second video memory switching instruction, the video memory state can be marked as being switched. Before the video memory switching module receives the second video memory switching instruction, the video memory state is marked as being switched. The states of the second FB may include an inactive state and an active state. The memory switch module may mark the second FB as invalid. The current number of the video memories is single, and the video memory switching module can set the number of the video memories from single to double.

Wherein S311, S315, and S316 may correspond to time T3 in fig. 2. It should be noted that the processes performed in S311, S315, and S316 are before and after the time T3, and are not one time, and the above images are only for easy understanding.

S317: the video memory switching module sends a second display switching instruction to the display driver.

After the video memory switching module performs S315, a second display switching instruction may be sent to the display driver. Correspondingly, the display driver can receive a second display switching instruction from the display memory switching module. The second display switching instruction is used for indicating to switch the display frame buffer area from the first FB to the second FB.

S318: the display driver switches the display frame buffer from the first FB to the second FB.

After the display driver receives the second display switching instruction from the display memory switching module, the display frame sending buffer area can be switched from the first FB to the second FB.

Here, S318 may refer to the switching process from time T3 to time T4 in fig. 2, and the related switching description of S308, which is not limited.

S319: and when the display driving is switched from the first FB to the second FB, marking the display memory state as non-switching.

When the display driver completes the switching of the display frame buffer from the first FB to the second FB, the display memory status may be recorded as non-switching.

S320: the display driver copies the data of the first FB to the second FB, and marks the second FB as a valid state in case the copying is completed.

Upon completion of the switch, the display driver may begin copying data of the first FB to the second FB. In the case of copy completion, the state of the second FB flag may be a valid state.

Under the condition that the second FB is marked as invalid, the data in the second FB is dirty data, namely the second FB comprises other data which is not rendering data, and at the moment, the data in the second FB cannot be directly used for display. Under the condition that the second FB is marked as a valid state, the data in the second FB are the data which are copied from the first FB, and the data of the second FB can be directly sent and displayed. Specifically, the display driver may copy the data of the first FB to the second FB, and the second FB state is valid in case the copying is completed. In the copying process, the video memory state is in switching, and the second FB is in an invalid state.

S321: the display driver uses the data of the second FB to send and display.

When the state of the second FB flag is valid, the display driver can perform transmission using the data of the second FB.

Wherein S321 may correspond to time T5 in fig. 2 and time periods thereafter.

In the event that the copy is complete, the second FB state is active and TE and/or ER interrupt signals may trigger the use of the second FB data for display.

It should be noted that, the first operation and the second operation may be an operation of opening an application and exiting an application, an operation of opening an applet and closing an applet, an operation of entering a video interface and exiting a video interface, and the like. The application is not limited in this regard. The first operation may be performed in accordance with the displayed screen, and the processes of S305 to S309 may be performed without requiring a high refresh rate. The second operation requires a high refresh rate for the displayed screen, and the processes of S314 to S318 described above can be performed.

It should also be noted that the electronic device may include at least two frame buffers. In addition to the first FB and the second FB, other frame buffers may be included. For example, a third FB, etc. The third FB may be in use, may not be in use, and is not limited.

In the above embodiment, the first application does not need to pursue a high refresh rate, and in the case of starting the first application, the electronic device may switch the video memory from the second FB to the first FB, and mark the video memory state as being switched. When the switching of the electronic device is completed, the memory state may be changed to the non-switching state. At this time, the number of display and storage used by the electronic device is reduced, the high refresh rate is not required to be maintained, the memory space of the second FB can be released, resources are effectively scheduled, the shortage of processing resources and storage resources is relieved, the processing speed is higher due to the coordination of the resources, and the performance of the electronic device is better. And under the condition that the first application exits, the electronic equipment can send and display the second FB by using the second FB after copying the data of the first FB. After that, the number of display memories used by the electronic equipment is increased, and the condition of high refresh rate is recovered, so that the high refresh requirements of other applications and displays are ensured, and the refresh experience of a user is ensured.

In the process of video memory switching, the display driver can send TE interrupt signals and ER interrupt signals to the video memory switching module. The TE interrupt signal may be a periodic signal that may trigger the TE to display a maintenance flow. ER interrupt signal can trigger ER to display maintenance flow. The TE interrupt signal triggers a TE maintenance flow, which may be used to determine whether the data of the first FB needs to be copied to the second FB. The ER interrupt signal triggers an ER maintenance flow, which may be used to determine whether a copy result is complete.

Referring to the method flows of fig. 2 and 3, fig. 5 is a schematic flow chart of a method for maintaining a video memory according to an exemplary embodiment of the present application. As shown in fig. 5, during the display process of the electronic device, the TE interrupt signal and the ER interrupt signal can trigger the display maintenance flow. The following describes the changes in the respective states and the corresponding changes in the current electronic device display process in connection with the TE display maintenance flow and the ER display maintenance flow in fig. 6 and 7.

As shown in fig. 5, in the period before the time T1, the first application is not started, the current number of video memories is two, and the state of the second FB is valid in the non-switching state. The display driver may send a TE interrupt signal to the display switching module, and the display switching module may execute a TE display maintenance flow. In the TE display maintenance flow, the number of the video memories is determined to be two in S602, and then S605 is executed to determine that the state of the second FB is available, and send and display the data of the second FB.

The display driver may send an ER interrupt signal to the display switching module, which may perform an ER display maintenance procedure. In the ER display maintenance flow, the number of the video memories is determined to be two in S702, and then S704 is executed to determine whether the state of the first FB is available, and processing is performed according to the determination result of S704. If the first FB is available, S706 is executed; if the first FB is not available, S706 is also executed when it is determined that the memory status is not in handover.

At time T1, the electronic device acquires a first operation. In response to the first operation, the number of memories becomes single, the memory state is in the switch, and the state of the second FB is valid. The memory state is in the switching state, the switching process of S308 is performed, and the memory state may be marked as being in the non-switching state when the switching is completed. TE or ER interrupts may be received during the handoff, and the interrupts may be discarded (TE and ER interrupt interception) without triggering the maintenance flow shown in fig. 6 or fig. 7.

At the time T2 after the switching is completed, receiving a TE interrupt signal, and executing a TE display maintenance flow; or an ER interrupt signal, and executing an ER display maintenance flow. If at the time T2, the display driver sends a TE interrupt signal to the display switching module, and the display switching module can execute the TE display maintenance flow. In the TE display maintenance flow, S602 determines that the current number of video memories is single, and S603, S604, and S608 are executed. If at the time T2, the display driver sends an ER interrupt signal to the display switching module, and the display switching module can execute an ER display maintenance flow. In the TE display maintenance flow, S702 judges the number of the current video memories as a single, S703 is executed, and the data of the first FB is sent and displayed. The time T2 may correspond to a TE interrupt or an ER interrupt, and is not limited.

Before the second operation arrives, the interruption may be performed according to the processing procedure at the time T2 between the times T2 and T3, which is not described in detail.

At time T3, the electronic device acquires a second operation. In response to the second operation, the number of memories becomes double, the memory state is in the process of switching, and the state of the second FB is invalid. The memory state is in the process of switching, and the switching process of S318 is performed, and when the switching is completed, the memory state may be marked as not in the process of switching, and the copy process of S320 may be performed. TE or ER interrupts may be received during the handoff, and the interrupts may be discarded (TE and ER interrupt interception) without triggering the maintenance flow shown in fig. 6 or fig. 7.

At the time T4 after the switching is completed, receiving a TE interrupt signal, and executing a TE display maintenance flow; or an ER interrupt signal, and executing an ER display maintenance flow. If at the time T4, the display driver sends a TE interrupt signal to the display switching module, and the display switching module can execute the TE display maintenance flow. In the TE display maintenance flow, S602 determines that the current number of video memories is two, and S605 is executed to determine whether the second FB is available. In executing the copying process of S320, no copying is completed, the state of the second FB is invalid, and executing S606 does not require that the second FB data be displayed, thereby avoiding screen display. If at the time T4, the display driver sends an ER interrupt signal to the display switching module, and the display switching module can execute an ER display maintenance flow. In the ER display maintenance flow, the number of the video memories is determined to be two in S702, and then S704 is executed to determine whether the state of the first FB is available, and processing is performed according to the determination result of S704. If the first FB is available, S706 is executed; if the first FB is not available, determining whether the video memory status is in switching, and executing S706 when the video memory status is in non-switching; in the case that the video memory state is non-switching, the copying process of S707 can be executed, so as to ensure the execution sequence of switching and copying, thereby maintaining the safety and reliability of the processing flow. Wherein, the time period between T4 and T5 can be processed according to the logic.

At time T5, in performing the copy processing of S320, the state of the second FB becomes valid after the copy is completed. If the TE interrupt signal is received, executing a TE display maintenance flow, in the TE display maintenance flow, S602 judges that the number of the current video memories is double, S605 is executed, S607 is executed, the second FB is judged to be available, and the second FB data is sent to be displayed, so that the display flow is ensured. If the ER interrupt signal is received, executing an ER display maintenance process, wherein in the ER display maintenance process, S702 judges that the current number of the video memories is double, then executing S704, judging whether the state of the first FB is available or not, and processing according to the judging result of S704. If the first FB is available, S706 is executed; if the first FB is not available, determining whether the video memory status is in switching, and executing S706 when the video memory status is in non-switching; in the case that the video memory state is non-switching, the copying process of S707 can be executed, so as to ensure the execution sequence of switching and copying, thereby maintaining the safety and reliability of the processing flow. The time T5 may correspond to a TE interrupt or an ER interrupt, and is not limited.

The time period after T5 may be all processed according to the logic at the time of T5, which is not described in detail.

The TE interrupt signal and the ER interrupt signal may trigger different interrupt signals. First, a TE display maintenance procedure triggered by a TE interrupt signal is described:

Fig. 6 is a flow chart illustrating a maintenance method according to an exemplary embodiment of the present application. As shown in fig. 6, the TE interrupt signal triggers the TE display maintenance method:

s601: the display memory switching module acquires a TE interrupt signal from a display driver;

s602: the display memory switching module judges whether the display memory quantity is double FB; if the number of video memories is two, S605 is executed; in the case where the number of memories is single (not double), S603 is executed.

Determining whether to double the FB in the case of using the first FB and the second FB; in the case of using the first FB, it is determined to use a single FB.

S603: the rendering processing module performs rendering.

In the case of using a single FB, the rendering processing module performs rendering. The rendering process may refer to the related description of S304, which is not repeated.

S604: the rendering processing module stores the rendered image to the first FB.

After the rendering processing module renders the resulting rendered image, the rendered image may be stored into the first FB. The process of rendering the data storage may refer to the related description of S304, which is not described in detail.

S605: the video memory switching module judges whether the second FB is valid. In the case of being valid, S607 is performed; in the case of invalidation, S606 is performed.

The judgment can ensure that the second FB data can be displayed effectively, and the screen is avoided.

S606: the memory switching module is not executed.

And under the condition that the second FB is invalid, the video memory switching module does not process, and the TE display maintenance flow is ended.

S607: and the video memory driver sends and displays the data of the second FB.

And under the condition that the second FB is effective, the video memory driver can determine to send and display the data of the second FB. Specific reference may be made to the description of S321, which is not repeated.

S608: the display driver transmits and displays the data of the first FB.

The description of S608 may refer to the description of S310 specifically, and will not be repeated.

In the TE interrupt triggered display maintenance method, it is determined whether the number of display memories is two, if the number of display memories is two, it is determined whether the second FB is valid, if the second FB is in an invalid state, the interrupt event is ignored, and if the second FB is in an valid state, it is sent to display. And if the number of the video memories is single, triggering rendering, and executing the original business logic. Therefore, the logic of switching display can be maintained, effective execution of image rendering and screen display is ensured, and the logic accords with display processing logic.

Secondly, description is made on an ER display maintenance flow triggered by an ER interrupt signal:

fig. 7 is a flow chart illustrating another exemplary disclosed maintenance method according to an embodiment of the present application. As shown in fig. 7, the ER interrupt signal triggers the ER display maintenance flow:

S701: the display memory switching module acquires an ER interrupt signal from a display driver;

the specific description of S701 may refer to the related description of S601, which is not described in detail.

S702: the display memory switching module judges whether the display memory quantity is double FB; in the case where the number of video memories is two, S704 is executed; if the number of video memories is single, S703 is executed.

The S702 may refer to the related description of S602 specifically, and is not described in detail.

S703: the display driver transmits and displays the data of the first FB.

The specific description of S703 may refer to the related description of S310, which is not described in detail.

S704: the video memory switching module judges whether the first FB state is available. If available, S705 is performed; in the case of unavailability, S706 is performed.

The state of the first FB includes both available and unavailable. Wherein the first FB is in a state of being available, meaning that the newly rendered image in the first FB has not yet been copied to the second FB, the copying state can be performed. The first FB unavailable state indicates that the current rendering is slow and no new image data needs to be copied.

S705: the video memory switching module judges whether the video memory state is in switching. If the video memory state is in the process of switching, S706 is executed; in the case where the memory state is in non-switching, S707 is executed.

The judgment processing can ensure that the switching is finished and then copying is carried out, and ensure the implementation reliability of the scheme.

S706: the rendering processing module performs rendering, and stores a first FB of the rendered image.

The S706 may refer to the descriptions related to S603 and S604 specifically, which are not described in detail.

S707: and the video memory switching module copies the data of the first FB to the second FB.

The memory switching module may copy the data of the first FB to the second FB, and then S706 and S708 may be performed.

S708: and under the condition that copying is completed, the second FB mark is valid by the video memory switching module.

The second FB flag is valid, and can be used in the judging process of S605 in TE interrupt, so as to ensure the correspondence of maintenance of processing, thereby ensuring that the second FB data can be displayed effectively and avoiding screen splash.

S709: and the video memory driver sends and displays the data of the second FB.

In S709, reference may be specifically made to the description related to S321, which is not repeated.

In the above ER interrupt triggered display maintenance method, it is determined whether a dual frame buffer is used, if so, it is determined whether the first FB data is ready (i.e., whether the state of the first FB is available), and if not, it is not ready to trigger rendering logic (unavailable). If the state of the second FB is available, but the current video memory state is in switching, the rendering is triggered at this time. Only when the switch is not in progress (the video memory state is in non-switch), the data of the first FB is triggered to be copied to the second FB. And marks the state of the second FB as valid, so as to avoid the problem of screen display caused by the fact that the second FB refreshes the display screen when the second FB is not ready for data in the switching process. If the number of the video memories is single, the video memories are directly transmitted and displayed, the original business logic is executed, and the display processing logic is ensured.

In the above process, the electronic device may include at least two frame buffers, and the electronic device may use a quasi-buffer region that can be switched for display. Illustratively, the following describes a data processing procedure in which a double frame buffer and a single frame buffer are displayed.

Fig. 8A shows a data processing flow diagram using a dual frame buffer display. As shown in fig. 8A, the electronic device may use two frame buffers: a first FB and a second FB. The rendering processing module performs rendering processing and stores the obtained rendering data to the first FB. The electronic device can copy rendering data in the first FB to the second FB. The display screen can send and display through the data of the second FB. In the switching process, the above-mentioned double-frame buffer is used for displaying in the time period before T1 and after T5.

Fig. 8B shows a data processing flow diagram using a single frame buffer display. As shown in fig. 8B, the electronic device may use one frame buffer: and a first FB. The rendering processing module performs rendering processing and stores the obtained rendering data to the first FB. The display screen of the electronic device can directly send and display through the data of the first FB. In the switching process, the single frame buffer area is used for displaying in the time period of T2-T3. When the single-frame buffer area is used for displaying, the first application of the electronic equipment can call the second FB as an internal storage space, so that more memory space can be provided for the first application, the processing and the storage are faster, and the resource scheduling of the electronic equipment is more in line with the requirements of the first application, thereby optimizing the processing process.

Fig. 9 shows a hardware configuration diagram of the electronic device 100.

The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, a sensor module 180, a display screen 194, and the like. The sensor module 180 may include a touch sensor 180K.

It should be understood that the illustrated structure of the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the application, electronic device 100 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

The power management module 141 is used for connecting the battery 142, and the charge management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be configured to monitor battery capacity, battery cycle number, battery health (leakage, impedance) and other parameters. In other embodiments, the power management module 141 may also be provided in the processor 110. In other embodiments, the power management module 141 and the charge management module 140 may be disposed in the same device.

The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution for wireless communication including 2G/3G/4G/5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 150 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be provided in the same device as at least some of the modules of the processor 110.

The wireless communication module 160 may provide solutions for wireless communication including wireless local area network (wireless local area networks, WLAN) (e.g., wireless fidelity (wireless fidelity, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), etc., as applied to the electronic device 100. The wireless communication module 160 may be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.

The display screen 194 is used to display pictures, videos, and the like. The display 194 includes a display panel. The display panel may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED) or an active-matrix organic light-emitting diode (matrix organic light emitting diode), a flexible light-emitting diode (flex), a mini, a Micro led, a Micro-OLED, a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like. In some embodiments, the electronic device 100 may include 1 or N display screens 194, N being a positive integer greater than 1. The display screen may display the first application.

The touch sensor 180K is also referred to as a "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also referred to as a "touch screen". The touch sensor 180K is used to detect a touch operation acting thereon or thereabout. The touch sensor may communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to touch operations may be provided through the display 194. In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100, which is different from the position of the display 194.

In the embodiment of the present application, the user touches the icon of the first application on the display screen, and in response to the first operation of the user, the electronic device may execute the related flows in fig. 3, fig. 5, fig. 6, and fig. 7. The electronic device may execute the related flows in fig. 3, 5, 6, and 7 described above in response to the user touching the exit control of the first application of the display screen.

In the above-described embodiments, all or part of the functions may be implemented by software, hardware, or a combination of software and hardware. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present application, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer readable storage medium. The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a Solid State Disk (SSD)), or the like.

Those of ordinary skill in the art will appreciate that implementing all or part of the above-described method embodiments may be accomplished by a computer program to instruct related hardware, the program may be stored in a computer readable storage medium, and the program may include the above-described method embodiments when executed. And the aforementioned storage medium includes: ROM or random access memory RAM, magnetic or optical disk, etc.

Claims

1. The method is characterized in that the method is applied to electronic equipment, the electronic equipment is provided with a first application, and the video memory of the electronic equipment at least comprises a first frame buffer zone and a second frame buffer zone, and the method comprises the following steps:

the electronic equipment copies the rendering data in the first frame buffer area to the second frame buffer area, sends the rendering data in the second frame buffer area to a display screen, and displays a first user interface;

the electronic equipment responds to a first operation, directly sends the rendering data in the first frame buffer area to the display screen, and displays a second user interface;

wherein the second user interface is an interface of the first application, and the first operation is used for starting the first application.

2. The method of claim 1, wherein the electronic device, in response to a first operation, directly transmitting the rendered data in the first frame buffer to the display screen, displaying a second user interface, comprising:

and the electronic equipment responds to the first operation, switches the sending and displaying frame buffer area from the second frame buffer area to the first frame buffer area, and sends the rendering data in the first frame buffer area to the display screen to display the second user interface under the condition that the switching is completed.

3. The method of claim 2, wherein the sending the rendering data in the second frame buffer to the display screen displays a first user interface, comprising:

before the first operation, responding to a first TE interrupt signal, judging that the display quantity is a second quantity, sending the rendering data in the second frame buffer area to the display screen, and displaying the first user interface;

the method further comprises the steps of:

setting the number of the video memories from a second number to a first number in response to the first operation;

the step of directly sending the rendering data in the first frame buffer to the display screen to display a second user interface, and the step of further comprising:

After the first operation, in response to a second TE interrupt signal, determining that the display number is a first number, rendering image data, and storing the rendering data in the first frame buffer.

4. The method of claim 2, wherein the electronic device copying the rendered data in the first frame buffer to the second frame buffer, sending the rendered data in the second frame buffer to a display screen, displaying a first user interface, comprising:

before the first operation, responding to a first ER interrupt signal, judging that the display quantity is a second quantity, and if the state of the first frame buffer area is available, copying the rendering data in the first frame buffer area to the second frame buffer area; rendering image data and storing the rendered data into the first frame buffer if the state of the first buffer is unavailable;

the method further comprises the steps of:

the step of directly sending the rendering data in the first frame buffer to the display screen to display a second user interface, including:

After the first operation, responding to a second ER interrupt signal, judging that the display quantity is a first quantity, directly sending the rendering data in the first frame buffer area to the display screen, and displaying the second user interface.

5. The method according to claim 1, wherein the method further comprises:

the electronic equipment responds to a second operation, copies the rendering data in the first frame buffer area to the second frame buffer area, sends the rendering data in the second frame buffer area to the display screen, and displays a third user interface;

wherein the first operation is to exit the first application.

6. The method of claim 5, wherein the directly sending the rendered data in the first frame buffer to the display screen displays a second user interface, comprising:

before the second user interface is displayed and the second operation is acquired, responding to a third TE interrupt signal, judging the display quantity as a first quantity, rendering image data, storing the rendering data into the first frame buffer area, sending the rendering data in the first frame buffer area to the display screen, and displaying the second user interface;

The method further comprises the steps of:

setting the number of the video memories from a first number to a second number in response to the second operation;

copying the rendering data in the first frame buffer area to the second frame buffer area, and sending the rendering data in the second frame buffer area to the display screen to display a third user interface, including:

after the second operation, in response to a fourth TE interrupt signal, if the display number is the second number, determining whether a state of a second frame buffer is valid, and if the state of the second frame buffer is valid, sending rendering data in the second frame buffer to the display screen, and displaying the third user interface.

7. The method of claim 6, wherein the electronic device, in response to a second operation, copies the rendered data in the first frame buffer to the second frame buffer, sends the rendered data in the second frame buffer to the display screen, and displays a third user interface, further comprising:

in response to the second operation, marking the state of the second frame buffer area as invalid, judging the state of the second frame buffer area as invalid, and suspending sending the rendering data in the second frame buffer area to the display screen;

Copying the rendering data in the first frame buffer area to the second frame buffer area, and marking the state of the second frame buffer area as valid under the condition that copying is completed.

8. The method of claim 5, wherein the directly sending the rendered data in the first frame buffer to the display screen displays a second user interface, comprising:

before the second user interface is displayed and the second operation is acquired, responding to a third ER interrupt signal, judging that the display quantity is the first quantity, directly sending the rendering data in the first frame buffer area to a display screen, and displaying the second user interface;

the method further comprises the steps of:

after the second operation, responding to a fourth ER interrupt signal, judging that the display quantity is a second quantity, judging whether a video memory state is in switching or not, copying the rendering data in the first frame buffer area to the second frame buffer area under the condition that the video memory state is in non-switching, and sending the rendering data in the second frame buffer area to the display screen based on the video memory state to display the third user interface.

9. The method of claim 8, wherein copying the rendered data in the first frame buffer to the second frame buffer, transmitting the rendered data in the second frame buffer to the display screen, displaying a third user interface, further comprises:

in response to the second operation, marking the video memory state as being switched;

judging that the video memory state is in switching, rendering image data, storing the rendering data into the first frame buffer area, copying the rendering data in the first frame buffer area into the second frame buffer area, and sending the rendering data in the second frame buffer area to the display screen to display the third user interface;

and switching the display sending frame buffer area from the first frame buffer area to the second frame buffer area, and marking the display memory state as non-switching under the condition that the switching is completed, and judging that the display memory state is non-switching.

10. An electronic device, comprising: one or more processors and one or more memories; the one or more processors being coupled with the one or more memories, the one or more memories being configured to store computer program code, the computer program code comprising computer instructions that, when executed by the one or more processors, cause the electronic device to perform the method of any of claims 1-9.

11. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program which, when executed by a processor, implements the method according to any of claims 1-9.