WO2022222721A1 - Computational resource scheduling method and apparatus - Google Patents

Abstract

The present application relates to the technical field of communications, and provides a computational resource scheduling method and apparatus. The method comprises: a terminal creates a thread group comprising graphic synthesis related threads, and adjusts, according to target image quality, a processing resource of a CPU corresponding to the thread group and/or a GPU frequency. By means of the method, frame loss and stuttering phenomena appearing in applications in scenarios of starting, exiting, and gesture navigation and the like can be reduced, a corresponding graphic synthesis resource is provided according to user requirements, the power consumption of the terminal is reduced, and the user experience is improved.

Description

Computing resource scheduling method and device

This application claims the priority of the Chinese patent application with the application number 202110438616.7 and the application name "Computing Resource Scheduling Method and Device", which was submitted to the State Intellectual Property Office on April 22, 2021, the entire contents of which are incorporated into this application by reference .

technical field

The present application relates to the field of communication technologies, and in particular, to a computing resource scheduling method and apparatus.

Background technique

The current mainstream smart terminal operating systems include the Android operating system (android operation system,

Android OS) (hereinafter referred to as the Android system), in this system, in the application (also known as application) startup, application exit, gesture navigation and other scenarios, there will be various situations where the interface refreshes quickly or slowly. This situation may lead to frame loss and freeze, reducing user experience. Especially in high frame rate scenes, the phenomenon of frame loss and freeze is more serious.

SUMMARY OF THE INVENTION

Embodiments of the present application provide a computing resource scheduling method and apparatus, which are used to solve the problem of frame loss and freeze in scenarios such as application startup, exit, and gesture navigation.

To achieve the above purpose, the embodiments of the present application provide the following technical solutions:

In a first aspect, a computing resource scheduling method is provided, including: a terminal creates a thread group including threads related to graphics synthesis, and adjusts the CPU processing resources and/or GPU frequency corresponding to the thread group according to target image quality. The method provided in the first aspect can reduce the occurrence of frame dropping and stuck phenomenon in applications such as startup, exit, gesture navigation, etc., and provide corresponding graphics synthesis resources according to user needs, reduce the power consumption of the terminal, and improve the user experience.

In a possible implementation, the terminal adjusts the processing resources of the CPU corresponding to the thread group and/or adjusts the GPU frequency according to the target image quality, including: the terminal adjusts the processing resources of the CPU corresponding to the thread group according to the target frame rate of the image; and or, the terminal adjusts the GPU frequency according to the GPU synthesis duration of the single-frame image of the image. In this possible implementation, the processing resources of the CPU are adjusted according to the target frame rate and/or the frequency of the GPU is adjusted according to the GPU synthesis duration of a single frame image, so that the image synthesis resources can be scheduled in time to ensure the timeliness of image display.

In a possible implementation manner, the terminal adjusts the processing resources of the CPU corresponding to the thread group according to the target frame rate of the image, including: the terminal determines that the frame rate range in which the target frame rate is located is the first frame rate range; The threshold value corresponding to the frame rate range adjusts the processing resources of the CPU corresponding to the thread group, and the threshold value is greater than 0 and less than 1. In this possible implementation, the processing resources of the CPU to be adjusted are directly determined according to the first frame rate range in which the target frame rate is located. For the division of the frame rate range, the CPU can be determined by judging the frame rate range in which the target frame rate is located. The threshold value of the resource is processed, thereby solving the problem in the prior art that the resource cannot be configured according to the real-time requirement of the user for the frame rate.

In a possible implementation manner, the terminal adjusts the processing resources of the CPU corresponding to the thread group according to the threshold value corresponding to the first frame rate range, including: the terminal determines the adjustment value of the processing resources of the CPU, and the adjustment value is the first frame rate The product of the threshold value corresponding to the range and the remaining resources of the CPU; the terminal increases the processing resources of the CPU for the thread group according to the adjustment value. This possible implementation provides a specific calculation method for calculating the adjustment amount of the processing resources of the CPU corresponding to the thread group according to the threshold value corresponding to the first frame rate range, and the terminal calculates the CPU corresponding to the target frame rate according to this formula. The processing resources are adjusted accordingly.

In a possible implementation manner, the terminal adjusts the GPU frequency according to the GPU synthesis duration of the single-frame image of the image, including: the terminal determines that the frame rate range in which the target frame rate is located is the second frame rate range and the range corresponding to the second frame rate range. GPU frequency; when it is determined that under the GPU frequency corresponding to the second frame rate range, the GPU synthesis duration of a single frame image is greater than or equal to the first threshold, adjust the GPU frequency to the GPU frequency corresponding to the maximum value of the second frame rate range. A threshold is the GPU synthesis duration of the single-frame image corresponding to the maximum value of the second frame rate range, and the GPU frequency corresponding to the maximum value of the second frame rate range is greater than the GPU frequency corresponding to the second frame rate range. In this possible implementation, the corresponding GPU frequency is determined according to the second frame rate range in which the target frame rate is located. The GPU performs image synthesis at this frequency, and simultaneously detects the GPU synthesis duration of a single frame image. The relationship of a threshold determines the adjustment method of the corresponding GPU frequency, so that when it is judged that the GPU synthesis time of a single frame image cannot meet the user's needs, the GPU frequency can be adjusted in time to reduce the phenomenon of frame loss and freeze.

In a possible implementation manner, the method further includes: the terminal monitors the change of the frame rate in real time; and/or the terminal monitors the GPU synthesis duration of the single frame image in real time. In this possible implementation, the terminal adjusts the processing resources of the CPU and/or the frequency of the GPU by monitoring the change of the frame rate and/or the GPU synthesis time of a single frame image in real time, so as to realize the real-time adjustment of the graphics synthesis resources according to the needs of the user, and improve the user experience.

In a possible implementation manner, the graphics synthesis related threads include threads in one or more of the SF process, the memory allocation process, the display sending process, and the working process.

In a possible implementation manner, the method further includes: the terminal increases the scheduling priority of threads related to graphics synthesis. In this possible implementation, by increasing the scheduling priority of the graphics synthesis related threads, the priority of the thread group where the graphics synthesis related threads are located can be improved, so that the graphics synthesis related threads can run in time to meet the user's image quality requirements.

In a second aspect, a terminal device is provided, including: functional units for executing any one of the methods provided in the first aspect, and actions performed by each functional unit are implemented by hardware or by executing corresponding software by hardware. For example, the terminal device may include: a creation unit and an adjustment unit; a creation unit for creating a thread group, where the thread group includes threads related to graphics synthesis; an adjustment unit for adjusting the processing resources of the CPU corresponding to the thread group and/or according to the target image quality Or adjust the GPU frequency. Exemplarily, the terminal device may exist in the form of a chip product.

In a third aspect, a terminal device is provided, including: a processor. The processor is connected to the memory, the memory is used for storing computer-executed instructions, and the processor executes the computer-executed instructions stored in the memory, thereby implementing any one of the methods provided in the first aspect. Among them, the memory and the processor can be integrated together or can be independent devices. In the latter case, the memory may be located in the communication device or outside the communication device.

In a fourth aspect, a terminal device is provided, the terminal device includes: a processor and an interface circuit; the interface circuit is used to receive code instructions and transmit them to the processor; the processor is used to run the code instructions to execute the code instructions provided in the first aspect any of the methods.

In a fifth aspect, a computer-readable storage medium is provided, including computer-executable instructions, which, when the computer-executable instructions are run on a computer, cause the computer to perform any one of the methods provided in the first aspect.

In a sixth aspect, a computer program product is provided, including computer-executable instructions, which, when the computer-executable instructions are run on the computer, cause the computer to perform any one of the methods provided in the first aspect.

For the technical effect brought by any one of the implementations in the second aspect to the sixth aspect, reference may be made to the technical effects brought by the corresponding implementation in the first aspect, and details are not repeated here.

Description of drawings

FIG. 1 is a schematic diagram of a hardware structure of a terminal according to an embodiment of the present application;

FIG. 2 is a schematic diagram of the composition of software modules of a terminal according to an embodiment of the present application;

3 is a schematic diagram of the composition of a combination of software and hardware provided by an embodiment of the present application;

4 is a schematic diagram of a method for detecting the duration of a single-frame image GPU synthesis provided by an embodiment of the present application;

FIG. 5 is a flowchart of a computing resource scheduling method provided by an embodiment of the present application;

6 is a flowchart of a method for creating a thread group provided by an embodiment of the present application;

7 is a schematic diagram of adjusting a GPU frequency according to an embodiment of the present application;

FIG. 8 is a flowchart of a computing resource scheduling method provided by an embodiment of the present application;

FIG. 9 is a flowchart of a strategy configuration and execution module execution strategy provided by an embodiment of the present application;

FIG. 10 is a schematic diagram of the composition of a terminal device according to an embodiment of the present application;

FIG. 11 is a schematic diagram of a hardware structure of a terminal device according to an embodiment of the present application.

Detailed ways

In the description of this application, unless otherwise stated, "/" means "or", for example, A/B can mean A or B. In this article, "and/or" is only an association relationship to describe the associated objects, which means that there can be three kinds of relationships, for example, A and/or B, which can mean that A exists alone, A and B exist at the same time, and B exists alone these three situations. Further, "at least one" means one or more, and "plurality" means two or more. The words "first" and "second" do not limit the quantity and execution order, and the words "first", "second" and the like do not limit certain differences.

It should be noted that, in this application, words such as "exemplary" or "for example" are used to represent examples, illustrations or illustrations. Any embodiment or design described in this application as "exemplary" or "such as" should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present the related concepts in a specific manner.

The embodiment of the present application provides a computing resource scheduling method, which can be applied to a terminal, where the terminal is used to provide one or more of a voice service and a data connectivity service to a user. A terminal may also be referred to as user equipment (UE), terminal equipment, access terminal, subscriber unit, subscriber station, mobile station, remote station, remote terminal, mobile device, user terminal, wireless communication device, user agent, or user device. The terminal can be a mobile phone, an augmented reality (AR) device, a virtual reality (VR) device, a tablet computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (personal digital assistant, PDA) etc., the specific form of the terminal is not limited in the following embodiments.

The operating system of the terminal in the embodiments of the present application may be an Android system, an Internet operating system (iOS) system, Linux, or other operating systems.

An exemplary hardware structure of the terminal in the embodiment of the present application can be seen in FIG. 1, including: a CPU, a display screen, a GPU, and a memory, and the terminal may also include other devices, such as a radio frequency (RF) circuit, a Bluetooth device, a or more components such as sensors, touchpads, pointing devices, audio circuits, peripheral interfaces, and power systems, which can communicate through one or more communication buses or signal lines (not shown in Figure 1). Those skilled in the art can understand that the hardware structure shown in FIG. 1 does not constitute a limitation on the terminal, and the terminal may include more or less components than the one shown, or combine some components, or arrange different components.

Among them, the CPU is the control center of the terminal, and uses various interfaces and lines to connect various parts of the terminal. The display screen is used to display information input by the user or information provided to the user and various menus of the terminal. GPU is a kind of microprocessor specialized in image computing work on the terminal. It can convert and drive the information that the terminal needs to display, and provide a line scan signal to the display screen to control the correct display of the display screen. The memory is used to store applications and data, and the CPU and GPU execute various functions of the terminal by running the applications and data stored in the memory. In the embodiment of the present application, after the terminal receives input events such as application startup, application exit, gesture navigation, etc., the CPU can process the input events, and finally display the information to be displayed on the display screen through the GPU.

Referring to FIG. 2, a schematic diagram of another exemplary software module composition of the terminal in the embodiment of the present application includes: a resource management service (resource management service, RMS) real-time processing module and a policy configuration and execution module. Among them, the RMS real-time processing module is used to obtain the real-time frame rate of the system, and send the corresponding policy to the policy configuration and execution module according to the real-time frame rate. The policy configuration and execution module is used for receiving the policy sent by the RMS real-time processing module, and takes effect through the module processing the policy in the policy configuration and execution module. Exemplarily, the terminal receives input events such as application startup, application exit, and gesture navigation, obtains the system real-time frame rate through the RMS real-time processing module, generates a corresponding policy according to the real-time frame rate, and sends the policy to the policy configuration and execution module. The execution module takes effect of the strategy, and finally completes the output and display to the user through the display screen. The input event of the terminal may be triggered by a user's operation on the terminal (for example, an action of the user interacting with an application of the terminal).

Referring to FIG. 3 , a schematic diagram of another exemplary combination of software and hardware of the terminal in the embodiment of the present application includes a frame rate module, an RMS real-time processing module, a policy configuration and execution module, a kernel, a CPU, and a GPU. It includes an energy aware scheduling (EAS) scheduler and a GPU driver. The connection relationship of each module can be seen in Figure 3. Among them, the frame rate module is used to perceive the frame rate change and notify other modules (for example, the RMS real-time processing module). The kernel is the most basic part of the operating system. It is a part of software that provides secure access to computer hardware for many applications. As shown in Figure 3, the kernel can include programs such as EAS scheduler and GPU driver that communicate with CPU and GPU hardware. The EAS scheduler is used to create a new thread group (also called a scheduling group). Other modules in the kernel can add threads to the thread group based on the process granularity, that is to say, generally one or more processes are added to the thread group. At this time, all the threads in the one or more processes form a thread group .

In order to make the embodiments of the present application more clear, the following briefly introduces concepts and some contents related to the embodiments of the present application.

1. Graphic synthesis related threads

Threads related to graphics synthesis can also be called graphics synthesis engines, which refer to threads that participate in interface synthesis (surface flinger, SF) and other threads that are depended on by these threads. Among them, it can include SF process, memory allocation (allocator buffer thread for SF using, ALLOCATOR) process, sending display process (with the function of using hardware to complete image data combination and display), work (kworker) process, etc. and its sub-threads.

Among them, the above-mentioned related threads have direct or indirect dependencies on each other. For example, the SF process depends on the display process, and the display process depends on the kworker process. Then the SF process and the display process, and the display process and kworker. Processes can be called direct dependencies, and SF processes and kworker processes can be called indirect dependencies.

2. Frame rate (Frame per-second, FPS)

The frame rate refers to the number of image frames displayed in a unit time, where the unit time can be 1 second (s) or other time units.

3. Duration of single-frame image synthesis

The duration of single-frame image synthesis refers to the duration of processing one frame of image, and the duration of single-frame image synthesis includes the duration of GPU synthesis of single-frame images and the duration of synthesis by other processors.

Taking the Android system as an example, the system frame rate can be 60 Hz, 90 Hz or 120 Hz, and the corresponding single-frame image synthesis time is 16.66 milliseconds (ms), 11 ms or 8 ms, and the single-frame image GPU synthesis duration can be The ratio of the frame image GPU synthesis duration to the single frame image synthesis duration and the single frame image synthesis duration are calculated. Specifically, when the system frame rate is 60 Hz, the GPU synthesis time of a single-frame image is 1/2 of the single-frame image synthesis time; when the system frame rate is 90 Hz, the single-frame image GPU synthesis time is 1/2 of the single-frame image synthesis time. /3, when the system frame rate is 120Hz, the GPU synthesis time of a single frame image is 1/4 of the single frame image synthesis time. Specifically, the terminal can perform instrumentation in the SF process in the GPU synthesis process, so as to monitor the GPU synthesis duration of a single frame image. Referring to FIG. 4 , the terminal may perform instrumentation respectively at the start of GPU synthesis of each frame of image and at the end of GPU synthesis, and calculate the GPU synthesis duration of a single frame of image according to the time points of the two insertions.

The above is a brief introduction to some concepts involved in this application.

For the current prior art, the terminal has the following problems:

Problem 1. There is no independent group scheduling for graphics synthesis-related threads closely related to user experience, which is likely to cause dependency blocking among graphics synthesis-related threads.

Among them, if threads with dependencies are divided into different thread groups, due to the different scheduling policies of different thread groups, the following situations may occur: a graphics synthesis thread existing in a thread group has completed processing, but is in Threads of another thread group related to the graphics compositing thread are still in a waiting state, which will cause the graphics compositing to fail to complete. This phenomenon is called inter-thread dependency blocking.

Question 2. Currently, the resources corresponding to the thread group cannot be changed according to the real-time frame rate, which will lead to the inability to respond in time when the frame rate suddenly changes, resulting in the phenomenon of frame loss and freeze.

Question 3. If the GPU frequency in the terminal is too low, the GPU synthesis time of a single frame image will be too long, which will cause SF blocking (ie, the SF process times out), resulting in the phenomenon of frame dropping and freezing.

In order to solve the above problem, the present application provides a computing resource scheduling method. In the method, the terminal adjusts resources such as CPU and GPU according to the target image quality, so as to ensure the smoothness and timeliness of the application running. As shown in Figure 5, the method includes:

501. The terminal creates a thread group, where the thread group includes threads related to graphics synthesis.

See above for a description of graphics compositing related threads. Among them, the thread group in this application includes graphics synthesis related threads. Therefore, dependency blocking among threads related to graph synthesis can be avoided. The thread group may only include graphics synthesis related threads. In this case, the problem that graphics synthesis threads cannot be completed in time due to other unrelated threads included in the same group can be avoided, and the graphics synthesis efficiency can be significantly improved.

When step 501 is specifically implemented, it can be implemented through steps 601 to 603 as shown in FIG. 6 .

601. The terminal is initialized (that is, the terminal is powered on and started).

602. The EAS scheduler creates a new thread group.

603. The RMS real-time processing module adds graphics synthesis-related threads to the thread group, where the graphics synthesis-related threads may include SF process, ALLOCATOR process, display sending process, Kworker process, and the like.

502. The terminal adjusts the processing resources of the CPU corresponding to the thread group and/or adjusts the frequency of the GPU according to the target image quality.

It should be noted that since the GPU is a microprocessor specialized in image computing on the terminal, adjusting the GPU frequency must be aimed at graphics synthesis related threads. Therefore, this application is directly described as adjusting the GPU frequency.

The target image quality refers to the image quality of the image to be displayed or to be displayed on the terminal, the target image quality needs to meet the requirements of the target frame rate, and the target frame rate refers to the image to be displayed or to be displayed due to the user's trigger The frame rate of the image. For example, when the user triggers application startup, application exit, and gesture navigation, the frame rate of the image to be displayed by the terminal is the target frame rate. The target frame rate may be higher than the frame rate of the currently displayed image, may also be lower than the frame rate of the currently displayed image, or may be the same as the frame rate of the currently displayed image, which is not limited in this application.

Among them, the terminal can monitor the change of the frame rate in real time. Specifically, the RMS real-time processing module can perform callback registration with the frame rate module during the terminal initialization phase, and the callback registration is used to instruct the frame rate module to notify the RMS real-time processing module when the frame rate changes, and the RMS real-time processing module can obtain the latest frame rate. .

The target frame rate can be the latest frame rate obtained by the RMS real-time processing module based on the current time. For example, if the current terminal has not been powered on, the target frame rate can be the frame rate (that is, the initial frame rate) obtained by the RMS real-time processing module from the frame rate module for the first time after the terminal is initialized (that is, after the callback is registered). After the terminal is powered on, the target frame rate may be the frame rate newly obtained by the RMS real-time processing module from the frame rate module in the subsequent process.

When step 502 is specifically implemented, the terminal may adjust the processing resources of the CPU corresponding to the thread group and/or adjust the GPU frequency based on the target frame rate of the image.

The above step 502 may include the following action 1 and/or action 2 when specifically implemented:

Action 1. The terminal adjusts the processing resources of the CPU corresponding to the thread group according to the target frame rate of the image.

Action 2. The terminal adjusts the GPU frequency according to the GPU synthesis duration of the single-frame image of the image.

When specifically implemented, action 1 may include: the terminal determines that the frame rate range in which the target frame rate is located is the first frame rate range; the terminal adjusts the processing of the CPU corresponding to the thread group according to the threshold value (Threshold) corresponding to the first frame rate range Resource, the threshold value is greater than 0 and less than 1.

The correspondence between at least one frame rate range (it is assumed to be N frame rate ranges) and the threshold value (referred to as the first correspondence) can be pre-configured, and the first correspondence includes the Threshold value. The threshold value corresponding to each frame rate range is greater than 0 and less than 1. The threshold value in the first corresponding relationship may also be referred to as a load threshold value. N is an integer greater than 0. Any two frame rate ranges in the N frame rate ranges do not overlap, and as the frame rate range increases, the threshold value increases correspondingly. After being preset, the first corresponding relationship may remain unchanged or may be changed periodically or according to a certain time rule. Wherein, the N frame rate ranges may be preset according to the version of the operating system of the terminal, the capability of the terminal, and the like, and the method for possessing them is not limited in this application.

Exemplarily, Table 1 shows a possible first correspondence.

Table 1

Frame rate range	[0,60)Hz	[60,90)Hz	[90, 120) Hz	[120, Y] Hz
Threshold value (%)	10	20	30	40

Based on the example shown in Table 1, if the target frame rate is less than 60 Hz, at this time, the first frame rate range is [0, 60) Hz, then the threshold value 10 corresponding to [0, 60) Hz is used to adjust the corresponding thread group CPU processing resources; if the target frame rate is greater than or equal to 60Hz and less than 90Hz, at this time, the first frame rate range is [60, 90) Hz, then the threshold value 20 corresponding to [60, 90) Hz is used to adjust the thread group The processing resources of the corresponding CPU; if the target frame rate is greater than or equal to 90Hz and less than 120Hz, at this time, the first frame rate range is [90, 120) Hz, then the threshold value 30 corresponding to [90, 120) Hz is used to adjust The processing resources of the CPU corresponding to the thread group; if the target frame rate is greater than or equal to 120Hz and less than or equal to Y, at this time, the first frame rate range is [120, Y] Hz, and the gate corresponding to [120, Y] Hz is used The limit value of 40 adjusts the processing resources of the CPU corresponding to the thread group. Wherein, Y in this application is the maximum frame rate that the terminal can support, that is, the maximum frame rate of the image that the terminal can display.

In the above action 1, the terminal adjusts the processing resources of the CPU corresponding to the thread group according to the threshold value corresponding to the first frame rate range, including: the terminal determines the adjustment value of the processing resources of the CPU, and the adjustment value corresponds to the first frame rate range. The product of the threshold value and the remaining resources of the CPU; the terminal increases the processing resources of the CPU for the thread group according to the adjustment value. For example, based on the example shown in Table 1, it is assumed that the target frame rate obtained by the RMS real-time processing module is 70 Hz, the target frame rate is at [60, 90) Hz, and the threshold corresponding to [60, 90) Hz is 20. The processing resource of the CPU allocated to the thread group is denoted as a, and the total processing resource of the CPU is denoted as b, then the adjustment value is (b-a) × 20%, and the obtained adjustment value is taken as the increment of the allocated resource a to realize the The adjustment of the processing resources of the CPU.

It should be noted that the form of the first correspondence may not be the correspondence between the frame rate range and the threshold, but the correspondence between the frame rate and the threshold. In this case, the first correspondence includes N frame rates. The corresponding relationship with the threshold value, when the target frame rate is less than the minimum frame rate among the N frame rates, the processing resources of the CPU corresponding to the thread group can be adjusted according to the threshold value corresponding to the minimum frame rate. When the target frame rate is between two consecutive frame rates among the N frame rates, the processing resources of the CPU corresponding to the thread group are adjusted according to the threshold value corresponding to the larger frame rate among the two consecutive frame rates . When the target frame rate is greater than the maximum frame rate among the N frame rates, the processing resources of the CPU corresponding to the thread group may be adjusted according to the threshold value corresponding to the maximum frame rate. An example of the first correspondence can be found in Table 2.

Table 2

frame rate	60Hz	90Hz	120Hz	Y
Threshold value (%)	10	20	30	40

Based on the examples shown in Table 2, if the target frame rate is less than 60Hz, the threshold value 10 corresponding to 60Hz is used to adjust the processing resources of the CPU corresponding to the thread group; The threshold value of 20 adjusts the processing resources of the CPU corresponding to the thread group; if the target frame rate is greater than or equal to 90Hz and less than 120Hz, the threshold value 30 corresponding to 120Hz is used to adjust the processing resources of the CPU corresponding to the thread group; if the target frame rate If it is greater than or equal to 120 Hz, the threshold value 40 corresponding to Y is used to adjust the processing resources of the CPU corresponding to the thread group. The process of adjusting the processing resources of the CPU after the threshold value is determined may be referred to above, and will not be repeated here.

Based on the terminal architecture shown in FIG. 3 , the above-mentioned action 1 may include: the RMS real-time processing module obtains the target frame rate from the frame rate module, and determines a policy ID according to the target frame rate, where the policy ID is used to indicate the first frame rate range and the threshold value corresponding to the first frame rate range, the RMS real-time processing module sends the policy ID to the policy configuration and execution module, and the policy configuration and execution module parses the policy ID to obtain the threshold value, and sends the threshold value to The kernel obtains the adjustment value through calculation, sends the adjustment value to the CPU, and the CPU adjusts the processing resources according to the adjustment value.

The CPU of the terminal consists of multiple cores, and the processing resources of the CPU can be further divided into large, medium and small cores, and the large, medium and small cores are further divided into multiple clock frequencies ranging from high, medium and low. The clock frequency corresponding to the core is higher, and the clock frequency corresponding to the small core is lower. Usually to complete the same transaction, a small core has a higher energy efficiency ratio (ratio of power consumption and performance) and a longer duration than a large core; low frequency is more energy efficient than high frequency, and the duration is also longer. In order to balance performance and power consumption, for scenarios where the user interacts with the application, it is possible to process application transactions in a short time, while for transactions that are not perceived by foreground users, use lower power consumption as much as possible. Therefore, in the present application, for the scenario where the user interacts with the application, sufficient processing resources of the CPU can be allocated for displaying the image after the interaction to ensure the smoothness of the image. After the adjustment value of CPU processing resources is determined and adjusted based on the target frame rate, if the adjusted CPU processing resources reach the CPU core migration threshold, core migration can be performed to ensure smooth images and improve user experience. It can be seen from this that, by adjusting the processing resources of the CPU, the core of the CPU that processes the threads related to graphics synthesis can also be indirectly adjusted, so as to ensure the timeliness of image synthesis.

When specifically implemented, action 2 may include: the terminal determines that the frame rate range in which the target frame rate is located is the second frame rate range; the terminal determines the GPU frequency corresponding to the second frame rate range; when determining the GPU frequency corresponding to the second frame rate range When the GPU synthesis duration of a single frame image is greater than or equal to the first threshold, the terminal adjusts the GPU frequency to the GPU frequency corresponding to the maximum value of the second frame rate range, and the first threshold is the single frame corresponding to the maximum value of the second frame rate range. Image GPU synthesis duration, the GPU frequency corresponding to the maximum value of the second frame rate range is greater than the GPU frequency corresponding to the second frame rate range. Hereinafter, the GPU frequency corresponding to the maximum value of the second frame rate range is recorded as the target GPU frequency.

It should be noted that the correspondence between the frame rate range and the GPU frequency may be preset, and the correspondence may include M correspondences between the frame rate range and the GPU frequency (referred to as the second correspondence), each frame rate The maximum value of the range may also correspond to a GPU frequency, and the GPU frequency corresponding to the maximum value of a frame rate range is greater than the GPU frequency corresponding to the frame rate range. M is an integer greater than 1.

When action 2 is specifically implemented, after the terminal determines the GPU frequency corresponding to the second frame rate range, the terminal can run at the GPU frequency corresponding to the second frame rate range. When the GPU frequency corresponding to the second frame rate range is determined, a single frame When the image GPU synthesis duration is greater than or equal to the first threshold, it means that the current GPU frequency cannot meet the requirement of the image GPU synthesis duration when the frame rate is the maximum value of the second frame rate range. In this case, the GPU frequency can be adjusted to The target GPU frequency. Since the target GPU frequency is greater than the GPU frequency corresponding to the second frame rate range, the synthesis efficiency of images can be improved and frame loss can be avoided.

Exemplarily, Table 3 exemplarily shows a second correspondence relationship, and Table 4 exemplarily shows the GPU frequency corresponding to the maximum value of each frame rate range in the second correspondence relationship.

table 3

Frame rate range	[0,60)Hz	[60,90)Hz	[90, 120) Hz	[120, Y] Hz
GPU frequency	200MHz	300MHz	400MHz	500MHz

Table 4

frame rate	60Hz	90Hz	120Hz	Y
GPU frequency	250MHz	360MHz	480MHz	600MHz

Based on the examples shown in Tables 3 and 4, if the target frame rate obtained by the RMS real-time processing module is 50 Hz, and the target frame rate is in [0, 60) Hz, the second frame rate range is [0, 60 Hz ) Hz, then the terminal adopts the GPU frequency 200MHz corresponding to [0,60) Hz to perform GPU synthesis. During the GPU synthesis process, the GPU synthesis duration of the single-frame image is detected, and the GPU synthesis duration of the single-frame image is compared with the first threshold (i.e. The GPU synthesis time of a single frame image corresponding to 60Hz, that is, the size of 16.66/2=8.33ms), see Figure 7. If the detection result of the terminal in the first frame is 8.13ms, since 8.13ms is less than 8.33ms, the terminal can not adjust the GPU Frequency; if the detection result of the terminal in the second frame is 8.66ms, since 8.66ms is greater than 8.33ms, it means that the current GPU frequency cannot meet the requirements of the target image quality. Therefore, the terminal increases the GPU frequency before the GPU synthesis in the third frame. Increase to the corresponding GPU frequency of 60Hz (ie 250MHz).

It should be noted that the terminal can monitor the GPU synthesis duration of a single-frame image in real time, so as to adjust the GPU frequency at any time to avoid frame loss and freeze.

Based on the terminal architecture shown in FIG. 3 , the above-mentioned action 2 may include: in the SF process, determining whether the GPU synthesis duration of a single-frame image exceeds a first threshold, and if so, the CPU sends indication information to the RMS real-time processing module in the SF process , the instruction information is used to indicate that the single-frame image GPU synthesis duration exceeds the first threshold, the RMS real-time processing module determines the target GPU frequency, and sends the strategy ID to the strategy configuration and execution module, and the strategy corresponding to the strategy ID is used to indicate the target GPU frequency, The policy configuration and execution module obtains the target GPU frequency by parsing the policy ID, and sends the target GPU frequency to the GPU driver in the kernel, and the GPU driver controls the GPU to adjust the GPU frequency to the target GPU frequency.

It should be noted that due to the adjustment of the GPU frequency, other GPU resources related to the GPU frequency, such as memory resources (for example, double data rate, DDR) used for GPU synthesis, will also be adjusted accordingly. Specifically, some methods well known to those skilled in the art may be adopted, which will not be described in detail in this application.

The above actions 1 and 2 do not interfere with each other during implementation, and only one of them may be performed, or both may be performed.

Referring to FIG. 8 , the overall flow of the method provided by the above embodiment may include:

11) The frame rate module detects the input event and determines the target frame rate. The input events may be events such as application startup, application exit, gesture navigation, etc. received by the terminal.

12) The frame rate module sends the target frame rate to the RMS real-time processing module and the CPU.

13) The CPU determines the target GPU frequency according to the target frame rate, and sends the instruction information to the RMS real-time processing module. The indication information is used to indicate that the GPU synthesis duration of the single-frame image exceeds the first threshold.

14) The RMS real-time processing module determines the policy ID, and the policy ID is used to adjust the processing resources of the CPU or adjust the frequency of the GPU. If the policy ID is used to adjust the processing resources of the CPU corresponding to the thread group, the policy ID is determined according to the target frame rate. If the policy ID is used to adjust the GPU frequency, the policy ID is determined according to the indication information. The specific implementation of step 14) can refer to the above.

Wherein, the policy ID can indicate the type of the policy, and the types of the policy include: the type used to adjust the processing resources of the CPU corresponding to the thread group (denoted as the first type policy), the type used to adjust the GPU frequency (denoted as the second type of policy) type policy). For example, referring to FIG. 8 , policies corresponding to policies 1001 and 1002 are policies of the first type, and policies corresponding to policies 2001 and 2002 are policies of the second type.

Wherein, the first type of strategy includes frame rate range and threshold value, and the second type of strategy includes target GPU frequency.

15) The RMS real-time processing module sends the policy ID to the policy configuration and execution module.

16) The policy configuration and execution module adjusts the processing resources of the CPU or the frequency of the GPU according to the policy ID.

Wherein, referring to Figure 9, step 16) can include:

901. The policy configuration and execution module receives the policy ID from the RMS real-time processing module.

902. The policy configuration and execution module determines whether a policy corresponding to the policy ID exists in the extensible markup language (extensible markup language, xml) configuration file.

If there is, go to step 903, if not, end.

903. The policy configuration and execution module adjusts the processing resources of the CPU or the frequency of the GPU according to the policy ID.

Wherein, the xml configuration file may be pre-stored in the terminal for policy configuration and the policy corresponding to the query policy ID of the execution module. As shown in FIG. 9, exemplarily, if the policy ID is policy 1001, parse the policy 1001 to obtain the frame rate range (ie [0, 60) Hz) and its corresponding threshold value (ie 10), and use the threshold The value is sent to the kernel, the kernel obtains the adjustment value through calculation, and sends the adjustment value to the CPU, and the CPU adjusts the processing resources of the CPU according to the adjustment value. Exemplarily, if the strategy ID is strategy 2001, parse the strategy 2001 to obtain the target frame rate corresponding to 60Hz (that is, 250MHz), send the target GPU frequency to the GPU driver in the kernel, and the GPU driver controls the GPU to adjust the GPU frequency to the target GPU frequency. .

The first correspondence and the second correspondence in the foregoing embodiments of the present application are only examples, and may be other forms in actual implementation, which are not limited.

Optionally, the above method further includes: the terminal increases the scheduling priority of threads related to graphics synthesis, or the terminal increases the scheduling priority of the thread group in the present application.

In the prior art, one or two most important threads can be added to a thread group (in this case, the thread group can be called a critical group), and the priority of the critical group is higher than that of the non-critical group to ensure performance Experience first. This method does not add related threads with dependencies to the same thread group, but the threads in a thread group are coordinated and scheduled uniformly. The scheduling strategy is also different, which leads to some threads in the related threads migrate early, and some threads migrate late, resulting in dependent blocking between threads. In the present application, a thread group can be created that includes threads related to graphics synthesis, and the priority of all threads in the thread group can be increased. The priority of all threads in the thread group is higher than that of threads in other groups. Therefore, the priority of the thread group is higher than that of other groups. Due to the higher priority of the thread group, priority processing can be achieved, so that in the process of image synthesis, the smoothness and timeliness of the thread processing process are ensured, and frame loss is further avoided. The occurrence of the stuttering phenomenon improves the user experience.

At present, for game applications, since the user has high requirements for the smoothness of the image, when the user triggers the demand for higher image quality, the processing resources of the CPU and the frequency of the GPU can be adjusted to the maximum, that is, the presence of graphics All threads in the thread group that synthesize related threads are allocated sufficient CPU processing resources and GPU frequencies, so that although the user's needs can be met, resource waste is serious and power consumption is relatively high. In this application, since an independent thread group related to graphics synthesis is established, the user can adjust the processing resources and GPU frequency of the GPU for the thread group according to the actual image quality requirements, so as to avoid resource waste and reduce the power consumption of the terminal. That is to say, the present application can create independent thread groups for graphics synthesis related threads, and allocate resources to the thread groups in the application as needed. Compared with placing graphics synthesis related threads in different thread groups, waste of resources can be avoided. , reduce the power consumption of the terminal.

The method provided by this embodiment of the present application reasonably adjusts the processing resources of the CPU corresponding to the thread group by judging the level of the target frame rate of the image (or can also be described as the length of the target frame interval of the image), and by monitoring the GPU of a single frame image Synthesis time, reasonable adjustment of GPU frequency, can allocate resources to thread groups as needed, thereby avoiding waste of resources and reducing power consumption of terminals.

In the above-mentioned embodiment of the present application, step 501 and step 502 may be independent solutions, when only step 501 is executed, the above problem 1 can be solved, and only step 502 is executed (in this case, the thread group may not be the thread group in the present application, Instead of the thread group in the prior art), the above problem 2 can be solved.

The solutions of the embodiments of the present application have been introduced above mainly from the perspective of methods. It can be understood that each module, for example, in order to implement the above-mentioned functions, the terminal includes at least one of a hardware structure and a software module corresponding to executing each function. Those skilled in the art should easily realize that the present application can be implemented in hardware or in the form of a combination of hardware and computer software, in conjunction with the units and algorithm steps of each example described in the embodiments disclosed herein. Whether a function is performed by hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.

In this embodiment of the present application, the terminal may be divided into functional units according to the foregoing method examples. For example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units. It should be noted that the division of units in the embodiments of the present application is illustrative, and is only a logical function division, and other division methods may be used in actual implementation.

Exemplarily, FIG. 10 shows a possible schematic structural diagram of a terminal device (referred to as a terminal device 100 ) involved in the above-mentioned embodiment, where the terminal device 100 includes a creation unit 1001 and an adjustment unit 1002 .

A creation unit 1001 is used to create a thread group, where the thread group includes graphics synthesis related threads;

The adjustment unit 1002 is configured to adjust the processing resources of the central processing unit CPU corresponding to the thread group and/or adjust the frequency of the graphics processor GPU according to the target image quality.

Optionally, the adjustment unit 1002 is specifically configured to: adjust the processing resources of the CPU corresponding to the thread group according to the target frame rate of the image; and/or adjust the GPU frequency according to the GPU synthesis duration of a single frame of the image.

Optionally, the adjusting unit 1002 is specifically configured to: determine the frame rate range where the target frame rate is located as the first frame rate range; adjust the processing resources of the CPU corresponding to the thread group according to the threshold value corresponding to the first frame rate range, The limit is greater than 0 and less than 1.

Optionally, the adjustment unit 1002 is specifically configured to: determine the adjustment value of the processing resources of the CPU, where the adjustment value is the product of the threshold value corresponding to the first frame rate range and the remaining resources of the CPU; Process resources.

Optionally, the adjustment unit 1002 is specifically configured to: determine the frame rate range in which the target frame rate is located as the second frame rate range; determine the GPU frequency corresponding to the second frame rate range; when determining the GPU frequency corresponding to the second frame rate range; Under the frequency, when the GPU synthesis time of a single frame image is greater than or equal to the first threshold, adjust the GPU frequency to the GPU frequency corresponding to the maximum value of the second frame rate range, and the first threshold is the single frame corresponding to the maximum value of the second frame rate range. Image GPU synthesis duration, the GPU frequency corresponding to the maximum value of the second frame rate range is greater than the GPU frequency corresponding to the second frame rate range.

Optionally, the terminal device further includes a monitoring unit 1003, and the monitoring unit 1003 is configured to: monitor the change of the frame rate in real time; and/or monitor the GPU synthesis duration of the single frame image in real time.

Optionally, the graphics synthesis related threads include threads in one or more of the SF process, the memory allocation process, the sending and display process, and the worker process.

Optionally, the terminal device further includes a priority configuration unit 1004; the priority configuration unit 1004 is configured to improve the scheduling priority of graphics synthesis related threads.

Optionally, the terminal device 100 further includes a storage unit 1005 . The storage unit 1005 is used for storing computer-executed instructions, and other units in the terminal device can perform corresponding actions according to the computer-executed instructions stored in the storage unit 1005 .

Exemplarily, the actions performed by the creation unit 1001 may also be performed by the above-mentioned RMS real-time processing module and the kernel; the actions performed by the adjustment unit 1002 may also be performed by the above-mentioned policy configuration and execution modules; the actions performed by the monitoring unit 1003 may also be performed by the above-mentioned frames. The rate module and the kernel are executed; the actions executed by the priority configuration unit 1004 can also be executed by the above-mentioned kernel. Wherein, all relevant contents of the steps involved in the above method embodiments can be cited in the functional descriptions of the corresponding functional modules, which will not be repeated here.

The terminal device 100 may be a device or a chip or a chip system.

The integrated unit in FIG. 10 may be stored in a computer-readable storage medium if it is implemented in the form of software functional modules and sold or used as a stand-alone product. Based on this understanding, the technical solutions of the embodiments of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, and the computer software products are stored in a storage The medium includes several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (processor) to execute all or part of the steps of the methods of the various embodiments of the present application. Storage media for storing computer software products include: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or CD, etc. that can store program codes medium.

An embodiment of the present application further provides a schematic diagram of a hardware structure of a terminal device. Referring to FIG. 11 , the terminal device includes a processor 1101 and, optionally, a memory 1102 connected to the processor 1101 . The processor 1101 and the memory 1102 are connected by a bus.

The processor 1101 may include a CPU, a GPU, a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the programs of the present application. The processor 1101 may also include multiple CPUs, and the processor 1101 may be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. A processor herein may refer to one or more devices, circuits, or processing cores for processing data (eg, computer program instructions).

The memory 1102 can be a ROM or other type of static storage device that can store static information and instructions, a RAM or other type of dynamic storage device that can store information and instructions, or an electrically erasable programmable read-only memory. read-only memory, EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compact disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), magnetic disk A storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program codes in the form of instructions or data structures and that can be accessed by a computer, is not limited in this embodiment of the present application. The memory 1102 may exist independently, or may be integrated with the processor 1101 . Among them, the memory 1102 may contain computer program code. The processor 1101 is configured to execute the computer program codes stored in the memory 1102, so as to implement the methods provided by the embodiments of the present application.

The processor 1101 is configured to control and manage actions of the terminal. For example, the processor 1101 is configured to execute actions 501 to 502 in FIG. 5 and/or actions performed by the terminal in other processes described in the embodiments of this application. The memory 1102 is used to store program codes and data of the terminal.

In the implementation process, each step in the method provided in this embodiment may be completed by an integrated logic circuit of hardware in a processor or an instruction in the form of software. The steps of the method disclosed in conjunction with the embodiments of the present application may be directly embodied as executed by a hardware processor, or executed by a combination of hardware and software modules in the processor.

Embodiments of the present application further provide a computer-readable storage medium, including instructions, which, when executed on a computer, cause the computer to execute any of the foregoing methods.

Embodiments of the present application also provide a computer program product containing instructions, which, when run on a computer, cause the computer to execute any of the above methods.

In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using a software program, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the procedures or functions according to the embodiments of the present application are generated in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable device. Computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server, or data center over a wire (e.g. coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (eg infrared, wireless, microwave, etc.) means to transmit to another website site, computer, server or data center. Computer-readable storage media can be any available media that can be accessed by a computer or data storage devices including one or more servers, data centers, etc., that can be integrated with the media. Useful media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVDs), or semiconductor media (eg, solid state disks (SSDs)), and the like.

Although the application is described herein in conjunction with various embodiments, in practicing the claimed application, those skilled in the art can understand and implement the disclosure by reviewing the drawings, the disclosure, and the appended claims Other variations of the embodiment. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude a plurality. A single processor or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that these measures cannot be combined to advantage.

Although the application has been described in conjunction with specific features and embodiments thereof, it will be apparent that various modifications and combinations can be made therein without departing from the spirit and scope of the application. Accordingly, this specification and drawings are merely exemplary illustrations of the application as defined by the appended claims, and are deemed to cover any and all modifications, variations, combinations or equivalents within the scope of this application. Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims (19)

1. A computing resource scheduling method, comprising:

   The terminal creates a thread group, and the thread group includes graphics synthesis related threads;

   The terminal adjusts the processing resources of the central processing unit CPU corresponding to the thread group and/or adjusts the frequency of the graphics processor GPU according to the target image quality.
2. The method according to claim 1, wherein the terminal adjusts the processing resources of the CPU corresponding to the thread group and/or adjusts the GPU frequency according to the target image quality, comprising:

   The terminal adjusts the processing resources of the CPU corresponding to the thread group according to the target frame rate of the image; and/or,

   The terminal adjusts the GPU frequency according to the GPU synthesis duration of a single frame of the image.
3. The method according to claim 2, wherein the terminal adjusts the processing resources of the CPU corresponding to the thread group according to the target frame rate of the image, comprising:

   The terminal determines that the frame rate range in which the target frame rate is located is the first frame rate range;

   The terminal adjusts the processing resources of the CPU corresponding to the thread group according to a threshold value corresponding to the first frame rate range, where the threshold value is greater than 0 and less than 1.
4. The method according to claim 3, wherein the terminal adjusts the processing resources of the CPU corresponding to the thread group according to the threshold value corresponding to the first frame rate range, comprising:

   determining, by the terminal, an adjustment value of the processing resources of the CPU, where the adjustment value is the product of the threshold value corresponding to the first frame rate range and the remaining resources of the CPU;

   The terminal increases the processing resources of the CPU for the thread group according to the adjustment value.
5. The method according to claim 2, wherein the terminal adjusts the GPU frequency according to the GPU synthesis duration of the single-frame image of the image, comprising:

   The terminal determines that the frame rate range in which the target frame rate is located is the second frame rate range;

   The terminal determines the GPU frequency corresponding to the second frame rate range;

   When it is determined that under the GPU frequency corresponding to the second frame rate range, the GPU synthesis duration of a single frame image is greater than or equal to the first threshold, the terminal adjusts the GPU frequency to correspond to the maximum value of the second frame rate range the GPU frequency, the first threshold is the single-frame image GPU synthesis duration corresponding to the maximum value of the second frame rate range, and the GPU frequency corresponding to the maximum value of the second frame rate range is greater than the second frame rate The GPU frequency corresponding to the range.
6. The method according to any one of claims 1-5, wherein the method further comprises:

   The terminal monitors changes in the frame rate in real time; and/or,

   The terminal monitors the GPU synthesis duration of a single frame image in real time.
7. The method according to any one of claims 1-6, wherein the graphics synthesis related threads include threads in one or more of an interface synthesis SF process, a memory allocation process, a display sending process, and a work process. .
8. The method according to any one of claims 1-7, wherein the method further comprises:

   The terminal increases the scheduling priority of the graphics synthesis related thread.
9. A terminal device, characterized in that it includes:

   A creation unit for creating a thread group, the thread group including graphics synthesis related threads;

   An adjustment unit, configured to adjust the processing resources of the central processing unit CPU corresponding to the thread group and/or adjust the frequency of the graphics processor GPU according to the target image quality.
10. The terminal device according to claim 9, wherein the adjustment unit is specifically configured to:

    Adjust the processing resources of the CPU corresponding to the thread group according to the target frame rate of the image; and/or,

    The GPU frequency is adjusted according to the GPU synthesis duration of the single-frame image of the image.
11. The terminal device according to claim 10, wherein the adjustment unit is specifically configured to:

    determining that the frame rate range in which the target frame rate is located is the first frame rate range;

    The processing resources of the CPU corresponding to the thread group are adjusted according to a threshold value corresponding to the first frame rate range, where the threshold value is greater than 0 and less than 1.
12. The terminal device according to claim 11, wherein the adjustment unit is specifically configured to:

    determining an adjustment value of the processing resources of the CPU, where the adjustment value is the product of the threshold value corresponding to the first frame rate range and the remaining resources of the CPU;

    The processing resources of the CPU are increased for the thread group according to the adjustment value.
13. The terminal device according to claim 10, wherein the adjustment unit is specifically configured to:

    determining that the frame rate range in which the target frame rate is located is the second frame rate range;

    determining the GPU frequency corresponding to the second frame rate range;

    When it is determined that under the GPU frequency corresponding to the second frame rate range, the GPU synthesis duration of a single frame image is greater than or equal to the first threshold, adjust the GPU frequency to the GPU frequency corresponding to the maximum value of the second frame rate range , the first threshold is the single-frame image GPU synthesis duration corresponding to the maximum value of the second frame rate range, and the GPU frequency corresponding to the maximum value of the second frame rate range is greater than the GPU frequency corresponding to the second frame rate range. GPU frequency.
14. The terminal device according to any one of claims 9-13, wherein the terminal device further comprises a monitoring unit, and the monitoring unit is configured to:

    monitor frame rate changes in real time; and/or,

    Real-time monitoring of single-frame image GPU synthesis time.
15. The terminal device according to any one of claims 9-14, wherein the graphics synthesis related thread comprises one or more of an interface synthesis SF process, a memory allocation process, a display sending process, and a work process. thread.
16. The terminal device according to any one of claims 9-15, wherein the terminal device further comprises a priority configuration unit;

    The priority configuration unit is configured to improve the scheduling priority of the graphics synthesis related thread.
17. A terminal device, comprising: a processor;

    The processor is connected to a memory, the memory is used to store computer-executed instructions, and the processor executes the computer-executed instructions stored in the memory, so that the terminal device implements any one of claims 1-8 the method described.
18. A computer-readable storage medium, characterized in that it is used for storing computer instructions, which, when the computer instructions are executed on a computer, cause the computer to perform the method of any one of claims 1-8.
19. A computer program product, characterized by comprising computer instructions which, when executed on a computer, cause the computer to perform the method of any one of claims 1-8.

Images