WO2022100646A1

WO2022100646A1 - Picture frame rate adjustment method for electronic device, electronic device, and storage medium

Info

Publication number: WO2022100646A1
Application number: PCT/CN2021/129988
Authority: WO
Inventors: 潘品睿; 陈毓书
Original assignee: 深圳市万普拉斯科技有限公司
Priority date: 2020-11-16
Filing date: 2021-11-11
Publication date: 2022-05-19
Also published as: CN114510274A

Abstract

Disclosed in the present application is a picture frame rate adjustment method for an electronic device, comprising: identifying a drawing thread of an electronic device to obtain a game name and a game vendor; according to a whitelist set by the game vendor and the current state of the electronic device, determining whether to change a game frame rate; if a game picture needs to reduce the frame rate, loading, before or after a buffer region, the game picture that is drawn by the drawing thread, or when the drawing thread invokes a graphics library, calculating a sleep time, and enabling the drawing thread to sleep; and after a sleep time is ended, releasing the sleep state of the drawing thread to reduce the output time interval of the game picture, and reduce the frame rate of the game picture. Adjusting the sleep time can adjust the time interval of the game picture in the buffer region by the drawing thread of a game, thereby controlling the frame rate of the game picture at will, and thus, the manufacturer of the electronic device can adjust the frame rate according to the performance, power consumption, and temperature of hardware, thereby improving the flexibility and expandability of the game frame rate.

Description

Frame rate adjustment method of electronic equipment, electronic device and storage medium

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based on the Chinese patent application with the application number of 202011283182.X and the filing date of November 16, 2020, and claims the priority of the Chinese patent application. The entire content of the Chinese patent application is incorporated herein by reference.

technical field

The present application relates to the technical field of image processing, and in particular, to a frame rate adjustment method of an electronic device, an electronic device, and a storage medium.

Background technique

With the development of science and technology, the computing power of components such as the Central Processing Unit (CPU) and Graphics Processing Unit (GPU) of electronic equipment has been greatly strengthened. For image display applications with high power consumption, the frame rate and complexity of the picture are gradually increased, in order to obtain a better user experience.

When the electronic device runs the game, the drawing thread of the game will load the drawn game screen into the buffer, and then the center (SurfaceFlinger) used to manage the screen in the operating system will take out the game screen from the buffer; however, for For electronic devices, the higher and more refined the frame rate of the picture, the more likely the electronic device will get hot.

In order to reduce the risk of overheating of electronic devices, the method of reducing the game frame rate is generally used to reduce the heat generation of electronic devices. However, for electronic devices, the frame rate can only be reduced by controlling the frequency of the display screen. A display screen whose refresh rate can be controlled at will is expensive, and the reduced frame rate is usually fixed, so it does not have flexibility and scalability.

SUMMARY OF THE INVENTION

In view of this, the present application provides a frame rate adjustment method for electronic equipment, an electronic device and a storage medium, which solves the problem that a display screen whose screen refresh frequency can be controlled at will cost is relatively high, and the reduced frame rate is not flexible and expandable. The problem.

A first aspect of the present application provides a method for adjusting a picture frame rate of an electronic device, including: identifying a drawing thread of the electronic device to obtain a game drawing thread of the electronic device running a game; and judging whether to change according to the whitelist and the current state of the electronic device Game frame rate, the whitelist contains at least the frame rates corresponding to different states of the electronic device; if the game screen needs to reduce the frame rate, before loading the game screen drawn by the drawing thread into the buffer or into any After the buffer, or when the drawing thread calls the drawing function library, the sleep time is calculated and the drawing thread is put to sleep; and after the sleep time is over, the sleep state of the drawing thread is released to slow down the game screen The output time interval will reduce the frame rate of the game screen.

The calculation of the sleep time includes: the time difference between obtaining the sleep end time of the previous frame of the game screen and executing the judgment on whether the game screen of the current frame needs to sleep; obtaining the desired frame of the frame rate of the game screen in the buffer or whitelist The sleep time is calculated according to the time difference and the expected frame length; the calculation formula of the sleep time is as follows:

SleepDuration=ExpectedPeriod-TimeDiff

Wherein, SleepDuration represents the sleep time, ExpectedPeriod represents the expected frame length, and TimeDiff represents the time difference.

Wherein, the calculating the sleep time further includes: when the game screen of the current frame has at least two and an even number of frames, calculating a sleep correction item; according to the time difference, the expected frame length and the sleep correction item Calculate the sleep time; the calculation formula of the sleep time is as follows:

SleepDuration=ExpectedPeriod-TimeDiff+SleepCorrection

Wherein, SleepDuration represents the sleep time, ExpectedPeriod represents the expected frame length, TimeDiff represents the time difference, and SleepCorrection represents the sleep correction item.

The calculating the sleep correction item includes: calculating the average frame length of all frames of the game screen of the current frame; calculating the difference between the expected frame length and the average frame length, and using the difference as the sleep correction term; the formula for calculating the sleep correction term is as follows:

Wherein, SleepCorrection represents the sleep correction item,

Represents ExpectedPeriod, EFPS is the expected frame rate preset by the game,

represents the average frame length, N represents the size of the small window in the game screen of the current frame, and the size of the small window represents the number of frames included in the calculation at one time. Fi represents the frame length of the ith frame, and i is the ith frame in the current frame.

The calculating the sleep correction item includes: obtaining the size of the small window in the game screen of the current frame; calculating the frame lengths of all frames of the game screen of the current frame; The frame length of all frames of the picture calculates the sleep correction term; the formula for calculating the sleep correction term is as follows:

where Q represents the sleep correction term,

Represents ExpectedPeriod, EFPS is the expected frame rate preset by the game, N represents the size of the small window in the game screen, and Fi represents the frame length of the i-th frame of the small window of the game screen.

The calculation of the sleep time further includes: obtaining the size of the large window and the size of the small window in the game screen of the current frame, where the size of the large window represents the number of frames included in the calculation at one time, wherein the size of the large window is larger than the size of the small window; calculate a long-term correction value; obtain a short-term correction value according to the sleep correction term; use the time difference, the expected frame length, the long-term correction value and the sleep correction term to calculate the described sleep time; the calculation formula of described sleep time is as follows:

SleepDuration=ExpectedPeriod-TimeDiff+STC+LTC

Wherein, SleepDuration represents the sleep time, ExpectedPeriod represents the expected frame length, TimeDiff represents the time difference, LTC represents the long-term correction value, STC represents the short-term correction value, and the short-term correction value is consistent with the sleep correction item.

The calculating the long-term correction value includes: setting a gear interval, each integer in the gear interval is a gear, and each of the gears represents a time value; dividing the large window screen into are different sub-areas; match the gears for each sub-area according to the time of each sub-area; obtain the gears matched by each of the sub-areas, and use the most matched gear as the long-term Correction value.

Wherein, the calculating the long-term correction value further includes: using machine learning or a neural network to divide each of the sub-regions into different categories; matching different categories with different gears; matching the most The gear is used as the long-term correction value.

The calculating the long-term correction value includes: acquiring at least one current feature value of the electronic device that affects the frame rate of the game screen; inputting the current feature value into the reinforcement learning model, and receiving the preliminary correction value output by the reinforcement learning model ; Use the preparatory correction value to replace the long-term correction value to calculate the sleep time; after the sleep time of the drawing thread, calculate the average frame rate of the game screen, and obtain the target under the current feature value frame rate; compare the average frame rate and the target frame rate; if the average frame rate is greater than the target frame rate, input the first negative feedback data to the reinforcement learning model, and make the reinforcement learning model output The preparatory correction value of , moves in the direction of increasing until the average frame rate is equal to the target frame rate; if the average frame rate is less than the target frame rate, input a second negative value to the reinforcement learning model Feedback data to make the preliminary correction value output by the reinforcement learning model move in a direction of decreasing until the average frame rate is equal to the target frame rate; if the average frame rate is equal to the target frame rate, then The preliminary correction value is set as a long-term correction value.

A second aspect of the present application provides an electronic device, comprising: a memory, a processor, and a computer program stored on the memory and executable on the processor, when the processor executes the computer program, the above-mentioned any of the methods described in .

A third aspect of the present application provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements any one of the methods described above.

In the above-mentioned method for adjusting the picture frame rate of an electronic device of the present application, when the frame rate of the game picture needs to be reduced, the game drawing thread only needs to be put to sleep, and the sleep state of the game drawing thread is released after the sleep is over, so that the game drawing thread is released from the sleep state. The adjustment of the frame rate of the game screen by the thread sleeps for a period of time, thus slowing down the output interval of the game drawing thread from the buffer to the game screen, thereby reducing the frame rate of the game screen, so there is no need to use the screen refresh rate The display can be controlled at will The application of the screen to the electronic device can reduce the frequency of the game screen and reduce the development cost of the electronic device. By adjusting the sleep time, the time interval of the game drawing thread from the buffer to the game screen can be adjusted, so as to control the game screen at will. Therefore, manufacturers of electronic equipment can adjust the frame rate according to the performance, power consumption and temperature of the hardware, thus improving the flexibility and scalability of the game frame rate.

Description of drawings

In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the drawings that are used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained from these drawings without creative effort.

1 is a schematic flowchart of a method for adjusting a picture frame rate of an electronic device according to an embodiment of the present application;

Fig. 2 is the relation diagram of TimeDiff and sleep time of the picture frame rate adjustment method of the electronic device of the embodiment of the present application;

FIG. 3 is a schematic structural block diagram of an electronic device according to an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative efforts shall fall within the protection scope of this application. In the case of no conflict, the following various embodiments and their technical features can be combined with each other.

Please refer to FIG. 1 , a method for adjusting the frame rate of an electronic device proposed by the application includes: S1, identifying the drawing thread of the electronic device, obtaining the game drawing thread of the game running on the electronic device, and obtaining, for example, the game name, and the whitelist that comes with the game set by the game manufacturer. The whitelist contains at least the frame rates corresponding to different states of the electronic device; S2. Determine whether to change the game frame rate according to the whitelist and the current state of the electronic device; S3. If the game screen If the frame rate needs to be reduced, before or after loading the game screen drawn by the game drawing thread into the buffer, or when the drawing thread calls the drawing function library, calculate the sleep time and put the game drawing thread to sleep ; S4. After the sleep time ends, release the sleep state of the game drawing thread, so as to slow down the output time interval of the game screen and reduce the frame rate of the game screen.

In practical applications, the drawing thread responsible for issuing drawing commands will call the drawing function library of the operating system, so the drawing thread can be easily identified, so that when the drawing thread of the game or application calls the drawing function library, according to the process of the thread Identifier (Process Identity, PID) to identify whether the current drawing thread is the target of frame stabilization (that is, whether the game needs to be stabilized). If it belongs to the goal of stable frame, sleep the drawing thread for a period of time at the moment. As long as the sleep time is properly controlled, the game can slow down the time interval of outputting the picture, and the system computing unit will have more time to do calculations, so that It can operate at a lower frequency and ultimately achieve the goal of reducing power consumption.

Therefore, when it is necessary to reduce the frame rate of the game screen, it is only necessary to put the game drawing thread to sleep, and release the sleep state of the game drawing thread after the sleep is over, so as to adjust the progress of the game drawing thread to the frame rate of the game screen for a period of time. sleep, thus slowing down the time interval at which the game drawing thread outputs the game screen from the buffer, thereby reducing the frame rate of the game screen. Therefore, it is not necessary to use a display screen whose refresh rate can be freely controlled to be applied to an electronic device, which can reduce the frequency of the game screen and reduce the development cost of the electronic device. By adjusting the sleep time, the game drawing thread can be adjusted to put the game screen into the system. The time interval of the buffer, that is, slows down the time when the drawing thread puts the game screen into the buffer, thereby arbitrarily reducing the frame rate of the game screen, thus increasing the elasticity of the game frame rate.

In this embodiment, the frame rate of the game is reduced by means of indirect influence. The indirect influence refers to a module or thread that adopts a certain "synchronization mechanism" with the drawing thread of the game, and the synchronization mechanism makes the drawing thread of the game wait for the module or thread. After the execution is completed, the work of the next frame will continue, so it can indirectly affect the game frame rate. The modules or threads involved in the synchronization mechanism include: Inter-process communication (IPC) calls or core layer Hooks, etc.

The calculation of the sleep time includes: the time difference between obtaining the sleep end time of the previous frame of the game screen and executing the judgment on whether the game screen of the current frame needs to sleep; obtaining the expected frame rate of the frame rate of the game screen in the whitelist; using the expected frame rate to calculate The expected frame length is calculated; the sleep time is calculated according to the time difference and the expected frame length; the calculation formula of the sleep time is shown in the following formula 1:

SleepDuration=ExpectedPeriod-TimeDiff

Among them, SleepDuration represents the sleep time, ExpectedPeriod represents the expected frame length, and TimeDiff represents the time difference.

The calculation method of the expected frame length is: expected frame length=1/expected frame rate;

In this embodiment, if you want the game screen to be at 50FPS (that is, the frame length is 20ms), the TimeDiff is obtained according to the time from the previous sleep time to the current sleep judgment time. If the TimeDiff is 8ms, the sleep time obtained according to formula 1 is: 12ms, what needs to be understood is that the game drawing thread has been put to sleep since the last time; in order to wait for other threads of the game to complete the operation, the game thread may also go through a period of sleep time. Wake up and get a picture of how it should be drawn. This kind of sleep is controlled by the game itself, and the sleep time TimeDiff is required by this application and is used to calculate SleepDuration.

Please refer to Figure 2, which is a schematic diagram of the time difference TimeDiff equal to 8ms and the above-mentioned sleep time SleepDuration equal to 12ms. In Figure 2, the top is the drawing thread, or other threads that will indirectly affect the drawing thread, the middle part of the thread ( The part shown in SleepDuration) indicates that the thread is in a sleep state that is not performed by the game itself (the mobile phone is in a state after the sleep time SleepDuration added in this embodiment), and the duration is the sleep time. Enqueue in Figure 2 represents changing the game The content in Figure 2 shows that when you want the game to stabilize at 50FPS (frame length is 20ms), the time difference TimeDiff is 8ms, and the sleep time (the area shown by SleepDuration) is 12ms.

However, although the above embodiment makes the drawing thread sleep through the calculation of formula 1, the effect of stabilizing the frame can be achieved, and the frame rate can be reduced to the target value, but the frame rate jitter may still be unstable, because the " Therefore, in one embodiment, calculating the sleep time further includes: recording the interval of each frame of the game screen, and calculating the sleep correction item when calculating the sleep time of the current frame; according to the recorded interval of each frame of the game screen The sleep time is calculated by the time difference, the expected frame length and the sleep correction term; the calculation formula of the sleep time is shown in the following formula 2:

SleepDuration=ExpectedPeriod-TimeDiff+SleepCorrection

Among them, SleepDuration represents the sleep time, ExpectedPeriod represents the expected frame length, TimeDiff represents the time difference, and SleepCorrection represents the sleep correction item.

The interval time between each frame of the game screen of multi-threaded games may be different. The long and short frames are the result of one long frame and one short frame in the game. However, due to the complementarity of long and short frames, the overall situation may not cause frame drop. When only the data of the current frame is used to determine the sleep time, it will cause the short frame to sleep for too long, making it unable to complement the long frame. , which will eventually cause the frame rate to drop; in order to make the frame rate jitter more stable, a sleep correction item needs to be added to correct the sleep time.

In this implementation, calculating the sleep correction item includes: calculating the average frame length of all frames of the game screen; calculating the difference between the expected frame length and the average frame length, and using the difference as the sleep correction item; the formula for calculating the sleep correction item is as follows:

Among them, SleepCorrection represents the sleep correction item,

Represents ExpectedPeriod, EFPS is the expected frame rate preset by the game,

Represents the average frame length, N represents the size of the small window in the game screen of the current frame, and the size of the small window represents the number of frames included in the calculation at one time. F _i represents the frame length of the ith frame, and i is the ith frame in the current frame.

In other embodiments, calculating the sleep correction item includes: acquiring the size of the small window in the game screen; calculating the frame length of the game screen of the current frame; calculating sleep according to the expected frame length, the size of the small window and the frame length of the game screen of the current frame Correction term; the formula for calculating the sleep correction term is as follows:

where Q represents the sleep correction term,

In other embodiments, the calculation method of the sleep correction term can also be obtained by using a neural network, for example, using an artificial neural network (Artificial Neural Networks, ANN) or a convolutional neural network (Convolution Neural Networks, CNN) or a fully connected neural network ( Fully-Connected Neural Networks, FC). Input the frame length of the number of small windows into the neural network, and the neural network will output the correction term of sleep. The above network can be obtained through supervised learning, and its training data can be recorded by recording the frame length of each frame of the game and the above TimeDiff, and through artificial countermeasures. Push to get the time you need to sleep and sleep modifiers.

The sleep time calculated by formula 2 takes into account the correction of long frames and short frames, which greatly increases the stability of the frame rate of the game screen. However, since the calculation method centered on formula 2 can only correct the local frame rate (small window screen), and does not take into account the long-term frame rate trend of the system or the game, there is still room for improvement in the stability of the frame rate. In order to further improve the stability of the game frame rate, a long-term correction value and a short-term correction value are introduced.

Wherein, calculating the sleep time also includes: acquiring the size of the large window and the size of the small window in the game screen, the size of the large window represents the number of frames included in the calculation at one time, wherein the size of the large window is larger than the size of the small window Calculate the long-term correction value; obtain the short-term correction value according to the sleep correction item; use the time difference, expected frame length, long-term correction value and sleep correction item to calculate the sleep time; the calculation formula of the sleep time is as follows:

SleepDuration=ExpectedPeriod-TimeDiff+STC+LTC

Among them, SleepDuration represents the sleep time, ExpectedPeriod represents the expected frame length, TimeDiff represents the time difference, LTC represents the long-term correction value, STC represents the short-term correction value, and the short-term correction value is consistent with the sleep correction item.

Among them, calculating the long-term correction value includes: setting a gear interval, each integer in the gear interval is a gear, and each gear represents a time value; dividing the large window screen into different sub-areas; Match the gears for each sub-area according to the time of each sub-area; obtain the gears matched by each sub-area, and use the most matched gear as the long-term correction value.

In this embodiment, the long-term correction value is divided into several gears, for example, from -5 to +5, each integer is a gear, and a long enough time (large window screen) is counted at one end, such as half a Second or one second frame rate, and divide the large window into several sub-regions, each sub-region votes on the gear according to the internal situation, and finally uses the vote-drunk gear as the current long-term correction value, and each sub-region decides The method of voting for a certain gear can be obtained in the following ways: each sub-area can be rounded up with the result of the short-term correction value, and finally the corresponding gear corresponding to the result is matched and voted. For example, the current group area has a short-term correction value. +4.3ms is calculated, and after rounding, the sub-region matches the +4 gear and votes for the +4 gear.

The way each sub-area decides to cast a certain gear can also be obtained by the following methods: use machine learning or a neural network to classify the current sub-area, and each category corresponds to a certain gear.

Among them, calculating the long-term correction value also includes: using machine learning or neural network to divide each sub-region into different categories; matching different categories with different gears; taking the most matched gear as the long-term correction value.

The calculation of the long-term correction value includes: obtaining at least one current feature value of the electronic device that affects the frame rate of the game screen; inputting the current feature value into the reinforcement learning model, and receiving the preliminary correction value output by the reinforcement learning model; using the preliminary correction value instead of The long-term correction value calculates the sleep time; after the sleep time of the game drawing thread, the average frame rate of the game screen is calculated, and the target frame rate under the current feature value is obtained; the average frame rate and the target frame rate are compared; if the average frame rate is greater than the target frame rate frame rate, input the first negative feedback data to the reinforcement learning model, so that the preparatory correction value output by the reinforcement learning model moves in the direction of increasing until the average frame rate is equal to the target frame rate; if the average frame rate is less than the target frame rate, then Input the second negative feedback data to the reinforcement learning model, so that the preparatory correction value output by the reinforcement learning model moves to a smaller direction until the average frame rate is equal to the target frame rate; if the average frame rate is equal to the target frame rate, the preparatory correction value will be Set to long-term correction value.

In this embodiment, the current feature value may be the frame length (Frame Length), the execution time (Runtime), or TimeDiff, etc. It can be understood that as long as it is a feature value that can affect the frame rate of the game screen, it can be used as the present embodiment. The current eigenvalues in .

In this embodiment, the output of the enhancement model can be the gear corresponding to the long-term correction value, or it can be described as the modified value of the long-term correction value. Increase 2.3ms), -1.5ms (decrease 1.5ms for long-term correction value), etc.

The reinforcement learning model can be a Monte Carlo method, a tabular solution method, or an approximate solution method such as an artificial neural network (Artificial Neural Networks).

In the initial state of the reinforcement learning model, the long-term correction value is zero. In this embodiment, the calculation method of the short-term correction value is consistent with the algorithm of the sleep correction term. In other embodiments, the short-term correction value can also be obtained by using the reinforcement learning model. out, the reinforcement learning model directly outputs the short-term correction value.

In other embodiments, the long-term corrections and short-term corrections may be replaced by a neural network-like network; for example, using CNN or FC to acquire local data and simulate the effects of short-term corrections. Use Recurrent Neural Network (RNN) such as Long-Short-Term-Memory (LSTM) to obtain and retain data on the long-term trend of game frame rates to simulate the effect of long-term correction values, where LSTM has Long-term memory mechanics are preserved, thus reflecting long-term trends in game load.

When using LSTM to replace the effect of the long-term correction value, input sequence data, that is, the frame length of each frame, but also input features such as Runtime, TimeDiff, etc. that may be used to judge the running smoothness of the game, and represent the data in another dimension.

When the time is T, the frame length of several frames is input into the CNN to obtain local data, and then the data is input into the LSTM, and the LSTM outputs the current total correction value.

When the time is T+1, the frame length of several frames is also input into the CNN to obtain local data, and then the data is input into the LSTM. During this process, the LSTM will selectively retain the previous memory and will represent The "state" of the memory is sent to the next frame, and the memory retains the long-term trend. In this way, the model can not only judge the trend of the sleep correction item under the long-term trend, but also have the function of corresponding short-term changes. During the implementation of , the long-term correction value and the short-term correction value can be calculated separately by LSTM.

An embodiment of the present application provides an electronic device, please refer to FIG. 2, the electronic device includes: a memory 601, a processor 602, and a computer program stored in the memory 601 and running on the processor 602, and the processor 602 executes the computer When the program is executed, the method for adjusting the picture frame rate of the electronic device described above is implemented.

Further, the electronic device further includes: at least one input device 603 and at least one output device 604 .

The above-mentioned memory 601 , processor 602 , input device 603 and output device 604 are connected through a bus 605 .

The input device 603 may specifically be a camera, a touch panel, a physical button, a mouse, or the like. The output device 604 may specifically be a display screen.

The memory 601 may be a high-speed random access memory (RAM, Random Access Memory) memory, or may be a non-volatile memory (non-volatile memory), such as a disk memory. Memory 601 is used to store a set of executable program codes, and processor 602 is coupled to memory 601 .

Further, an embodiment of the present application further provides a computer-readable storage medium, which may be provided in the electronic device in each of the foregoing embodiments, and the computer-readable storage medium may be the foregoing memory 601. A computer program is stored on the computer-readable storage medium, and when the program is executed by the processor 602, the method for adjusting the picture frame rate of the electronic device described in the foregoing embodiments is implemented.

Further, the computer-storable medium may also be a U disk, a removable hard disk, a read-only memory 601 (ROM, Read-Only Memory), a RAM, a magnetic disk or an optical disk and other mediums that can store program codes.

While the application has been shown and described with respect to one or more implementations, equivalent variations and modifications will occur to those skilled in the art based on a reading and understanding of this specification and the accompanying drawings. This application includes all such modifications and variations and is limited only by the scope of the appended claims. In particular with respect to the various functions performed by the above-described components, the terms used to describe such components are intended to correspond to any component that performs the specified function of the component (eg, which is functionally equivalent) (eg, which is functionally equivalent) (unless otherwise indicated) , even if it is not structurally equivalent to the disclosed structure that performs the functions of the exemplary implementations of the specification shown herein.

That is, the above descriptions are only the embodiments of the present application, which are not intended to limit the scope of the patent of the present application. Any equivalent structure or equivalent process transformation made by using the contents of the description and drawings of the present application, such as the technical features between the embodiments Combining with each other, or directly or indirectly used in other related technical fields, are also included in the scope of patent protection of this application.

In addition, in the several embodiments provided in this application, it should be understood that, for the convenience of description, the foregoing method embodiments are all expressed as a series of action combinations, but those skilled in the art should know that, The application is not limited by the order of actions described, as certain steps may be performed in other orders or concurrently in accordance with the application. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily all necessary for the present application.

In the above-mentioned embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

In this application, the word "exemplary" is used to mean "serving as an example, illustration, or illustration." Any one embodiment described in this application as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments. The above description is presented in the present application to enable any person skilled in the art to make and use the present application. In the above description, various details are set forth for the purpose of explanation. It is to be understood that one of ordinary skill in the art can realize that the present application may be practiced without the use of these specific details. In other instances, well-known structures and procedures have not been described in detail so as not to obscure the description of the present application with unnecessary detail. Therefore, this application is not intended to be limited to the embodiments shown but is to be accorded the widest scope consistent with the principles and features disclosed herein.

The above is a description of a picture frame rate adjustment method of an electronic device, an electronic device, and a storage medium provided by the present application. For those skilled in the art, according to the ideas of the embodiments of the present application, the specific implementation and application scope are all There will be changes. In conclusion, the content of this specification should not be construed as a limitation on this application.

Claims

A picture frame rate adjustment method of an electronic device, comprising:

Identify the drawing thread of the electronic device to obtain the game drawing thread of the electronic device running the game;

Determine whether to change the game frame rate according to the whitelist and the current state of the electronic device. The whitelist contains at least the frame rates corresponding to different states of the electronic device; if the game screen needs to reduce the frame rate, the game drawing thread is drawn Before the good game picture is loaded into the buffer or after the buffer is loaded, or when the game drawing thread calls the drawing function library, the sleep time is calculated, and the game drawing thread is put to sleep;

After the sleep time expires, the sleep state of the game drawing thread is released, so as to slow down the output time interval of the game screen and reduce the frame rate of the game screen.
The method for adjusting the frame rate of an electronic device according to claim 1, wherein,

The calculating sleep time includes:

The time difference from obtaining the sleep end time of the previous frame of the game screen to executing the described judgment on whether the game screen of the current frame needs to sleep;

Get the expected frame rate of the frame rate of the game screen in the whitelist;

Calculate the expected frame length according to the expected frame rate;

calculating the sleep time according to the time difference and the expected frame length;

The calculation formula of the sleep time is as follows:

SleepDuration=ExpectedPeriod-TimeDiff

Wherein, SleepDuration represents the sleep time, ExpectedPeriod represents the expected frame length, and represents the time difference.
The method for adjusting the frame rate of an electronic device according to claim 2, wherein,

The calculating sleep time also includes:

Record the interval of each frame of the game screen, and calculate the sleep correction item when calculating the sleep time of the current frame;

Calculate the sleep time according to the recorded time difference between each frame of the game screen, the expected frame length and the sleep correction item;

The calculation formula of the sleep time is as follows:

SleepDuration=ExpectedPeriod-TimeDiff+SleepCorrection

Wherein, SleepDuration represents the sleep time, ExpectedPeriod represents the expected frame length, TimeDiff represents the time difference, and SleepCorrection represents the sleep correction item.
The method for adjusting the frame rate of an electronic device according to claim 3, wherein,

The calculating sleep correction term includes:

Calculate the average frame length of all frames of the game screen;

calculating the difference between the expected frame length and the average frame length, and using the difference as the sleep correction term;

The formula for calculating the sleep correction term is as follows:

Wherein, SleepCorrection represents the sleep correction item,
Represents ExpectedPeriod, EFPS is the expected frame rate preset by the game,
Represents the average frame length, N represents the size of the small window in the game screen of the current frame, and the size of the small window represents the number of frames included in the calculation at one time; F i represents the frame length of the i-th frame, and i is the current frame. ith frame.
The method for adjusting the frame rate of an electronic device according to claim 3, wherein,

The calculating sleep correction term includes:

Get the size of the small window in the game screen;

Calculate the frame length of the game screen of the current frame;

Calculate the sleep correction item according to the expected frame length, the size of the small window and the frame length of the game screen of the current frame;

The formula for calculating the sleep correction term is as follows:

where Q represents the sleep correction term,
Represents ExpectedPeriod, EFPS is the expected frame rate preset by the game, N represents the size of the small window in the game screen, and Fi represents the frame length of the i-th frame of the small window of the game screen.
The method for adjusting the frame rate of an electronic device according to claim 3, wherein,

The calculating sleep time also includes:

Obtain the size of the large window and the size of the small window in the game screen, the size of the large window represents the number of frames included in the calculation at one time, wherein the size of the large window is larger than the size of the small window;

Calculate long-term corrections;

obtaining a short-term correction value according to the sleep correction term;

calculating the sleep time using the time difference, the desired frame length, the long-term correction value, and the sleep correction term;

The calculation formula of the sleep time is as follows:

SleepDuration=ExpectedPeriod-TimeDiff+STC+LTC

Wherein, SleepDuration represents the sleep time, ExpectedPeriod represents the expected frame length, TimeDiff represents the time difference, LTC represents the long-term correction value, STC represents the short-term correction value, and the short-term correction value is consistent with the sleep correction item;

The calculated long-term correction value includes:

Setting a gear interval, each integer in the gear interval is a gear, and each of the gears represents a time value;

Divide the large window screen into different sub-areas;

matching the gear for each of the sub-regions according to the time of each of the sub-regions;

The gears matched by each of the sub-regions are acquired, and the most matched gears are used as long-term correction values.
The method for adjusting the frame rate of an electronic device according to claim 6, wherein,

The calculating long-term correction value also includes:

classifying each of said sub-regions into different categories using machine learning or neural networks;

matching different said categories with different said gears;

The gear that is matched the most is used as the long-term correction value.
The picture frame rate adjustment method of an electronic device according to claim 5, wherein,

The calculated long-term correction value includes:

Obtain at least one current feature value of the electronic device that affects the frame rate of the game screen;

Inputting the current feature value into the reinforcement learning model, and receiving the preliminary correction value output by the reinforcement learning model;

calculating the sleep time using the preliminary correction value in place of the long-term correction value;

After the sleep time of the game drawing thread, calculate the average frame rate of the game screen, and obtain the target frame rate under the current feature value;

comparing the average frame rate and the target frame rate;

If the average frame rate is greater than the target frame rate, input the first negative feedback data to the reinforcement learning model, so that the preliminary correction value output by the reinforcement learning model is moved in a direction of increasing until the The average frame rate is equal to the target frame rate;

If the average frame rate is lower than the target frame rate, input second negative feedback data to the reinforcement learning model, so that the preliminary correction value output by the reinforcement learning model is moved in a direction of decreasing until the The average frame rate is equal to the target frame rate;

If the average frame rate is equal to the target frame rate, the preliminary correction value is set as a long-term correction value.
An electronic device, comprising: a memory, a processor, and a computer program stored on the memory and executable on the processor, when the processor executes the computer program, the computer program of claims 1 to 8 is implemented any one of the methods.
A computer-readable storage medium on which a computer program is stored, when the computer program is executed by a processor, the method of any one of claims 1 to 8 is implemented.