CN117234319B

CN117234319B - Screen refresh rate setting method and electronic equipment

Info

Publication number: CN117234319B
Application number: CN202311506265.4A
Authority: CN
Inventors: 王小品; 赵中阳
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2023-11-13
Filing date: 2023-11-13
Publication date: 2024-04-09
Anticipated expiration: 2043-11-13
Also published as: CN117234319A

Abstract

The application provides a method for setting a screen refresh rate and electronic equipment, and relates to the technical field of display. The method can identify whether the equipment opens the barrage or not, and set different screen refresh rates when the barrage is opened or not so as to reduce the electricity consumption. The method comprises the following steps: setting a screen refresh rate to a first refresh rate during the process of displaying video by the electronic device; judging whether a bullet screen exists in the video picture according to the DWM frame rate and the first refresh rate of the desktop window manager; wherein the DWM frame rate is used for reflecting the frame rate generated by other pictures except the video picture; if the bullet screen exists in the video picture, setting the screen refresh rate as a second refresh rate; wherein the second refresh rate is less than the first refresh rate; if the bullet screen does not exist in the video picture, the screen refreshing rate is set to be a third refreshing rate, and the third refreshing rate is smaller than the second refreshing rate.

Description

Screen refresh rate setting method and electronic equipment

Technical Field

The application relates to the technical field of display, in particular to a method for setting a screen refresh rate and electronic equipment.

Background

The refresh rate is the number of times a screen is refreshed per second. With the development of display technology, electronic devices such as mobile phones, tablet computers, personal computers (personal computer, PC) and the like can switch refresh rates to adapt to requirements in different scenes. For example, most video applications currently support a barrage function, and a user can control the barrage function to be turned on or off during the process of playing a video by an electronic device, and the requirement for a refresh rate is high when the barrage is turned on.

However, in the video playing scene of the electronic device, no matter whether the bullet screen is opened or not, the electronic device always displays the picture with a fixed and higher refresh rate, which results in the situation that the actual refresh rate is higher than the required refresh rate in the process of playing the video by the electronic device, and waste of resources and electric quantity is caused.

Disclosure of Invention

The embodiment of the application provides a method for setting a screen refresh rate and electronic equipment, which are used for reducing power consumption when the electronic equipment plays videos and opens a barrage and reducing electric quantity consumption.

In order to achieve the above purpose, the embodiments of the present application adopt the following technical solutions:

in a first aspect, the present application provides a method for setting a screen refresh rate, which is applied to an electronic device, and the method includes: receiving an operation of playing a video by a user, wherein the frame rate of the video is a first frame rate; setting a screen refresh rate to a preset first refresh rate in the process of displaying the video by the electronic equipment, wherein the first refresh rate is larger than a first frame rate; judging whether a bullet screen exists in the video picture according to the DWM frame rate and the first refresh rate of the desktop window manager; wherein the DWM frame rate is used for reflecting the frame rate generated by other pictures except the video picture; if the bullet screen exists in the video picture, setting the screen refresh rate as a second refresh rate; wherein the second refresh rate is greater than the first frame rate and less than the first refresh rate; if the bullet screen does not exist in the video picture, the screen refreshing rate is set to be a third refreshing rate, and the third refreshing rate is smaller than the second refreshing rate and larger than or equal to the first frame rate.

It can be understood that, this application can judge whether there is the barrage in the video picture according to DWM frame rate and first refresh rate, then set up different screen refresh rates when there is/not the barrage in the video picture to satisfy the refresh rate demand under the different scenes, can avoid setting up the extravagant problem of electric quantity that fixed, higher refresh rate lead to when the flow shows the picture like this, extension electronic equipment's continuation of journey.

In a possible implementation manner provided in the first aspect, determining whether a bullet screen exists in a video frame according to a DWM frame rate and a first refresh rate of a desktop window manager includes: if the difference value between the first refresh rate and the DWM frame rate is smaller than or equal to a first threshold value, determining that a bullet screen exists in the video picture; if the difference between the first refresh rate and the DWM frame rate is greater than a first threshold, determining that a bullet screen does not exist in the video picture.

It will be appreciated that if the difference between the first refresh rate and the DWM frame rate is less than or equal to the first threshold, it is indicated that the DWM frame rate follows the screen refresh rate, thereby determining that a bullet screen is present in the video frame.

In a possible implementation manner provided in the first aspect, in a case where the electronic device receives an operation of opening the bullet screen by a user, a difference between the first refresh rate and the DWM frame rate is less than or equal to a first threshold; in the event that the electronic device receives a user operation to change a screen displayed on the desktop, the difference between the first refresh rate and the DWM frame rate is greater than a first threshold.

In a possible implementation manner provided in the first aspect, determining whether a bullet screen exists in a video frame according to a DWM frame rate and a first refresh rate of a desktop window manager includes: if the duration time length of the difference value between the first refresh rate and the DWM frame rate is smaller than or equal to the first threshold value is larger than or equal to the first time length, determining that a bullet screen exists in the video picture; if the duration of the difference between the first refresh rate and the DWM frame rate is less than or equal to the first threshold is less than the first duration, determining that a bullet screen does not exist in the video picture. By the method, misjudgment can be reduced, and accuracy of judgment results of whether the bullet screen exists in the video picture is improved.

In a possible implementation manner provided in the first aspect, in a case where the electronic device receives an operation of opening the bullet screen by a user, a duration time period of a difference between the first refresh rate and the DWM frame rate is less than or equal to a first threshold value is greater than or equal to a first duration time period; in the event that the electronic device receives a user operation to change a screen displayed on the desktop, a duration in which a difference between the first refresh rate and the DWM frame rate is less than or equal to a first threshold is less than a first duration.

In a possible implementation manner provided in the first aspect, the method further includes: acquiring a DWM frame rate; setting the screen refresh rate to a preset first refresh rate, comprising: setting the screen refresh rate to the first refresh rate in the case where the difference between the fourth refresh rate and the DWM frame rate is less than or equal to the first threshold; the fourth refresh rate is the current screen refresh rate, and the fourth refresh rate is smaller than the first refresh rate.

That is, in the case where the difference between the fourth refresh rate and the DWM frame rate is less than or equal to the first threshold, it may be considered that the electronic apparatus has a high possibility of opening a pop (or that a pop exists in a video picture), and then the screen refresh rate is set to the first refresh rate, and whether or not a pop exists in the video picture is determined by determining whether or not the DWM frame rate follows the screen refresh rate. Therefore, the accuracy of the judging result can be improved through multiple judgments, and resource waste caused by setting the screen refresh rate to the first refresh rate under the unnecessary condition (the difference between the fourth refresh rate and the DWM frame rate is larger than the first threshold value) of the electronic equipment can be avoided.

In a possible implementation manner provided in the first aspect, the method further includes: acquiring a plurality of video frame rates; each video frame rate is used for reflecting the frame rate of the video in a preset time period; if the change rate of the video frame rates is less than or equal to the frame rate threshold, determining that the electronic device is in the process of displaying the video. It can be appreciated that if the rate of change of the plurality of video frame rates is less than or equal to the frame rate threshold, the video frame rate tends to be stable, and the video correlation process can be considered to be outputting the frame rate stably, so as to determine that the electronic device is displaying the video.

In one possible implementation manner provided by the first aspect, the first refresh rate is greater than or equal to 100Hz.

It will be appreciated that either the user opening a bullet screen while the electronic device is playing video or the user changing the screen displayed on the desktop may cause the DWM frame rate to increase. However, due to physiological restrictions of the human body, it is difficult for the user to increase the DWM frame rate to 100Hz or more by changing the operation of the screen displayed on the desktop, and therefore by setting the first refresh rate to a value of 100Hz or more, it is possible to distinguish whether the DWM frame rate is due to the opening of the bullet screen or the user changes the operation of the screen displayed on the desktop.

In a possible implementation manner provided in the first aspect, the second refresh rate is a maximum value of a first frame rate and a barrage minimum frame rate, the barrage minimum frame rate is a minimum frame rate required for the barrage not to be blocked, and the third refresh rate is the first frame rate.

Therefore, the electronic equipment can set the screen refreshing rate to be the minimum value required by enabling the pictures to be displayed smoothly when the bullet screen is opened or not opened, and the effect of saving electric quantity is achieved.

In a possible implementation manner provided in the first aspect, the electronic device has turned on a dynamic refresh rate function, and the extended display identification data of the electronic device includes a first-gear refresh rate. Therefore, the phenomenon of black screen when the electronic equipment switches the screen refresh rate can be avoided.

In a possible implementation manner provided in the first aspect, the electronic device includes a video management service and an event tracking module, and the method further includes: the event tracking module sends tracking data to the video management service; the video management service obtains the DWM frame rate according to the tracking data; judging whether a bullet screen exists in a video picture according to the DWM frame rate and the first refresh rate of the desktop window manager, wherein the method comprises the following steps: the video management service judges whether the difference value between the first refresh rate and the DWM frame rate is smaller than or equal to a first threshold value; if the difference value between the first refresh rate and the DWM frame rate is smaller than or equal to a first threshold value, the video management service determines that a barrage exists in the video picture; if the difference between the first refresh rate and the DWM frame rate is greater than a first threshold, the video management service determines that a bullet screen does not exist in the video frame.

In a possible implementation manner provided in the first aspect, the electronic device further includes a display control module; setting the screen refresh rate to a preset first refresh rate, comprising: the video management service sends a first setting instruction to the display control module, wherein the first setting instruction carries a first refresh rate; the display control module sets the screen refresh rate to a first refresh rate; setting the screen refresh rate to a second refresh rate, comprising: the video management service sends a second setting instruction to the display control module, wherein the second setting instruction carries a second refresh rate; the display control module sets the screen refresh rate to a second refresh rate; setting the screen refresh rate to a third refresh rate, comprising: the video management service sends a third setting instruction to the display control module, wherein the third setting instruction carries a third refresh rate; the display control module sets the screen refresh rate to a third refresh rate.

In a possible implementation manner provided in the first aspect, before the video management service sends the first setting instruction to the display control module, the method further includes: the video management service judges whether the difference value between the fourth refresh rate and the DWM frame rate is smaller than or equal to a first threshold value, wherein the fourth refresh rate is the current screen refresh rate, and the fourth refresh rate is smaller than the first refresh rate; the video management service sends a first setting instruction to the display control module, and the method comprises the following steps: in the case that the difference between the fourth refresh rate and the DWM frame rate is less than or equal to the first threshold, the video management service sends a first setting instruction to the display control module.

In a possible implementation manner provided in the first aspect, the method further includes: the video management service obtains a plurality of video frame rates according to the tracking data; before the video management service determines whether the difference between the fourth refresh rate and the DWM frame rate is less than or equal to the first threshold, the method further comprises: if the change rate of the video frame rates is smaller than or equal to the frame rate threshold, judging whether the difference value between the fourth refresh rate and the DWM frame rate is smaller than or equal to the first threshold.

In a second aspect, the present application provides an electronic device, including: a memory and one or more processors; wherein the memory is for storing computer program code, the computer program code comprising computer instructions; the computer instructions, when executed by a processor, cause an electronic device to perform a method as in the first aspect and any implementation thereof.

In a third aspect, the present application provides a computer-readable storage medium comprising computer instructions; when executed on an electronic device, the computer instructions cause the electronic device to perform a method as in the first aspect and any implementation thereof.

It will be appreciated that the above-mentioned advantages achieved by the electronic device according to the second aspect and the computer-readable storage medium according to the third aspect may refer to the advantages as in the first aspect and any possible implementation manners thereof, and are not described herein again.

Drawings

Fig. 1 is an interface schematic diagram of a PC according to an embodiment of the present application;

FIG. 2 is a schematic diagram of an interface of another PC according to an embodiment of the present application;

fig. 3 is a schematic hardware structure of an electronic device according to an embodiment of the present application;

fig. 4 is a schematic diagram of an electronic device according to an embodiment of the present application;

FIG. 5 is a schematic diagram of a workflow of an electronic device for setting a refresh rate;

FIG. 6 is a schematic diagram of the workflow of software and hardware for displaying video pictures for an electronic device;

fig. 7 is a flowchart of a method for setting a screen refresh rate according to an embodiment of the present application;

fig. 8 is a second flowchart of a method for setting a screen refresh rate according to an embodiment of the present application;

Fig. 9 is a flowchart of a method for setting a screen refresh rate according to an embodiment of the present application;

FIG. 10 is a graph showing the trend of the screen refresh rate, video frame rate, and DWM frame rate in a scene where an electronic device opens a bullet screen during video playback;

fig. 11 is a flowchart of a method for setting a screen refresh rate according to an embodiment of the present application;

FIG. 12 is a graph showing the trend of the screen refresh rate, video frame rate, and DWM frame rate in a scenario where the user slides the mouse wheel during the video playing process of the electronic device;

fig. 13 is a schematic diagram of an interface of another PC according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application are described below with reference to the drawings in the embodiments of the present application. In the description of the embodiments of the present application, the terminology used in the embodiments below is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification of this application and the appended claims, the singular forms "a," "an," "the," and "the" are intended to include, for example, "one or more" such forms of expression, unless the context clearly indicates to the contrary. It should also be understood that in the various embodiments herein below, "at least one", "one or more" means one or more than two (including two). The term "and/or" is used to describe an association relationship of associated objects, meaning that there may be three relationships; for example, a and/or B may represent: a alone, a and B together, and B alone, wherein A, B may be singular or plural. The character "/" generally indicates that the context-dependent object is an "or" relationship.

Reference in the specification to "one embodiment" or "some embodiments" or the like means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," and the like in the specification are not necessarily all referring to the same embodiment, but mean "one or more but not all embodiments" unless expressly specified otherwise. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless expressly specified otherwise. The term "coupled" includes both direct and indirect connections, unless stated otherwise. The terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated.

In the embodiments of the present application, words such as "exemplary" or "such as" are used to mean serving as examples, illustrations, or descriptions. Any embodiment or design described herein as "exemplary" or "for example" should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.

Currently, most video applications support a barrage function, and a user can control the barrage function to be turned on or off during the process of playing a video by an electronic device. However, in a video playing scenario of an electronic device, the electronic device cannot recognize whether a bullet screen exists, so in order for the electronic device to smoothly play a video including the bullet screen, the electronic device typically performs refresh display at a fixed high refresh rate, for example, at a fixed refresh rate of 60Hz, 90Hz, or 120Hz, when playing the video.

Taking an electronic device as an example of a PC, fig. 1 (a) shows an interface 101 of the PC. The interface 101 is an interface of a video application, and the interface 101 includes a plurality of playable videos, such as a video a, a video b, a video c, and the like. In response to a user operation on video a, as shown in (b) of fig. 1, the PC may display interface 102. The interface 102 is a playing interface of the video a, the interface 102 includes a barrage switch 102a, and the barrage switch 102a is in a closed state. At this point, the PC refreshes the screen at a fixed refresh rate, e.g., 60 Hz. If the user wishes to view the bullet screen, the bullet screen switch 102a may be clicked, and in response to the user clicking on the bullet screen switch 102a, as shown in fig. 2, the PC may display the interface 103. The interface 103 is similar to the interface 102, except that the barrage switch 102a in the interface 103 is in an on state, and the barrage 103a also rolls on the video frame in the interface 103, where the barrage 103a is, for example, "haha", "good smile", etc. At this point, the PC still refreshes the screen at 60 Hz.

However, in a video playing scene of an electronic device, a fixed refresh rate is difficult to meet the requirement for the refresh rate in the video playing process. For example, for the scene shown in fig. 2 in which video is played and the bullet screen is not opened, the requirement of smooth display of the picture can be met only by a lower refresh rate (for example, 24Hz and 30 Hz), and the adoption of the refresh rate of 60Hz can cause that the processor is overloaded and consumes higher power, resulting in higher power consumption of the electronic device. For another example, for the scene shown in fig. 2 in which video is played and the bullet screen is opened, since the bullet screen is still required to be dynamically displayed on the screen, the refresh rate requirement in the scene is higher than the refresh rate requirement in the scene shown in fig. 1 (b), and in this case, if the refresh rate requirement in the scene shown in fig. 2 is higher than 60Hz, the screen is blocked, which affects the user experience.

In summary, the fixed refresh rate is higher than the actual demand refresh rate in the video playing scene, which is easy to cause the situation of higher power consumption and does not meet the requirement of low power consumption of the PC; secondly, the refresh rate requirement in the video playing scene is dynamically changed, and the fixed refresh rate cannot be suitable for different refresh rate requirements in the video playing scene.

In view of this, the embodiments of the present application provide a method for setting a screen refresh rate, which can determine whether an electronic device plays a video by monitoring a video frame rate, determine whether to start a barrage in a video playing scene by monitoring whether a DWM frame rate follows the screen refresh rate, and set the refresh rate according to whether to start the barrage. If the bullet screen is not opened, displaying the picture at a first refresh rate; if the barrage is opened, the picture is displayed at a second refresh rate, which is greater than the first refresh rate. Therefore, not only can the overhigh load and overlarge power consumption caused by overhigh refresh rate be avoided, but also the picture blocking caused by overhigh refresh rate can be avoided.

It should be noted that, the method for setting the screen refresh rate provided by the embodiment of the present application may be applied to video playing scenes, net lesson scenes, network live broadcast scenes, video conference scenes, subtitle real-time recognition scenes, and the like. The above-mentioned electronic device playing video may be understood as that the electronic device plays online/local video, displays recorded or live net lessons, displays an ongoing video conference, or displays live pictures, etc. In these scenarios, the user may communicate with other users through the barrage. Particularly, in the subtitle real-time recognition scene, the electronic device can convert the voice in the video into characters and display the characters, and the characters converted from the voice in the case are the "barrage".

It should be further noted that, in the embodiment of the present application, when the barrage is opened in the video playing scene, it indicates that there is barrage scrolling in the video frame, and some situations where the barrage is opened, but no user sends the barrage or the system clears the barrage, resulting in no barrage in the video frame, are not considered in the present application.

The method for setting the screen refresh rate can be applied to electronic devices such as PCs, mobile phones, tablet computers, notebook computers, ultra-mobile personal computers (UMPC), handheld computers, netbooks, personal digital assistants (Personal Digital Assistant, PDA), wearable electronic devices, smart watches and the like, and preset applications are installed in the electronic devices. The preset application mentioned in the embodiment of the present application refers to an application that can play a video picture and support a barrage function, for example, a video application, a conference application, a live broadcast application, a learning application, and the like.

Fig. 3 shows a schematic diagram of a hardware structure of an electronic device. As shown in fig. 3, the electronic device 200 may include: processor 210, external memory interface 220, internal memory 221, universal serial bus (universal serial bus, USB) interface 230, charge management module 240, power management module 241, battery 242, wireless communication module 250, display 260, and the like.

It should be understood that the connection relationship between the modules illustrated in this embodiment is only illustrative, and does not limit the structure of the electronic device 200. In other embodiments, the electronic device 200 may also employ different interfaces in the above embodiments, or a combination of interfaces.

Processor 210 may include one or more processing units such as, for example: the processor 210 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

The controller may be a neural hub and command center of the electronic device 200. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 210 for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The memory may hold instructions or data that the processor 210 has just used or recycled. If the processor 210 needs to reuse the instruction or data, it may be called directly from the memory. Repeated accesses are avoided and the latency of the processor 210 is reduced, thereby improving the efficiency of the system.

In some embodiments, processor 210 may include one or more interfaces. The interfaces may include two-wire serial bus (inter-integrated circuit, I2C) interfaces, integrated circuit built-in audio (inter-integrated circuit sound, I2S) interfaces, pulse code modulation (pulse code modulation, PCM) interfaces, universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interfaces, mobile industry processor interfaces (mobile industry processor interface, MIPI), general-purpose input/output (GPIO) interfaces, and/or USB interfaces, among others.

The external memory interface 220 may be used to connect an external memory card, such as a Micro SD card, to enable expansion of the memory capabilities of the electronic device 200. The external memory card communicates with the processor 210 through an external memory interface 220 to implement data storage functions. For example, files such as music, video, etc. are stored in an external memory card.

Internal memory 221 may be used to store computer executable program code that includes instructions. The processor 210 executes various functional applications of the electronic device 200 and data processing by executing instructions stored in the internal memory 221. The internal memory 221 may include a storage program area and a storage data area.

The storage program area may store, among other things, an operating system, application programs required for at least one function (such as a video playing function, an audio playing function, etc.), and the like. The storage data area may store data (e.g., audio data, image frames, etc.) created during use of the electronic device 200, and so forth. In addition, the internal memory 221 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like.

The charge management module 240 is configured to receive a charge input from a charger. The charger can be a wireless charger or a wired charger. The charging management module 240 may also provide power to the electronic device through the power management module 241 while charging the battery 242.

The power management module 241 is used for connecting the battery 242, and the charge management module 240 and the processor 210. The power management module 241 receives input from the battery 242 and/or the charge management module 240 and provides power to the processor 210, the internal memory 221, the external memory, the display 260, the camera 293, the wireless communication module 250, and the like. In some embodiments, the power management module 241 and the charge management module 240 may also be provided in the same device.

The wireless communication module 250 may provide solutions for wireless communication including wireless local area network (wireless local area network, WLAN), bluetooth, global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), etc. applied to the electronic device 200.

The wireless communication module 250 may be one or more devices that integrate at least one communication processing module. The wireless communication module 250 receives electromagnetic waves via the antenna 2, frequency-modulates and filters the electromagnetic wave signals, and transmits the processed signals to the processor 210. The wireless communication module 250 may also receive a signal to be transmitted from the processor 210, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.

The electronic device 200 implements display functions through a GPU, a display screen 260, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display 260 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 210 may include one or more GPUs that execute program instructions to generate or change display information.

The display 260 is used to display images, videos, and the like. The display 260 includes a display panel.

It is to be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic apparatus 200. In other embodiments, the electronic device 200 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Fig. 4 is a schematic diagram of an electronic device according to an embodiment of the present application.

Referring to fig. 4, the electronic device includes physical hardware. The physical hardware may include any hardware device, such as one or more general purpose processors, memory, or any one or more of the hardware shown in fig. 3. As shown in fig. 4, the physical hardware layer provided in the embodiment of the present application includes a GPU, a memory, and a display screen, and it should be noted that one or more GPUs may be provided. The GPU may perform image rendering, video acceleration, and the like.

The memory comprises a front cache and a rear cache. The back buffer is used for storing the picture which is newly rendered by the display card, and the front buffer is used for transmitting the picture to the display screen. When the graphics card finishes rendering a frame and stores the frame in the rear buffer, the rear buffer is changed into the front buffer, and the process is called frame transfer. Accordingly, the front cache is changed to a new back cache.

The display screen includes an embedded display port (embedded display port, eDP) signal receiving module, a timing control module, a remote frame buffer (remote frame buffer, RFB) module, an RFB control module, and a liquid crystal display (liquid crystal display, LCD) module (not shown).

In addition, an operating system is run on the hardware device. Such as WINDOWS ™ operating system, android ™ operating system, IOS ™ operating system, and the like. An operating application may be installed on the operating system.

The layered architecture divides the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the WINDOWS ™ operating system may be divided into a user state and a kernel state, where the user state includes an application layer and a service layer, and the kernel state includes an Operating System (OS) layer.

As shown in fig. 4, the application layer includes video, live, conference, learning, etc. applications. It should be noted that only a part of the application programs are shown in the figure, and the application layer may further include more application programs.

The service layer includes a PC manager video service (also referred to as a video management service), an application programming interface runtime (application programming interface runtime, API run) in a graphics runtime, a User Mode Driver (UMD), a dynamic link library, a desktop window manager (desktop window manager, DWM), and the like.

Wherein the PC manager video service may register listening with the OS layer to monitor the frame rate of the video process (abbreviated as video frame rate) and the frame rate of the DWM process (abbreviated as DWM frame rate). And, the PC manager video service is also used for judging whether the electronic device is in a video playing scene (i.e. whether the video is being played), whether to start a barrage under the video playing scene, and the like.

The graphics runtime may provide an API that enables an application (e.g., a video application) to request execution of GPU functions of a supported rendering framework. In an alternative design, the graphics runtime may be implemented by DirectX.

In the user mode, the graphic runtime can provide an API for an application of the application layer through an API run so that the application can perform resource creation, state setting, drawing call and the like. In an alternative design, the API run may be implemented by Direct3D (D3D) run of Direct X.

The UMD is operable to receive graphics instructions, construct a hardware context and a command buffer in response to the graphics instructions, and pass the command buffer to a user mode driver (kernel mode driver, KMD) of the OS layer for further processing. Specifically, UMD can convert graphics commands issued by API runtimes into hardware-specific commands (i.e., GPU-specific commands). During the conversion process, the UMD may reserve the appropriate hardware context for the GPU.

The dynamic link library may provide system call entry and internal function support for the application. In the embodiment of the application, the dynamic link library includes GDI32.dll, GDI32.dll for providing functions implementing graphics device interfaces (graphics device interface, GDI), responsible for information exchange between the system and drawing programs, and handling the graphics output of all Windows programs.

DWM can render images of different windows into a frame of image. In the embodiment of the application, the DWM may render the video frame and the bullet screen into a frame of frame, so as to realize the effect of scrolling the bullet screen on the video frame. Thus, the DWM frame rate can reflect the bullet screen frame rate to some extent.

As shown in fig. 4, the OS layer includes an event tracking (event tracing for windows, etc) module, a graphics scheduler in a graphics runtime, KMD, and a display control module, etc.

The ETW module can monitor whether the process calls the rendering function, and feed back the time of calling the rendering function and the object for calling the rendering function to the PC manager video service process.

The graphics scheduler may queue management of rendering instructions. In an alternative design, the graphics scheduler may be implemented by the DirectX graphics kernel (DirectX graphics kernel, dxgkrnl).

The KMD can check the instruction stream transmitted by the graphics scheduler to avoid illegal instructions. KMD can also be used to implement physical memory allocation and mapping, set display modes of the display screen, transmit data, instructions, etc. to the GPU. It should be noted that, multiple UMDs may exist in one operating system at the same time, but only one KMD may exist.

The display control module can be used for setting different screen refresh rates for the display screen according to whether the barrage is started or not.

It should be noted that the above architecture is only illustrative, and in other embodiments, the solution of the present application can be implemented as long as the functions implemented by the respective functional modules are similar to those of the embodiments of the present application.

FIG. 5 is a schematic diagram of a workflow of an electronic device to set a refresh rate.

Referring to fig. 5, a PC management video service of a service layer may register listening with an ETW module of an OS layer to determine whether a video process or a DWM process calls a rendering function, and the ETW module may transmit monitored data to the PC management video service. Then, the PC management video service can determine a video frame rate and a DWM frame rate according to the monitored data, and further judge whether to start the barrage according to the video frame rate, the DWM frame rate, and whether the DWM frame rate follows the screen refresh rate. The PC management video service can also interact with the display control module of the OS layer, sends a judging result of whether to start the barrage or not to the display control module, and the display control module can set the refresh rate according to the judging result.

Fig. 6 is a schematic diagram of the workflow of software and hardware for displaying video pictures for an electronic device.

Referring to fig. 6, a video application or DWM of an application layer may interact with an API runtimes of a service layer, which may interact with a UMD belonging to the service layer, so that the video application may transmit a rendering instruction to the UMD through the API runtimes, and the UMD may convert the rendering instruction transmitted by the application into a rendering command that can be recognized by hardware. The UMD may interact with a graphics scheduler of the OS layer to transmit rendering commands to the graphics scheduler. The graphics scheduler may interact with KMDs belonging to the OS layer to send rendering commands to the KMDs. The KMD may interact with the graphics card to send rendering commands to the graphics card. After receiving the rendering command, the display card can render the image to be processed and send the rendered image frame into the rear buffer, and at the moment, the rear buffer is changed into the front buffer.

In an alternative design, the graphics card may send the pixel stream and the drawing instruction to the display screen according to a preset refresh rate, and after the display screen receives the drawing instruction, the display screen draws and displays the rendered image frame, where the actual refresh rate of the electronic device (i.e. the refresh rate of the display screen, abbreviated as the screen refresh rate) is equal to the preset refresh rate.

In another alternative design, the front buffer may send already rendered image frames to the display screen for storage by a buffer of the display screen (e.g., an RFB buffer). The graphics card may then send a screen self-refresh (panel self refresh, PSR) signal to the display screen according to the rate at which the image frames are currently rendered. And after the display screen receives the PSR signal, drawing and displaying the image frames stored in the RFB cache. In this case, the actual refresh rate of the electronic device may not be consistent with the preset refresh rate.

The method for setting the screen refresh rate according to the embodiment of the present application will be described in detail below with reference to the accompanying drawings.

The embodiment of the application provides a method for setting a screen refresh rate, which can be applied to the electronic device 200 shown in fig. 3. Referring to fig. 7, a flowchart of a method for setting a screen refresh rate according to an embodiment of the present application is shown. As shown in fig. 7, the method includes:

The electronic device acquires the video frame rate and DWM frame rate S701.

In one possible design, the electronic device may monitor the time and number of times the video process and DWM process call the rendering function, and then derive the video frame rate and DWM frame rate based on the time and number. The video frame rate is the frame rate of the video process, and can be used for reflecting whether the video application is playing the video.

The DWM frame rate is the frame rate of the DWM process and can be used to reflect user behavior. Wherein, the DWM frame rate can be increased by the user opening the bullet screen or by the user changing the screen displayed on the desktop when the electronic device plays the video. The operation of changing the screen displayed on the desktop by the user includes the operation of the window on the desktop by the user, such as the operation of dragging the window by the user, the operation of sliding a mouse wheel by the user to change the window screen, and the like. However, due to physiological limitations, it is very difficult for the user to operate the window at a very fast speed (e.g., 120 times/second), so that the user's operation of the window has a limited effect on the DWM frame rate, and the DWM frame rate cannot be made to break through 100Hz. Thus, based on the characteristic that the user's operation on the window cannot break the DWM frame rate by 100Hz, the electronic device may exclude the user's operation on the window from interfering with the DMW frame rate. The DWM frame rate can be regarded as the frame rate of the bullet screen (simply referred to as bullet screen frame rate) in the case where the interference of the operation of the user on the window to the DMW frame rate has been eliminated.

It should be noted that, the electronic device may continuously acquire the video frame rate and the DWM frame rate, and the video frame rate and the DWM frame rate may be changed in real time according to the actual situation.

S702, the electronic device judges whether to play the video according to the video frame rate.

If the electronic device does not play the video, re-executing S702; if the electronic device is playing video, S703 is performed.

In an alternative embodiment, the video frame rate is considered to be stable during the playing of the video by the electronic device. Therefore, if the fluctuation of the video frame rate is monitored to be smaller, the electronic equipment is indicated to play the video; if the fluctuation of the video frame rate is large, the electronic equipment is indicated to not play the video.

It can be understood that, in the case where the electronic device does not play the video, the electronic device will not play the video and display the bullet screen even if the user opens the bullet screen, and in this case, the meaning of determining whether the electronic device opens the bullet screen is small, so S702 may be re-executed, or the flow may be ended. Under the condition that the electronic equipment plays the video, whether the electronic equipment opens the barrage can be further judged.

S703, the electronic device sets the screen refresh rate to a preset refresh rate 1.

Wherein the refresh rate 1 (which may also be referred to as a first refresh rate) is a value greater than or equal to 100Hz, such as 101Hz,110Hz,115Hz,120Hz, etc., without specific limitation herein.

The inventor researches that the barrage frame rate will follow the screen refresh rate, i.e. as the screen refresh rate increases or decreases, the barrage frame rate will increase or decrease to a corresponding or near value. For example, if the screen refresh rate is changed to 40Hz, then the bullet screen frame rate is changed to 40Hz, or 38Hz, 39Hz, etc. near 40 Hz.

In addition, as described above, since the DWM frame rate cannot be broken through by 100Hz based on the operation of the window by the user, the screen refresh rate is set to a value greater than or equal to 100Hz to exclude the interference of the operation of the user on the window to the DMW frame rate, and then it is determined whether the electronic device starts the bullet screen by determining whether the DWM frame rate follows the screen refresh rate (i.e., executing S704).

S704, the electronic device determines whether the difference between the refresh rate 1 and the DWM frame rate is less than or equal to a threshold.

If the difference between the refresh rate 1 and the DWM frame rate is less than or equal to the threshold, then S705 is performed; if the difference between the refresh rate 1 and the DWM frame rate is greater than the threshold, S706 is performed.

Wherein the difference between the refresh rate 1 and the DWM frame rate is the refresh rate 1 minus the DWM frame rate. If the difference between the refresh rate 1 and the DWM frame rate is less than or equal to the threshold, it indicates that the bullet screen frame rate is close to the screen refresh rate, so as to determine that the electronic device opens the bullet screen, and further execute S705; if the difference between the refresh rate 1 and the DWM frame rate is greater than the threshold, it indicates that the bullet screen frame rate differs greatly from the screen refresh rate, so as to determine that the electronic device does not open the bullet screen, and further execute S706.

S705, the electronic device sets the screen refresh rate to refresh rate 2.

Wherein the refresh rate 2 (which may also be referred to as a second refresh rate) is the maximum of the video frame rate and the preset minimum barrage frame rate.

It will be appreciated that in a scenario where the electronic device plays video and has a barrage opened, the screen refresh rate may be set to the maximum of the video frame rate and the preset minimum barrage frame rate (i.e., refresh rate 2). The refresh rate 2 is a minimum value required for enabling both the bullet screen and the video to be displayed smoothly, and the power consumption of the chip and the display screen can be reduced.

It should be noted that the preset minimum barrage frame rate is a minimum frame rate required to ensure that the barrage display does not jam, for example, 30hz,35hz,48hz, etc., and is not limited herein.

By way of example, if the video frame rate is 24Hz and the lowest barrage frame rate is 48Hz, the electronic device sets the screen refresh rate to 48Hz, which enables the electronic device to smoothly display both video and barrage with minimal power consumption.

S706, the electronic device sets the refresh rate to 3.

Wherein the refresh rate 3 (which may also be referred to as a third refresh rate) is the video frame rate.

That is, in a scene where the electronic device plays video and the bullet screen is not opened, the screen refresh rate may be set to the video frame rate. The refresh rate 2 is the minimum value capable of ensuring smooth display of video pictures, and capable of reducing the electric quantity consumption of the chip and the display screen.

The method for setting the screen refresh rate according to the embodiment of the present application will be further described with reference to the architecture diagram shown in fig. 4. Referring to fig. 8, a second flowchart of a method for setting a screen refresh rate according to an embodiment of the present application is shown. As shown in fig. 8, the method includes:

s801, the PC video management service transmits a request for registering event tracking to the ETW module.

In the embodiment of the application, the request for registering event trace (event trace) carries an event to be traced. The event to be tracked may include an event that all processes call a commit function. The submitting function refers to a function called when a process sends a frame of image which is already rendered by the display card to a display screen for display, and the submitting function is a present function for example.

It will be appreciated that any process when calling the commit function indicates that the process has a need to display a frame of image. And each time the process calls the submitting function, the display of one frame of image can be realized. In other words, each time a process invokes a commit function, it means a switch of image frames.

After receiving the request for registering event tracking, the ETW module can start tracking to acquire tracking data. The tracking data includes the time when the event to be tracked occurs and an object (hereinafter referred to as an initiating object) that initiates the event to be tracked. The initiating object may be understood as a process that invokes a rendering function, which may be identified by the name of the process.

In an alternative design, the ETW module can use StartTrace, enableTraceEx and ProcessTrace functions to track events.

S802, in response to a first operation of a user, the ETW module sends tracking data to the PC video management service.

The first operation includes any one of operations such as playing video, participating in a video conference, opening a barrage, closing the barrage, or sliding a mouse wheel on a window.

As can be appreciated, in the case where the first operation is that the user plays the video, the video application may call a rendering function to render the video frame; under the condition that the first operation is that the barrage is started, the DWM process calls a rendering function to render the barrage; in the case where the first operation is an operation to slide a mouse wheel over a window, the DWM process will invoke a rendering function to merge the user action with the window. Thus, the ETW module of the OS can monitor the events to be tracked, and thus send tracking data to the PC video management service.

It should be noted that, every time the ETW module of the OS monitors an event that a process calls a rendering function, trace data is sent to the PC video management service once. In addition, the ETW module can send tracking data to the PC video management service in a function callback mode.

In addition, the description of the tracking data is referred to S801, and is not described here.

S803, the PC video management service determines a video frame rate and a DWM frame rate from the tracking data.

The PC video management service can analyze the tracking data to determine an initiating object. The PC video management service may count the first times of the tracking data of the video process for all the initiating objects in the first time, count the second times of the tracking data of the DWM process for all the initiating objects in the first time, determine the video frame rate based on the first times and the first time, and determine the DWM frame rate based on the second times and the second time.

By way of example, the first time is 100ms, the first number is 2, the second number is 3, the video frame rate is 20Hz, and the DWM frame rate is 30Hz.

In an alternative design, the PC video management service may count the first number of times and the second number of times in the plurality of time periods, respectively, and obtain the video frame rate and the DWM frame rate according to the first number of times and the second number of times in the plurality of time periods. The video frame rate and the DWM frame rate obtained by the method are more accurate, and the risk of incorrect setting of the refresh rate of the equipment caused by inaccurate video frame rate and DWM frame rate can be reduced.

For example, the PC video management service may respectively count the first times 1 and the second times 3 for obtaining the tracking data of the video process and the DWM process of all the initiating objects within the 1 st 100ms, respectively count the first times 3 and the second times 4 for obtaining the tracking data of the video process and the DWM process of all the initiating objects within the 2 nd 100ms, respectively count the first times 2 and the second times 3 for obtaining the tracking data of the video process and the DWM process of all the initiating objects within the 3 rd 100 ms. Then, the PC video management service may take a first number of times within 100ms of an average value of 1, 3, and 2 (i.e., 2), take a second number of times within 100ms of an average value of 3, 4, and 4 (i.e., 3.7), and calculate a video frame rate of 20Hz and a dwm frame rate of 37Hz.

Considering that the PC video management service needs to screen out tracking data of which the initiating object is a video process and a DWM process from all tracking data when determining the video frame rate and the DWM frame rate, the method can bring larger calculation amount to the electronic equipment.

In one possible design, the event to be tracked may be an event of a video process or a DWM process invoking a rendering function. In this way, the ETW module of the OS may send trace data to the PC video management service only when it is monitored that the video process or the DWM process calls the rendering function, thereby reducing data that the PC video management service needs to filter when determining the video frame rate and the DWM frame rate, and improving the efficiency of the PC video management service in determining the video frame rate and the DWM frame rate.

It should be noted that the PC video management service may continuously determine the video frame rate and DWM frame rate from the tracking data. The ETW module can continuously send tracking data to the PC video management service as long as the video process or the DWM process continuously calls the rendering function, and the PC video management service can continuously obtain the video frame rate and the DWM frame rate so as to monitor the frame rates of the video process and the DWM process.

S804, the PC video management service determines whether the video frame rate is stable.

If the video frame rate is stable, S805 is executed; if the video frame rate is not stable, S803 is re-executed.

In one possible design, the PC video management service may continuously determine a plurality of video frame rates, then determine a rate of change based on the plurality of video frame rates, and if the rate of change is less than or equal to a frame rate threshold, then indicate that the video frame rate is stable; if the rate of change is greater than the frame rate threshold, then the video frame rate is indicated to be unstable.

In another possible design, the PC video management service may continuously determine a plurality of video frame rates, and calculate a variation between two adjacent video frame rates, and if the variation exceeds a preset number by less than or equal to a threshold, indicate that the video frame rates are stable; and if the preset number of variation amounts are not exceeded and are smaller than or equal to the threshold value, the video frame rate is not stable.

In other embodiments, whether the video frame rate is stable may be determined by other methods, so long as the trend of the video frame rate can be determined, and the method is not particularly limited.

It will be appreciated that it may be determined whether the electronic device is playing video by determining whether the video frame rate is stable. If the video frame rate is stable, it indicates that the electronic device is likely to play the video, and it may be further determined whether to start the bullet screen, so S805 may be executed; if the video frame rate is unstable, it indicates that the electronic device is likely to not play the video, and it may not need to further determine whether to start the bullet screen, in which case the PC video management service may continue to receive new tracking data, and monitor the video frame rate and DWM frame rate in real time.

S805, the PC video management service determines whether the DWM frame rate is greater than or equal to a threshold 1.

If the DWM frame rate is greater than or equal to threshold 1, then S806 is performed; if the DWM frame rate is less than threshold 1, then S812 is performed.

Wherein, the threshold value 1 is positively correlated with the screen refresh rate and is smaller than the current screen refresh rate. In an alternative design, threshold 1 is the difference between the screen refresh rate and a preset value (which may also be referred to as a first threshold). It should be noted that, the screen refresh rate described herein is a refresh rate actually used for refreshing a screen.

As already explained above, the bullet screen frame rate follows the screen refresh rate, i.e. as the screen refresh rate increases or decreases, the bullet screen frame rate increases or decreases to a corresponding value. For example, the screen refresh rate becomes 40Hz, and the bullet screen frame rate becomes 40Hz. As already described in connection with the foregoing, DWM frame rate may be used to reflect the barrage frame rate.

In addition, the user's operation on the window will also affect the DWM frame rate. For example, if the user opens window 1 and window 2 simultaneously in the electronic device, where window 1 is playing video and window 2 is a page of the browser, sliding the mouse wheel over window 2 by the user will also result in an increase in the DWM frame rate.

Thus, the sense of determining whether the DWM frame rate is greater than or equal to threshold 1 is to determine whether the barrage frame rate is approaching the screen refresh rate. If the DWM frame rate is greater than or equal to the threshold 1, it indicates that the bullet screen frame rate is close to the screen refresh rate, so that the electronic device has a higher possibility of opening the bullet screen, but it is not excluded that the user operates other windows, so that S806 is executed to further determine whether to open the bullet screen; if the DWM frame rate is less than the threshold 1, it indicates that the bullet screen frame rate is greater than the screen refresh rate, so that the electronic device has a low probability of opening the bullet screen, and the operation when the electronic device does not open the bullet screen may be directly performed, for example, S812 is performed.

In one possible design, the PC video management service may determine whether the difference between the screen refresh rate and the DWM frame rate (screen refresh rate minus DWM frame rate) is less than or equal to the preset value described above, and if the difference between the screen refresh rate and the DWM frame rate is less than or equal to the preset value, then indicate that the DWM frame rate is close to the screen refresh rate; if the screen refresh rate and the DWM frame rate are greater than the preset value, the DWM frame rate is far different from the screen refresh rate.

S806, the PC video management service determines whether the screen refresh rate is lower than 120Hz.

If the screen refresh rate is lower than 120Hz, S807 is performed; if the screen refresh rate is not lower than 120Hz, S810 is performed.

Due to physiological constraints, it is difficult for a user to operate the window at a very fast speed (e.g., 120 times/second), so that the user's operation of the window has a limited effect on the DWM frame rate, and it is difficult to break the DWM frame rate by 100Hz. That is, at a screen refresh rate of 120Hz, it is difficult for the user to rely on his own operation to bring the DWM frame rate to or near 120Hz as well.

Therefore, in the case where the DWM frame rate is greater than or equal to the threshold value 1, if the screen refresh rate is not lower than 120Hz, it is indicated that the DWM frame rate is close to the screen refresh rate and the screen refresh rate is close to 120Hz, and it can be considered that the DWM frame rate is likely due to the opening of the bullet screen, that is, the electronic device is playing a video and has opened the bullet screen, and thus the operation when the electronic device opens the bullet screen can be performed, for example, S810 is performed.

In the case where the DWM frame rate is greater than or equal to the threshold 1 and the screen refresh rate is lower than 120Hz, it is indicated that the DWM frame rate is close to the screen refresh rate but it is not determined whether the electronic device is on the bullet screen, so S807 can be performed to further determine whether the electronic device is on the bullet screen.

S807, the PC video management service transmits a setting instruction 1 to the display control module.

Wherein the setting instruction 1 (which may also be referred to as a first setting instruction) is for instructing the OS to set the screen refresh rate to 120Hz.

S808, the display control module sets the screen refresh rate to 120Hz.

S809, the PC video management service determines whether the DWM frame rate is greater than or equal to the threshold 2.

If the DWM frame rate is greater than or equal to threshold 2, then S810 is performed; if the DWM frame rate is less than threshold 2, then S812 is performed.

In the embodiment of the present application, the threshold 2 is the difference between the current screen refresh rate (i.e., 120 Hz) and the preset value. Wherein threshold 2 is greater than threshold 1.

Wherein, S809 and S805 are the same in function, both are for judging whether the DWM frame rate follows the screen refresh rate. It will be appreciated that by determining whether the DWM frame rate is greater than or equal to threshold 2, it can be determined whether the difference between 120Hz and the DWM frame rate is less than a preset value, and thus whether the DWM frame rate follows the screen refresh rate. If the DWM frame rate is greater than or equal to the threshold 2, determining that the difference between 120Hz and the DWM frame rate is less than the preset value, and further determining that the DWM frame rate follows the screen refresh rate, indicating that the electronic device has opened the barrage, so S810 may be performed; if the DWM frame rate is less than the threshold 2, it is determined that the difference between the 120Hz and the DWM frame rate is greater than the preset value, and further it is determined that the DWM frame rate does not follow the screen refresh rate, which indicates that the electronic device does not open the barrage, so S812 may be executed.

In an alternative design, to reduce misjudgment, the PC video management service may perform S810 in a case where it is determined to maintain the duration of DWM frame rate greater than or equal to threshold 2 greater than or equal to the first duration; otherwise, S812 is performed. Therefore, the method can avoid the interference of the DWM frame rate caused by triggering the DWM process to call the rendering function when a user operates other applications.

S810, the PC video management service transmits a setting instruction 2 to the display control module.

The setting instruction 2 (may also be referred to as a second setting instruction) carries a refresh rate 2, where the refresh rate 2 is the maximum value of the video frame rate and the preset minimum barrage frame rate.

S811, the display control module sets the screen refresh rate to refresh rate 2.

In one possible design, the display control module may call a ChangeDisplaySettings or changedisplaysettingex function to set the refresh rate.

S812, the PC video management service transmits a setting instruction 3 to the display control module.

The setting instruction 3 (may also be referred to as a third setting instruction) carries a refresh rate 3, where the refresh rate 3 is a video frame rate.

S813, the display control module sets the screen refresh rate to refresh rate 3.

It can be seen that, by the setting method of the screen refresh rate provided by the embodiment of the application, whether the barrage is opened or not can be accurately identified, and the screen refresh rate is set to be the minimum value required by enabling the pictures to be displayed smoothly when the barrage is opened or not, so that the effect of saving electric quantity is achieved.

In the related art, the method of switching the screen refresh rate mainly includes two methods, the first is to change the pixel clock and the second is to change the vertical blanking (VBlank). Wherein VBlank refers to a blank time between vertical synchronization signals.

For the first method, once the pixel clock is changed, the graphics card sends a relink signal to the display screen, and the display screen is restarted after receiving the relink signal, thereby causing the display screen to be black.

For the second method, the extended display identification data (extended display identification data, EDID) of the display screen has recorded therein a multi-level refresh rate supported by the display screen and monitor range limits (monitor range limit, MRL), the refresh rates of different levels corresponding to different display parameters including VBlank, pixel clock, etc. The display card can be switched between the multi-gear refresh rates by switching the display parameters. However, in this way, when the refresh rate is switched, even if the pixel clocks corresponding to the two refresh rates are the same, the display card will send a relink signal to the display screen due to the switching of the display parameters, thereby causing the display screen to be black.

That is, in the process of switching the refresh rate, the electronic device in the related art always has a condition of black screen, which results in poor user experience.

In the embodiment of the application, the EDID of the display screen is preconfigured to only include the first-file refresh rate, and the dynamic refresh rate (dynamic refresh rate, DRR) function of the electronic equipment is started in advance, so that the electronic equipment can seamlessly switch the screen refresh rate, and the screen is not blacked in the switching process, thereby improving the user experience. The DRR function may enable the electronic device to dynamically set a refresh rate, among other things.

In the VBlank mechanism, the refresh rate is divided into a desktop refresh rate and an active signal refresh rate. Wherein the desktop refresh rate corresponds to the refresh rate of the display screen, i.e., the screen refresh rate; the active signal refresh rate then corresponds to the reference refresh rate recorded by the EDID.

In a scenario where the DRR function is not turned on, switching the refresh rate changes the desktop refresh rate together with the active signal refresh rate, and the desktop refresh rate and the active signal refresh rate remain consistent, which in effect is switching according to the multi-level refresh rate recorded by EDID in the screen firmware, resulting in a display screen that is blacked out.

In the scene of starting the DRR function, the desktop refresh rate and the active signal refresh rate are not necessarily changed together when the refresh rate is switched, and the desktop refresh rate is always consistent with the refresh rate set by the OS, but the active signal refresh rate is taken from the reference refresh rate recorded in the EDID, and the desktop refresh rate is formed by calculating a proper VBlank based on the reference refresh rate.

In one possible design, the electronic device may turn on the DRR function in the registry by setting:

[HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\Class\{4d36e968-e325-11ce-bfc1-08002be10318}\0000]

"DisplayFeatureControl2"=dword:9

that is, for the OS, as long as the refresh rate of the active signal does not change, the display card does not change a whole set of display parameters, but calculates an appropriate VBlank based on the reference refresh rate and the refresh rate to be set, and switches the desktop refresh rate to the refresh rate to be set by changing only the VBlank, thereby realizing seamless switching of the refresh rate. It should be noted that, the refresh rate to be set described herein is the screen refresh rate described in the foregoing embodiment, and may also be understood as the desktop refresh rate described in the foregoing. However, it should be noted that the existence of the PSR mechanism may not be the same as the actual refresh rate of the display screen, but in this case the bullet frame rate still follows the screen refresh rate.

Thus, on this basis, the procedure described above with respect to the step of setting the screen refresh rate may be a procedure in which the electronic device calculates VBlank using the reference refresh rate and the screen refresh rate (e.g., refresh rate 1, refresh rate 2, refresh rate 3), and then sets the screen refresh rate to a corresponding value by changing VBlank.

Therefore, the method and the device can ensure that the refresh rate of the active signal is not changed in a mode of configuring the EDID to only comprise one reference refresh rate, thereby avoiding the phenomenon of black screen of the display screen. Alternatively, the EDID may be pre-burned by the manufacturer of the display screen.

Taking an electronic device as an example of a notebook computer, the EDID of the notebook computer originally records two-gear refresh rates of 120Hz and 60Hz, and the MRL is 48-120 Hz. And when the DRR function of the notebook computer is started, redundant 60Hz setting is deleted from the EDID, and only the 120Hz gear is reserved as the reference refresh rate. The OS may then calculate 5 refresh rate steps based on 120 Hz: 24Hz,30Hz,48Hz,75Hz,100Hz. Wherein, the MRL is 48-120 Hz, namely the display screen does not support 24Hz and 30Hz. Therefore, the notebook computer can seamlessly switch 5 grades of refresh rates, which are respectively: 48Hz,60Hz,75Hz,100Hz,120Hz.

Therefore, the DRR function is started in advance, so that the electronic equipment supports the function of dynamically setting the refresh rate based on the refresh rate of the active signal, and the refresh rate is switched; meanwhile, through the pre-configuration of the EDID of the display screen, the EDID of the display screen only comprises the first-gear refresh rate, so that the change of the refresh rate of the active signal is avoided, the phenomenon of the display screen blackout caused by switching the display parameters is avoided, and the user experience is improved.

The following describes, with reference to the accompanying drawings, a setting method of a screen refresh rate provided in the embodiments of the present application in a scenario where an electronic device opens a barrage in a video playing process. Referring to fig. 9, a flowchart of a method for setting a screen refresh rate according to an embodiment of the present application is shown. As shown in fig. 9, the method includes:

in S901, in response to an operation of playing a video by a user, the electronic device determines a video frame rate to be a frame rate F1, where a screen refresh rate is a refresh rate Fa.

S902, in response to the user opening the bullet screen, the electronic device determines the DWM frame rate to be the frame rate F2, and the second frame rate follows the refresh rate Fa.

S903, the electronic device sets the screen refresh rate to the refresh rate Fb.

S904, the electronic device determines the DWM frame rate to be the frame rate F3, and the frame rate F3 follows the refresh rate Fb.

S905, the electronic device determines whether the DWM frame rate follows the refresh rate Fb (yes in the determination result).

S906, the electronic device sets the screen refresh rate to a refresh rate Fc, which is the maximum value of the frame rate F1 and the preset lowest barrage frame rate.

Referring to fig. 10, a change trend chart of a screen refresh rate, a video frame rate, and a DWM frame rate in a scene where an electronic device opens a bullet screen in a video playing process is shown.

As shown in fig. 10, during time 0-t1, the electronic device does not play video, and the user does not perform any operation, the video frame rate is 0, the screen refresh rate is Fa, and the DWM frame rate is 0; at time t1, the electronic device plays video in response to a user operation, so the video frame rate changes from 0 to F1, and F1 is always maintained in the subsequent process; during time t 1-t 2, the user does not perform any operation, so the screen refresh rate continues to remain Fa and the DWM frame rate continues to remain at 0; at time t2, the electronic device opens the bullet screen in response to a user operation, the video frame rate and the screen refresh rate remain unchanged, and the DWM frame rate changes to F2 along with the screen refresh rate; during the time t 2-t 3, the DWM frame rate steadily follows the screen refresh rate; at time t3, the electronic device may determine that the DWM frame rate is stable and near the refresh rate Fa, setting the screen refresh rate to Fb; during the time t3 to t4, the video frame rate and the screen refresh rate remain unchanged, and the DWM frame rate changes to F3 (with some hysteresis) following the screen refresh rate; at time t4, the electronic device may determine that the DWM frame rate is stable and near the refresh rate Fb, setting the screen refresh rate to Fc; then, after time t4, the DWM frame rate becomes F4 following the screen refresh rate.

The following describes, with reference to the accompanying drawings, a method for setting a screen refresh rate in a scenario in which a user slides a mouse wheel during a video playing process of an electronic device. Referring to fig. 11, a flowchart of a method for setting a screen refresh rate according to an embodiment of the present application is shown. As shown in fig. 11, the method includes:

s1101, in response to the operation of playing the video by the user, the electronic device determines the video frame rate to be the frame rate F1, wherein the screen refresh rate is the refresh rate Fa.

S1102, in response to the user sliding the mouse wheel, the electronic device determines the DWM frame rate to be the frame rate F5, the frame rate F5 not following the refresh rate Fa.

S1103, the electronic device sets the screen refresh rate to the refresh rate Fb.

S1104 the electronic device determines the DWM frame rate to be frame rate F5, and the frame rate F5 does not follow the refresh rate Fb.

S1105, the electronic apparatus determines whether the DWM frame rate is close to the refresh rate Fb (no determination result).

S1106, the electronic device sets the screen refresh rate to a refresh rate Fd, which is the same as the frame rate F1.

Referring to fig. 12, a change trend chart of a screen refresh rate, a video frame rate and a DWM frame rate in a scene where a user slides a mouse wheel during playing a video is shown in the electronic device.

As shown in fig. 12, during the time 0-T1', the electronic device does not play video, and the user does not perform any operation, the video frame rate is 0, the screen refresh rate is Fa, and the DWM frame rate is 0; at time T1', the electronic device plays the video in response to the user operation, so the video frame rate changes from 0 to F1, and F1 is always maintained in the subsequent process; during the time T1 'to the time T2', the user does not perform any operation, so the screen refresh rate continues to remain Fa, and the DWM frame rate continues to remain 0; during the time T2 'to the time T3', the electronic device receives an operation of sliding the mouse wheel by the user, the DWM frame rate becomes F5 due to the operation, and the video frame rate and the screen refresh rate remain unchanged; at time T3', the DWM frame rate is changed back to 0 as the user stops sliding the mouse wheel; during the time T3 'to time T4', the video frame rate and the screen refresh rate remain unchanged; at time T4', the electronic device sets the screen refresh rate to Fb; during the time from the time T4 'to the time T5', the video frame rate and the screen refresh rate are kept unchanged, and the DWM frame rate is kept 0 continuously and is not changed along with the screen refresh rate; at time T5', the electronic device may determine that the DWM frame rate does not follow the screen refresh rate, setting the screen refresh rate to Fd, which is the same as F1.

It should be noted that, the above trend of the frame rate may be observed in real time through the ETW module, and the trend of the refresh rate may be observed from the display setting interface of the WINDOWS ™ operating system, or may be obtained by calling a related API.

Illustratively, referring to FIG. 13, an interface diagram is provided for the display of the WINDOWS ™ operating system. As shown in fig. 13, the setting interface includes display information and the like. The display information includes desktop resolution, active signal resolution, refresh frequency (actual refresh rate of the screen), bit depth, etc. For example, the display information indicates a desktop resolution of 1920×1080, an active signal resolution of 1920×1080, and a refresh frequency of 50.000Hz. In addition, a channel for setting the refresh frequency is also provided in the setting interface, for example, a selection box 1301, through which the user can set the refresh frequency of the display screen.

It should also be noted that, due to the PSR mechanism, the refresh rate set by the system (i.e., the screen refresh rate described above) may be different from the actual refresh rate of the display screen. In this case, the STV signal or VSync signal on the display screen panel may be observed using an oscilloscope to obtain an accurate screen refresh rate.

In summary, according to the embodiment of the application, whether the bullet screen is started or not is accurately identified, and the screen refresh rate is set to be the lowest frame rate capable of ensuring smooth operation of the picture in the corresponding scene, so that the power consumption of the electronic equipment can be effectively reduced, and the endurance of the electronic equipment is improved.

Embodiments of the present application also provide a chip system including at least one processor and at least one interface circuit. The processors and interface circuits may be interconnected by wires. For example, the interface circuit may be used to receive signals from other devices (e.g., a memory of an electronic apparatus). For another example, the interface circuit may be used to send signals to other devices (e.g., processors). The interface circuit may, for example, read instructions stored in the memory and send the instructions to the processor. The instructions, when executed by a processor, may cause an electronic device to perform the various steps of the embodiments described above. Of course, the chip system may also include other discrete devices, which are not specifically limited in this embodiment of the present application.

The present embodiment also provides a computer-readable storage medium having stored therein computer instructions which, when executed on an electronic device, cause the electronic device to perform the functions or steps of the method embodiments described above.

The present embodiment also provides a computer program product which, when run on an electronic device, causes the electronic device to perform the functions or steps of the method embodiments described above.

In addition, embodiments of the present application also provide an apparatus, which may be specifically a chip, a component, or a module, and may include a processor and a memory connected to each other; the memory is configured to store computer-executable instructions, and when the apparatus is running, the processor may execute the computer-executable instructions stored in the memory, so that the chip performs the functions or steps executed by the electronic device in the foregoing method embodiment.

The electronic device, the computer readable storage medium, the computer program product or the chip provided in this embodiment are used to execute the corresponding method provided above, so that the beneficial effects thereof can be referred to the beneficial effects in the corresponding method provided above, and will not be described herein.

From the foregoing description of the embodiments, it will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of functional modules is illustrated, and in practical application, the above-described functional allocation may be implemented by different functional modules according to needs, i.e. the internal structure of the apparatus is divided into different functional modules to implement all or part of the functions described above.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the modules or units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another apparatus, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and the parts displayed as units may be one physical unit or a plurality of physical units, may be located in one place, or may be distributed in a plurality of different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated unit may be stored in a readable storage medium if implemented in the form of a software functional unit and sold or used as a stand-alone product. Based on such understanding, the technical solution of the embodiments of the present application may be essentially or a part contributing to the prior art or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium, including several instructions to cause a device (may be a single-chip microcomputer, a chip or the like) or a processor (processor) to perform all or part of the steps of the methods of the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

Finally, it should be noted that the above embodiments are merely for illustrating the technical solution of the present application and not for limiting, and although the present application has been described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that the technical solution of the present application may be modified or substituted without departing from the spirit and scope of the technical solution of the present application.

Claims

1. A method for setting a screen refresh rate, which is applied to an electronic device, the method comprising:

receiving an operation of playing a video by a user, wherein the frame rate of the video is a first frame rate;

setting a screen refresh rate to a preset first refresh rate in the process of displaying the video by the electronic equipment, wherein the first refresh rate is larger than the first frame rate;

if the difference value between the first refresh rate and the DWM frame rate of the desktop window manager is smaller than or equal to a first threshold value, setting the screen refresh rate to be a second refresh rate;

if the difference value between the first refresh rate and the DWM frame rate is greater than the first threshold value, setting the screen refresh rate to a third refresh rate;

wherein the DWM frame rate is used for reflecting the frame rate generated by other pictures except the video picture, the second refresh rate is larger than the first frame rate and smaller than the first refresh rate, and the third refresh rate is smaller than the second refresh rate and larger than or equal to the first frame rate.

2. The method of claim 1, wherein the step of determining the position of the substrate comprises,

under the condition that the electronic equipment receives the operation of opening the barrage by a user, the difference value between the first refresh rate and the DWM frame rate is smaller than or equal to a first threshold value;

In the case where the electronic device receives an operation of changing a screen displayed on a desktop by a user, a difference between the first refresh rate and the DWM frame rate is greater than the first threshold.

3. The method of claim 1, wherein setting the screen refresh rate to a second refresh rate if the difference between the first refresh rate and a desktop window manager DWM frame rate is less than or equal to a first threshold value comprises:

if the duration of the difference between the first refresh rate and the DWM frame rate is less than or equal to a first threshold value is greater than or equal to a first duration, setting the screen refresh rate to the second refresh rate;

if the difference between the first refresh rate and the DWM frame rate is greater than the first threshold, setting the screen refresh rate to a third refresh rate includes:

and if the duration that the difference value between the first refresh rate and the DWM frame rate is smaller than or equal to a first threshold value is smaller than the first duration, setting the screen refresh rate to be the third refresh rate.

4. The method of claim 3, wherein the step of,

under the condition that the electronic equipment receives the operation of opening the barrage by a user, the duration time length of the difference value of the first refresh rate and the DWM frame rate is smaller than or equal to a first threshold value is longer than or equal to a first duration time length;

And under the condition that the electronic equipment receives the operation of changing the desktop displayed picture by a user, the duration that the difference value between the first refresh rate and the DWM frame rate is smaller than or equal to a first threshold value is smaller than the first duration.

5. The method according to any one of claims 1-4, further comprising:

acquiring the DWM frame rate;

the setting the screen refresh rate to a preset first refresh rate includes:

setting the screen refresh rate to the first refresh rate if a difference between a fourth refresh rate and the DWM frame rate is less than or equal to a first threshold; the fourth refresh rate is the current screen refresh rate, and the fourth refresh rate is smaller than the first refresh rate.

6. The method according to any one of claims 1-4, further comprising:

acquiring a plurality of video frame rates; each video frame rate is used for reflecting the frame rate of the video in a preset time period;

and if the change rate of the video frame rates is smaller than or equal to a frame rate threshold, determining that the electronic equipment is in the process of displaying the video.

7. The method of any of claims 1-4, wherein the first refresh rate is greater than or equal to 100Hz.

8. The method of any of claims 1-4, wherein the second refresh rate is a maximum of the first frame rate and a barrage minimum frame rate, the barrage minimum frame rate being a minimum frame rate required to keep the barrage from jamming, and the third refresh rate being the first frame rate.

9. The method of any of claims 1-4, wherein the electronic device has turned on a dynamic refresh rate function and wherein the extended display identification data of the electronic device includes a first-gear refresh rate.

10. The method of any of claims 1-4, wherein the electronic device comprises a video management service and an event tracking module, the method further comprising:

the event tracking module sends tracking data to the video management service;

the video management service obtains the DWM frame rate according to the tracking data;

the judging whether the bullet screen exists in the video picture according to the DWM frame rate of the desktop window manager and the first refresh rate comprises the following steps:

the video management service judges whether the difference value between the first refresh rate and the DWM frame rate is smaller than or equal to a first threshold value;

If the difference between the first refresh rate and the DWM frame rate is less than or equal to a first threshold, the video management service determines that a bullet screen exists in the video picture;

if the difference between the first refresh rate and the DWM frame rate is greater than the first threshold, the video management service determines that a bullet screen does not exist in the video frame.

11. The method of claim 10, wherein the electronic device further comprises a display control module;

the setting the screen refresh rate to a preset first refresh rate includes:

the video management service sends a first setting instruction to the display control module, wherein the first setting instruction carries the first refresh rate;

the display control module sets the screen refresh rate to the first refresh rate;

the setting the screen refresh rate to a second refresh rate includes:

the video management service sends a second setting instruction to the display control module, wherein the second setting instruction carries the second refresh rate;

the display control module sets the screen refresh rate to the second refresh rate;

the setting the screen refresh rate to a third refresh rate includes:

The video management service sends a third setting instruction to the display control module, wherein the third setting instruction carries the third refresh rate;

the display control module sets the screen refresh rate to the third refresh rate.

12. The method of claim 11, wherein before the video management service sends the first setup instruction to the display control module, the method further comprises:

the video management service judges whether the difference value between a fourth refresh rate and the DWM frame rate is smaller than or equal to a first threshold value, wherein the fourth refresh rate is the current screen refresh rate, and the fourth refresh rate is smaller than the first refresh rate;

the video management service sends a first setting instruction to the display control module, including:

and the video management service sends a first setting instruction to the display control module under the condition that the difference value between the fourth refresh rate and the DWM frame rate is smaller than or equal to a first threshold value.

13. The method according to claim 12, wherein the method further comprises:

the video management service obtains a plurality of video frame rates according to the tracking data;

before the video management service determines whether the difference between the fourth refresh rate and the DWM frame rate is less than or equal to the first threshold, the method further comprises:

And if the change rate of the video frame rates is smaller than or equal to a frame rate threshold, judging whether the difference value between the fourth refresh rate and the DWM frame rate is smaller than or equal to a first threshold.

14. An electronic device, the electronic device comprising: a memory and one or more processors;

wherein the memory is for storing computer program code, the computer program code comprising computer instructions; the computer instructions, when executed by the processor, cause the electronic device to perform the method of any of claims 1-13.

15. A computer-readable storage medium comprising computer instructions;

the computer instructions, when run on an electronic device, cause the electronic device to perform the method of any one of claims 1-13.