CN115499699A

CN115499699A - Screen projection method

Info

Publication number: CN115499699A
Application number: CN202110673972.7A
Authority: CN
Inventors: 段潇潇; 罗诚; 王金波; 李刚
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2021-06-17
Filing date: 2021-06-17
Publication date: 2022-12-20

Abstract

The application provides a screen projection method, which comprises the following steps: the electronic equipment and the display equipment are connected in a screen projection mode. The electronic equipment determines that the screen projection effect does not meet a preset condition, adjusts a first parameter of the electronic equipment to a first value according to a first-level adjustment strategy, and adjusts a second parameter of the electronic equipment to a second value; wherein the first value is greater than a first threshold value and the second value is greater than a second threshold value; after the electronic equipment adjusts the first parameter of the electronic equipment to a first value and adjusts the second parameter of the electronic equipment to a second value, the electronic equipment determines whether the screen projection effect does not meet a preset condition, the electronic equipment adjusts the first parameter of the electronic equipment to a third value according to a second-level adjustment strategy, and adjusts the second parameter of the electronic equipment to a fourth value; wherein the third value is less than the first threshold value and the fourth value is less than the second threshold value. Therefore, the electronic equipment realizes humanized parameter adjustment through a hierarchical adjustment strategy, and the influence on user experience is reduced.

Description

Screen projection method

Technical Field

The application relates to the technical field of screen projection, in particular to a screen projection method.

Background

With the development of network communication technology and the popularization of household intelligent equipment, the user experience is improved by utilizing the large-screen characteristic of the smart television and the portability of the smart phone and the tablet personal computer through the multi-screen cooperative work. The screen projection technology enables an electronic device such as a mobile phone or a tablet to project multimedia content on a local or network to a display device such as a Personal Computer (PC) or an intelligent screen having audio or video playing capability, and play the multimedia data on the display device.

However, due to the large difference of the conditions of the screen projection operation, for example, the network connection state such as wireless fidelity (Wi-Fi), the routing performance state of the router, the hardware configuration state of the electronic device, and the hardware configuration state of the display device, the screen projection content projected by the electronic device according to the fixed parameters is displayed on the display device with different effects, so that the poor display effects such as frame loss and display delay of the display device occur, and the user experience is affected to a certain extent.

Disclosure of Invention

The application provides a screen projection method, which has the advantages that on one hand, the electronic equipment or the display equipment can determine reasons influencing the screen projection effect, and the screen projection effect is improved by adopting a corresponding strategy; on the other hand, a screen projection effect grading adjustment strategy is adopted, factors influencing user experience are considered, and adjustment is carried out with the aim of reducing influence of the user.

In a first aspect, the present application provides a screen projection system, which includes an electronic device and a display device. The electronic equipment is used for establishing screen projection connection with the display equipment; the electronic equipment is also used for sending the first screen projection content to the display equipment through screen projection connection; the display device is used for displaying a screen projection interface based on the first screen projection content; the electronic equipment is also used for determining that the screen projection parameter meets a first condition, or when the electronic equipment determines that the screen projection effect does not meet a preset condition; adjusting a first parameter of the electronic equipment to a first value according to a first-level adjusting strategy, and adjusting a second parameter of the electronic equipment to a second value; wherein the first value is greater than a first threshold value and the second value is greater than a second threshold value; after the electronic equipment adjusts a first parameter of the electronic equipment to a first value and adjusts a second parameter of the electronic equipment to a second value, determining that the screen projection parameter meets a first condition; adjusting the first parameter of the electronic equipment to a third value and adjusting the second parameter of the electronic equipment to a fourth value according to a second-level adjusting strategy; wherein the third value is less than the first threshold value and the fourth value is less than the second threshold value.

The electronic equipment can adjust a first parameter of the electronic equipment to a first value according to the first-level adjusting strategy, and adjust a second parameter of the electronic equipment to a second value at the same time; the electronic device may also adjust a second parameter of the electronic device to a second value after adjusting the first parameter of the electronic device to the first value according to the first-level adjustment policy; the electronic device may also adjust the first parameter of the electronic device to the first value after adjusting the second parameter of the electronic device to the second value according to the first level adjustment policy. The order in which the electronic device adjusts the first parameter and the second parameter is not limited herein.

When the electronic equipment determines that the screen projection effect does not meet the preset condition, the first parameter of the electronic equipment is adjusted to a first value through a first-level adjusting strategy, and the second parameter of the electronic equipment is adjusted to a second value. And then, when the electronic equipment determines that the screen projection effect does not meet the preset condition, continuously adjusting the first parameter to a third value according to a second-stage adjustment strategy, and adjusting the second parameter to a fourth value. And the third value is less than the first threshold and the fourth value is less than the second threshold. Therefore, the electronic equipment adopts a strategy of hierarchical adjustment, and the adjustment range of the first parameter and the second parameter is not too large at one time but is slowly adjusted. And after the parameters are adjusted, when the electronic equipment determines that the screen projection effect is not good, adjusting the first parameters and the second parameters again. Therefore, humanized adjustment parameters are realized through a strategy of hierarchical adjustment, and adjustment is performed with the aim of reducing the influence of users.

In one possible implementation, the third value is greater than the third threshold value, and the fourth value is greater than the fourth threshold value. That is, the first parameter and the second parameter both have the lowest threshold, so that the problem that the adjustment range of the first parameter and the second parameter is too large to influence the user experience can be avoided.

Through the system of the first aspect, the electronic device or the display device can determine the reason for influencing the screen projection effect, adopt the corresponding strategy to improve the screen projection effect, adopt the screen projection effect hierarchical adjustment strategy, consider the factors influencing the user experience, and adjust the screen projection effect with the aim of reducing the influence of the user.

In a possible implementation manner, when the electronic device determines that the screen projection effect is not good and determines that the first load meets the second condition, the electronic device adjusts the first parameter of the electronic device to a first value according to the first-level adjustment strategy and adjusts the second parameter of the electronic device to a second value.

The first parameter and the second parameter are related to the first load information. Illustratively, when the first load is a utilization rate of hardware (such as a CPU or a GPU or a DDR or an encoder) in the electronic device, and the CPU and the GPU in the electronic device are greater than a preset utilization rate, the second parameter is an operating frequency of the CPU, and the third parameter is an operating frequency of the GPU. Illustratively, when the data transmission delay in the electronic device is greater than the preset delay, the second parameter is the screen projection code rate of the electronic device. Illustratively, when the image synthesis time on the electronic device side is greater than a preset time or the utilization rate of hardware in the electronic device is greater than a preset utilization rate, the second parameter is the sampling frame rate of the electronic device. Illustratively, when the image composition time of the display device is greater than a preset time or the utilization rate of hardware in the display device is greater than a preset utilization rate, the second parameter is the screen projection resolution of the electronic device. That is, the electronic device may adjust the first parameter or the second parameter only when the first load satisfies a certain condition, that is, the first load is too high. Therefore, the electronic equipment can determine the reason causing poor screen projection effect, and adopt corresponding measures to improve the screen projection effect.

With reference to the first aspect, in an optional implementation manner, when the electronic device determines that the screen projection effect is not good, the electronic device is further configured to send first information to the display device, where the first information is used to instruct the display device to adjust a third parameter of the display device; and the display device is further used for adjusting a third parameter of the display device after receiving the first information. Therefore, the electronic equipment can adjust the parameters of the electronic equipment side and the parameters of the display equipment, and multi-end adjustment is realized.

In a possible implementation manner, the display device may not receive the first information sent by the electronic device, and when monitoring that the screen projection effect does not meet the preset condition, the display device adjusts a third parameter of the display device. Therefore, the display equipment can monitor the screen projection effect of the display equipment side and adjust the third parameter in real time according to the screen projection effect.

In a possible implementation manner, the display device is further configured to adjust the third parameter to a fifth value after receiving the first information; wherein the fifth value is less than the third preset value. The problem that the user experience is influenced due to the fact that the adjusting range of the third parameter is too large can be avoided.

In a possible implementation manner, when the electronic device determines that the screen projection effect is not good and the electronic device determines that the second load meets a third condition, the electronic device is further configured to send first information to the display device, where the first information is used to instruct the display device to adjust a third parameter of the display device; and the display device is further used for adjusting a third parameter of the display device after receiving the first information.

The second load includes, but is not limited to, the usage rate of hardware (e.g., CPU or GPU or DDR or encoder) in the display device, or the image composition time in the display device. When the utilization rate of hardware in the display device is larger than the preset utilization rate or the image synthesis time in the display device is larger than the preset time, the electronic device sends first information to the display device. Therefore, the electronic equipment can determine the reason causing poor screen projection effect, and adopt corresponding measures to improve the screen projection effect.

With reference to the first aspect, in an optional implementation manner, the first parameter and the second parameter include any one of the following: the method comprises the following steps of (1) working frequency of a Central Processing Unit (CPU) of the electronic equipment, working frequency of a Graphics Processing Unit (GPU) of the electronic equipment, working frequency of a coder of the electronic equipment, working frequency of a double-rate synchronous dynamic random access memory (DDR) of the electronic equipment, screen projection code rate of the electronic equipment, sampling frame rate of the electronic equipment and screen projection resolution of the electronic equipment; the first parameter is different from the second parameter.

The third parameter includes any one of: the display device comprises a CPU working frequency in the display device, a GPU working frequency in the display device, a decoder working frequency in the display device, a DDR working frequency in the display device and a display frame rate of the display device.

In one possible implementation manner, the first parameter may be a screen projection rate of the electronic device, and the second parameter may be a sampling frame rate of the electronic device. When the electronic equipment determines that the screen projection effect is not good, the electronic equipment adjusts the screen projection code rate of the electronic equipment to a first code rate, and adjusts the display frame rate of the display equipment to a first frame rate, wherein the first code rate is greater than a first preset code rate, and the first frame rate is greater than a first preset frame rate. Then, when the electronic equipment determines that the screen projection effect is not good, the electronic equipment adjusts the screen projection code rate of the electronic equipment to a second code rate, and adjusts the display frame rate of the display equipment to a second frame rate; the second code rate is less than the first preset code rate, and the second frame rate is less than the first preset frame rate. Therefore, the electronic equipment cannot adjust the screen projection code rate or the screen projection frame rate too much at one time through a multi-stage adjustment strategy, monitors the screen projection effect in real time after one-stage adjustment, and reduces the screen projection code rate or the screen projection frame rate by one stage when the screen projection effect is not improved, so that humanized adjustment parameters are realized through a strategy of stage adjustment to reduce the influence of a user for adjustment.

In one possible implementation, the first parameter may be an operating frequency of a CPU in the electronic device. When the electronic equipment determines that the screen projection effect is not good, the electronic equipment adjusts the working frequency of a CPU in the electronic equipment to a first frequency. And then, when the electronic equipment determines that the screen projection effect is not good, the electronic equipment adjusts the working frequency of a CPU in the electronic equipment to a second frequency, wherein the second frequency is greater than the first preset frequency and less than the second preset frequency. In this way, by setting the maximum value (second preset frequency) of the adjustment of the operating frequency of the CPU in the electronic device, it is possible to prevent the problem that the electronic device generates heat due to excessively high adjustment of the operating frequency of the CPU in the electronic device.

With reference to the first aspect, in an optional implementation manner, the electronic device is further configured to obtain a fourth parameter and a fifth parameter before adjusting the first parameter of the electronic device to the first value according to the first-level adjustment policy; the screen projection parameters comprise screen projection time delay, the fourth parameter comprises a first moment when the display equipment displays a first screen projection frame picture in first screen projection content, and the fifth parameter comprises a second moment when the electronic equipment sends the first screen projection frame picture; the electronic equipment is also used for determining screen projection time delay based on the first time and the second time; the first condition includes: the screen projection time delay is greater than the preset time delay; and/or the screen projection parameters comprise screen projection frame rate differences, the fourth parameters comprise a first frame rate of a first screen projection frame image displayed by the display equipment, and the fifth parameters comprise a second frame rate of the first screen projection frame image acquired by the electronic equipment; the electronic equipment is further used for determining a screen projection frame rate difference based on the first frame rate and the second frame rate; the first condition includes: the difference of the screen-projecting frame rate is larger than the preset frame rate difference.

Here, when the screen projection parameter is a screen projection time delay, the first condition is that the screen projection time delay is greater than a preset time delay, that is, the basis for the electronic device to determine that the screen projection effect is not good is that the screen projection time delay is greater than the preset time delay. When the screen projection parameter is the screen projection frame rate difference, the first condition is that the screen projection frame rate difference is larger than the preset frame rate difference, namely the electronic equipment determines that the screen projection effect is poor and that the screen projection frame rate difference is larger than the preset frame rate difference. The screen projection parameters are a screen projection frame rate difference and a screen projection time delay, the first condition is that the screen projection frame rate difference is larger than a preset frame rate difference and/or the screen projection time delay is larger than a preset time delay, namely the basis that the electronic equipment determines that the screen projection effect is not good is that the screen projection frame rate difference is larger than the preset frame rate difference and/or the screen projection time delay is larger than the preset time delay.

In a possible implementation manner, the electronic device may comprehensively measure the screen projection effect according to the screen projection delay and the screen projection frame rate difference according to the following formula:

as can be seen from the above formula, cast _ cost = (delay-delay _ base)/delay _ base = 0.5+ fps \/diff/fps _ base = 0.5, delay represents the screen projection delay, and the screen projection delay is measured by the electronic device in real time. delay _ base represents a screen projection reference delay, the screen projection reference delay is a preset value, and a common screen projection reference delay is 50ms or 100ms. fps _ diff represents a screen projection frame rate difference which is measured by the electronic equipment in real time. fps _ base represents a screen projection reference frame rate difference which is a preset value, and the general screen projection reference time delay is 60hz. The value range of cast _ cost is 0-1. The electronic device may measure the screen projection effect according to the cast _ cost, that is, when the electronic device determines that the cast _ cost is greater than a preset value (e.g., 0.25), the electronic device determines that the screen projection effect does not meet a preset condition.

In a second aspect, the present application provides a screen projection method, including: the electronic equipment and the display equipment establish screen projection connection; the electronic equipment sends the first screen projection content to the display equipment through screen projection connection; displaying the first screen projection content on a screen projection interface of the display device; the electronic equipment determines that the screen projection parameters meet a first condition, adjusts the first parameters of the electronic equipment to a first value according to a first-level adjusting strategy, and adjusts the second parameters of the electronic equipment to a second value; wherein the first value is greater than a first threshold value and the second value is greater than a second threshold value; after the electronic equipment adjusts the first parameter of the electronic equipment to a first value and adjusts the second parameter of the electronic equipment to a second value, the electronic equipment determines that the screen projection parameter meets a first condition; the electronic equipment adjusts the first parameter of the electronic equipment to a third value and adjusts the second parameter of the electronic equipment to a fourth value according to the second-level adjusting strategy; wherein the third value is less than the first threshold value and the fourth value is less than the second threshold value.

When the electronic equipment determines that the screen projection effect does not meet the preset condition, the first parameter of the electronic equipment is adjusted to a first value through a first-level adjusting strategy, and the second parameter of the electronic equipment is adjusted to a second value. And then, when the screen projection effect is determined to be not met or the preset condition is determined, the first parameter is continuously adjusted to the third value according to the second-stage adjustment strategy, and the second parameter is adjusted to the fourth value. And the third value is less than the first threshold and the fourth value is less than the second threshold. Therefore, the electronic equipment adopts a strategy of hierarchical adjustment, and the adjustment range of the first parameter and the second parameter is not too large at one time but is slowly adjusted. And after the parameters are adjusted, when the electronic equipment determines that the screen projection effect is not good, adjusting the first parameters and the second parameters again. Therefore, humanized adjustment parameters are realized through a strategy of hierarchical adjustment, and adjustment is performed with the aim of reducing the influence of users.

By the method in the second aspect, the electronic device or the display device can determine the reason for influencing the screen projection effect, adopt the corresponding strategy to improve the screen projection effect, adopt the screen projection effect hierarchical adjustment strategy, consider the factors influencing the user experience, and adjust the screen projection effect with the aim of reducing the influence of the user.

With reference to the second aspect, in a possible implementation manner, the method further includes: when the electronic equipment determines that the screen projection effect is not good, the electronic equipment sends first information to the display equipment, and the first information is used for indicating the display equipment to adjust a third parameter of the display equipment. Therefore, the electronic equipment can adjust the parameters of the electronic equipment side and the parameters of the display equipment, and multi-end adjustment is realized.

With reference to the second aspect, in a possible implementation manner, the first parameter and the second parameter include any one of the following: the method comprises the following steps of (1) working frequency of a Central Processing Unit (CPU) of the electronic equipment, working frequency of a Graphics Processing Unit (GPU) of the electronic equipment, working frequency of a coder of the electronic equipment, working frequency of a double-rate synchronous dynamic random access memory (DDR) of the electronic equipment, screen projection code rate of the electronic equipment, sampling frame rate of the electronic equipment and screen projection resolution of the electronic equipment; the first parameter is different from the second parameter.

The third parameter includes any one of: the working frequency of a CPU in the display device, the working frequency of a GPU in the display device, the working frequency of a decoder in the display device, the working frequency of a DDR in the display device and the display frame rate of the display device.

With reference to the second aspect, in a possible implementation manner, before the electronic device determines that the screen projection parameter meets the first condition and adjusts the first parameter of the electronic device to the first value according to the first-level adjustment policy, the method further includes: the electronic equipment acquires a third parameter and a fourth parameter; the screen projection parameters comprise screen projection time delay, the fourth parameter comprises a first moment when the display equipment displays a first screen projection frame picture in first screen projection content, and the fifth parameter comprises a second moment when the electronic equipment sends a screen projection effect adjusting strategy to enable the first screen projection frame picture to be displayed; the electronic equipment determines screen projection time delay based on the first time and the second time; the first condition includes: the screen projection time delay is greater than the preset time delay; and/or the screen projection parameters comprise screen projection frame rate differences, the fourth parameters comprise a first frame rate of a first screen projection frame image displayed by the display equipment, and the fifth parameters comprise a second frame rate of the first screen projection frame image acquired by the electronic equipment; the electronic equipment determines a screen projection frame rate difference based on the first frame rate and the second frame rate; the first condition includes: the difference of the screen-projecting frame rate is larger than the preset frame rate difference.

cast_cost＝(delay-delay_base)/delay_base*0.5+fps_diff/fps_base*0.5

as can be seen from the above formula, delay represents the screen-projecting time delay, which is measured by the electronic device in real time. delay _ base represents a screen projection reference delay, the screen projection reference delay is a preset value, and a common screen projection reference delay is 50ms or 100ms. fps _ diff represents a screen projection frame rate difference which is measured by the electronic equipment in real time. fps _ base represents a screen projection reference frame rate difference which is a preset value, and the general screen projection reference time delay is 60hz. The value range of cast _ cost is 0-1. The electronic device may measure the screen projection effect according to the cast _ cost, that is, when the electronic device determines that the cast _ cost is greater than a preset value (e.g., 0.25), the electronic device determines that the screen projection effect does not meet a preset condition.

In a third aspect, the present application provides a screen projection method, including: the display equipment and the electronic equipment establish screen projection connection; the display equipment receives first screen projection content sent by the electronic equipment through screen projection connection; the display equipment displays a screen projection interface based on the first screen projection content; and when the electronic equipment determines that the screen projection parameters meet the first condition, receiving first information sent by the electronic equipment, and adjusting third parameters of the display equipment. Therefore, the electronic equipment can adjust the parameters of the electronic equipment side and the parameters of the display equipment, and multi-end adjustment is realized.

In a possible implementation manner, the display device may not receive the first information sent by the electronic device, and when monitoring that the screen projection effect does not meet the preset condition, the display device adjusts a third parameter of the display device. Therefore, the display equipment can monitor the screen projection effect of the display equipment side, and the third parameter can be adjusted in real time according to the screen projection effect.

In a possible implementation manner, after the electronic device determines that the screen projection effect is not good and the electronic device determines that the second load meets the third condition, the display device receives first information sent by the electronic device, wherein the first information is used for indicating the display device to adjust a third parameter of the display device; and after receiving the first information, the display device adjusts a third parameter of the display device.

The second load includes, but is not limited to, the usage rate of hardware (e.g., CPU or GPU or DDR or encoder) in the display device, or the image composition time in the display device. When the utilization rate of hardware in the display device is greater than the preset utilization rate, or the image synthesis time in the display device is greater than the preset time, the display device receives first information sent by the electronic device. Therefore, the electronic equipment can determine the reason causing poor screen projection effect, and adopt corresponding measures to improve the screen projection effect.

With reference to the third aspect, in a possible implementation manner, the third parameter includes any one of: the working frequency of a CPU in the display device, the working frequency of a GPU in the display device, the working frequency of a decoder in the display device, the working frequency of a DDR in the display device and the display frame rate of the display device.

With reference to the third aspect, in a possible implementation manner, before the display device receives the first information sent by the electronic device, the method further includes: the display equipment sends the fourth parameter to the electronic equipment; the screen projection parameters comprise screen projection time delay, and the fourth parameter comprises a first moment when the display equipment displays a first screen projection frame picture in first screen projection content; the fourth parameter is used for determining screen projection time delay by the electronic equipment based on the first time and the second time when the electronic equipment sends the first screen projection frame picture; the first condition includes: the screen projection time delay is greater than the preset time delay; and/or the screen projection parameters comprise screen projection frame rate differences, and the fourth parameters comprise a first frame rate of a first screen projection frame picture displayed by the display equipment; the fourth parameter is used for determining a screen projection frame rate difference by the electronic equipment based on the first frame rate and a second frame rate of the first screen projection frame image acquired by the electronic equipment; the first condition includes: the difference of the screen projection frame rate is larger than the difference of the preset frame rate.

Here, when the screen projection parameter is a screen projection time delay, the first condition is that the screen projection time delay is greater than a preset time delay, that is, the basis for the electronic device to determine that the screen projection effect is not good is that the screen projection time delay is greater than the preset time delay. When the screen projection parameter is the screen projection frame rate difference, the first condition is that the screen projection frame rate difference is larger than the preset frame rate difference, namely the basis that the electronic equipment determines that the screen projection effect is not good is that the screen projection frame rate difference is larger than the preset frame rate difference. The screen projection parameters are a screen projection frame rate difference and a screen projection time delay, the first condition is that the screen projection frame rate difference is larger than a preset frame rate difference and/or the screen projection time delay is larger than a preset time delay, namely the basis that the electronic equipment determines that the screen projection effect is not good is that the screen projection frame rate difference is larger than the preset frame rate difference and/or the screen projection time delay is larger than the preset time delay.

In a fourth aspect, the present application provides an electronic device, comprising: one or more processors, one or more memories; one or more memories are coupled to the one or more processors, the one or more memories storing computer program code comprising computer instructions which are invoked by the one or more processors to cause the electronic device to perform the method steps in any of the possible implementations of any of the above aspects.

In a fifth aspect, the present application provides a display device comprising: one or more processors, one or more memories; one or more memories coupled to the one or more processors, the one or more memories for storing computer program code, the computer program code including computer instructions, the one or more processors invoking the computer instructions to cause the display device to perform the method steps in any of the possible implementations of any of the above aspects.

In a sixth aspect, the present application provides a computer storage medium including computer instructions, which, when executed on an electronic device, cause the electronic device to perform the method steps in any one of the possible implementations of any one of the above aspects.

In a seventh aspect, the present application provides a computer storage medium, which includes computer instructions that, when executed on a display device, cause the display device to perform the method steps in any one of the possible implementations of any one of the above aspects.

In an eighth aspect, the present application provides a computer program product, which when run on an electronic device, causes the electronic device to perform the method steps in any one of the possible implementations of any one of the above aspects.

In a ninth aspect, the present application provides a computer program product, which when run on a display device, causes the display device to perform the method steps in any one of the possible implementations of any one of the above aspects.

Drawings

Fig. 1 is a flowchart illustrating how an electronic device 100 transmits screen projection content to a display device 200 according to an embodiment of the present application;

FIG. 2 is a diagram of a system architecture according to an embodiment of the present application;

FIG. 3 is another system architecture diagram provided in accordance with an embodiment of the present application;

fig. 4 is a schematic structural diagram of an electronic device 100 according to an embodiment of the present application;

fig. 5 is a block diagram of a software structure of an electronic device 100 according to an embodiment of the present disclosure;

fig. 6 is a schematic diagram illustrating an ability of the electronic device 100 and the display device 200 to monitor a system load capacity and a screen projection performance parameter in the device in real time and dynamically adjust the system load according to the screen projection performance parameter according to an embodiment of the present disclosure;

7A-7D illustrate UI diagrams for user operation of the electronic device 100 to initiate a collaborative screen projection function;

fig. 8 is a process of negotiating display parameters between the electronic device 100 and the display device 200 according to an embodiment of the present application;

9-10. A flowchart of a first method for adjusting a screen projection effect according to a first embodiment of the present application;

fig. 11 is a schematic diagram illustrating that the electronic device 100 adjusts a screen projection rate between the electronic device 100 and the display device 200 according to an embodiment of the present disclosure;

fig. 12 is a schematic diagram of an electronic device 100 adjusting a sampling frame rate of a side of the electronic device 100 according to an embodiment of the present application;

fig. 13 is a schematic diagram of a display apparatus 200 according to an embodiment of the present application for adjusting a display frame rate of the display apparatus 200;

fig. 14 is a schematic diagram illustrating that the electronic device 100 adjusts a side screen-projecting resolution of the electronic device 100 according to an embodiment of the present application;

fig. 15 is a flowchart of a screen projection method provided in an embodiment of the present application;

fig. 16 is a flowchart of another screen projection method provided in the embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described in detail and clearly with reference to the accompanying drawings. In the description of the embodiments herein, "/" means "or" unless otherwise specified, for example, a/B may mean a or B; the "and/or" in the text is only an association relation describing the association object, and indicates that three relations may exist, for example, a and/or B may indicate: three cases of a alone, a and B both, and B alone exist, and in addition, "a plurality" means two or more than two in the description of the embodiments of the present application.

In the following, the terms "first", "second" are used for descriptive purposes only and are not to be understood as implying or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature, and in the description of embodiments of the application, unless stated otherwise, "plurality" means two or more.

The term "User Interface (UI)" in the specification, claims and drawings of the present application is a medium interface for interaction and information exchange between an application or operating system and a user, and it realizes conversion between an internal form of information and a form acceptable to the user. The user interface of the application program is source code written by a specific computer language such as java, extensible markup language (XML), and the like, and the interface source code is analyzed and rendered on the terminal device, and finally presented as content that can be recognized by a user, such as an image, a text, a button, and other controls. Controls (control), also called widgets, are basic elements of user interfaces, and typical controls are tool bars (toolbar), menu bars (menu bar), input boxes, buttons (button), scroll bars (scrollbar), images, and text. The properties and contents of the controls in the interface are defined by tags or nodes, such as XML defining the controls contained by the interface by nodes < Textview >, < ImgView >, < VideoView >, and the like. A node corresponds to a control or attribute in the interface, and the node is rendered as user-viewable content after parsing and rendering. In addition, many applications, such as hybrid applications (hybrid applications), typically include web pages in their interfaces. A web page, also called a page, can be understood as a special control embedded in an application program interface, the web page is a source code written by a specific computer language, such as hypertext markup language (HTML), cascading Style Sheets (CSS), java scripts (JavaScript, JS), etc., and the web page source code can be loaded and displayed as a content recognizable to a user by a browser or a web page display component similar to a browser function. The specific content contained in the web page is also defined by tags or nodes in the source code of the web page, such as HTML, which defines elements and attributes of the web page by < p >, < img >, < video >, < canvas >.

A commonly used presentation form of the user interface is a Graphical User Interface (GUI), which refers to a user interface related to computer operations and displayed in a graphical manner. It may be an interface element such as a window, control, etc. displayed in the display screen of the electronic device.

Currently, the electronic device 100 establishes a screen-cast connection with the display device 200. The electronic apparatus 100 acquires the screen-shot content in real time and transmits the screen-shot content to the display apparatus 200. The display device 200 receives and displays the screen-shot content transmitted by the electronic device 100.

As shown in fig. 1, fig. 1 illustrates a flowchart of how the electronic device 100 transmits screen-shot content to the display device 200.

As shown in fig. 1, the electronic device 100 includes a virtual display. And an image synthesis module. The device comprises an encoding module and a packaging module; the display device 200 includes an unpacking module, an encoding module, an image synthesizing module, and a display.

The electronic device 100 acquires image information displayed on the display from the display of the electronic device 100. The image information displayed by the Display may be image information displayed by a Virtual Display Screen (VDS).

After that, the electronic apparatus 100 transmits the image information to the image synthesis module. The image synthesis module receives the image information and synthesizes the image information displayed by the display into an image. Thereafter, the image synthesis module sends the synthesized image to the encoding module.

The encoding module is used for receiving the synthesized image, encoding the synthesized image by adopting a corresponding encoder, and then sending the encoded image to the packing module.

The packing module is configured to receive the encoded image sent by the encoding module, compress the encoded image, and then transmit the compressed encoded image to the display device 200 in a form of a data stream through a channel between the electronic device 100 and the display device 200.

The unpacking module of the display device 200 is configured to receive the data stream sent by the packing module in the electronic device 100, and decode the data stream to obtain an encoded image. The unpacking module sends the encoded image to the decoding module.

The decoding module is configured to receive the encoded image sent by the unpacking module, decode the encoded image according to a decoder corresponding to an encoder adopted by the electronic device 100 to obtain a decoded image, and send the decoded image to the unpacking module by the encoding module.

The decoding module is also used for receiving the decoded image sent by the decoding module and sending the decoded image to the image synthesis module of the display device 200.

The image synthesis module of the display device 200 is configured to receive the decoded image sent by the unpacking module and synthesize the decoded image into an image format suitable for display by the display device 200. Thereafter, the Display apparatus 200 displays the synthesized decoded image on a Virtual Display Screen (VDS) of the Display apparatus 200.

If the screen projection effect is not good at this time, for example, the frame rate difference between the sampling frame rate of the electronic device 100 and the display frame rate of the display device 200 is greater than the preset frame rate difference, or the screen projection time delay between the electronic device 100 and the display device 200 is greater than the preset time delay, the electronic device 100 monitors whether the network state is normal. If the electronic device 100 monitors that the screen projection effect is poor due to the fact that the network load is too high, the electronic device 100 reduces the code rate of data transmission to improve the screen projection effect.

If the electronic device 100 monitors that the screen projection effect is not poor due to the network problem, the electronic device 100 and the display device 200 cannot improve the screen projection effect of the electronic device 100 by other means besides reducing the code rate.

Therefore, the present application provides a screen projection method, which includes: the electronic device 100 and the display device 200 adjust the system load capacity or the screen projection parameters by adopting a screen projection effect hierarchical adjustment strategy, so that the screen projection performance parameters meet preset conditions, the screen projection effect hierarchical adjustment strategy is adjusted with the degree of influencing the user experience from low to high as a target, and the influence on the user experience when the electronic device 100 or the display device 200 adjusts the system load capacity or the screen projection parameters is reduced. By adopting the method, on one hand, the electronic device 100 or the display device 200 can determine the reason for influencing the screen projection effect, and adopt the corresponding strategy to improve the screen projection effect; on the other hand, a screen projection effect grading adjustment strategy is adopted, factors influencing user experience are considered, and adjustment is carried out with the aim of reducing influence of the user.

Specifically, first, when the electronic device 100 and/or the display device 200 monitor that the respective hardware load is relatively high, the operating frequency of the respective hardware is increased; if the operating frequency of the hardware of the electronic device 100 and/or the display device 200 is increased, the screen projection effect is still not good, the electronic device 100 reduces the code rate and the sampling frame rate, and if the screen projection effect is still not good, the display device 200 reduces the display frame rate of the display device 200. If the screen projection effect is still not good, the electronic device 100 reduces the resolution to improve the screen projection effect.

Fig. 2 is a system architecture diagram provided in the embodiment of the present application, as shown in fig. 2.

Fig. 2 schematically shows a structural diagram of one system 20 provided in the embodiments of the present application. As shown in fig. 2, the system 20 includes an electronic device 100 and a display device 200.

The electronic device 100 may be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a Personal Digital Assistant (PDA), an Augmented Reality (AR) device, a Virtual Reality (VR) device, an Artificial Intelligence (AI) device, a wearable device, a vehicle-mounted device, a smart home device, and/or a smart city device, and the specific type of the electronic device is not particularly limited by the embodiments of the present application. Software systems for electronic device 100 include, but are not limited to

Linux, or other operating systems.

The display apparatus 200 refers to an electronic apparatus having a large-sized display screen, such as a tablet, a television, a Personal Computer (PC), a desktop computer, or an electronic billboard, etc.

The present application is not limited as to the type of the electronic device 100 and the display device 200. The present embodiment takes the electronic device 100 as a mobile phone and the display device 200 as a personal computer as an example, and the present embodiment is described.

In an embodiment of the present application, the electronic device 100 may be directly connected with the display device 200 through a short-range wireless communication connection or a local wired connection. For example, the electronic device 100 and the display device 200 may have one or more of Wireless Local Area Network (WLAN) technology, wireless fidelity direct (Wi-Fi direct) (also called wireless fidelity peer-to-peer (Wi-Fi P2P)), ultra Wide Band (UWB) communication module, bluetooth (bluetooth) communication module, near Field Communication (NFC) communication module, and ZigBee communication module. Taking the electronic device 100 as an example, the electronic device 100 may detect and scan electronic devices near the electronic device 100 by transmitting signals through a near field communication module (e.g., wi-Fi P2P), so that the electronic device 100 may discover the nearby electronic devices through a near field wireless communication protocol, establish a wireless communication connection with the nearby electronic devices, and transmit data to the nearby electronic devices (e.g., the display device 200).

In the embodiment of the application, after the electronic device 100 and the display device 200 establish the screen-projecting connection, the electronic device 100 may send the image data and/or the audio data and the like of the screen projection to the display device 200, and the display device 200 may perform interface display and/or audio output based on the data sent by the electronic device 100. The electronic device 100 may also be referred to as an output terminal or a source terminal (source terminal), and the display device 200 may also be referred to as a sink terminal or a sink terminal (sink terminal).

The format of the multimedia content displayed or played by the electronic device 100 may include any one or more of the following: video, text, pictures, photographs, audio, or forms, etc. For example, when the format of the multimedia content is a video, the type of the video may be a movie, a tv show, a short video, a music show, and the like.

It is to be understood that the illustrated configuration of the present embodiment is not to be construed as a specific limitation of system 20. In other embodiments of the present application, system 20 may include more or fewer devices than those shown.

Fig. 3 is another system architecture diagram provided in accordance with an embodiment of the present application, as shown in fig. 3.

Fig. 3 schematically shows a structural diagram of another system 30 provided in the embodiment of the present application. As shown in fig. 3, the electronic device 100 may establish a screen-cast connection with multiple display devices simultaneously. The system 30 includes an electronic device 100 and a plurality of display devices, which may include a display device 200, a display device 300, and a display device 400, among others. The system 30 may further include more display devices, which are not limited herein.

Linux, or other operating systems.

The display apparatus refers to an electronic apparatus having a larger-sized display screen, such as a tablet, a television, a Personal Computer (PC), a desktop computer, or an electronic billboard.

The application is not limited as to the type of electronic device 100 and the display device. The present embodiment takes the electronic device 100 as a mobile phone, the display device 200 as a personal computer, the display device 300 as a tablet, and the display device 400 as a television as examples, and the embodiments of the present application will be described.

The mobile phone can simultaneously transmit multimedia contents to the display apparatus 200, the display apparatus 300, and the display apparatus 400.

When the electronic apparatus 100 simultaneously establishes a screen-projection connection with a plurality of display apparatuses, in this case, the connections of the electronic apparatus 100 with the plurality of display apparatuses, respectively, may be regarded as the composition of a plurality of independent systems. That is, the electronic device 100 and the display device 200 perform data transmission, the electronic device 100 and the display device 300 perform data transmission, and the electronic device 100 and the display device 400 perform data transmission independently and independently of each other.

The method for the electronic device 100 to establish the screen-projection connection with the plurality of display devices and transmit data to the plurality of display devices, and the method for the electronic device 100 to establish the screen-projection connection with one display device and transmit data to the one display device are consistent. The embodiment of the present application takes the example that the electronic device 100 establishes a screen-projection connection with a display device.

Fig. 4 shows a schematic structural diagram of the electronic device 100.

The following describes an embodiment specifically by taking the electronic device 100 as an example. The device types of the electronic device 100 may include a mobile phone, a tablet computer, a smart screen, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, and the like. The embodiment of the present application does not particularly limit the type of the electronic device 100.

It should be understood that the electronic device 100 shown in fig. 4 is merely an example, and that the electronic device 100 may have more or fewer components than shown in fig. 4, may combine two or more components, or may have a different configuration of components. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 130, a Universal Serial Bus (USB) interface 140, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a display screen 191, a camera 192, a sim card interface 193, and the like. Wherein the sensor module 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

It is to be understood that the illustrated structure of the embodiment of the present invention does not specifically limit the electronic device 100. In other embodiments of the present application, electronic device 100 may include more or fewer components than shown, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 110 may include one or more processing units, such as: the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. Wherein, the different processing units may be independent devices or may be integrated in one or more processors.

The controller may be, among other things, a neural center and a command center of the electronic device 100. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.

A memory may also be provided in processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 110, thereby increasing the efficiency of the system.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to extend the memory capability of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music, video, etc. are saved in an external memory card.

Internal memory 130 may be used to store computer-executable program code, including instructions. The processor 110 executes various functional applications of the electronic device 100 and data processing by executing instructions stored in the internal memory 130.

The USB interface 140 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 140 may be used to connect a charger to charge the electronic device 100, and may also be used to transmit data between the electronic device 100 and a peripheral device. And the method can also be used for connecting a headset and playing audio through the headset. The interface may also be used to connect other electronic devices, such as AR devices and the like.

The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The

antennas

1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas.

The mobile communication module 150 may provide a solution including 2G/3G/4G/5G wireless communication applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 150 may receive the electromagnetic wave from the antenna 1, filter, amplify, etc. the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation. The mobile communication module 150 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave.

The wireless communication module 160 may provide a solution for wireless communication applied to the electronic device 100, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), bluetooth (bluetooth, BT), global Navigation Satellite System (GNSS), frequency Modulation (FM), near Field Communication (NFC), infrared (IR), and the like. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, perform frequency modulation and amplification on the signal, and convert the signal into electromagnetic waves through the antenna 2 to radiate the electromagnetic waves.

The electronic device 100 implements display functions via the GPU, the display screen 191, and the application processor, among other things. The GPU is a microprocessor for image processing, and is connected with a display screen 191 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 191 is used to display images, videos, and the like. In some embodiments, the electronic device 100 may include 1 or N display screens 191, N being a positive integer greater than 1.

The electronic device 100 may implement a shooting function through the ISP, the camera 192, the video codec, the GPU, the display screen 191, the application processor, and the like.

The ISP is used to process the data fed back by the camera 192. For example, when a user takes a picture, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, an optical signal is converted into an electric signal, and the camera photosensitive element transmits the electric signal to the ISP for processing and converting into an image visible to the naked eye. In some embodiments, the ISP may be provided in camera 192.

The camera 192 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing element converts the optical signal into an electrical signal, which is then passed to the ISP where it is converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into image signal in standard RGB, YUV and other formats. In some embodiments, electronic device 100 may include 1 or N cameras 192, N being a positive integer greater than 1.

The digital signal processor is used for processing digital signals, and can process digital image signals and other digital signals. For example, when the electronic device 100 selects a frequency bin, the digital signal processor is used to perform fourier transform or the like on the frequency bin energy.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record video in a variety of encoding formats, such as: moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, and the like.

The NPU is a neural-network (NN) computing processor that processes input information quickly by using a biological neural network structure, for example, by using a transfer mode between neurons of a human brain, and can also learn by itself continuously. Applications such as intelligent recognition of the electronic device 100 can be realized through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, and the like.

The electronic device 100 may implement audio functions via the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals.

The speaker 170A, also called a "horn", is used to convert the audio electrical signal into an acoustic signal.

The receiver 170B, also called "earpiece", is used to convert the electrical audio signal into an acoustic signal.

The microphone 170C, also referred to as a "microphone," is used to convert sound signals into electrical signals.

The earphone interface 170D is used to connect a wired earphone.

The SIM card interface 193 is used to connect a SIM card. The SIM card can be brought into and out of contact with the electronic apparatus 100 by being inserted into the SIM card interface 193 or being pulled out from the SIM card interface 193. The electronic device 100 may support 1 or N SIM card interfaces, N being a positive integer greater than 1. In some embodiments, the electronic device 100 employs esims, namely: an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

The software system of the electronic device 100 may employ a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present invention uses an Android system with a layered architecture as an example to exemplarily illustrate a software structure of the electronic device 100.

Fig. 5 is a block diagram of the software configuration of the electronic apparatus 100 according to the embodiment of the present invention.

The layered architecture divides the software into several layers, each layer having a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, an application layer, an application framework layer, an Android runtime (Android runtime) and system library, and a kernel layer from top to bottom.

The application layer may include a series of application packages.

As shown in fig. 5, the application package may include applications such as camera, gallery, calendar, phone call, map, navigation, WLAN, bluetooth, music, video, short message, etc.

The application framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions.

As shown in FIG. 5, the application framework layer may include a window manager, a content provider, a resource manager, a notification manager, etc., a monitoring module, a decision module, and an execution module.

The window manager is used for managing window programs. The window manager can obtain the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

Content providers are used to store and retrieve data and make it accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and the like.

The notification manager enables the application to display notification information in the status bar, can be used to convey notification-type messages, can disappear automatically after a short dwell, and does not require user interaction. Such as a notification manager used to inform download completion, message alerts, etc. The notification manager may also be a notification that appears in the form of a chart or scroll bar text at the top status bar of the system, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, prompting text information in the status bar, sounding a prompt tone, vibrating the electronic device, flashing an indicator light, etc.

The monitoring module is used for:

1. the sampling frame rate of the electronic device 100 and the time of acquiring the screen-shot content are sent to a monitoring module in the display device 200.

2. And receiving the display frame rate and the time of displaying the screen projection content sent by the monitoring module in the display device 200. The display frame rate is used for calculating a screen-projecting frame rate difference by the electronic device 100 according to the display frame rate of the display device 200 and the sampling frame rate of the electronic device 100. The time when the screen-projected content is displayed is used for calculating the screen-projection time delay by the electronic device 100 according to the time when the display device 200 displays the screen-projected content and the time when the electronic device 100 acquires the screen-projected content.

3. And monitoring the screen projection frame rate difference and the screen projection time delay. The screen projection frame rate difference is equal to a difference value between the display frame rate of the display device 200 and the sampling frame rate of the electronic device 100, and the screen projection time delay is equal to a difference value between the time of the display device 200 displaying the screen projection content and the time of the electronic device 100 acquiring the screen projection content.

4. System load capacity in the electronic device 100 is monitored. The system load capacity comprises CPU utilization rate, GPU utilization rate, DDR utilization rate, codec utilization rate, network transmission delay and image synthesis time.

5. And sending the system load capacity and the screen projection performance parameters to a decision module. The screen projection performance parameters comprise screen projection frame rate difference and screen projection time delay.

The CPU utilization is a CPU resource occupied by a program running in the electronic device 100. The higher the CPU utilization, the more programs are run in the electronic device 100. When the CPU utilization rate is lower than the preset utilization rate, the load of the CPU is normal, and when the CPU utilization rate is higher than the preset utilization rate, the load of the CPU is too high.

GPU usage is the occupancy of the graphics card in the electronic device 100.

DDR usage is the double data Rate synchronous dynamic random Access memory occupancy in electronic device 100.

Codec usage is the occupancy of the Codec in the electronic device 100.

The network transmission delay is data transmission delay between the electronic device 100 and the display device 200, and is equal to a time difference between a time when the screen-projected content leaves the electronic device 100 and a time when the screen-projected content reaches the display device 200. The smaller the network transmission delay, the better the network condition between the electronic device 100 and the display device 200 is.

Image composition time the electronic device 100 or the display device 200 takes time to compose a predetermined number of image frames (for example, one frame).

A decision module to:

1. and receiving the system load capacity and the screen projection performance parameters sent by the monitoring module.

2. And determining whether the screen projection performance parameters meet preset conditions, if the screen projection performance parameters do not meet the preset conditions, judging that the screen projection frame rate difference is larger than a preset frame rate difference and/or the screen projection time delay is larger than a preset screen projection time delay by the decision module, monitoring the system load capacity by the decision module, and if the system load capacity is larger than the preset capacity, sending a screen projection parameter adjusting request to the execution module by the decision module.

An execution module to:

1. and receiving a screen projection parameter adjusting request sent by the decision module.

2. And adjusting the screen projection parameters according to the screen projection parameter adjusting request. The screen projection parameters comprise a sampling frame rate, a screen projection code rate, a screen projection resolution and the like.

Here, how the decision module sends a request for adjusting the screen projection parameters to the execution module according to the system load capacity, and how the execution module adjusts the system load capacity or the screen projection parameters according to the request for adjusting the screen projection parameters will be described in detail in the following embodiments, which are not described herein again.

The Android Runtime comprises a core library and a virtual machine. The Android Runtime is responsible for scheduling and managing an Android system.

The core library comprises two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.

The application layer and the application framework layer run in a virtual machine. And executing java files of the application program layer and the application program framework layer into a binary file by the virtual machine. The virtual machine is used for performing the functions of object life cycle management, stack management, thread management, safety and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface managers (surface managers), media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., openGL ES), 2D graphics engines (e.g., SGL), and the like.

The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

The media library supports a variety of commonly used audio, video format playback and recording, and still image files, among others. The media library may support a variety of audio-video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, and the like.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.

The following describes exemplary workflow of the software and hardware of the electronic device 100 in connection with capturing a photo scene.

When the touch sensor 180K receives a touch operation, a corresponding hardware interrupt is issued to the kernel layer. The kernel layer processes the touch operation into an original input event (including touch coordinates, a time stamp of the touch operation, and other information). The raw input events are stored at the kernel layer. And the application program framework layer acquires the original input event from the kernel layer and identifies the control corresponding to the input event. Taking the touch operation as a touch click operation, and taking a control corresponding to the click operation as a control of a camera application icon as an example, the camera application calls an interface of an application frame layer, starts the camera application, further starts a camera drive by calling a kernel layer, and captures a still image or a video through the camera.

As shown in fig. 6, fig. 6 is a schematic diagram illustrating an ability of the electronic device 100 and the display device 200 to monitor a system load capacity and a screen projection performance parameter in the device in real time and dynamically adjust the system load according to the screen projection performance parameter.

It should be noted that, the electronic device 100 may monitor the screen projection performance parameter and the system load capacity in the electronic device 100, and simultaneously, monitor the system load capacity in the display device 200; the display device 200 may monitor the system load capability in the electronic device 100 while monitoring the projection performance parameters and the system load capability in the display device 200; the electronic device 100 may monitor only the projection performance parameter and the system load capacity in the electronic device 100, and the display device 200 may monitor only the projection performance parameter and the system load capacity in the display device 200. It is not limited to this.

The following embodiments of the present application take the example that the electronic device 100 monitors the screen projection performance parameters and the system load capacity in the electronic device 100, and the display device 200 monitors the screen projection performance parameters and the system load capacity in the display device 200 as examples.

As shown in fig. 6, the electronic device 100 includes a monitoring module, a decision-making module, and an execution module; the display device 200 includes a monitoring module, a decision module, and an execution module.

It should be noted that the monitoring module, the decision module, and the execution module may be substantially a single module, that is, a single module may implement the functions of the monitoring module, the decision module, and the execution module, the monitoring module, the decision module, and the execution module may also be three independent modules, and the monitoring module, the decision module, and the execution module may also be combined into a module in pairs. In some embodiments, the electronic device 100 may not include a monitoring module, a decision module and an execution module, and the monitoring module, the decision module and the execution module are only used as examples to explain the solution and should not be used for limitation.

The monitoring module, the decision module and the execution module in the electronic device 100 are described in detail in the embodiment shown in fig. 5, and are not described herein again. The monitoring modules, decision-making modules and execution modules in the display device 200 function similarly to the monitoring modules, decision-making modules and execution modules in the electronic device 100.

A monitoring module:

specifically, the function of the monitoring module of the electronic device 100 is described in the embodiment of fig. 5, and is not described herein again.

In some embodiments, the monitoring module in the electronic device 100 is further configured to transmit the system load capability of the electronic device 100 to the monitoring module in the electronic device 100.

In some embodiments, the monitoring module in the electronic device 100 receives the system load capability in the display device 200 transmitted by the monitoring module of the display device 200 and monitors the system load capability in the display device 200 while monitoring the system load capability in the electronic device 100. The system load capacity comprises CPU utilization rate, GPU utilization rate, DDR utilization rate, codec utilization rate, network transmission delay, image synthesis time and the like.

For the display device 200, the monitoring module is to:

1. the display frame rate of the display device 200 and the time when the screen projection content is displayed are transmitted to the monitoring module in the electronic device 100. The display frame rate is used for calculating a screen projection frame rate difference by the electronic device 100 according to the display frame rate of the display device 200 and the sampling frame rate of the electronic device 100. The time of displaying the screen projection content is used for calculating the screen projection time delay by the electronic equipment 100 according to the time of displaying the screen projection content by the display equipment 200 and the time of acquiring the screen projection content by the electronic equipment 100.

2. Receiving the sampling frame rate sent by the monitoring module in the electronic device 100 and the time when the screen-shot content is acquired. The sampling frame rate is used for the display device 200 to calculate a screen projection frame rate difference according to the display frame rate of the display device 200 and the sampling frame rate sent by the electronic device 100. The time of acquiring the screen-shot content is used for the display device 200 to calculate the screen-shot time delay according to the time of displaying the screen-shot content of the display device 200 and the time of acquiring the screen-shot content sent by the electronic device 100.

In some embodiments, the monitoring module in the display device 200 receives the system load capability in the electronic device 100 transmitted by the monitoring module of the electronic device 100 while monitoring the system load capability in the display device 200, and monitors the system load capability in the electronic device 100. The system load capacity comprises CPU utilization rate, GPU utilization rate, DDR utilization rate, codec utilization rate, network transmission delay, image synthesis time and the like.

3. And monitoring the screen projection frame rate difference and the screen projection time delay. The difference of the screen projection frame rate is equal to the difference between the display frame rate of the display device 200 and the sampling frame rate of the electronic device 100, and the screen projection time delay is equal to the difference between the time when the display device 200 displays the screen projection content and the time when the electronic device 100 acquires the screen projection content.

4. The system load capacity in the display apparatus 200 is monitored in real time. The system load capacity includes CPU usage, GPU usage, DDR usage, codec usage, network transmission delay, and image composition time of the display apparatus 200.

5. The screen projection performance parameters and the system load capacity of the display device 200 are sent to a decision module. Among them, the system load capacity of the display device 200 includes: CPU usage, GPU usage, DDR usage, codec usage, network transmission delay, image composition time in the display device 200; the screen projection performance indexes comprise screen projection frame rate difference and screen projection time delay.

In some embodiments, the monitoring module is further configured to send the system load capability in the electronic device 100 to the decision module.

A decision module:

the function of the decision module of the electronic device 100 is shown in the embodiment of fig. 5, and the detailed description of the present application is omitted here.

In some embodiments, if the monitoring module of the electronic device 100 monitors that the system load capacity in the display device 200 is higher than the preset capacity, the monitoring module of the electronic device 100 sends a request for adjusting the screen projection parameters to a decision module in the display device 200, where the screen projection parameters are used to request the display device 200 to adjust the system load capacity or the screen projection parameters in the display device 200.

For the display device 200, a decision module to:

1. and receiving the system load and screen projection performance index of the display device 200 sent by the monitoring module.

In some embodiments, the decision module is further configured to receive the system load capability in the electronic device 100 sent by the monitoring module.

2. Determining whether the screen projection performance index meets a preset condition, if the screen projection performance index does not meet the preset condition, namely the decision module judges that the screen projection frame rate difference is larger than the preset frame rate difference and/or the screen projection time delay is larger than the preset screen projection time delay, the decision module sends a screen projection parameter adjusting request to the execution module, and the screen projection parameter adjusting request is used for requesting the display device 200 to adjust the system load capacity or the screen projection parameter in the display device 200.

Specifically, if the monitoring module monitors that the system load capacity in the display device 200 is higher than the preset capacity, the monitoring module sends a screen projection parameter adjustment request to a decision module in the display device 200, where the screen projection parameter adjustment request is used to adjust the system load capacity or screen projection parameters in the display device 200.

In some embodiments, if the monitoring module monitors that the system load capacity in the electronic device 100 is higher than the preset capacity, the monitoring module sends a request for adjusting the screen projection parameters to the monitoring module in the electronic device 100, where the request for adjusting the screen projection parameters is used to adjust the system load capacity or the screen projection parameters in the electronic device 100.

An execution module:

the function of the execution module of the electronic device 100 is shown in the embodiment of fig. 5, and is not described herein again.

In some embodiments, after the decision module in the electronic device 100 receives the request for adjusting the screen projection parameters sent by the decision module in the display device 200, the decision module in the electronic device 100 sends the request for adjusting the screen projection parameters to the execution module in the electronic device 100, and the execution module receives and responds to the request for adjusting the screen projection parameters, where the request for adjusting the screen projection parameters is used to adjust the system load capacity or the screen projection parameters in the electronic device 100.

For the display device 200, the execution modules are to:

2. And adjusting the system load capacity or screen projection parameters according to the screen projection parameter adjusting request.

In some embodiments, after the decision module in the display device 200 receives the request for adjusting the screen projection parameters sent by the decision module in the electronic device 100, the decision module in the display device 200 sends the request for adjusting the screen projection parameters to the execution module in the display device 200, and the execution module receives and responds to the request for adjusting the screen projection parameters, which is used for adjusting the system load capacity or the screen projection parameters in the display device 200.

How the electronic device 100 and the display device 200 establish a screen-casting connection will be described in detail below with reference to the UI diagram.

The electronic device 100 may establish a screen-cast connection with the display device 200 in the following manner.

Fig. 7A to 7D are UI diagrams exemplarily illustrating user operations for turning on the cooperative screen projection function, which are monitored by the electronic device 100.

Fig. 7A illustrates an exemplary video playback user interface 40 on the electronic device 100. The user interface 40 displays: the video title (brave stride), the video playing progress (1 st episode), the video playing time (4 minutes and 13 seconds), the total video time (7 minutes and 33 seconds), the popularity of the video (5946), the total episode number of the video (23 episodes full), more video icons, and more images corresponding to the video.

As shown in fig. 7A and 7B, when the electronic device 100 monitors a downward sliding gesture on the display screen, the electronic device 100 displays a window 401 on the user interface 40 in response to the sliding gesture. As shown in fig. 7B, a control 402 may be displayed in the window 401, and the control 402 may receive an operation (e.g., a touch operation, a click operation) of turning on/off the cooperative screen projection function of the electronic device 100. The representation of control 402 may include an icon and/or text (e.g., the text "screen shot"). Other functions such as Wi-Fi, bluetooth, flashlight, ringing, automatic rotation, instant sharing, flight mode, mobile data, position information, screen capture, eye protection mode, hot spot, screen recording, NFC, and other switch controls may also be displayed in the window 401, that is, a user operation for turning on the cooperative screen projection function is monitored. In some embodiments, after the electronic device 100 monitors the user operation on the control 402, the display form of the control 402 may be changed, for example, a shadow when the control 402 is displayed is increased.

Not limited to the video playback user interface 40 shown in fig. 7A, the user may also enter a slide-down gesture on another interface, triggering the electronic device 100 to display the window 401.

The user operation of the user on the control 402 in the window 401 shown in fig. 7A and 7B is not limited, in this embodiment of the present application, the user operation of starting the collaborative screen projection function may also be implemented in other forms, and this embodiment of the present application is not limited.

For example, the electronic device 100 may further display a setting interface provided by a settings (settings) application, and the setting interface may include a control provided for a user to turn on/off the collaborative screen projection function of the electronic device 100, and the user may turn on the collaborative screen projection function of the electronic device 100 by inputting a user operation on the control.

When the user operation of starting the cooperative screen projection function is monitored, the electronic device 100 discovers screen projectable electronic devices near the electronic device 100 through one or more of Wi-Fi P2P, wireless local area network, bluetooth and NFC. For example, the electronic device 100 may discover nearby display devices 200 and other electronic devices through Wi-Fi P2P.

Besides displaying the identifier of the electronic device found by the electronic device 100 to be acceptable for cooperative screen projection, the electronic device 100 may also display other information, such as an image of the found electronic device, and the like.

Thereafter, illustratively, as shown in FIG. 7C, a pop-up window 403 is displayed on the electronic device 100. The window 403 includes: interface indicator 404, icon 405, image 406 of one or more display devices, and identification 407.

Illustratively, as shown in fig. 7C, the user operation to select the display apparatus 200 may be a user operation acting on the image 406 and/or the logo 407 corresponding to the display apparatus 200. The user operation for selecting the display device 200 may also be implemented in other forms, and the embodiment of the present application is not limited.

In response to the user operation, the electronic apparatus 100 may establish a communication connection with the display apparatus 200 through a wireless communication technology such as Wi-Fi P2P, wireless lan, or the like. For example, the electronic device 100 and the display device 200 establish a Wi-Fi P2P communication connection. After the electronic device 100 and the display device 200 establish a communication connection, the electronic device 100 transmits the content displayed in real time to the display device 200.

Specifically, the electronic device 100 may obtain currently displayed multimedia content (including images or images and audio) by means of screen recording, sound recording, or the like, and then transmit the obtained content to the display device 200 through a communication connection with the display device 200 after compressing the content. Taking the example that the electronic device 100 and the display device 200 share multimedia content based on miracast as an example, the electronic device 100 may obtain an image displayed on a display screen in a screen recording manner according to the provisions in the miracast protocol, and compress the image by using an h.264 encoding algorithm; collecting audio played by the electronic device 100, and compressing the audio using an Advanced Audio Coding (AAC) algorithm; then, the compressed audio data and image data are encapsulated into a Transport Stream (TS), and then the TS stream is encoded according to a real-time transport protocol (RTP) and the encoded data is sent to the display device 200 through the Wi-Fi direct connection. That is, the multimedia content is transmitted by way of streaming media.

As shown in fig. 7D, the electronic device 100 transmits the currently displayed multimedia content (including images and/or audio) to the display device 200, and the display device 200 receives the currently displayed multimedia content (including images and/or audio) transmitted by the electronic device 100 and displays the same on the display screen of the display device 200.

After receiving the multimedia content transmitted by the electronic device 100 based on the communication connection, the display device 200 may perform a decoding process on the multimedia content, thereby acquiring the multimedia content. Taking the example that the electronic device 100 and the display device 200 share multimedia content based on miracast as an example, the display device 200 may receive a TS stream encoded by RTP based on a Wi-Fi direct communication connection with the electronic device 100, may sequentially perform RTP decoding, TS stream decapsulation, audio-video quality processing/delay synchronization processing on the TS stream, and finally output audio and video, that is, play multimedia content.

It should be noted that, the above is only an exemplary example of a manner in which the electronic device 100 establishes the screen-projection connection with the display device 200, and the electronic device 100 may also establish the screen-projection connection with the display device 200 in other manners, and the application itself is not limited herein.

After the electronic device 100 establishes the screen-projecting connection with the display device 200, the electronic device 100 performs negotiation of display parameters with the display device 200, where the display parameters include a coding format, a screen resolution, an audio format, a sampling frame rate, a code rate for data transmission, and the like supported by both sides, so as to facilitate transmission of screen-projecting content performed subsequently.

As shown in fig. 8, fig. 8 illustrates a process in which the electronic device 100 negotiates display parameters with the display device 200.

S801, the electronic device 100 and the display device 200 establish screen projection connection.

Please refer to the embodiment shown in fig. 7A-7D for the process of establishing the connection between the electronic device 100 and the display device 200, which is not described herein again.

S802, the electronic device 100 receives the first display parameter sent by the display device 200, wherein the first display parameter comprises a display frame rate and a screen resolution supported by the display device 200.

The display frame rate is the number of image frames that the display apparatus 200 can display in a fixed time (e.g., 1 s). Illustratively, the display frame rates supported by the display apparatus 200 may include 60Hz, 70Hz, 90Hz, 100Hz, 120Hz, and so on. The higher the display frame rate of the display apparatus 200 is, the smoother the screen displayed by the display apparatus 200 is.

The screen resolution is the number of pixels displayed in the horizontal direction and the horizontal direction by the display device 200. Illustratively, the screen resolution is 150 × 128, which means that the horizontal direction has 150 pixels and the vertical direction has 128 pixels. The higher the screen resolution, the higher the sharpness of the image displayed by the display device 200. The screen resolution is the resolution of the displayed image that the display device 200 can support, and the screen resolution reflects the ability of the display device 200 to support the resolution. It should be noted that the screen resolution is an inherent attribute of the display device 200, and the type of resolution supported by the display device 200 is determined by the hardware condition of the display device 00 and is generally not variable. Illustratively, the screen resolution supported by the display device 200 may be one or more of 1080P,720P and 540P.

The screen resolution is related to the type of a Central Processing Unit (CPU) of the display device 200, the type of a WiFi chip, the size of a memory, and the type of a channel between the electronic device 100 and the display device 200.

When the CPU is a high-performance CPU, the WiFi chip is a high-performance WiFi chip, the capacity of the memory is greater than the preset capacity, and the channel type between the electronic device 100 and the display device 200 is any one or more of 5G channels, the display device 200 supports a screen resolution of 1080P.

Illustratively, as shown in table 1, table 1 exemplarily shows an example that the display device 200 determines the screen resolution supported by the display device 200 according to the CPU type, the WiFi chip type, the memory size, and the channel type.

TABLE 1

As shown in table 1, the display device 200 may support a screen resolution of 1080P only when the CPU of the display device 200 is of any type 980/985/990/9A0, the WiFi chip of the display device 200 is of any type 1103/1105, the memory of the display device 200 is of any type 6G/8G, and the data channel established between the display device 200 and the electronic device 100 is a 5G channel. When the type of the CPU of the display device 200 does not belong to any one of 980/985/990/9A0, for example, the type of the CPU of the display device 200 belongs to any one of 710/810/970, the display device 200 supports only a screen resolution of 540P regardless of the type of the WiFi chip of the display device 200, the memory size, and the type of the data channel established with the electronic device 100. When the type of the WiFi chip of the display device 200 does not belong to any one of 1103/1105, for example, the type of the WiFi chip of the display device 200 belongs to any one of 1102/1102A, the display device 200 supports only a screen resolution of 540P regardless of the CPU type, the memory size, and the data channel type established with the electronic device 100 of the display device 200. When the memory size of the display device 200 does not belong to any of 6G/8G, for example, the memory size of the display device 200 belongs to any of 3G/4G, the display device 200 supports only a screen resolution of 540P regardless of the CPU type of the display device 200, the WiFi chip type, and the data channel type established with the electronic device 100. When the type of the data channel established between the display device 200 and the electronic device 100 does not belong to 5G, for example, when the type of the data channel established between the display device 200 and the electronic device 100 is 2.4G, the display device 200 only supports a screen resolution of 540P regardless of the CPU type of the display device 200, the type of the WiFi chip, and the memory of the display device 200.

Illustratively, if the screen resolutions supported by the display device 200 are 540P and 1080P, the display device 200 transmits the values of the supported screen resolutions to the electronic device 100.

The first display parameter further includes other parameters, such as a coding type, and the like, which are not limited herein.

The encoding type includes a speech encoding type and an image stream encoding type. Illustratively, the image stream coding type includes any one of: XVid, AVC/H.264, MPEG1, MPEG2; the speech coding type includes any one of: MP3, AAC. It should be noted that the image stream coding type and the voice coding type may be other types, and the present application is not limited herein.

And S803, the electronic device 100 obtains screen projection parameters according to the second display parameter and the first display parameter, wherein the screen projection parameters comprise screen projection code rate, sampling frame rate and screen projection resolution.

The display parameters include a display frame rate and a screen resolution supported by the electronic device 100.

The display frame rate is the number of image frames that the electronic device 100 can display in a fixed time (e.g., 1 s). Illustratively, the display frame rates supported by the electronic device 100 may include 60Hz, 70Hz, 90Hz, 100Hz, 120Hz, and so on. The higher the display frame rate of the electronic apparatus 100 is, the smoother the screen displayed by the electronic apparatus 100 is.

The screen projection resolution is variable in real time, and the screen projection resolution reflects the display state of the screen projection content in the electronic device 100. That is, the electronic apparatus 100 may change the resolution of the projected content according to the network condition, the load condition of the hardware, and the like. For example, if the electronic device 100 and the display device 200 both support screen resolutions of 1080P and 540P, and the current screen projection resolution is 1080P, when the network condition is poor or the load of hardware is high, the electronic device 100 may reduce the screen projection resolution between the electronic device 100 and the display device 200 to 540P. For the same size of the electronic device 100 or the display device 200, the higher the projection resolution is for the same projection content, the more the number of pixels of each frame of image displayed by the electronic device 100 or the display device 200 is.

The screen resolution is related to the types of a Central Processing Unit (CPU), a Graphic Processing Unit (GPU) and a WiFi chip of the electronic device 100.

As shown in table 2, table 2 exemplarily shows that the electronic device 100 determines the screen resolution supported by the display device 200 according to the CPU type, the WiFi chip type, the memory size, and the channel type.

When the CPU is a high-performance CPU, the WiFi chip is a high-performance WiFi chip, the capacity of the memory is greater than the preset capacity, and the channel type between the electronic device 100 and the display device 200 is any one or more of 5G channels, the electronic device 100 supports the screen resolution of 1080P.

Illustratively, as shown in table 2, table 2 exemplarily shows an example that the electronic device 100 determines the screen resolution supported by the electronic device 100 according to the CPU type, the WiFi chip type, the memory size, and the channel type.

TABLE 2

As shown in table 2, the display device 200 may support a screen resolution of 1080P only when the CPU of the display device 200 is of any type 980/985/990/9A0, the WiFi chip of the display device 200 is of any type BCM43596/1103/1105, the memory of the display device 200 is of any type 6G/8G/12G, and the data channel established between the display device 200 and the electronic device 100 is a 5G channel. When the type of the CPU of the display device 200 does not belong to any one of 980/985/990/9A0, for example, the type of the CPU of the display device 200 belongs to any one of 710/810/820/970, the display device 200 supports only a screen resolution of 540P regardless of the type of the WiFi chip of the display device 200, the memory size, and the type of the data channel established with the electronic device 100. When the type of the WiFi chip of the display device 200 does not belong to any of BCM43596/1103/1105, for example, the type of the WiFi chip of the display device 200 belongs to any of 1102/1102A, the display device 200 supports only a screen resolution of 540P regardless of the CPU type, memory size, and data channel type established with the electronic device 100 of the display device 200. When the memory size of the display device 200 does not belong to any one of 6G/8G/12G, for example, the memory size of the display device 200 belongs to any one of 3G/4G, the display device 200 supports only a screen resolution of 540P regardless of the CPU type of the display device 200, the type of the WiFi chip, and the type of the data channel established with the electronic device 100. When the type of the data channel established between the display device 200 and the electronic device 100 does not belong to 5G, for example, when the type of the data channel established between the display device 200 and the electronic device 100 is 2.4G, the display device 200 only supports a screen resolution of 540P regardless of the CPU type of the display device 200, the type of the WiFi chip, and the memory of the display device 200.

The electronic equipment 100 receives the numerical value of the screen resolution sent by the display equipment 200, determines the numerical value of the screen resolution shared by the electronic equipment 100 and the display equipment 200, and determines the numerical value of the screen projection resolution from the numerical value of the shared screen resolution; if the value of the screen resolution shared by the electronic device 100 and the display device 200 includes only one value, the one value is the screen projection resolution of the data transmitted by the electronic device 100 and the display device 200; if the value of the resolution shared by the electronic device 100 and the display device 200 is greater than one value, the electronic device 100 needs to determine one value from the more than one value as the screen projection resolution of the data transmitted by the electronic device 100 and the display device 200. In a possible embodiment, the electronic device 100 determines, from the plurality of screen resolution values, a screen projection resolution with a highest resolution value, which is used for data transmission between the electronic device 100 and the display device 200. Thus, the images displayed by the electronic device 100 and the display device 200 are clearer.

Illustratively, when the screen resolutions supported by the electronic device 100 are 540P and 1080P, and the screen resolutions supported by the display device 200 are also 540P and 1080P. The screen resolutions supported by the electronic device 100 and the display device 200 are 540P and 1080P in numerical values. The electronic device 100 can perform data transmission with the display device 200 at any resolution of 540P and 1080P. In a possible embodiment, when the values of the screen resolutions supported by the electronic device 100 and the display device 200 are 540P and 1080P, the electronic device 100 preferentially adopts the resolution of 1080P (screen projection resolution) to perform data transmission with the display device 200. Thus, the images displayed by the electronic device 100 and the display device 200 are clearer.

Illustratively, when the value of the screen resolution supported by the display device 200 is 540P, and the screen resolution supported by the display device 200 is also 540P, the electronic device 100 determines 540P (screen projection resolution) as the resolution at which the electronic device 100 and the display device 200 transmit data.

In some embodiments, the display device 200 may also transmit the CPU type, the WiFi chip type, the memory size, and the channel type of the display device 200 to the electronic device 100, and the electronic device 100 determines the value of the screen resolution supported by the display device 200. Then, the electronic device 100 determines the value of the screen resolution supported by both the display device 200 and the electronic device 100 according to the value of the screen resolution supported by both the display device and the electronic device. Specifically, please refer to the above embodiments, and details of the method for determining, by the electronic device 100, the numerical value of the screen resolution supported by the display device 200 are not repeated herein.

In addition, the code rate is related to the projection resolution. When the screen projection resolution is 1080P, the code rate range is 3M-10M; when the screen projection resolution is 540P, the code rate range is 1M-5M;

that is, after the electronic device 100 and the display device 200 determine the screen projection resolution, the range of the screen projection code rate is defined in the screen projection resolution, and the electronic device 100 adopts the highest code rate corresponding to the screen projection resolution as the screen projection code rate.

For example, after the electronic device 100 and the display device 200 determine that the screen projection resolution is 1080P, the electronic device 100 adopts a code rate of 10M as the screen projection code rate; after the electronic device 100 and the display device 200 determine that the screen projection resolution is 540P, the electronic device 100 adopts a code rate of 5M as the screen projection code rate.

The electronic device 100 receives the value of the display frame rate sent by the display device 200, and determines the value of the display frame rate shared by the electronic device 100 and the display device 200; if the value of the display frame rate shared by the electronic device 100 and the display device 200 includes only one value, the one value is the sampling frame rate of the data transmitted by the electronic device 100 and the display device 200; if the value of the display frame rate shared by the electronic device 100 and the display device 200 is greater than a value, the electronic device 100 needs to determine a value from the value and the value as the sampling frame rate of the data transmitted by the electronic device 100 and the display device 200. In a possible embodiment, the electronic device 100 determines, from the plurality of display frame rate values, the highest display frame rate value as the sampling frame rate at which the electronic device 100 and the display device 200 transmit data. Thus, the images displayed by the electronic device 100 and the display device 200 are clearer.

Illustratively, when the display frame rates supported by the electronic device 100 are 60Hz, 70Hz, 90Hz, 100Hz, and 120Hz, and the display frame rates supported by the display device 200 are also 60Hz, 70Hz, 90Hz, 100Hz, and 120Hz. The values of the display frame rates supported by the electronic apparatus 100 and the display apparatus 200 are 60Hz, 70Hz, 90Hz, 100Hz, and 120Hz. The electronic device 100 may perform data transmission with the display device 200 using any one of display frame rates of 60Hz, 70Hz, 90Hz, 100Hz, and 120Hz. In a possible embodiment, when the display frame rates supported by the electronic device 100 and the display device 200 are 60Hz, 70Hz, 90Hz, 100Hz, and 120Hz, the electronic device 100 preferentially uses the display frame rate of 120Hz as the sampling frame rate for data transmission with the display device 200. Thus, the images displayed by the electronic device 100 and the display device 200 can be smoother.

For example, when the value of the display frame rate supported by the display apparatus 200 is 90hz, and the value of the display frame rate supported by the display apparatus 200 is 90hz, the electronic apparatus 100 determines that 90hz is the sampling frame rate at which the electronic apparatus 100 and the display apparatus 200 transmit data.

In some embodiments, the screen projection parameters include a screen projection coding type in addition to a screen projection code rate, a sampling frame rate, and a screen projection resolution, and the screen projection parameters may also include other parameters, which are not described herein one by one.

S804, the electronic device 100 sends the screen projection parameters to the display device 200.

The screen projection parameters comprise screen projection code rate, sampling frame rate and screen projection resolution. The projection parameters may also include a projection coding type.

In response to the transmitted screen projection parameters, the display apparatus 200 receives the screen projection parameters transmitted by the electronic apparatus 100.

And S805, the electronic device 100 acquires the first screen projection content, and processes the first screen projection content according to the screen projection parameters to obtain screen projection data.

S806, the electronic device 100 sends the screen projection data to the display device 200.

The electronic device 100 may obtain the first screen projection content through screen recording and/or sound recording, and process the first screen projection content according to the screen projection parameters to obtain screen projection data processed by the screen projection parameters.

The electronic apparatus 100 compresses the screen projection data, and then transmits the screen projection data to the display apparatus 200.

S807, the display device 200 displays the first screen projection content based on the screen projection data and the screen projection parameters.

In response to the screen projection data sent by the electronic device 100, the display device 200 receives the screen projection data, decodes the screen projection data in sequence, and performs audio-visual quality processing to obtain a first screen projection content, and then the display device 200 displays the first screen projection content. As shown in fig. 7D, fig. 7D is a schematic diagram of the display device 200 displaying the first screen shot content.

After the electronic device 100 sends the screen projection content to the display device 200, the monitoring module, the decision module, and the execution module in the electronic device 100 and the display device 200 adjust the operating frequency and the screen projection parameters of the hardware based on the system load capacity and the screen projection performance parameters, so that the screen projection performance parameters reach preset conditions to improve the screen projection effect.

Next, a detailed description will be given of how the decision modules in the electronic device 100 and the display device 200 send requests for adjusting screen projection parameters to the execution module according to the system load capacity, and how the execution module adjusts the system load capacity or the screen projection parameters according to the requests for adjusting screen projection parameters.

In the embodiment of the application, when the electronic device 100 or the display device 200 monitors that the screen projection performance parameter does not satisfy the preset condition, that is, the screen projection effect is not good, the electronic device 100 or the display device 200 detects the reason causing the screen projection effect to be not good, and after the specific reason is determined, the electronic device 100 or the display device 200 adjusts the system load capacity or the screen projection parameter so that the screen projection performance parameter satisfies the preset condition, so as to improve the screen projection effect.

At present, if the screen projection effect is not good at this time, for example, if the frame rate difference between the sampling frame rate of the electronic device 100 and the display frame rate of the display device 200 monitored by the electronic device 100 is greater than the preset frame rate difference, or the screen projection time delay between the electronic device 100 and the display device 200 is greater than the preset time delay, the electronic device 100 will monitor whether the network state is normal. If the electronic device 100 monitors that the screen projection effect is poor due to too high network load, the electronic device 100 reduces the code rate of data transmission to improve the screen projection effect.

If the electronic device 100 monitors that the screen projection effect is not poor due to the network problem, the electronic device 100 and the display device 200 cannot improve the screen projection effect of the electronic device 100 by other means besides reducing the code rate. Therefore, the embodiment of the present application provides a screen projection method, where the electronic device 100 and the display device 200 adjust the system load capacity or the screen projection parameters by using a screen projection effect hierarchical adjustment strategy, so that the screen projection performance parameters meet the preset conditions, and the screen projection effect hierarchical adjustment strategy adjusts the screen projection effect hierarchical adjustment strategy with the target that the degree of affecting the user experience is from low to high, so as to reduce the influence on the user experience when the electronic device 100 or the display device 200 adjusts the system load capacity or the screen projection parameters. By adopting the method, on one hand, the electronic device 100 or the display device 200 can determine the reason for influencing the screen projection effect, and adopt the corresponding strategy to improve the screen projection effect; on the other hand, a screen projection effect grading adjustment strategy is adopted, factors influencing user experience are considered, and adjustment is carried out with the aim of reducing influence of the user.

Fig. 9-fig. 14 exemplarily show several strategies for adjusting the screen projection effect in stages, where the electronic device 100 or the display device 200 sequentially determines which strategy is adopted to improve the screen projection effect, and when the electronic device 100 or the display device 200 adjusts the system load capacity or the screen projection parameters so that the screen projection performance parameters meet the preset conditions, the electronic device 100 or the display device 200 stops adjusting the system load capacity or the screen projection parameters; after the electronic device 100 or the display device 200 adjusts the system load capacity or the screen projection parameter, whether the screen projection performance parameter does not meet the preset condition or not, the electronic device 100 or the display device 200 will continuously determine which strategy to adopt to improve the screen projection effect by adopting a polling mechanism until the screen projection performance parameter meets the preset condition.

It should be noted that fig. 9-fig. 14 only exemplarily show a part of the screen projection effect adjustment strategies, and further, the embodiment of the present application may further include more screen projection effect adjustment strategies, which is not limited herein.

Also, the execution sequence of several screen-projection effect adjustment strategies exemplarily shown in fig. 9-14 is not limited herein.

Next, the strategy of the hierarchical adjustment of the screen projection effect will be described in detail.

Screen projection effect adjusting strategy one

First, as shown in fig. 9-10, a flowchart of a method of a first screen-casting effect adjustment strategy is exemplarily shown. The screen-projection effect adjustment strategy-adjusts the operating frequency of hardware in the electronic device 100 or the display device 200. When the screen projection delay is greater than the preset delay and/or the screen projection frame rate difference is greater than the preset frame rate difference, and the electronic device 100 determines that the hardware load of the electronic device 100 is high, or the display device 200 determines that the hardware load of the display device 200 is high, and when the operating frequency of hardware in the electronic device 100 or the display device 200 is adjusted, the screen projection parameters of the electronic device 100 and the display device 200 are not changed, so that the operating frequency of the hardware is adjusted to enable the screen projection performance parameters to meet the preset conditions without affecting user experience. The hardware includes a CPU, a GPU, a DDR, a Codec, and the like.

Since the screen projection parameter is not adjusted as soon as the screen projection effect adjustment strategy is adopted, the screen projection parameter is not changed after the electronic device 100 or the display device 200 adjusts the operating frequency of the hardware. The screen projection parameters obtained by negotiation when the electronic device 100 establishes the screen projection connection with the display device 200 include a screen projection code rate, a sampling frame rate, and a screen projection resolution. Illustratively, the screen projection rate is a first rate (e.g., 10M), the sampling frame rate is a first sampling frame rate (e.g., 60 hz), and the screen projection resolution is a first screen projection resolution (e.g., 1080P). After the electronic device 100 or the display device 200 adjusts the operating frequency of the hardware, the screen projection rate is still the first rate (e.g., 10M), the sampling frame rate is still the first sampling frame rate (e.g., 60 hz), and the screen projection resolution is still the first screen projection resolution (e.g., 1080P).

Fig. 9 exemplarily shows a schematic diagram of the electronic device 100 adjusting an operating frequency of hardware of the electronic device 100.

The electronic device 100 monitors screen projection performance parameters, which include a screen projection frame rate difference and a screen projection time delay. When the electronic device 100 determines that the screen-casting frame rate difference is greater than the preset frame rate difference and/or the screen-casting time delay is greater than the preset time delay, the electronic device 100 determines whether the screen-casting performance parameter caused by the high hardware load in the electronic device 100 does not satisfy the preset condition, and if the screen-casting performance parameter caused by the high hardware load in the electronic device 100 does not satisfy the preset condition, the electronic device 100 increases the operating frequency of the hardware and monitors whether the screen-casting performance parameter satisfies the preset condition. If the operating frequency of the hardware has been increased to the preset value, but the screen projection performance parameter still does not meet the preset condition, the electronic device 100 executes a second screen projection effect adjustment strategy.

The electronic device 100 can increase the operating frequency of the hardware by the following formula one and formula two:

p2= P1 (1 + cast _cost) formula one

cast _ cost = (delay-delay _ base)/delay _ base 0.5+ fps_diff/fps _ base 0.5 formula two

As shown by the formula I, P2 represents the working frequency after hardware frequency boosting, P1 represents the working frequency before hardware frequency boosting, cast _ cost represents the screen projection performance parameter normalization index, and 1+ cast_cost represents the frequency boosting.

As shown in the formula two, delay represents the screen projection delay, and the screen projection delay is measured by the electronic device 100 in real time. delay _ base represents a screen projection reference delay, the screen projection reference delay is a preset value, and a common screen projection reference delay is 50ms or 100ms. fps _ diff represents the screen-cast frame rate difference, which is measured by the electronic device 100 in real time. fps _ base represents a screen projection reference frame rate difference which is a preset value, and the general screen projection reference time delay is 60hz. The value range of cast _ cost is 0-1.

To avoid power consumption and heat generation problems, the frequency of the boost is less than a predetermined boost frequency (e.g., 1.25).

Specifically, as shown in fig. 9, the electronic device 100 monitors a screen projection frame rate difference and a screen projection delay, and if the screen projection frame rate difference is greater than a preset frame rate difference and/or the screen projection delay is greater than a preset delay, the electronic device 100 determines that a hardware load in the electronic device 100 is high, where the hardware load is high and includes: the utilization rate of the CPU of the electronic device 100 is greater than a preset value and/or the utilization rate of the GPU of the electronic device 100 is greater than a preset value and/or the utilization rate of the DDR of the electronic device 100 is greater than a preset value and/or the utilization rate of the Codec of the electronic device 100 is greater than a preset value. Then, the electronic device 100 obtains the frequency raising rate according to the formula two based on the screen-projecting time delay and the screen-projecting frame rate difference, and then, when the usage rate of the CPU is greater than the preset value, the electronic device 100 may raise the operating frequency of the CPU from the frequency one to the frequency two (the first value or the second value) according to the formula one, and/or when the usage rate of the GPU is greater than the preset value, the electronic device 100 may raise the operating frequency of the GPU from the frequency three to the frequency four (the first value or the second value) according to the formula one, and/or when the usage rate of the DDR is greater than the preset value, the electronic device 100 may raise the operating frequency of the DDR from the frequency five to the frequency six (the first value or the second value) according to the formula one, and/or when the usage rate of the Codec is greater than the preset value, the electronic device 100 may raise the operating frequency of the Codec from the frequency seven to the frequency eight (the first value or the second value).

It should be noted that frequency two, frequency four, frequency six, and frequency eight are greater than the first threshold or the second threshold. After the electronic device 100 increases the operating frequency of the hardware, the electronic device 100 continues to monitor the screen projection delay and the screen projection frame rate difference.

Then, the electronic device 100 continues to monitor whether the difference of the screen-casting frame rates is smaller than the preset frame rate difference and the screen-casting time delay is smaller than the preset time delay. If the screen-projecting frame rate difference is smaller than the preset frame rate difference and the screen-projecting time delay is smaller than the preset time delay, the electronic device 100 increases the operating frequency of the hardware, and then improves the screen-projecting effect. Thereafter, the electronic device 100 will not perform the subsequent method steps.

If the screen-projecting frame rate difference is greater than the preset frame rate difference and/or the screen-projecting time delay is greater than the preset time delay, the electronic device 100 determines whether the frequency of the hardware is less than the preset frequency, and if the frequency is less than the preset frequency (a third threshold or a fourth threshold), the electronic device 100 continues to determine which hardware has a high load and increases the operating frequency of the corresponding hardware. Illustratively, the electronic device 100 sets the operating frequency of the CPU to a frequency m (a third value or a fourth value), where the frequency m is greater than the first threshold or the second threshold and not less than a preset frequency. Until the frequency is higher than the preset frequency, the electronic device 100 does not adjust the operating frequency of the hardware any more to avoid the problems of power consumption and heat generation, and executes a second screen projection effect adjustment strategy.

Fig. 10 exemplarily shows a schematic diagram in which the display apparatus 200 adjusts an operating frequency of hardware of the display apparatus 200.

The display device 200 monitors screen projection performance parameters, which include a screen projection frame rate difference and a screen projection time delay. When the display device 200 determines that the screen-casting frame rate difference is greater than the preset frame rate difference and/or the screen-casting time delay is greater than the preset time delay, the display device 200 determines whether the screen-casting performance parameter caused by the high hardware load in the display device 200 does not satisfy the preset condition, if the screen-casting performance parameter caused by the high hardware load in the display device 200 does not satisfy the preset condition, the display device 200 increases the operating frequency of the hardware, and then monitors whether the screen-casting performance parameter satisfies the preset condition. If the frequency of the hardware has been increased to the preset value, but the screen projection performance parameter still does not meet the preset condition, the display device 200 executes a second screen projection effect adjustment strategy.

The display device 200 may improve the operating frequency of the hardware by using a formula one and a formula two, and reference may be made to the embodiment shown in fig. 9 for the description of the formula one and the formula two, which is not described herein again.

Specifically, as shown in fig. 10, the display device 200 monitors a screen projection frame rate difference and a screen projection delay, and if the screen projection frame rate difference is greater than a preset frame rate difference and/or the screen projection delay is greater than a preset delay, the display device 200 determines that a hardware load in the display device 200 is high, where the hardware load is high and includes: the utilization rate of the CPU of the display device 200 is greater than a preset value, and/or the utilization rate of the GPU of the display device 200 is greater than a preset value, and/or the utilization rate of the DDR of the display device 200 is greater than a preset value, and/or the utilization rate of the Codec of the display device 200 is greater than a preset value. Then, the display device 200 obtains the frequency raising rate according to the formula two based on the screen projecting time delay and the screen projecting frame rate difference, and then, when the usage rate of the CPU is greater than the preset value, the display device 200 may raise the operating frequency of the CPU from the frequency nine to the frequency ten (the first value or the second value) according to the formula one, and/or when the usage rate of the GPU is greater than the preset value, the display device 200 may raise the operating frequency of the GPU from the frequency eleven to the frequency twelve (the first value or the second value) according to the formula one, and/or when the usage rate of the DDR is greater than the preset value, the display device 200 may raise the operating frequency of the DDR from the frequency thirteen to the frequency fourteen (the first value or the second value) according to the formula one, and/or when the usage rate of the Codec is greater than the preset value, the display device 200 may raise the operating frequency of the Codec from the frequency fifteen to the frequency sixteen (the first value or the second value) according to the formula one.

It should be noted that frequency ten, frequency twelve, frequency fourteen and frequency sixteen are greater than the first threshold or the second threshold. After the display device 200 increases the operating frequency of the hardware, the display device 200 continues to monitor the screen projection delay and the screen projection frame rate difference.

Then, the display device 200 determines whether the difference of the screen-casting frame rates is smaller than the preset frame rate difference and the screen-casting time delay is smaller than the preset time delay. If the screen projecting frame rate difference is smaller than the preset frame rate difference and the screen projecting time delay is smaller than the preset time delay, the display device 200 improves the working frequency of the hardware, and then the screen projecting effect is improved. Thereafter, the display device 200 will not perform the subsequent method steps.

If the screen-projecting frame rate difference is greater than the preset frame rate difference and/or the screen-projecting time delay is greater than the preset time delay, the display device 200 determines whether the frequency of the hardware is less than the preset frequency, and if the frequency is less than the preset frequency (a third threshold or a fourth threshold), the display device 200 continues to determine which hardware has a high load and increases the operating frequency of the corresponding hardware. Illustratively, the electronic device 100 sets the operating frequency of the CPU to a frequency m (a third value or a fourth value), where the frequency m is greater than the first threshold or the second threshold and not less than a preset frequency. Until the frequency is higher than the preset frequency, the display device 200 does not adjust the operating frequency of the hardware any more to avoid the problems of power consumption and heat generation, and executes a second screen projection effect adjustment strategy.

Screen projection effect adjusting strategy II

When the frequency of the working frequency of the hardware of the electronic device 100 or the display device 200 reaches the preset frequency, the screen projecting frame rate difference is still larger than the preset frame rate difference and/or the screen projecting time delay is larger than the preset time delay; alternatively, if the hardware load in the electronic device 100 is not high and the hardware load in the display device 200 is not high, the screen projection effect is not poor due to the problem of the hardware load. The electronic device 100 will execute the screen projection effect adjustment strategy two.

The screen projection effect adjustment strategy two adjusts the screen projection code rate between the electronic device 100 and the display device 200. And the screen projection effect adjustment strategy II is adopted, so that the screen projection code rate between the electronic equipment 100 and the display equipment 200 is reduced. Compared with the screen projection effect adjusting strategy I, the screen projection effect adjusting strategy II slightly influences the experience of the user.

Specifically, as shown in fig. 11, fig. 11 exemplarily shows a schematic diagram of the electronic device 100 adjusting a screen projection rate between the electronic device 100 and the display device 200.

First, the electronic device 100 monitors screen projection performance parameters, which include a screen projection frame rate difference and a screen projection delay. When the electronic device 100 determines that the screen-casting frame rate difference is greater than the preset frame rate difference and/or the screen-casting delay is greater than the preset delay, the electronic device 100 calculates the data transmission delay between the electronic device 100 and the display device 200. When the data transmission delay is greater than the preset value, the screen projection effect may be poor due to too high network load. The electronic device 100 will reduce the screen-projecting code rate, so that the screen-projecting frame rate difference is smaller than the preset frame rate difference and the screen-projecting time delay is smaller than the preset time delay. When the data transmission delay is smaller than the preset value, the network load is not high at this time, and the electronic device 100 determines that the screen projection effect is poor due to no network problem. The electronic device 100 directly executes the screen projection effect adjustment strategy three.

When the data transmission delay is greater than the preset value, the electronic device 100 may adopt the following formula three to reduce the screen projection code rate:

r = R1- (R1-R2) cast _ cost formula III

And as shown in the formula III, R is the screen projection code rate after adjustment, and the value range of R is between R2 and R1. R1 is a real-time screen projection rate between the electronic device 100 and the display device 200, R2 is a lowest screen projection rate, and cast _ cost represents a screen projection performance parameter normalization index. For the calculation method of cast _ cost, reference may be made to formula two, which is not described herein again.

Illustratively, when the projection resolution is 1080P, the range of the projection screen code rate is 3M-R1, R1 is less than or equal to 10M, and R2 is 3M, and the value range of R is 3M-R1.

When the screen projection resolution is 540P, the range of the screen projection code rate is 1M-R1, R1 is less than or equal to 5M, and R2 is 1M, then the value range of R is 1M-R1.

After the electronic device 100 reduces the screen-projection code rate from the first code rate to the second code rate (the first value or the second value) according to the formula three, the first value or the second value is greater than the first threshold or the second threshold. The electronic device 100 continues to monitor whether the difference of the screen-casting frame rates is smaller than the preset frame rate difference and the screen-casting time delay is smaller than the preset time delay. If the screen-projecting frame rate difference is smaller than the preset frame rate difference and the screen-projecting time delay is smaller than the preset time delay, the electronic device 100 reduces the screen-projecting code rate and improves the screen-projecting effect. Thereafter, the electronic device 100 will not perform the subsequent method steps.

If the screen-casting frame rate difference is still greater than the preset frame rate difference and/or the screen-casting delay is greater than the preset delay, the electronic device 100 determines whether the adjusted screen-casting code rate (e.g., code rate two) is less than the lowest screen-casting code rate (third threshold or fourth threshold), if the adjusted screen-casting code rate (e.g., code rate two) is less than the lowest screen-casting code rate, and determines whether the data transmission delay between the electronic device 100 and the display device 200 is greater than the preset value, if so, the electronic device 100 continues to reduce the screen-casting code rate (e.g., code rate two) between the electronic device 100 and the display device 200 to code rate three (third value or fourth value), the code rate three is greater than the first threshold or the second threshold, and after not less than the third threshold or the fourth threshold, the electronic device 100 will not adjust the code rate any more, and execute the screen-casting effect adjustment policy three.

The electronic device 100 determines that the data transmission delay between the electronic device 100 and the display device 200 is greater than the preset delay, and after the electronic device 100 adjusts the screen projection code rate according to the screen projection effect adjustment policy two, the sampling frame rate and the screen projection resolution are not changed, so that the sampling frame rate is still the first sampling frame rate (for example, 60 hz), the screen projection resolution is still the first screen projection resolution (for example, 1080P), the screen projection code rate is the second screen projection code rate, and the second screen projection code rate is greater than or equal to the lowest screen projection code rate and is less than the first screen projection code rate. For example, if the first screen projection resolution is 1080P, the second screen projection rate is greater than or equal to 3M and smaller than the first screen projection rate (e.g., 10M). If the first screen projection resolution is 540P, the second screen projection rate is greater than or equal to 1M and smaller than the first screen projection rate (for example, 5M).

Or, if the electronic device 100 determines that the data transmission delay between the electronic device 100 and the display device 200 is smaller than the preset delay, the network load is not high at this time, and the electronic device 100 determines that the screen projection effect is poor due to no network problem. The electronic device 100 directly executes the third screen projection effect adjustment strategy without adjusting the screen projection code rate. Therefore, the sampling frame rate is still the first sampling frame rate (e.g. 60 hz), the screen projection resolution is still the first screen projection resolution (e.g. 1080P), and the screen projection rate is still the first screen projection rate (e.g. 10M).

Screen projection effect adjusting strategy III

When the data transmission delay between the electronic device 100 and the display device 200 is greater than the preset time delay, after the electronic device 100 reduces the screen projection code rate to the lowest screen projection code rate, the screen projection frame rate difference is still greater than the preset frame rate difference and/or the screen projection delay is greater than the preset time delay; or, if the data transmission delay between the electronic device 100 and the display device 200 is smaller than the preset delay, it is not the poor screen projection effect caused by the network problem. The electronic device 100 will execute the screen-projection effect adjustment strategy three.

The screen-projection effect adjustment strategy three adjusts the sampling frame rate of the electronic device 100. And adopting a third screen projection effect adjusting strategy, and reducing the sampling frame rate by the electronic equipment 100. Compared with the screen projection effect adjusting strategy II, the screen projection effect adjusting strategy III can influence the experience of the user to a certain extent. Namely, the influence of the screen projection effect adjusting strategy three on the user experience is larger than that of the screen projection effect adjusting strategy two.

Specifically, as shown in fig. 12, fig. 12 exemplarily shows a schematic diagram of the electronic device 100 for adjusting the sampling frame rate on the side of the electronic device 100.

First, the electronic device 100 monitors screen projection performance parameters, which include a screen projection frame rate difference and a screen projection delay. When the electronic device 100 determines that the screen-projecting frame rate difference is greater than the preset frame rate difference and/or the screen-projecting time delay is greater than the preset time delay, the electronic device 100 monitors the data transmission time delay between the electronic device 100 and the display device 200, the image synthesis time of the electronic device 100, and the image synthesis time of the display device 200. The image composition time of the electronic device 100 includes time taken for the electronic device 100 to compose a preset number of image frames (e.g., 1 frame), and the image composition time of the display device 200 includes time taken for the display device 200 to compose a preset number of image frames (e.g., 1 frame). When the electronic device 100 monitors that the data transmission delay is greater than a preset value, or the image synthesis time of the electronic device 100 is greater than a preset time, or the image synthesis time of the display device 200 is greater than a preset time, it may be that the screen projection effect is poor due to an excessively high sampling frame rate on the side of the electronic device 100, and the electronic device 100 may reduce the sampling frame rate on the side of the electronic device 100. When the electronic device 100 monitors that the hardware load of the display device 200 is not high, and the image synthesis time of the electronic device 100 is less than the preset time and the image synthesis time of the display device 200 is less than the preset time, the electronic device 100 determines that the screen projection effect is not poor due to the high sampling frame rate. The electronic device 100 directly executes the screen-projection effect adjustment strategy four.

When the hardware load of the display apparatus 200 is high, or the image synthesis time of the electronic apparatus 100 is greater than the preset time, or the image synthesis time of the display apparatus 200 is greater than the preset time, the electronic apparatus 100 may lower the sampling frame rate by the following formula four:

PD = PD1- (PD 1-PD 2) × cast _ cost formula four

And as shown in the formula IV, the PD is the sampling frame rate after adjustment, and the value range of the PD is D2-D1. PD1 is a real-time sampling frame rate between the electronic device 100 and the display device 200, PD2 is a minimum sampling frame rate, and cast _ cost represents a screen projection performance parameter normalization index. For the calculation method of cast _ cost, reference may be made to formula two, which is not described herein again.

Illustratively, the real-time sampling frame rate PD1 is 60hz, and the lowest sampling frame rate PD2 is 52hz, so the value range of PD is 52hz-60 hz.

After the electronic device 100 reduces the sampling frame rate from the first frame rate to the second frame rate (the first value or the second value) according to the formula four, the second frame rate is greater than the first threshold or the second threshold, and the electronic device 100 continues to monitor whether the difference of the screen-casting frame rates is smaller than the preset frame rate difference and whether the screen-casting delay is smaller than the preset delay. If the difference of the screen-projecting frame rates is smaller than the preset frame rate difference and the screen-projecting time delay is smaller than the preset time delay, the electronic device 100 reduces the sampling frame rate, and then improves the screen-projecting effect. Thereafter, the electronic device 100 will not perform the subsequent method steps.

If the difference of the screen-casting frame rates is greater than the preset frame rate difference and/or the screen-casting delay is greater than the preset delay, the electronic device 100 determines whether the adjusted sampling frame rate (e.g., the second frame rate) is less than the lowest sampling frame rate (the third threshold or the fourth threshold), and if the adjusted sampling frame rate (e.g., the second frame rate) is less than the lowest sampling frame rate, and monitors that the data transmission delay is greater than the preset value, or the image synthesis time of the electronic device 100 is greater than the preset time, or the image synthesis time of the display device 200 is greater than the preset time, the electronic device 100 continues to reduce the sampling frame rate (e.g., the second frame rate) between the electronic device 100 and the display device 200 to the third frame rate (the third value or the fourth value), and the third frame rate is greater than the first threshold or the second threshold, and after the third frame rate is not less than the lowest sampling frame rate, so as to avoid a problem of serious frame loss after the sampling frame rate is less than the lowest sampling frame rate. Therefore, after the frame rate three is greater than the lowest sampling frame rate, the electronic device 100 executes the screen-projection-effect adjustment policy three.

After the electronic device 100 adjusts the sampling frame rate by using the second screen-projecting effect adjustment strategy, the screen-projecting effect is still not good, and when the electronic device 100 monitors that the data transmission delay is greater than the preset value, or the image synthesis time of the electronic device 100 is greater than the preset time, or the image synthesis time of the display device 200 is greater than the preset time, after the electronic device 100 adjusts the sampling frame rate according to the third screen-projecting effect adjustment strategy, the screen-projecting resolution is not changed, the screen-projecting resolution is still the first screen-projecting resolution (for example, 1080P), the screen-projecting code rate is the second screen-projecting code rate, and the second screen-projecting code rate is greater than or equal to the lowest screen-projecting code rate and is less than the first screen-projecting code rate. For example, if the first screen projection resolution is 1080P, the second screen projection rate is greater than or equal to 3M and smaller than the first screen projection rate (e.g., 10M). If the first screen projection resolution is 540P, the second screen projection code rate is greater than or equal to 1M and smaller than the first screen projection code rate (for example, 5M). The sampling frame rate is a second sampling frame rate, and the second sampling frame rate is greater than or equal to the lowest screen projection code rate (for example, 52 hz) and less than the first screen projection code rate (for example, 60 hz).

Or after the electronic device 100 increases the operating frequency of hardware in the electronic device 100 or the display device 200 according to the first screen projection effect adjustment policy, the screen projection frame rate difference is still greater than the preset frame rate difference and/or the screen projection time delay is greater than the preset time delay, but if the electronic device 100 monitors that the data transmission time delay between the electronic device 100 and the display device 200 is less than the preset time delay, the screen projection effect is not good due to the network problem. The electronic device 100 does not need to adjust the screen-projecting code rate according to the screen-projecting effect adjustment strategy two. And when the electronic device 100 monitors that the hardware load of the display device 200 is high, or the image synthesis time of the electronic device 100 is greater than the preset time, or the image synthesis time of the display device 200 is greater than the preset time, the electronic device 100 directly adjusts the sampling frame rate according to the screen projection effect adjustment strategy three, and at this time, the screen projection code rate and the screen projection resolution are not changed. The screen projection resolution is still the first screen projection resolution (for example, 1080P), the screen projection rate is still the first screen projection rate (for example, 10M), the sampling frame rate is the second sampling frame rate, and the second sampling frame rate is greater than or equal to the lowest screen projection rate (for example, 52 hz) and less than the first screen projection rate (for example, 60 hz).

Or after the electronic device 100 increases the operating frequency of hardware in the electronic device 100 or the display device 200 according to the first screen projection effect adjustment policy, the screen projection frame rate difference is still greater than the preset frame rate difference and/or the screen projection time delay is greater than the preset time delay, but if the electronic device 100 monitors that the data transmission time delay between the electronic device 100 and the display device 200 is less than the preset time delay, the screen projection effect is not good due to the network problem. The electronic device 100 does not need to adjust the screen-projecting code rate according to the screen-projecting effect adjustment strategy two. And if the electronic device 100 monitors that the hardware load of the display device 200 is not high, and the image synthesis time of the electronic device 100 is less than the preset time and the image synthesis time of the display device 200 is less than the preset time, the screen projection effect is not good due to the high sampling frame rate. The electronic device 100 also does not need to adjust the sampling frame rate according to the screen projection effect adjustment policy three, and the electronic device 100 directly executes the screen projection effect adjustment policy four. At this time, the screen projection code rate, the sampling frame rate and the screen projection resolution are not changed. Therefore, the sampling frame rate is still the first sampling frame rate (e.g. 60 hz), the screen projection resolution is still the first screen projection resolution (e.g. 1080P), and the screen projection rate is still the first screen projection rate (e.g. 10M).

Screen projection effect adjusting strategy four

If the electronic device 100 determines that the screen-casting frame rate difference is larger than the preset frame rate difference and/or the screen-casting time delay is larger than the preset time delay, the reason is not caused by the high sampling frame rate of the electronic device 100; or, the electronic device 100 determines that the reason that the difference of the screen-casting frame rates is greater than the preset frame rate difference and/or the screen-casting delay is greater than the preset delay is the reason that the sampling frame rate of the electronic device 100 is high, but after the electronic device 100 reduces the sampling frame rate to the lowest sampling frame rate, the difference of the screen-casting frame rates is still greater than the preset frame rate difference and/or the screen-casting delay is greater than the preset delay. The display device 200 will implement the screen-projection effect adjustment strategy four.

The screen-projection effect adjustment strategy IV adjusts the display frame rate of the display apparatus 200. And adopting the screen projection effect adjustment strategy four, the display device 200 will reduce the display frame rate. Compared with the screen projection effect adjusting strategy III, the screen projection effect adjusting strategy IV can influence the experience of the user to a certain extent. Namely, the influence of the screen projection effect regulation strategy four on the user experience is larger than that of the third-level screen projection effect regulation strategy.

Specifically, as shown in fig. 13, fig. 13 exemplarily shows a schematic diagram in which the display apparatus 200 adjusts the display frame rate on the display apparatus 200 side.

First, the display device 200 monitors screen projection performance parameters, which include a screen projection frame rate difference and a screen projection delay. When the display device 200 determines that the screen-casting frame rate difference is greater than the preset frame rate difference and/or the screen-casting time delay is greater than the preset time delay, the display device 200 monitors the hardware load of the display device 200 and the image synthesis time of the display device 200. The hardware load of the display apparatus 200 includes a usage rate of a CPU of the display apparatus 200, a usage rate of a GPU of the display apparatus 200, a usage rate of a DDR of the display apparatus 200, and a usage rate of a Codec of the display apparatus 200. The image composition time of the display apparatus 200 includes a time taken for the display apparatus 200 to compose a preset number of image frames (e.g., 1 frame). When the display device 200 monitors that the hardware load of the display device 200 is high or the image synthesis time of the display device 200 is longer than the preset time, it may be that the screen projection effect is poor due to the excessively high display frame rate on the display device 200 side, and the display device 200 may decrease the sampling frame rate on the display device 200 side. When the display device 200 monitors that the hardware load of the display device 200 is not high and the image synthesis time of the display device 200 is less than the preset time, the display device 200 determines that the screen projection effect is not poor due to the high display frame rate. The display apparatus 200 directly performs the screen-projection effect adjustment policy five.

When the hardware load of the display apparatus 200 is high or the image synthesis time of the display apparatus 200 is greater than the preset time, the display apparatus 200 may lower the sampling frame rate by the following formula five:

d = D1- (D1-D2) cast _ cost formula five

And D is the display frame rate after adjustment, and the value range of D is between D2 and D1. D1 is the real-time display frame rate of the display device 200, D2 is the lowest display frame rate, and cast _ cost represents the screen projection performance parameter normalization index. For the calculation method of cast _ cost, reference may be made to formula two, which is not described herein again.

Illustratively, the real-time display frame rate D1 is 52hz, the lowest display frame rate D2 is 45hz, and the value range of D is 45hz to 52 hz.

After the display device 200 reduces the display frame rate from the frame rate four to the frame rate five according to the formula five, the display device 200 continues to monitor whether the difference of the screen casting frame rates is smaller than the preset frame rate difference and the screen casting time delay is smaller than the preset time delay. If the difference of the screen projection frame rates is smaller than the preset frame rate difference and the screen projection time delay is smaller than the preset time delay, the display device 200 reduces the display frame rate, and then the screen projection effect is improved. Thereafter, the display device 200 does not perform the subsequent method steps.

If the screen projection frame rate difference is greater than the preset frame rate difference and/or the screen projection time delay is greater than the preset time delay, the display device 200 determines whether the adjusted display frame rate (for example, frame rate five) is less than the lowest display frame rate (third threshold or fourth threshold), and if the adjusted display frame rate (for example, frame rate five) is less than the lowest display frame rate and it is monitored that the hardware load of the display device 200 is high, or the image synthesis time of the display device 200 is greater than the preset time, the display device 200 continues to reduce the display frame rate (for example, frame rate five) of the display device 200 to frame rate six, until the frame rate six is greater than the lowest display frame rate, the display device 200 does not adjust the display frame rate any more. When the frame rate six is greater than the lowest display frame rate, the display device 200 executes the screen projection effect adjustment policy five.

After the display device 200 adjusts the screen-casting rate by using the screen-casting effect adjustment strategy two and adjusts the sampling frame rate by using the screen-casting effect adjustment strategy three, the screen-casting effect is still not good, and the display device 200 monitors that the hardware load of the display device 200 is high, or when the image synthesis time of the display device 200 is greater than the preset time, after the display device 200 adjusts the display frame rate of the display device 200 according to the screen-casting effect adjustment strategy four, the screen-casting resolution is not changed, the screen-casting resolution is still the first screen-casting resolution (for example, 1080P), the screen-casting rate is the second screen-casting rate, and the second screen-casting rate is greater than or equal to the lowest screen-casting rate and is less than the first screen-casting rate. For example, if the first screen projection resolution is 1080P, the second screen projection rate is greater than or equal to 3M and smaller than the first screen projection rate (e.g., 10M). If the first screen projection resolution is 540P, the second screen projection rate is greater than or equal to 1M and smaller than the first screen projection rate (for example, 5M). The sampling frame rate is a second sampling frame rate, and the second sampling frame rate is greater than or equal to the lowest screen projection code rate (for example, 52 hz) and smaller than the first screen projection code rate (for example, 60 hz).

Or, the electronic device 100 does not adjust the screen-projecting code rate by using the screen-projecting effect adjustment strategy two, and directly adjusts the sampling frame rate of the electronic device 100 according to the screen-projecting effect adjustment strategy three. When the display device 200 monitors that the difference of the screen projection frame rate is greater than the preset frame rate difference and/or the screen projection time delay is greater than the preset time delay, and the display device 200 monitors that the hardware load of the display device 200 is high, or the image synthesis time of the display device 200 is greater than the preset time, the screen projection code rate and the screen projection resolution are not changed after the display device 200 adjusts the display frame rate of the display device 200 according to the screen projection effect adjustment strategy four. The screen projection resolution is still the first screen projection resolution (for example, 1080P), the screen projection rate is still the first screen projection rate (for example, 10M), the sampling frame rate is the second sampling frame rate, and the second sampling frame rate is greater than or equal to the lowest screen projection rate (for example, 52 hz) and smaller than the first screen projection rate (for example, 60 hz).

Or, the electronic device 100 adjusts the screen-projection rate by using the screen-projection effect adjustment strategy two, and does not adjust the sampling frame rate of the electronic device 100 by using the screen-projection effect adjustment strategy three. When the display device 200 monitors that the difference of the screen projection frame rate is greater than the preset frame rate difference and/or the screen projection time delay is greater than the preset time delay, and the display device 200 monitors that the hardware load of the display device 200 is high, or the image synthesis time of the display device 200 is greater than the preset time delay, the sampling frame rate and the screen projection resolution are not changed after the display device 200 adjusts the display frame rate of the display device 200 according to the screen projection effect adjustment strategy IV. The screen projection resolution is still the first screen projection resolution (for example, 1080P), the sampling frame rate is still the first sampling frame rate (for example, 60 hz), the screen projection code rate is the second screen projection code rate, and the second screen projection code rate is greater than or equal to the lowest screen projection code rate and less than the first screen projection code rate. For example, if the first screen projection resolution is 1080P, the second screen projection rate is greater than or equal to 3M and smaller than the first screen projection rate (e.g., 10M). If the first screen projection resolution is 540P, the second screen projection rate is greater than or equal to 1M and smaller than the first screen projection rate (for example, 5M).

Or, the electronic device 100 does not adjust the screen projection rate by using the screen projection effect adjustment strategy two, nor adjusts the sampling frame rate of the electronic device 100 by using the screen projection effect adjustment strategy three, and the screen projection frame rate difference is still greater than the preset frame rate difference and/or the screen projection time delay is greater than the preset time delay, and the display device 200 monitors that the hardware load of the display device 200 is high, or when the image synthesis time of the display device 200 is greater than the preset time, the display device 200 adjusts the display frame rate of the display device 200 according to the screen projection effect adjustment strategy four. At this time, the screen projection code rate, the sampling frame rate and the screen projection resolution are not changed. Therefore, the sampling frame rate is still the first sampling frame rate (e.g. 60 hz), the screen projection resolution is still the first screen projection resolution (e.g. 1080P), and the screen projection rate is still the first screen projection rate (e.g. 10M).

Screen projection effect adjusting strategy five

If the display device 200 determines that the reason that the display frame rate difference is greater than the preset frame rate difference and/or the screen projection time delay is greater than the preset time delay is not the reason that the display frame rate of the display device 200 is too high; or, the reason that the screen projecting frame rate difference is larger than the preset frame rate difference and/or the screen projecting time delay is larger than the preset time delay is determined by the display device 200, which is caused by the display frame rate of the display device 200 being too high, but after the display device 200 reduces the display frame rate of the display device 200, the screen projecting frame rate difference is still larger than the preset frame rate difference and/or the screen projecting time delay is larger than the preset time delay. The electronic device 100 will execute the screen-projection effect adjustment strategy five.

Projection effect adjustment strategy five adjusts the projection resolution of the electronic device 100. With the screen projection effect adjustment strategy five, the electronic device 100 will reduce the screen projection resolution. Compared with the screen projection effect adjusting strategy IV, the screen projection effect adjusting strategy V can influence the experience of the user to a certain extent. Namely, the influence of the screen projection effect adjusting strategy five on the user experience is larger than that of the screen projection effect adjusting strategy of the fourth level.

Specifically, as shown in fig. 14, fig. 14 exemplarily shows a schematic diagram of the electronic device 100 for adjusting the screen-projecting resolution of the electronic device 100.

First, the display device 200 monitors screen projection performance parameters, which include a screen projection frame rate difference and a screen projection delay. When the display device 200 determines that the screen projecting frame rate difference is greater than the preset frame rate difference and/or the screen projecting time delay is greater than the preset time delay, and the hardware load of the display device 200 is high or the image synthesis time of the display device 200 is greater than the preset time, the screen projecting effect may be poor due to too high resolution of the electronic device 100 side. The display apparatus 200 transmits a request for lowering the screen resolution to the electronic apparatus 100, and the electronic apparatus 100 receives and responds to the request for lowering the screen resolution, and the electronic apparatus 100 lowers the screen resolution. When the hardware load of the display apparatus 200 is not high and the image composition time of the display apparatus 200 is less than the preset time, the display apparatus 200 determines that it is not the poor screen projection effect caused by the too high resolution of the electronic apparatus 100 side. The electronic device 100 or the display device 200 will execute the first screen-projection-effect adjustment strategy. The hardware load of the display apparatus 200 includes a usage rate of a CPU of the display apparatus 200, a usage rate of a GPU of the display apparatus 200, a usage rate of a DDR of the display apparatus 200, and a usage rate of a Codec of the display apparatus 200. The image composition time of the display apparatus 200 includes a time taken for the display apparatus 200 to compose a preset number of image frames (e.g., 1 frame).

When the hardware load of the display device 200 is high or the image composition time of the display device 200 is greater than the preset time, the electronic device 100 reduces the screen projection resolution from the first resolution to the second resolution.

After the electronic device 100 reduces the screen-projecting resolution from the first resolution to the second resolution (the first value or the second value), and the second resolution is greater than the first threshold or the second threshold, the display device 200 continues to monitor whether the screen-projecting frame rate difference is smaller than the preset frame rate difference and the screen-projecting time delay is smaller than the preset time delay. If the screen projecting frame rate difference is smaller than the preset frame rate difference and the screen projecting time delay is smaller than the preset time delay, the electronic device 100 reduces the screen projecting resolution, and then the screen projecting effect is improved. Thereafter, the electronic device 100 does not perform the subsequent method steps.

If the difference of the screen-casting frame rates is still greater than the preset frame rate difference and/or the screen-casting time delay is greater than the preset time delay, the electronic device 100 determines whether the screen-casting resolution (e.g., resolution two) after adjustment is smaller than the lowest screen-casting resolution (third threshold or fourth threshold), if the screen-casting resolution (e.g., resolution two) after adjustment is smaller than the lowest screen-casting resolution and the hardware load of the display device 200 is high, or the image synthesis time of the display device 200 is greater than the preset time, the electronic device 100 continues to reduce the screen-casting resolution (e.g., resolution two) of the electronic device 100 to resolution three (third value or fourth value) which is smaller than the first threshold or the second threshold, and if the resolution is not smaller than the lowest screen-casting resolution, the electronic device 100 does not adjust the screen-casting resolution any more. When the resolution three is greater than the minimum screen projection resolution, the electronic device 100 executes a screen projection effect adjustment strategy one.

The electronic device 100 adjusts the screen projection code rate by adopting a screen projection effect adjusting strategy two and adjusts the sampling frame rate by adopting a screen projection effect adjusting strategy three, the display device 200 adjusts the display frame rate by adopting a screen projection effect adjusting strategy four, the electronic device 100 adjusts the screen projection resolution by adopting a screen projection effect adjusting strategy five, the screen projection resolution is the second screen projection resolution, and the second screen projection resolution is greater than or equal to the lowest screen projection resolution and is smaller than the first screen projection resolution. The screen projection code rate is a second screen projection code rate, and the second screen projection code rate is greater than or equal to the lowest screen projection code rate and smaller than the first screen projection code rate. For example, if the first screen projection resolution is 1080P, the second screen projection rate is greater than or equal to 3M and smaller than the first screen projection rate (e.g., 10M). If the first screen projection resolution is 540P, the second screen projection rate is greater than or equal to 1M and smaller than the first screen projection rate (for example, 5M). The sampling frame rate is a second sampling frame rate, and the second sampling frame rate is greater than or equal to the lowest screen projection code rate (for example, 52 hz) and smaller than the first screen projection code rate (for example, 60 hz).

Or the electronic device 100 does not adjust the screen-casting code rate by adopting the screen-casting effect adjustment strategy two and does not adjust the sampling frame rate by adopting the screen-casting effect adjustment strategy three, the display device 200 does not adjust the display frame rate by adopting the screen-casting effect adjustment strategy four, after the electronic device 100 adjusts the screen-casting resolution by adopting the screen-casting effect adjustment strategy five, the screen-casting resolution is the second screen-casting resolution, and the second screen-casting resolution is greater than or equal to the lowest screen-casting resolution (the third threshold or the fourth threshold) and is smaller than the first screen-casting resolution. The screen projection rate is still the first screen projection rate (e.g., 10M). The frame rate of the on-screen sampling is still the first sampling frame rate (e.g., 60 hz).

Or, after the electronic device 100 adjusts the display frame rate by using the screen-projecting-effect adjusting strategy two and the sampling frame rate by using the screen-projecting-effect adjusting strategy three, and after the display device 200 adjusts the display frame rate by using the screen-projecting-effect adjusting strategy four, the electronic device 100 does not adjust the screen-projecting resolution by using the screen-projecting-effect adjusting strategy five, and the screen-projecting resolution is still the first screen-projecting resolution (for example, 1080P). The screen projection code rate is a second screen projection code rate, and the second screen projection code rate is greater than or equal to the lowest screen projection code rate and smaller than the first screen projection code rate. For example, if the first screen projection resolution is 1080P, the second screen projection rate is greater than or equal to 3M and smaller than the first screen projection rate (e.g., 10M). If the first screen projection resolution is 540P, the second screen projection rate is greater than or equal to 1M and smaller than the first screen projection rate (for example, 5M). The sampling frame rate is a second sampling frame rate, and the second sampling frame rate is greater than or equal to the lowest screen projection code rate (for example, 52 hz) and smaller than the first screen projection code rate (for example, 60 hz).

It should be noted that, the embodiments of the present application only exemplarily show several screen projection effect adjustment strategies, and may further include more screen projection effect adjustment strategies, which are not listed here.

Specifically, the electronic device 100 and the display device 200 adjust the system load capacity or the screen projection parameters by adopting a screen projection effect hierarchical adjustment strategy, so that the screen projection performance parameters meet the preset conditions, the screen projection effect hierarchical adjustment strategy is adjusted with the target that the degree of influencing the user experience is from low to high, and the influence on the user experience when the electronic device 100 or the display device 200 adjusts the system load capacity or the screen projection parameters is reduced.

As shown in fig. 15, fig. 15 is a flowchart illustrating a screen projection method provided by an embodiment of the present application.

S1501, the electronic device 100 and the display device 200 establish screen projection connection.

Please refer to the embodiments shown in fig. 7A to 7D, and the manner of establishing the screen-projecting connection between the electronic device 100 and the display device 200 is not repeated in this application.

The two modes of the electronic device 100 and the display device 200 for establishing the screen-projecting connection are not limited, and the electronic device 100 may also adopt other modes for establishing the screen-projecting connection with the display device 200, which is not limited herein.

S1502, the electronic device 100 and the display device 200 monitor whether the screen projection time delay is greater than a preset time delay or whether the screen projection frame rate difference is greater than a preset frame rate difference.

The screen-casting delay is a difference between a time when the electronic device 100 acquires the first screen-casting content and a time when the display device 200 displays the first screen-casting content.

The screen projection frame rate difference is a frame rate difference between a sampling frame rate of the electronic apparatus 100 and a display frame rate of the display apparatus 200.

When the electronic device 100 monitors that the screen projection time delay is greater than the preset time delay or the screen projection frame rate difference is greater than the preset frame rate difference, the electronic device 100 executes S1503.

When the display device 200 monitors that the screen casting delay is greater than the preset delay or the screen casting frame rate difference is greater than the preset frame rate difference, the display device 200 performs S1505.

It should be noted that, when the subsequent electronic device 100 or the display device 200 adjusts the screen projection parameter or the hardware working leveling rate according to the hierarchical adjustment strategy, as long as the screen projection time delay is smaller than the preset time delay and the screen projection frame rate difference is smaller than the preset frame rate difference, the electronic device 100 or the display device 200 does not execute the hierarchical adjustment strategy to adjust the screen projection parameter.

When the screen-projecting time delay is greater than the preset time delay due to the fact that the use frequency of the hardware is greater than the preset value, or the screen-projecting frame rate difference is greater than the preset frame rate difference, the electronic device 100 may reduce the operating frequency of the hardware in the electronic device 100 or the display device 200 may reduce the operating frequency of the hardware in the electronic device 100.

Specifically, S1503-S1506 describe a method flow of adjusting the hardware operating frequency of the electronic device 100 or the display device 200. It should be noted that the method flow of adjusting the hardware operating frequency of the electronic device 100 or the display device 200 may include more or less steps than S1503-S1506, and the application is not limited herein. In addition, the present application does not limit the execution order of each step in S1503 to S1506.

S1505 and S1506 may be executed after S1504, and S1502 may also be executed after S1502, and the present application does not limit the execution sequence of S1503 and S1504, S1505 and S1506.

S1503, the electronic device 100 determines whether the usage rate of the hardware in the electronic device 100 is greater than a preset value?

If the electronic device 100 determines that the utilization rate of the hardware in the electronic device 100 is greater than the preset value, the electronic device 100 performs S1504, otherwise, the electronic device 100 performs S1507.

The usage rate of the hardware in the electronic apparatus 100 includes a usage rate of a CPU of the electronic apparatus 100, a usage rate of a GPU of the electronic apparatus 100, a usage rate of a DDR of the electronic apparatus 100, and a usage rate of a Codec of the electronic apparatus 100.

The fact that the utilization rate of the hardware in the electronic device 100 is greater than the preset value means that the utilization rate of the CPU of the electronic device 100 is greater than the preset value and/or the utilization rate of the GPU of the electronic device 100 is greater than the preset value and/or the utilization rate of the DDR of the electronic device 100 is greater than the preset value and/or the utilization rate of the Codec of the electronic device 100 is greater than the preset value.

S1504, when the electronic device 100 determines that the usage rate of the hardware in the electronic device 100 is greater than the preset value, the electronic device 100 executes the first screen-projection effect adjustment policy.

Projection effect adjustment strategy-it is the operating frequency of the hardware in electronic device 100 that is improved. For example, when the electronic device 100 monitors that the usage rate of the CPU is greater than the preset value, the electronic device 100 increases the operating frequency of the CPU from the first frequency to the second frequency. The second frequency is less than the highest working frequency, and the highest working frequency is used for limiting the overhigh working frequency of the CPU, so that the problems of heat generation and overhigh power consumption are solved.

Specifically, please refer to the embodiment shown in fig. 9 for how the electronic device 100 executes the first screen projection effect adjustment policy, which is not described herein again.

It should be noted that, for S1503 and S1504, the electronic device 100 may monitor that the usage rate of the hardware in the electronic device 100 is higher than a preset value, and execute the first screen-projection effect adjustment policy; or the display device 200 may monitor that the usage rate of hardware in the electronic device 100 is higher than a preset value, and the display device 200 sends instruction information to the electronic device 100, where the instruction information is used to instruct the electronic device 100 to execute the first screen projection effect adjustment policy.

It should be noted that, when the electronic device 100 monitors that the usage rate of the hardware in the electronic device 100 is less than the preset value, the electronic device 100 may not execute S1504.

S1505, the display apparatus 200 determines whether the usage rate of hardware in the display apparatus 200 is greater than a preset value?

If the display apparatus 200 determines that the usage rate of the hardware in the display apparatus 200 is greater than the preset value, the display apparatus 200 performs S1506, otherwise the electronic apparatus 100 performs S1507.

The usage rate of the hardware in the display apparatus 200 includes a usage rate of a CPU of the display apparatus 200, a usage rate of a GPU of the display apparatus 200, a usage rate of a DDR of the display apparatus 200, and a usage rate of a Codec of the display apparatus 200.

The fact that the utilization rate of the hardware in the display device 200 is greater than the preset value means that the utilization rate of the CPU of the display device 200 is greater than the preset value and/or the utilization rate of the GPU of the display device 200 is greater than the preset value and/or the utilization rate of the DDR of the display device 200 is greater than the preset value and/or the utilization rate of the Codec of the display device 200 is greater than the preset value.

And S1506, when the display device 200 judges that the utilization rate of the hardware in the display device 200 is greater than the preset value, the display device 200 executes a first screen projection effect adjustment strategy.

Projection effect adjustment strategy-it is the operating frequency of the hardware in the display device 200 that is improved. For example, when the display device 200 monitors that the usage rate of the CPU is greater than the preset value, the display device 200 increases the operating frequency of the CPU from the first frequency to the second frequency. The second frequency is less than the highest working frequency, and the highest working frequency is used for limiting the overhigh working frequency of the CPU, so that the problems of heat generation and overhigh power consumption are solved.

Specifically, please refer to the embodiment shown in fig. 10 for how the display device 200 executes the first screen projection effect adjustment policy, which is not described herein again.

It should be noted that, when the display device 200 monitors that the usage rate of the hardware in the display device 200 is less than the preset value, the display device 200 may not execute S1506.

It should be noted that, for S1505 and S1506, the display device 200 may monitor that the usage rate of the hardware in the display device 200 is higher than a preset value, and execute a first screen projection effect adjustment policy; or when the electronic device 100 monitors that the usage rate of the hardware in the display device 200 is higher than a preset value, the electronic device 100 sends instruction information to the display device 200, where the instruction information is used to instruct the display device 200 to execute the first screen projection effect adjustment policy.

S1505 and S1506 may be executed after S1502, and the present application does not limit the execution order of S1503 and S1504, S1505 and S1506.

When the screen projection delay is greater than the preset delay or the screen projection frame rate difference is greater than the preset frame rate difference due to high network load, the electronic device 100 may decrease the data transmission rate between the electronic device 100 and the display device 200.

Specifically, S1507-S1508 describe a method flow of the electronic device 100 for reducing the data transmission rate between the electronic device 100 and the display device 200. It should be noted that the method flow of the electronic device 100 for reducing the data transmission rate between the electronic device 100 and the display device 200 may include more or less steps than S1507-S1508, which is not limited herein. In addition, the execution sequence of each step in S1507 to S1508 is not limited in this application.

S1507 and S1508 may also be executed after S1502, S1504 or S1506, and the present application does not limit the execution order of S1503 and S1504, S1505 and S1506, S1507 and S1508.

S1507, is the electronic device 100 monitoring that the data transmission delay between the electronic device 100 and the display device 200 is greater than a preset value?

If the electronic device 100 determines that the data transmission delay between the electronic device 100 and the display device 200 is greater than the preset value, the electronic device 100 performs S1508, otherwise, the electronic device 100 performs S1509.

The data transmission delay between the electronic device 100 and the display device 200 refers to a time difference between a time when the electronic device 100 leaves the electronic device 100 and a time when the projected content reaches the display device 200.

S1508, the electronic device 100 monitors that the data transmission delay between the electronic device 100 and the display device 200 is greater than the preset delay, and the electronic device 100 executes a second screen projection effect adjustment policy.

The screen projection effect adjustment strategy two reduces the screen projection code rate between the electronic device 100 and the display device 200. When the electronic device 100 monitors that the data transmission delay between the electronic device 100 and the display device 200 is greater than the preset delay, the electronic device 100 reduces the screen projection code rate from the first code rate to the second code rate. And the second code rate is greater than the lowest screen projection code rate.

Specifically, please refer to the embodiment shown in fig. 11 for how the electronic device 100 executes the second screen projection effect adjustment policy, which is not described herein again.

It should be noted that, for S1507 and S1508, the electronic device 100 may execute a screen projection effect adjustment policy two when monitoring that the data transmission delay in the electronic device 100 is greater than the preset delay; or when the display device 200 monitors that the data transmission delay in the electronic device 100 is greater than the preset delay, the display device 200 sends instruction information to the electronic device 100, where the instruction information is used to instruct the electronic device 100 to execute the screen projection effect adjustment policy two.

It should be noted that, when the electronic device 100 monitors that the data transmission delay between the electronic device 100 and the display device 200 is smaller than the preset delay, the electronic device 100 does not execute step S1508.

When the network load is high, or the screen projection delay is greater than the preset delay or the screen projection frame rate difference is greater than the preset frame rate difference due to the long time of the electronic device 100 or the long image synthesis time of the display device 200, the electronic device 100 may decrease the sampling frame rate between the electronic device 100 and the display device 200.

Specifically, S1509-S1510 describe a method flow of the electronic device 100 for reducing the sampling frame rate between the electronic device 100 and the display device 200. It should be noted that the method flow of the electronic device 100 for reducing the sampling frame rate between the electronic device 100 and the display device 200 may include more or less steps than S1509-S1510, which is not limited herein. In addition, the execution sequence of each step in S1509-S1510 is not limited in this application.

S1509 and S1510 may also be executed after S1502 or S1504 or S1506 or S1508, and the execution sequence of S1503 and S1504, S1505 and S1506, S1507 and S1508, S1509 and S1510 is not limited in the present application.

S1509, is the hardware usage rate of the display device 200 greater than a preset value, or is the image composition time of the electronic device 100 greater than a preset time, or is the image composition time of the display device 200 greater than a preset time?

When the data transmission delay is greater than the preset delay, or the image composition time of the electronic device 100 is greater than the preset time, or the image composition time of the display device 200 is greater than the preset time, the electronic device 100 performs S1510. Otherwise, the electronic apparatus 100 performs S1511.

The image composition time of the electronic apparatus 100 is a time taken for the electronic apparatus 100 to compose a preset number of image frames (e.g., 1 frame).

The image composition time of the display apparatus 200 is a time taken for the display apparatus 200 to compose a preset number of image frames (for example, 1 frame).

S1510, when the hardware usage rate of the display device 200 is greater than the preset value, or the image composition time of the electronic device 100 is greater than the preset time, or the image composition time of the display device 200 is greater than the preset time, the electronic device 100 executes a third screen-projection effect adjustment policy.

The third reduction in the screen-projection-effect adjustment policy is the sampling frame rate on the electronic apparatus 100 side. Illustratively, when the hardware usage rate of the display device 200 is greater than a preset value, or the image synthesis time of the electronic device 100 is greater than a preset time, or the image synthesis time of the display device 200 is greater than a preset time, the electronic device 100 decreases the sampling frame rate from the frame rate one to the frame rate two. The second frame rate is greater than the lowest sampling frame rate. The lowest sampling frame rate is to prevent the sampling frame rate from being too low, which causes a serious problem of frame loss.

Specifically, please refer to the embodiment shown in fig. 12 for how the electronic device 100 executes the second screen projection effect adjustment policy, which is not described herein again.

It should be noted that, when the hardware utilization rate of the display device 200 is less than the preset value, the image composition time of the electronic device 100 is less than the preset time, and the image composition time of the display device 200 is less than the preset time, the electronic device 100 does not execute S1510.

It should be noted that, for S1509 and S1510, the electronic device 100 may monitor that the data transmission delay is greater than the preset delay, or the image synthesis time of the electronic device 100 is greater than the preset time, or the image synthesis time of the display device 200 is greater than the preset time, and then execute the third screen projection effect adjustment policy; or when the display device 200 monitors that the data transmission delay is greater than the preset delay, or the image synthesis time of the electronic device 100 is greater than the preset time, or the image synthesis time of the display device 200 is greater than the preset time, the display device 200 sends instruction information to the electronic device 100, where the instruction information is used to instruct the electronic device 100 to execute the screen projection effect adjustment policy three.

When the load of the display apparatus 200 is high, or the time of the electronic apparatus 100 or the image composition time of the display apparatus 200 is long, resulting in the screen projection delay being greater than the preset delay or the screen projection frame rate difference being greater than the preset frame rate difference, the display apparatus 200 may decrease the display frame rate of the display apparatus 200.

Specifically, S1511-S1512 describe a process of the method for the display apparatus 200 to decrease the display frame rate of the display apparatus 200. It should be noted that the method flow for the display apparatus 200 to reduce the display frame rate of the display apparatus 200 may include more or less steps than S1509-S1510, and the application is not limited herein. In addition, the execution sequence of each step in S1511 to S1512 is not limited in the present application.

S1511 and S1512 may also be executed after S1502 or S1504 or S1506 or S1508 or S1510, and the execution sequence of S1503 and S1504, S1505 and S1506, S1507 and S1508, S1509 and S1510, S1511 and S1512 is not limited in the present application.

S1511, is the hardware usage rate of the display device 200 greater than a preset value, or is the image composition time of the display device 200 greater than a preset time?

When the hardware usage rate of the display apparatus 200 is greater than the preset value, or the image synthesis time of the display apparatus 200 is greater than the preset time, the display apparatus 200 performs S1512. Otherwise, the display apparatus 200 performs S1513.

And S1512, when the hardware utilization rate of the display device 200 is greater than a preset value, or the image synthesis time of the display device 200 is greater than a preset time, the display device 200 executes a screen projection effect adjustment strategy IV.

The screen-projection-effect adjustment policy four lowers the display frame rate on the electronic apparatus 100 side. Illustratively, when the hardware usage rate of the display apparatus 200 is greater than a preset value, or the image synthesis time of the display apparatus 200 is greater than a preset time, the display apparatus 200 decreases the display frame rate from the frame rate four to the frame rate five. And the frame rate five is greater than the lowest display frame rate.

Specifically, please refer to the embodiment shown in fig. 13 for how the display device 200 executes the second screen projection effect adjustment policy, which is not described herein again.

It should be noted that, when the hardware utilization rate of the display device 200 is smaller than the preset value and the image composition time of the display device 200 is smaller than the preset time, the display device 200 does not execute S1512.

It should be noted that, for S1511 and S1512, the display device 200 may monitor that the hardware utilization rate of the display device 200 is greater than a preset value, or the image synthesis time of the display device 200 is greater than a preset time, and then execute a third screen projection effect adjustment policy; or when the electronic device 100 monitors that the hardware utilization rate of the display device 200 is greater than a preset value, or the image synthesis time of the display device 200 is greater than a preset time, the electronic device 100 sends instruction information to the display device 200, where the instruction information is used to instruct the display device 200 to execute the screen projection effect adjustment policy four.

When the load of the display apparatus 200 is high, or the time of the electronic apparatus 100 or the image composition time of the display apparatus 200 is long, resulting in the screen projection delay being greater than the preset delay or the screen projection frame rate difference being greater than the preset frame rate difference, the electronic apparatus 100 may decrease the screen projection resolution of the electronic apparatus 100.

Specifically, S1513-S1514 describe a flow of a method for the electronic device 100 to reduce the screen-projecting resolution of the electronic device 100. It should be noted that, the method flow of the electronic device 100 for reducing the screen-projecting resolution of the electronic device 100 may include more or less steps than S1513-S1514, and the present application is not limited herein. In addition, the execution sequence of each step in S1513 to S1514 is not limited in this application.

S1513 and S1514 may also be executed after S1502 or S1504 or S1506 or S1508 or S1510 or S1512, and the execution sequence of S1503 and S1504, S1505 and S1506, S1507 and S1508, S1509 and S1510, S1511 and S1512, S1513 and S1514 is not limited in the present application.

S1513, is the hardware usage rate of the display device 200 greater than a preset value, or is the image composition time of the display device 200 greater than a preset time?

When the hardware usage rate of the display apparatus 200 is greater than the preset value, or the image composition time of the display apparatus 200 is greater than the preset time, the electronic apparatus 100 performs S1514. Otherwise, the electronic device 100 performs S1503.

And S1514, when the hardware utilization rate of the display device 200 is greater than a preset value or the image synthesis time of the display device 200 is greater than a preset time, executing a screen projection effect adjusting strategy five by the electronic device 100.

The screen-projection effect adjustment strategy five reduces the screen-projection resolution on the side of the electronic apparatus 100. Illustratively, when the hardware utilization rate of the display device 200 is greater than a preset value, or the image composition time of the display device 200 is greater than a preset time, the electronic device 100 reduces the screen resolution from the first resolution to the second resolution. And the second resolution is larger than the lowest screen projection resolution.

Specifically, please refer to the embodiment shown in fig. 14 for how the electronic device 100 executes the screen projection effect adjustment policy v, which is not described herein again.

It should be noted that, when the hardware utilization rate of the display device 200 is smaller than the preset value and the image composition time of the display device 200 is smaller than the preset time, the display device 200 does not execute S1514.

It should be noted that, for S1513 and S1514, the electronic device 100 may monitor that the hardware usage rate of the display device 200 is greater than a preset value, or the image synthesis time of the display device 200 is greater than a preset time, and then the electronic device 100 executes a screen projection effect adjustment policy five; or when the display device 200 monitors that the hardware utilization rate of the display device 200 is greater than a preset value, or the image synthesis time of the display device 200 is greater than a preset time, the display device 200 sends instruction information to the electronic device 100, where the instruction information is used to instruct the electronic device 100 to execute the screen projection effect adjustment policy five.

As shown in fig. 16, fig. 16 illustrates a method flow diagram of another screen projection method.

S1601, the electronic device 100 establishes a screen projection connection with the display device 200.

S1602, the electronic device 100 determines that the screen projection parameter meets a first condition, adjusts the first parameter of the electronic device to a first value according to a first-level adjustment policy, and adjusts the second parameter of the electronic device to a second value.

The electronic device 100 determines that the screen projection parameter satisfies the first condition, or determines that the screen projection effect does not satisfy the preset condition.

The screen projection parameters comprise screen projection time delay and/or screen projection frame rate difference. The screen-casting delay is a difference between a time when the electronic device 100 acquires the first screen-casting content and a time when the display device 200 displays the first screen-casting content.

Before the electronic device 100 determines that the screen projection parameter meets the first condition or determines that the screen projection effect does not meet the preset condition, and the electronic device 100 adjusts the first parameter of the electronic device to the first value according to the first-level adjustment strategy by using the screen projection effect adjustment strategy, the method further includes: the electronic equipment acquires a third parameter and a fourth parameter; the screen projection parameters comprise screen projection time delay, the fourth parameter comprises a first moment when the display equipment displays a first screen projection frame picture in first screen projection content, and the fifth parameter comprises a second moment when the electronic equipment sends the first screen projection frame picture; the electronic equipment determines screen projection time delay based on the first time and the second time; the first condition includes: the screen projection time delay is greater than the preset time delay; and/or the screen projection parameters comprise screen projection frame rate differences, the fourth parameters comprise a first frame rate of a first screen projection frame image displayed by the display equipment, and the fifth parameters comprise a second frame rate of the first screen projection frame image acquired by the electronic equipment; the electronic equipment determines a screen frame rate difference based on the first frame rate and the second frame rate; the first condition includes: the difference of the screen projection frame rate is larger than the difference of the preset frame rate.

When the screen projection parameter is screen projection time delay, the first condition is that the screen projection time delay is greater than a preset time delay, namely the basis that the electronic equipment determines that the screen projection effect is not good is that the screen projection time delay is greater than the preset time delay. When the screen projection parameter is the screen projection frame rate difference, the first condition is that the screen projection frame rate difference is larger than the preset frame rate difference, namely the basis that the electronic equipment determines that the screen projection effect is not good is that the screen projection frame rate difference is larger than the preset frame rate difference. The screen projection parameters are a screen projection frame rate difference and a screen projection time delay, the first condition is that the screen projection frame rate difference is larger than a preset frame rate difference and/or the screen projection time delay is larger than a preset time delay, namely the basis that the electronic equipment determines that the screen projection effect is not good is that the screen projection frame rate difference is larger than the preset frame rate difference and/or the screen projection time delay is larger than the preset time delay.

Or, the electronic device 100 determines that the screen projection effect does not satisfy the preset condition, and in a possible implementation manner, the electronic device may comprehensively measure the screen projection effect according to the screen projection time delay and the screen projection frame rate difference according to the following formula:

ast_cost＝(delay-delay_base)/delay_base*0.5+fps_diff/fps_base*0.5

as can be seen from the above formula, delay represents the screen-projecting time delay, which is measured by the electronic device 100 in real time. delay _ base represents a screen projection reference delay, the screen projection reference delay is a preset value, and a common screen projection reference delay is 50ms or 100ms. fps _ diff represents the screen-cast frame rate difference, which is measured by the electronic device 100 in real time. fps _ base represents a screen projection reference frame rate difference which is a preset value, and the general screen projection reference time delay is 60hz. The value range of cast _ cost is 0-1. The electronic device may measure the screen projection effect according to the cast _ cost, that is, when the electronic device determines that the cast _ cost is greater than a preset value (e.g., 0.25), the electronic device determines that the screen projection effect does not meet a preset condition.

When the electronic device 100 determines that the screen projection effect does not meet the preset condition or the screen projection parameter meets the first condition, the electronic device may adjust the first parameter of the electronic device to a first value according to the first-level adjustment policy, and adjust the second parameter of the electronic device to a second value; the electronic device may also adjust a second parameter of the electronic device to a second value after adjusting the first parameter of the electronic device to the first value according to the first-level adjustment policy; the electronic device may also adjust the first parameter of the electronic device to the first value after adjusting the second parameter of the electronic device to the second value according to the first level adjustment policy. The order in which the electronic device adjusts the first parameter and the second parameter is not limited herein.

In some embodiments, when the electronic device determines that the screen projection effect is not good and determines that the first load meets the second condition, the electronic device adjusts the first parameter of the electronic device to a first value according to the first-level adjustment policy, and adjusts the second parameter of the electronic device to a second value.

The first parameter and the second parameter are related to the first load information. Illustratively, when the first load is a utilization rate of hardware (such as a CPU or a GPU or a DDR or an encoder) in the electronic device, and the CPU and the GPU in the electronic device are greater than a preset utilization rate, the second parameter is an operating frequency of the CPU, and the third parameter is an operating frequency of the GPU. Illustratively, when the data transmission delay in the electronic device is greater than the preset delay, the second parameter is the screen projection code rate of the electronic device. Illustratively, when the image synthesis time on the electronic device side is greater than a preset time or the utilization rate of hardware in the electronic device is greater than a preset utilization rate, the second parameter is the sampling frame rate of the electronic device. Illustratively, when the image composition time of the display device is greater than a preset time or the utilization rate of hardware in the display device is greater than a preset utilization rate, the second parameter is the screen projection resolution of the electronic device. That is, the electronic device may adjust the first parameter or the second parameter only if the first load satisfies a certain condition, that is, the first load is too high. Therefore, the electronic equipment can determine the reason causing poor screen projection effect, and adopt corresponding measures to improve the screen projection effect.

The first parameter and the second parameter include any one of: the method comprises the following steps of (1) working frequency of a CPU in the electronic equipment, working frequency of a GPU in the electronic equipment, working frequency of an encoder in the electronic equipment, working frequency of a DDR in the electronic equipment, screen projection code rate of the electronic equipment, sampling frame rate of the electronic equipment and screen projection resolution of the electronic equipment; the first parameter is different from the second parameter.

The electronic equipment can adjust a first parameter of the electronic equipment to a first value according to the first-level adjusting strategy and adjust a second parameter of the electronic equipment to a second value at the same time; the electronic device may also adjust a second parameter of the electronic device to a second value after adjusting the first parameter of the electronic device to the first value according to the first-level adjustment policy; the electronic device may also adjust the first parameter of the electronic device to the first value after adjusting the second parameter of the electronic device to the second value according to the first level adjustment policy. The order in which the electronic device adjusts the first parameter and the second parameter is not limited herein.

In some embodiments, the first parameter and the second parameter are prioritized, and for example, the first parameter may be an operating frequency of hardware of the electronic device 100 in the first screen-projection effect adjustment strategy described in the embodiment in fig. 15; the second parameter may be the operating frequency of the hardware of the electronic device 100 in the second screen-projection effect adjustment strategy described in the embodiment of fig. 15. For example, the first parameter may also be a screen-projection code rate of the electronic device 100 in the screen-projection effect adjustment strategy two described in the embodiment in fig. 15; the second parameter may be the sampling frame rate of the electronic device 100 in the screen-projection effect adjustment strategy three described in the embodiment of fig. 15. The first parameter and the second parameter may be combined arbitrarily, and the present application is not limited thereto. Specifically, how the electronic device 100 adjusts the first parameter and the second parameter may refer to the embodiment shown in fig. 15, which is not described herein again.

In some embodiments, when the electronic device 100 determines that the screen projection effect is not good, the electronic device 100 may further send first information to the display device 200, where the first information is used to instruct the display device 200 to adjust a third parameter of the display device; the display device 200 adjusts the third parameter of the display device after receiving the first information. In this way, the electronic device 100 can adjust the parameters of the electronic device 100 and also adjust the parameters of the display device 200, thereby realizing multi-terminal adjustment.

In a possible implementation manner, the display device may not receive the first information sent by the electronic device, and when the display device monitors that the screen projection effect does not meet the preset condition, the display device adjusts a third parameter of the display device. Therefore, the display equipment can monitor the screen projection effect of the display equipment side and adjust the third parameter in real time according to the screen projection effect.

The third parameter includes any one of: the working frequency of a CPU in the display device, the working frequency of a GPU in the display device, the working frequency of a decoder in the display device, the working frequency of a DDR in the display device and the display frame rate of the display device. How to adjust the third parameter by the display device may refer to how to adjust the third parameter by the display device 200 according to the first screen projection effect adjustment policy and the fourth screen projection effect adjustment policy in the embodiment of fig. 15, which is not described herein again.

S1603, after the electronic device adjusts the first parameter of the electronic device to a first value and adjusts the second parameter of the electronic device to a second value, it is determined that the screen projection parameter satisfies a first condition.

After the electronic device adjusts the first parameter of the electronic device to the first value and adjusts the second parameter of the electronic device to the second value, please refer to the embodiment described in S1602 for how the electronic device 100 determines that the screen projection parameter satisfies the first condition or how the electronic device 100 determines that the screen projection effect does not satisfy the preset condition, which is not described herein again.

And S1604, the electronic device adjusts the first parameter of the electronic device to a third value and adjusts the second parameter of the electronic device to a fourth value according to the second-level adjustment strategy.

It is understood that the electronic device 100 adjusts the first parameter to a first value and adjusts the second parameter of the electronic device to a second value, the first value being greater than the first value, the second value being greater than the second threshold. The first parameter and the second parameter are not adjusted too much at one time, but are adjusted slowly. When the electronic device 100 adjusts the first parameter to the first value and adjusts the second parameter of the electronic device to the second value, and it is determined that the screen projection parameter meets the first condition or it is determined that the screen projection effect does not meet the preset condition, the electronic device 100 adjusts the first parameter to the third value according to the second-level adjustment strategy and adjusts the second parameter of the electronic device to the fourth value, where the first value is smaller than the first value and the second value is smaller than the second threshold. In this way, after the parameters are adjusted, when the electronic equipment determines that the screen projection effect is not good, the first parameters and the second parameters are adjusted again. Therefore, humanized adjustment parameters are realized through a strategy of hierarchical adjustment, and adjustment is performed with the aim of reducing the influence of users.

In some embodiments, the third value is greater than a third threshold and the fourth value is greater than a fourth threshold. That is, the first parameter and the second parameter both have the lowest threshold, so that the problem that the adjustment range of the first parameter and the second parameter is too large to influence the user experience can be avoided.

In some embodiments, when the electronic device determines that the screen projection effect is not good and that the first load meets the second condition, the electronic device adjusts the first parameter of the electronic device to a third value and adjusts the second parameter of the electronic device to a fourth value according to the second-level adjustment policy.

The above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

As used in the above embodiments, the term "when …" may be interpreted to mean "if …" or "after …" or "in response to determination …" or "in response to detection of …", depending on the context. Similarly, the phrase "in determining …" or "if (a stated condition or event) is monitored" may be interpreted to mean "if … is determined" or "in response to …" or "when (a stated condition or event) is monitored" or "in response to (a stated condition or event) being monitored", depending on the context.

Claims

1. A screen projection system is characterized in that the system comprises an electronic device and a display device; wherein, the first and the second end of the pipe are connected with each other,

the electronic equipment is used for establishing screen projection connection with the display equipment;

the electronic equipment is also used for sending the first screen projection content to the display equipment through the screen projection connection;

the display device is used for displaying a screen projection interface based on the first screen projection content;

the electronic equipment is also used for determining that the screen projection parameters meet a first condition;

adjusting a first parameter of the electronic equipment to a first value according to a first-level adjusting strategy, and adjusting a second parameter of the electronic equipment to a second value; wherein the first value is greater than a first threshold and the second value is greater than a second threshold;

after the electronic device adjusts a first parameter of the electronic device to the first value and adjusts a second parameter of the electronic device to the second value, determining that the screen projection parameter meets the first condition;

adjusting the first parameter of the electronic equipment to a third value and adjusting the second parameter of the electronic equipment to a fourth value according to a second-level adjusting strategy; wherein the third value is less than the first threshold and the fourth value is less than the second threshold.

2. The system of claim 1, wherein the electronic device is further configured to send first information to the display device, the first information being configured to instruct the display device to adjust a third parameter of the display device;

the display device is further configured to adjust a third parameter of the display device after receiving the first information.

3. The system of claim 2, wherein the first parameter and the second parameter comprise any one of: the working frequency of a Central Processing Unit (CPU) of the electronic equipment, the working frequency of a Graphics Processing Unit (GPU) of the electronic equipment, the working frequency of an encoder of the electronic equipment, the working frequency of a double-rate synchronous dynamic random access memory (DDR) of the electronic equipment, the screen projection code rate of the electronic equipment, the sampling frame rate of the electronic equipment and the screen projection resolution of the electronic equipment; the first parameter is different from the second parameter;

the third parameter includes any one of: the display device comprises the working frequency of a CPU in the display device, the working frequency of a GPU in the display device, the working frequency of a decoder in the display device, the working frequency of a DDR in the display device and the display frame rate of the display device.

4. The system of any of claims 1-3, wherein the electronic device is further configured to obtain a fourth parameter and a fifth parameter before adjusting the first parameter of the electronic device to the first value according to the first level adjustment strategy;

the screen projection parameters comprise screen projection time delay, the fourth parameters comprise a first moment when the display equipment displays a first screen projection frame picture in the first screen projection content, and the fifth parameters comprise a second moment when the electronic equipment sends the first screen projection frame picture;

the electronic equipment is further used for determining the screen projection time delay based on the first time and the second time;

the first condition includes: the screen projection time delay is greater than the preset time delay;

and/or the presence of a gas in the gas,

the screen projection parameters comprise a screen projection frame rate difference, the fourth parameters comprise a first frame rate of the first screen projection frame image displayed by the display equipment, and the fifth parameters comprise a second frame rate of the first screen projection frame image acquired by the electronic equipment;

the electronic device is further configured to determine the screen-casting frame rate difference based on the first frame rate and the second frame rate;

the first condition includes: and the difference of the screen projection frame rates is larger than the preset frame rate difference.

5. A method of screen projection, the method comprising:

the electronic equipment and the display equipment establish screen projection connection;

the electronic equipment sends first screen projection content to the display equipment through the screen projection connection; the first screen projection content is displayed on a screen projection interface of the display equipment;

the electronic equipment determines that the screen projection parameters meet a first condition;

the electronic equipment adjusts a first parameter of the electronic equipment to a first value and adjusts a second parameter of the electronic equipment to a second value according to a first-level adjusting strategy; wherein the first value is greater than a first threshold and the second value is greater than a second threshold;

after the electronic device adjusts a first parameter of the electronic device to the first value and adjusts a second parameter of the electronic device to the second value, the electronic device determines that the screen projection parameter meets the first condition;

the electronic equipment adjusts the first parameter of the electronic equipment to a third value and adjusts the second parameter of the electronic equipment to a fourth value according to a second-level adjusting strategy; wherein the third value is less than the first threshold and the fourth value is less than the second threshold.

6. The method of claim 5, further comprising:

the electronic equipment sends first information to the display equipment, wherein the first information is used for indicating the display equipment to adjust a third parameter of the display equipment.

7. The method of claim 6, wherein the first parameter and the second parameter comprise any one of: the working frequency of a Central Processing Unit (CPU) of the electronic equipment, the working frequency of a Graphics Processing Unit (GPU) of the electronic equipment, the working frequency of an encoder of the electronic equipment, the working frequency of a double-rate synchronous dynamic random access memory (DDR) of the electronic equipment, the screen projection code rate of the electronic equipment, the sampling frame rate of the electronic equipment and the screen projection resolution of the electronic equipment; the first parameter is different from the second parameter;

the third parameter includes any one of: the display device comprises a CPU (Central processing Unit) working frequency in the display device, a GPU (graphics processing Unit) working frequency in the display device, a decoder working frequency in the display device, a DDR (double data rate) working frequency in the display device and a display frame rate of the display device.

8. The method of any of claims 5-7, wherein before the electronic device determines that the screen-projection parameter satisfies the first condition and adjusts the first parameter of the electronic device to a first value according to a first level adjustment policy, the method further comprises:

the electronic equipment acquires a third parameter and a fourth parameter;

the electronic equipment determines the screen projection time delay based on the first time and the second time;

and/or the presence of a gas in the gas,

the screen projection parameters comprise screen projection frame rate differences, the fourth parameters comprise a first frame rate of the display device for displaying the first screen projection frame picture, and the fifth parameters comprise a second frame rate of the electronic device for acquiring the first screen projection frame picture;

the electronic device determining the screen-casting frame rate difference based on the first frame rate and the second frame rate;

9. A method of screen projection, the method comprising:

the display equipment and the electronic equipment establish screen projection connection;

the display equipment receives first screen projection content sent by the electronic equipment through the screen projection connection;

the display equipment displays a screen projection interface based on the first screen projection content;

when the electronic equipment determines that the screen projection parameters meet a first condition, the display equipment receives first information sent by the electronic equipment and adjusts third parameters of the display equipment.

10. The method of claim 9, the third parameter comprising any one of: the display device comprises the working frequency of a CPU in the display device, the working frequency of a GPU in the display device, the working frequency of a decoder in the display device, the working frequency of a DDR in the display device and the display frame rate of the display device.

11. The method according to any one of claims 9-10, wherein before the display device receives the first information sent by the electronic device, the method further comprises:

the display device sends a fourth parameter to the electronic device;

the screen projection parameters comprise screen projection time delay, and the fourth parameters comprise a first moment when the display equipment displays a first screen projection frame picture in the first screen projection content;

the fourth parameter is used for the electronic equipment to determine the screen projection time delay based on the first time and a second time when the electronic equipment sends the first screen projection frame picture;

and/or the presence of a gas in the gas,

the screen projection parameters comprise screen projection frame rate differences, and the fourth parameters comprise a first frame rate of the display equipment for displaying the first screen projection frame picture;

the fourth parameter is used for determining the screen projection frame rate difference by the electronic equipment based on the first frame rate and a second frame rate of the first screen projection frame picture acquired by the electronic equipment;

12. An electronic device, characterized in that the electronic device comprises: one or more processors, one or more memories; the one or more memories coupled with the one or more processors for storing computer program code, the computer program code comprising computer instructions, the one or more processors invoking the computer instructions to cause the electronic device to perform the method of any of claims 5-8.

13. A display device, characterized in that the display device comprises: one or more processors, one or more memories; the one or more memories coupled with the one or more processors for storing computer program code comprising computer instructions that the one or more processors invoke to cause the display device to perform the method of any of the above claims 9-11.

14. A readable storage medium storing computer instructions which, when executed on an electronic device, cause the electronic device to perform the method of any of claims 5-8.

15. A readable storage medium storing computer instructions which, when executed on a display device, cause the display device to perform the method of any of claims 9-11.