WO2022111684A1

WO2022111684A1 - Method for adjusting power consumption of terminal, and method for adjusting bit rate, and related devices

Info

Publication number: WO2022111684A1
Application number: PCT/CN2021/133968
Authority: WO
Inventors: 朱勇平; 吴昊; 刘红波; 杨勇; 吴亮
Original assignee: 华为技术有限公司
Priority date: 2020-11-30
Filing date: 2021-11-29
Publication date: 2022-06-02
Also published as: CN114584814A

Abstract

Disclosed is a method for adjusting the power consumption of a terminal, which method is used for adjusting the power consumption of a terminal when the terminal is in a used state. The method in the embodiments of the present application comprises: a terminal reporting, to a server, first power-consumption-related information that indicates the power consumption of the terminal; and the server determining and implementing the adjustment of the size of a bit rate according to the first power-consumption-related information, wherein the bit rate is the bit rate of a video stream sent to the terminal, such that the bit rate of the video stream after adjustment is different from that of the video stream before adjustment, thereby adjusting the power consumption of the terminal.

Description

Method for adjusting power consumption of terminal, method for adjusting code rate and related equipment

This application claims the priority of the Chinese patent application filed on November 30, 2020 with the application number 202011377224.6 and the invention titled "Method for Adjusting Terminal Power Consumption, Method for Adjusting Code Rate and Related Equipment", all of which The contents are incorporated herein by reference.

technical field

The embodiments of the present application relate to the field of data processing, and in particular, to a method for adjusting power consumption of a terminal, a method for adjusting a code rate, a device for adjusting a code rate, and a storage medium.

Background technique

Multimedia virtual scene technologies include technologies such as virtual reality (VR), augmented reality (AR), and mixed reality (MR). The multimedia virtual scene technology mainly generates a video stream on the server and sends it to the terminal, and the terminal decodes and plays the video stream to realize the reproduction of the virtual scene at the terminal.

Due to the high resolution and high bit rate of the viewing technology of some multimedia virtual scenes. When a terminal plays a video stream, video decoding and rendering consume a large amount of processing resources and power consumption of the terminal. As a result, when the terminal is used for a long time, it is prone to overheating, video freezes, or shutdown due to insufficient power. The current way to reduce the power consumption of the terminal is mainly to reduce the power consumption by turning off the terminal when it is detected that the user is not using the terminal. However, when the terminal is in use, the above-mentioned phenomena such as overheating, video freezes, or power-off due to insufficient power may still occur.

In this way, the power consumption is reduced only by detecting whether the user uses the terminal to decide whether to turn off the terminal. The degree of power consumption reduction is limited, and the adjustment method for the power consumption of the terminal is single.

SUMMARY OF THE INVENTION

The embodiment of the present application provides a method for adjusting the power consumption of a terminal, which is used to adjust the power consumption of the terminal when the terminal is in a use state.

A first aspect of the embodiments of the present application provides a method for adjusting power consumption of a terminal. The method includes: a server sends a video stream to the terminal at a first bit rate. After sending the video stream, the server receives first power consumption related information from the terminal, where the first power consumption related information is used to represent the power consumption of the terminal, and the power consumption of the terminal is related to the playback of the video stream. The server determines, according to the first power consumption related information, that the power consumption of the terminal satisfies the first preset condition. After determining that the power consumption of the terminal satisfies the first preset condition, the server sends the video stream to the terminal at a second bit rate lower than the first bit rate.

In this embodiment of the present application, the server sends a video stream to the terminal at a first bit rate, and when the terminal receives and plays the video stream, the server receives the first power consumption related information sent by the terminal, and the server sends the first power consumption related information to the terminal according to the first power consumption related information. The power consumption of the device satisfies the first preset condition, it is determined that the bit rate of the video stream needs to be adjusted, and the video stream is sent to the terminal at a second bit rate smaller than the first bit rate. Since the bit rate of the video stream is reduced, the power consumption generated by the terminal playing the video stream is reduced, thereby reducing the power consumption of the terminal. Therefore, it is possible to avoid phenomena such as overheating, video freezes, or shutdown caused by insufficient power when the terminal is used for a long time. Compared with the prior art, the power consumption of the terminal can only be reduced when the terminal is not used by the user, thereby reducing the power consumption of the terminal when the terminal is in use.

With reference to the first aspect, in the first implementation manner of the first aspect of the embodiments of the present application, the first power consumption related information includes the central processing unit (CPU) occupancy rate of the terminal, and the server according to the first power consumption related information Determining that the power consumption of the terminal satisfies the first preset condition includes: the server determining, according to the received CPU occupancy rate of the terminal, that the CPU occupancy rate of the terminal is greater than or equal to the first preset value.

In the embodiment of the present application, the power consumption of the terminal satisfies the first preset condition, which means that the terminal is in a state of excessive power consumption, and the power consumption of the terminal needs to be reduced. Specifically, in this embodiment, the first preset condition may include that the CPU occupancy rate of the terminal is greater than or equal to the first preset value. In addition to the CPU occupancy rate of the terminal, other terminal power consumption information may also satisfy the first preset condition, for example, the remaining power of the terminal is less than or equal to the second preset value, etc., which is not limited here.

In the embodiment of the present application, the server determines that the CPU occupancy rate of the terminal is too high according to the received CPU occupancy rate of the terminal, and reduces the bit rate of the video stream, thereby reducing the CPU occupancy rate of the terminal. It realizes the adjustment of the CPU occupancy rate of the terminal.

In combination with the first aspect or the first implementation manner of the first aspect, in the second implementation manner of the first aspect of the embodiments of the present application, the first power consumption related information includes the CPU occupancy rate of the terminal, and the terminal may report a plurality of first power consumption related information. Power consumption related information, a plurality of first power consumption related information represents the power consumption of the terminal at different times, and the server determines, according to the first power consumption related information, that the power consumption of the terminal meets the first preset condition, including: the server according to the received multiple power consumption related information. The CPU occupancy rate at different times is determined to be an average value of the CPU occupancy rate of the terminal in the first period of time greater than or equal to the first preset value.

In this embodiment of the present application, the bit rate of the video stream is adjusted according to the average value of multiple CPU occupancy rates in the first period. It can prevent improper adjustment of the video stream bit rate caused by abnormal fluctuations in CPU usage. For example, the current CPU resources of the terminal are sufficient to process the received video stream, but the CPU usage increases instantaneously due to occasional events, and then returns to normal immediately. In this case, it is not necessary to adjust the occupancy of the CPU resources of the terminal, and it is also not necessary to adjust the bit rate of the video stream. Adjusting the bit rate of the video stream according to the average value of the CPU usage can avoid improper adjustment of the bit rate of the video stream caused by the instantaneously increased CPU usage.

In combination with the first aspect, the first implementation manner or the second implementation manner of the first aspect, in the third implementation manner of the first aspect of the embodiments of the present application, the first power consumption related information includes the remaining power of the terminal, and the server according to Determining that the power consumption of the terminal satisfies the first preset condition by the first power consumption related information includes: the server determines that the remaining power of the terminal is less than or equal to the second preset value according to the received remaining power of the terminal.

In the embodiment of the present application, the server determines that the remaining power of the terminal is too low according to the received remaining power of the terminal, and reduces the bit rate of the video stream, so as to realize the adjustment of the video stream according to the remaining power of the terminal, so as to prolong the use of the terminal time.

In combination with the third implementation of the first aspect, in the fourth implementation of the first aspect of the embodiments of the present application, the first power consumption related information includes the remaining power of the terminal at the first moment and the remaining power at the second moment, and the At a moment earlier than a second moment, the server determines that the power consumption of the terminal satisfies the first preset condition according to the first power consumption related information, and further includes: the server determines that the remaining power of the terminal is in a constant or decreasing trend, that is, the remaining power at a later moment The value of the power is greater than or equal to the value of the remaining power at the previous moment. Specifically, the server may determine that the remaining power of the terminal at the first moment is greater than or equal to the remaining power at the second moment according to the received remaining power of the terminal.

In this embodiment of the present application, in the case where it is determined that the remaining power of the terminal is less than or equal to the second preset value, it is determined whether the remaining power of the terminal is in a constant or decreasing trend, and the constant or decreasing trend indicates that the power of the terminal may be Decrease, according to this, it is determined that the bit rate of the video stream needs to be reduced to reduce the power consumption of the terminal. Therefore, it can be ensured that when the terminal is in a charging state, the video stream can be received at a high bit rate, that is, the first bit rate, and the video quality of the playback data output by the terminal to the user is guaranteed.

With reference to the first aspect and any one of the first to fourth implementations of the first aspect, in the fifth implementation of the first aspect of the embodiments of the present application, the server uses a code rate lower than the first code rate. Before the second bit rate sends the video stream to the terminal, the method further includes: the server reduces the size of the field of view (field of view, Fov) angle.

In this embodiment of the present application, reducing the size of the Fov angle can reduce the amount of high-definition data included in the video stream, thereby reducing the power consumption or occupied by the terminal when decoding and rendering the video stream.

With reference to the first aspect and any one of the first to fifth implementations of the first aspect, in the sixth implementation of the first aspect of the embodiments of this application, the server uses a code rate lower than the first code rate. Before sending the video stream to the terminal at the second bit rate, the method further includes: the server reduces the bit rate of the video stream, and acquires the video stream according to the bit rate. The bit rate here is a preset value for obtaining a video stream, which is also called a preset bit rate. When the server determines that the power consumption of the terminal is too large, the preset bit rate can be reduced to reduce the bit rate of the video stream.

With reference to the first aspect and any one of the first to sixth implementations of the first aspect, in the seventh implementation of the first aspect of the embodiments of this application, the server uses a code rate lower than the first code rate. Before the second bit rate sends the video stream to the terminal, the method further includes: the server reduces at least one of a peak-to-average ratio, a ratio of a key frame (intra picture, I) to a reference frame (predictive picture, P), a frame rate, and a resolution . Decreasing any of these parameters can lead to a reduction in the bitrate of the video stream.

With reference to the first aspect and any one of the first to seventh implementations of the first aspect, in the eighth implementation of the first aspect of the embodiments of this application, the server uses a code rate lower than the first code rate. Before the second bit rate sends the video stream to the terminal, the method further includes: the server further includes: the server increases at least one of a quantization parameter (quantitative parameters, QP) or a key frame period (group of pictures, GOP). Increasing any of these parameters can lead to a reduction in the bit rate of the video stream.

With reference to the first aspect and any one of the first implementation to the eighth implementation of the first aspect, in the ninth implementation of the first aspect of the embodiments of this application, the server receives the second power consumption from the terminal Related information, the second power consumption related information is used to represent the power consumption of the terminal. When the server determines that the power consumption of the terminal satisfies the second preset condition according to the second power consumption related information, the server sends the video stream to the terminal at a third bit rate higher than the second bit rate.

In the embodiment of the present application, the bit rate of the video stream is reduced according to the first power consumption related information, and then the bit rate of the video stream is increased according to the second power consumption related information. After the video stream bit rate is reduced when the resources are insufficient, the video stream bit rate can be increased when the resources return to a sufficient state, that is, when the power consumption of the terminal satisfies the second preset condition, thereby increasing the video stream bit rate. the video quality of the playback data output to the user.

With reference to the ninth implementation of the first aspect, in the tenth implementation of the first aspect of the embodiments of the present application, the second power consumption related information includes the CPU occupancy rate of the terminal, and the server determines the terminal's CPU occupancy rate according to the second power consumption related information. The power consumption meeting the second preset condition includes: the server determines, according to the received CPU occupancy rate of the terminal, that the CPU occupancy rate of the terminal is less than or equal to the third preset value.

In the embodiment of the present application, the power consumption of the terminal satisfies the second preset condition, indicating that the terminal is not in a state of excessive power consumption, and the power consumption of the terminal can be improved. Specifically, in this embodiment, the second preset condition may include that the CPU occupancy rate of the terminal is less than or equal to the third preset value. In addition to the CPU occupancy rate of the terminal, other terminal power consumption information can also meet the second preset condition, for example, the remaining power of the terminal is greater than or equal to the fourth preset value, etc., which is not limited here.

With reference to the ninth implementation manner of the first aspect, in the eleventh implementation manner of the first aspect of the embodiments of the present application, the second power consumption related information includes the CPU occupancy rate of the terminal, and the terminal may report multiple second power consumption related information. information, multiple pieces of second power consumption related information represent the power consumption of the terminal at different times, and the server determines, according to the second power consumption related information, that the power consumption of the terminal satisfies the second preset condition, including: the server according to the received multiple different times The CPU occupancy rate of the terminal is determined, and the average value of the CPU occupancy rate of the terminal in the second period is less than or equal to the third preset value.

With reference to the ninth implementation of the first aspect, in the twelfth implementation of the first aspect of the embodiments of the present application, the second power consumption related information includes the remaining power of the terminal, and the server determines the terminal's power consumption according to the second power consumption related information. The power consumption meeting the second preset condition includes: the server determining, according to the received remaining power of the terminal, that the remaining power of the terminal is greater than or equal to a fourth preset value. In the embodiment of the present application, the fourth preset value is a threshold value of the remaining power of the terminal. When the remaining power of the terminal is not lower than the threshold, it means that the remaining power of the terminal is not too low, and the function of the terminal can be improved. consumption.

With reference to the ninth implementation manner of the first aspect, in the thirteenth implementation manner of the first aspect of the embodiments of the present application, the terminal may send multiple pieces of second power consumption related information, and the multiple pieces of second power consumption related information indicate that the terminal is in For the remaining power at different times, the server determines that the power consumption of the terminal satisfies the second preset condition according to the second power consumption related information. Specifically, the server determines, according to the received remaining power of the terminal at different times, that the remaining power of the terminal at the fourth time is greater than or equal to the remaining power of the third time, and the third time is earlier than the fourth time.

In the embodiment of the present application, when it is determined that the remaining power of the terminal is no longer reduced, for example, the terminal is in a charging state, it is determined that the terminal can continue to play a video stream with a high bit rate, thereby increasing the bit rate of the video stream. The video quality of the playback data output by the terminal to the user can be guaranteed without reducing the remaining power.

With reference to any one of the ninth implementation manner to the thirteenth implementation manner of the first aspect, in the fourteenth implementation manner of the first aspect of the embodiments of the present application, the server uses a third code rate higher than the second code rate. Before the bit rate sends the video stream to the terminal, the method further includes: the server increases the Fov angle size of the field of view.

In the embodiment of the present application, by increasing the Fov angle size, the amount of high-definition data included in the video stream can be increased, and the video quality of the playback data output to the user can be improved.

With reference to any one of the ninth implementation manner to the fourteenth implementation manner of the first aspect, in the fifteenth implementation manner of the first aspect of the embodiments of the present application, the server uses a third code rate higher than the second code rate. Before the bit rate sends the video stream to the terminal, the method further includes: the server increases the preset bit rate of the video stream, and obtains the video stream according to the bit rate. The bit rate here is a preset value for obtaining a video stream, which is also called a preset bit rate. The server can increase the bit rate of the video stream by increasing the preset bit rate.

With reference to any one of the ninth implementation manner to the fifteenth implementation manner of the first aspect, in the sixteenth implementation manner of the first aspect of the embodiments of the present application, the server uses a third code rate higher than the second code rate. Before the bit rate sends the video stream to the terminal, it further includes: the server increases at least one of a peak-to-average ratio, a ratio of a key frame (intra picture, I) to a reference frame (predictive picture, P), a frame rate, and a resolution. Increasing any of these parameters can lead to an increase in the bit rate of the video stream.

With reference to any one of the ninth implementation manner to the sixteenth implementation manner of the first aspect, in the thirteenth implementation manner of the first aspect of the embodiments of the present application, the server uses a third code rate higher than the second code rate. Before the bit rate sends the video stream to the terminal, the method further includes: the server reduces at least one of a quantization parameter (quantitative parameters, QP) or a key frame period (group of pictures, GOP). Decreasing any of these parameters can lead to an increase in the bit rate of the video stream.

A second aspect of the embodiments of the present application provides a method for adjusting power consumption of a terminal. The method includes: the terminal receives a video stream from a server at a first bit rate. The terminal sends first power consumption related information to the server, where the first power consumption related information is used to indicate the power consumption of the terminal, and the power consumption of the terminal is related to the playback of the video stream. When the server determines that the power consumption of the terminal satisfies the first preset condition according to the first power consumption related information, the terminal receives the video stream from the server at a second bit rate, which is lower than the first bit rate.

For the beneficial effects of the second aspect, refer to the first aspect, which will not be repeated here.

With reference to the second aspect, in the first implementation manner of the second aspect of the embodiments of the present application, the first power consumption related information includes the CPU occupancy rate of the terminal, and the power consumption of the terminal satisfying the first preset condition includes: the CPU occupancy rate of the terminal is greater than or equal to the first preset value; or, the average value of the CPU occupancy rate of the terminal in the first period of time is greater than or equal to the first preset value.

With reference to the second aspect, in the second implementation manner of the second aspect of the embodiments of the present application, the first power consumption related information includes the remaining power of the terminal, and the power consumption of the terminal satisfying the first preset condition includes: the remaining power of the terminal is less than or is equal to the second preset value; or, the remaining power of the terminal is decreasing. Specifically, the remaining power of the terminal at the first moment is greater than the remaining power at the second moment, and the first moment is earlier than the second moment.

With reference to the second aspect and any one of the first implementation to the second implementation of the second aspect, in the third implementation of the second aspect of the embodiments of the present application, the server uses a code lower than the first code After sending the video stream to the terminal at the second bit rate of the rate, the method further includes: the terminal sending second power consumption related information to the server, where the second power consumption related information is used to indicate the power consumption of the terminal, the power consumption of the terminal and the playback of the video stream. related. When the server determines according to the second power consumption related information that the power consumption of the terminal satisfies the second preset condition, the terminal receives the video stream from the server at the third bit rate, the video stream has the third bit rate, and the third bit rate is high at the first bit rate.

In combination with the third implementation of the second aspect, in the fourth implementation of the second aspect of the embodiments of the present application, the second power consumption related information includes the CPU occupancy rate of the terminal, and the second preset condition includes: the CPU occupation of the terminal The rate is less than or equal to the third preset value; or, the average value of the CPU occupancy rate of the terminal in the second period is less than or equal to the third preset value.

With reference to the second aspect and any one of the first to fourth implementations of the second aspect, in the fifth implementation of the second aspect of the embodiments of the present application, the second power consumption related information includes the Remaining power, the second preset condition includes: the remaining power of the terminal is greater than or equal to the fourth preset value; or, the remaining power of the terminal at the third time is less than or equal to the remaining power at the fourth time, and the third time is earlier than the fourth time. time.

The embodiment of the present application also provides a bit rate adjustment method, which is used to adjust the bit rate of the video stream according to the network bandwidth.

A third aspect of the embodiments of the present application provides a method for adjusting a bit rate. The method includes: a server sends a video stream to a terminal at a first bit rate. The server receives the first bandwidth information from the terminal, where the first bandwidth information is used to indicate the network bandwidth of the terminal. The server determines, according to the first bandwidth information, that the network bandwidth of the terminal satisfies the third preset condition. The server sends the video stream to the terminal at a second bit rate lower than the first bit rate.

In this embodiment of the present application, when the terminal receives and plays the video stream with the first bit rate, the server receives the first bandwidth information sent by the terminal, and the server determines, according to the first bandwidth information, that the current network bandwidth is insufficient to carry the video stream. During transmission, it is determined that the bit rate of the video stream needs to be adjusted, and the video stream is sent to the terminal at a second bit rate smaller than the first bit rate. Since the bit rate of the video stream is reduced, the current network bandwidth can carry the transmission of the current video stream. Therefore, it is possible to avoid phenomena such as freezing, video stream packet loss, or untimely video stream transmission occurring in the state of insufficient network bandwidth.

With reference to the third aspect, in the first implementation manner of the third aspect of the embodiments of the present application, the first bandwidth information includes the network bandwidth of the terminal, and the server determines according to the first bandwidth information that the network bandwidth of the terminal meets the third preset condition, including: According to the received network bandwidth of the terminal, the server determines that the network bandwidth of the terminal is less than or equal to the fifth preset value; or, according to the received network bandwidth of the terminal, the server determines that the average value of the network bandwidth of the terminal in the third time period is less than or equal to the fifth preset value; or equal to the fifth preset value.

In the embodiment of the present application, the network bandwidth of the terminal satisfies the third preset condition, indicating that the transmission of the video stream may be greater than the carrying capacity of the network of the terminal, and therefore the bit rate of the video stream may need to be reduced. Specifically, in this embodiment, the third preset condition may include that the network bandwidth of the terminal is less than or equal to the fifth preset value. In addition to the network bandwidth of the terminal, other bandwidth information may also satisfy the third preset condition, for example, the average value of the network bandwidth of the terminal within a certain period is less than or equal to the fifth preset value, etc., which is not limited here.

In this embodiment of the present application, the bit rate of the video stream is adjusted according to the average value of multiple network bandwidths in the third time period. It can prevent improper adjustment of video stream bit rate caused by abnormal fluctuation of network bandwidth. For example, the network bandwidth is momentarily reduced due to occasional events, and then returns to normal immediately. In this case, it is not necessary to adjust the bit rate of the video stream. Adjusting the bit rate of the video stream according to the average value of the network bandwidth can avoid improper adjustment of the bit rate of the video stream caused by the instantaneously reduced network bandwidth.

With reference to the third aspect or the first implementation manner of the third aspect, in the second implementation manner of the third aspect of the embodiments of the present application, before the server sends the video stream to the terminal at a second bit rate lower than the first bit rate, It also includes: the server reduces the field of view (field of view, Fov) angle size; or the server reduces the bit rate of the video stream. The bit rate here is a preset value for obtaining a video stream, which is also called a preset bit rate. When the server determines that the bit rate of the video stream is too large, it can reduce the bit rate of the video stream by reducing the preset bit rate.

With reference to the third aspect and any one of the first implementation manner to the second implementation manner of the third aspect, in the third implementation manner of the third aspect of the embodiments of the present application, the server uses a code rate lower than the first code rate. Before the second bit rate sends the video stream to the terminal, the method further includes: the server reduces at least one of a peak-to-average ratio, a ratio of a key frame (intra picture, I) to a reference frame (predictive picture, P), a frame rate, and a resolution .

With reference to the third aspect and any one of the first to third implementation manners of the third aspect, in the fourth implementation manner of the third aspect of the embodiments of the present application, the server uses a code rate lower than the first code rate. Before sending the video stream to the terminal at the second bit rate, the method further includes: the server increases at least one of a quantization parameter (quantitative parameters, QP) or a key frame period (group of pictures, GOP).

With reference to the third aspect and any one of the first to fourth implementation manners of the third aspect, in the fifth implementation manner of the third aspect of the embodiments of the present application, the server uses a code rate lower than the first code rate. Before the second bit rate sends the video stream to the terminal, the method further includes: the server determines a first target bit rate according to the first bandwidth information, where the first target bit rate is the product of the first bandwidth information and a preset ratio. The server reduces the preset bit rate of the video stream according to the first target bit rate.

In this embodiment of the present application, the bit rate of the video stream is reduced according to the first bandwidth information, so as to determine the most suitable bit rate for the current network. It can avoid the problems caused by the bit rate of the video stream being greater than the network bandwidth, such as freezing, packet loss of the video stream, or untimely transmission of the video stream.

With reference to the third aspect and any one of the first to fourth implementation manners of the third aspect, in the sixth implementation manner of the third aspect of the embodiments of the present application, the server may receive multiple pieces of first bandwidth information , and the multiple pieces of first bandwidth information represent bandwidth information of the terminal at different times. Before the server sends the video stream to the terminal at the second bit rate lower than the first bit rate, the method further includes: the server determines, according to a plurality of pieces of first bandwidth information, an average value of the network bandwidth of the terminal in the fourth period, and the average value is called The first bandwidth average. The server determines the first target code rate according to the first average bandwidth, where the first target code rate is the product of the first average bandwidth and a preset ratio. The server reduces the preset bit rate of the video stream according to the first target bit rate.

In the embodiment of the present application, the excessively frequent adjustment of the bit rate of the video stream caused by the network fluctuation is reduced by the first bandwidth average value.

With reference to the third aspect and any one of the first to sixth implementation manners of the third aspect, in the seventh implementation manner of the third aspect of the embodiments of the present application, the server uses a code rate lower than the first code rate. After the second bit rate sends the video stream to the terminal, the method further includes: the server receives second bandwidth information from the terminal, where the second bandwidth information is used to indicate the network bandwidth of the terminal. The server determines a second target code rate according to the second bandwidth information, where the second target code rate is the product of the second bandwidth information and a preset ratio. The server increases the bit rate of the video stream according to the second target bit rate, and sends the video stream to the terminal at a third bit rate higher than the second bit rate. The bit rate here is a preset value for obtaining a video stream, which is also called a preset bit rate. When the server determines that the network bandwidth of the terminal can carry a video stream with a higher bit rate, the video stream bit rate can be improved by increasing the preset bit rate.

In this embodiment of the present application, the bit rate of the second video stream is determined according to the product of the second bandwidth information and the preset ratio. Can maximize the use of network bandwidth.

With reference to the third aspect and any one of the first to sixth implementation manners of the third aspect, in the eighth implementation manner of the third aspect of the embodiments of the present application, the server uses a code rate lower than the first code rate. After the second bit rate sends the video stream to the terminal, the method further includes: the server receives second bandwidth information from the terminal, where the second bandwidth information is used to indicate the network bandwidth of the terminal. The server may receive multiple pieces of second bandwidth information, where the multiple pieces of second bandwidth information represent bandwidth information of the terminal at different times. The server determines the average value of the network bandwidth of the terminal in the fifth period according to the plurality of pieces of second bandwidth information, and the average value is called the second bandwidth average value. The server determines the second target code rate according to the second average bandwidth, where the second target code rate is the product of the second average bandwidth and the preset ratio. The server increases the preset bit rate of the video stream according to the second target bit rate, and sends the video stream to the terminal at a third bit rate higher than the second bit rate.

A fourth aspect of the embodiments of the present application provides a method for adjusting a bit rate. The method includes: a terminal receives a video stream from a server at a first bit rate. The terminal sends first bandwidth information to the server, where the first bandwidth information is used to indicate the network bandwidth of the terminal. In the case that the network bandwidth of the terminal satisfies the third preset condition, the terminal receives the video stream from the server at the second bit rate, and the second bit rate is lower than the first bit rate.

For the beneficial effects of the fourth aspect of the embodiments of the present application, refer to the third aspect, which will not be repeated here.

With reference to the fourth aspect, in the first implementation manner of the fourth aspect of the embodiments of the present application, the first bandwidth information includes the network bandwidth of the terminal, and the network bandwidth of the terminal satisfying the third preset condition includes: the network bandwidth of the terminal is less than or equal to the third five preset values; or, the average value of the network bandwidth of the terminal in the third time period is less than or equal to the fifth preset value.

With reference to the fourth aspect or the first implementation manner of the fourth aspect, in the second implementation manner of the fourth aspect of the embodiments of the present application, after the terminal receives the video stream from the server at the second bit rate, the method further includes: sending the terminal to the server Send second bandwidth information, where the second bandwidth information is used to indicate the network bandwidth of the terminal; the terminal receives the video stream from the server at a third code rate, and the third code rate is higher than the second code rate.

A fifth aspect of the embodiments of the present application provides a device for adjusting a code rate, where the device includes: a processor and a memory coupled to the processor. The memory is used to store executable instructions, and the executable instructions are used to instruct the processor to perform the method of the foregoing first aspect.

A sixth aspect of the embodiments of the present application provides a device for adjusting a code rate, where the device includes: a processor and a memory coupled to the processor. The memory is used to store executable instructions, and the executable instructions are used to instruct the processor to perform the method of the aforementioned second aspect.

A seventh aspect of an embodiment of the present application provides a device for adjusting a code rate, where the device includes: a processor and a memory coupled to the processor. The memory is used to store executable instructions, and the executable instructions are used to instruct the processor to perform the method of the foregoing third aspect.

An eighth aspect of the embodiments of the present application provides a device for adjusting a code rate, where the device includes: a processor and a memory coupled to the processor. The memory is used to store executable instructions, and the executable instructions are used to instruct the processor to perform the method of the foregoing fourth aspect.

A ninth aspect of an embodiment of the present application provides a computer-readable storage medium, where a program is stored in the computer-readable storage medium, and when the computer executes the program, the first aspect or the third aspect described above is executed. method.

A tenth aspect of an embodiment of the present application provides a computer-readable storage medium, where a program is stored in the computer-readable storage medium, and when the computer executes the program, the computer-readable storage medium executes the second aspect or the fourth aspect. method.

An eleventh aspect of the embodiments of the present application provides a computer program product. When the computer program product is executed on a computer, the computer executes the method described in the first aspect or the third aspect.

A twelfth aspect of the embodiments of the present application provides a computer program product. When the computer program product is executed on a computer, the computer executes the method described in the foregoing second aspect or the fourth aspect.

Description of drawings

Fig. 1 is the scene schematic diagram that the server provides video stream;

2 is a flowchart of a method for adjusting power consumption of a terminal in an embodiment of the present application;

3 is another flowchart of a method for adjusting power consumption of a terminal in an embodiment of the present application;

4 is another flowchart of a method for adjusting power consumption of a terminal in an embodiment of the present application;

5 is another flowchart of a method for adjusting power consumption of a terminal in an embodiment of the present application;

6 is another flowchart of a method for adjusting power consumption of a terminal in an embodiment of the present application;

7 is another flowchart of a method for adjusting power consumption of a terminal in an embodiment of the present application;

8 is another flowchart of a method for adjusting power consumption of a terminal in an embodiment of the present application;

FIG. 9 is another flowchart of a method for adjusting power consumption of a terminal in an embodiment of the present application;

10 is another flowchart of a method for adjusting power consumption of a terminal in an embodiment of the present application;

11 is another flowchart of a method for adjusting power consumption of a terminal in an embodiment of the present application;

12 is another flowchart of a method for adjusting power consumption of a terminal in an embodiment of the present application;

13 is another flowchart of a method for adjusting power consumption of a terminal in an embodiment of the present application;

14 is a flowchart of a method for adjusting a code rate in an embodiment of the present application;

FIG. 15 is another flowchart of a method for adjusting a code rate in an embodiment of the present application;

16 is another flowchart of a method for adjusting a code rate in an embodiment of the present application;

17 is another flowchart of a method for adjusting a code rate in an embodiment of the present application;

18 is a schematic structural diagram of a server in an embodiment of the present application;

FIG. 19 is a schematic structural diagram of a terminal in an embodiment of the present application.

Detailed ways

The embodiment of the present application provides a method for adjusting the power consumption of a terminal, which adjusts the power consumption of the terminal when the terminal is in a use state.

In this embodiment of the present application, the power consumption of the terminal represents the power or energy consumption of the terminal, which is a resource required or generated for processing received data, and may specifically include remaining power or CPU occupancy.

Please refer to FIG. 1 , which is a schematic diagram of a scenario in which a server provides a video stream to a terminal. Based on this scenario, the terminal can process the video stream from the server and play it to the user.

Next, some data appearing in the examples of the present application will be described. The film source data is the data obtained by the server, the video stream is the data sent by the server to the terminal, and the playback data is the data output by the terminal to the user.

Specifically, the server obtains slice source data, obtains a video stream according to the slice source data, and then sends the video stream to the terminal. After receiving the video stream, the terminal performs processing such as decoding the video stream to obtain playback data for output to the user.

In this embodiment of the present application, the terminal is also referred to as user equipment (user equipment, UE).

In this embodiment of the present application, in addition to decoding, the server may also have other processing methods for the video stream, such as rendering, which is not specifically limited here.

Processing video streams by a terminal will generate power consumption. To prevent excessive power consumption of the terminal, in an example, the method of adjusting the power consumption of the terminal is to detect the use state of the terminal, and turn off the terminal when it is detected that the terminal is not being used by the user. However, this method can only reduce the power consumption of the terminal when the terminal is not in use, and cannot adjust the power consumption of the terminal when the terminal is in use. The embodiment of the present application will provide a data processing method to realize the adjustment of the power consumption of the terminal when the terminal is in a use state.

The method for adjusting the power consumption of the terminal in the embodiment of the present application is as follows: the terminal reports the first power consumption related information to the server, and the first power consumption related information is used to indicate the power consumption of the terminal, and the power consumption of the terminal is related to the playback of the video stream by the terminal. . The server determines and adjusts the bit rate according to the first power consumption related information, and the bit rate is the bit rate of the video stream sent to the terminal, so that the bit rate of the adjusted video stream is different from that of the pre-adjusted video stream. The power consumption of the terminal is adjusted by adjusting the bit rate of the video stream.

In the embodiment of the present application, the server determines the power consumption information of the terminal according to the first power consumption related information, and when the terminal power consumption information satisfies the first preset condition, triggers to adjust the bit rate of the video stream.

The first power consumption related information is used to represent the power consumption of the terminal. In addition to the information that is represented by the CPU occupancy rate and represents the resources consumed by the terminal to process the video stream, the first power consumption related information may also be other information, which is not limited here. For example, the first power consumption related information may also be a resource indicating that the terminal is currently available for processing a video stream, and the resource may be the remaining power. In addition to the remaining power, the resource may also be other resources such as network bandwidth, which are not limited here. Next, different first power consumption related information will be illustrated by example.

1. The first power consumption related information is the CPU occupancy rate.

In this embodiment of the present application, the video stream bit rate can be adjusted by adjusting processing parameters.

In this embodiment of the present application, the video stream sent by the server before receiving the first state information is called the first video stream, and the video stream obtained by the server after adjusting the processing parameters is called the second video stream. The bit rate of the first video stream is greater than the bit rate of the second video stream, that is to say, the embodiment of the present application realizes the adjustment of the bit rate of the video stream by adjusting the processing parameters, and reduces the bit rate of the video stream, thereby reducing the bit rate of the video stream. Reduce the power consumption of the terminal.

In this embodiment of the present application, the processing parameters can be divided into initial processing parameters and first target processing parameters. The initial processing parameters are processing parameters before receiving the first power consumption related information, and the first target processing parameters are the processing parameters after being reduced. . The first video stream can be obtained according to the initial processing parameters, and the second video stream can be obtained according to the first target processing parameters.

In this embodiment of the present application, the processing parameter may be a field of view (field of view, Fov) angle size. In addition to the Fov angle, there are many possible processing parameters, such as preset bit rate, peak-to-average ratio, ratio of key frame I to reference frame P, frame rate, resolution, quantization parameter (QP) or key The frame period (group of pictures, GOP), etc., is not specifically limited here. The different processing parameters are exemplified next.

In this embodiment of the present application, the bit rate as a processing parameter is a preset value for obtaining a video stream, which is also referred to as a preset bit rate. The server can adjust the bit rate of the video stream by adjusting the preset bit rate.

1. The processing parameters are the Fov angle and the preset bit rate.

Please refer to FIG. 2 , which is a flowchart of a method for adjusting power consumption of a terminal in an embodiment of the present application. When the first state information is the CPU occupancy rate, and the adjusted processing parameters are the Fov angle and the preset bit rate, the process of the method for adjusting the power consumption of a terminal provided by the embodiment of the present application includes:

201. The server obtains the film source data.

When the server receives a play instruction from the terminal, the server can obtain the source data of the film. The play instruction indicates that the terminal needs to obtain the video stream for playing.

In this embodiment of the present application, obtaining slice source data may also be triggered by other conditions. For example, the trigger condition may also be that the server receives a data identifier from the terminal, etc. The data identifier is used to indicate slice source data, which is not specifically limited here.

202. The server generates a first video stream, and sends the first video stream to the terminal.

The server performs encoding processing on the slice source data according to the initial processing parameters to obtain the first video stream.

Specifically, the h264 standard may be used for encoding, and in addition to h264, other standards such as h265 may also be used for encoding, which is not limited here.

In the embodiment of the present application, the specific values of the initial processing parameters are: the Fov angle size is 120×120, and the preset bit rate is 30 Mbps.

It should be noted that the specific values of the initial processing parameters are only examples of the initial processing parameters, and do not limit the types and values of the initial processing parameters. The initial processing parameter may also be of other types and values. For example, the type of the processing parameter is frame rate, and the specific value is 120 frames per second, etc., which is not limited here.

In this embodiment of the present application, in addition to encoding, the server may also have other processing methods for acquiring video streams, such as sampling, which is not limited here.

In this embodiment of the present application, the initial processing parameters are processing parameters preset by the server, and the initial processing parameters may also come from other sources, which are not specifically limited here. For example, the initial processing parameter may be the processing parameter on which the server obtains the video stream in the last play task.

After acquiring the first video stream, the server sends the first video stream to the terminal.

Specifically, the server may encapsulate the first video stream through the Box protocol, and then encapsulate the first video stream through the HTTP-based dynamic adaptive streaming (dynamic adaptive streaming over HTTP, DASH) protocol. In this embodiment of the present application, in addition to the box protocol, the video stream can also be encapsulated by other protocols, such as a transport stream (transport stream, TS) protocol, which is not limited here. In addition to the DASH protocol, other protocols can also be used for encapsulation, such as a hypertext transfer protocol real-time streaming (HTTP Live Streaming, HLS) protocol, which is not limited here.

Specifically, the server may send the video stream through a network protocol represented by a hypertext transfer protocol (HTTP). In addition to HTTP, the server can also send through other protocols, such as the quick UDP internet connection (QUIC) protocol, etc., which are not limited here.

203. The terminal decodes the first video stream, and outputs playback data to the user.

After receiving the first video stream, the terminal decodes the first video stream to obtain playback data, and outputs the playback data to the user.

Specifically, outputting the playing data may be displaying the playing data on the screen of the terminal, and the screen is used for the user to receive the playing data from the terminal. The terminal may also output the playback data in other ways, for example, transmitting the playback data to a module or unit for displaying the playback data to the user, which is not specifically limited here.

In this embodiment of the present application, in addition to decoding, the terminal may process the first video stream in other ways to obtain playback data, such as rendering, which is not specifically limited here.

204. The terminal reports the CPU usage to the server.

Processing the received video stream will occupy the CPU running resources of the terminal. At this time, the terminal obtains the CPU occupancy rate, and the CPU occupancy rate represents the resources consumed by the terminal to process the received video stream. In this embodiment of the present application, the reported CPU occupancy rate at this time is the first power consumption related information.

Specifically, the terminal can collect the average occupancy rate of multiple CPUs. When a single CPU occupies too much, it can coordinate the processing resources of other CPU cores to share the workload of the CPU core. Collecting the average value can ensure the processing of multiple CPU cores. Reasonable use of resources to prevent over-regulation.

Specifically, the terminal may report the first power consumption related information periodically, for example, once every 5 seconds. In addition to periodic reporting, it can also be reported in other ways, such as reporting when certain reporting conditions are met, which is not limited here.

Specifically, 5 seconds is only an example of the reporting period, and the reporting period may also be 10 seconds or 12 seconds, which is not limited here.

Specifically, the reporting condition may be that the terminal determines that the CPU occupancy rate exceeds 40%, or may be other forms of conditions, for example, the terminal determines that the remaining power is less than 20%, etc., which is not limited here.

Specifically, the CPU occupancy rate reported here may be the CPU occupancy rate generated by the terminal processing the first video stream. It may also be the CPU occupancy rate generated by processing the video stream received before or after the first video stream, as long as the processed video stream is obtained according to the initial processing parameters, which is not limited here. For the terminal, the common point of these video streams is that the bit rate is the same.

Specifically, the terminal may report the first power consumption related information through a network protocol represented by HTTP. In addition to HTTP, the terminal can also report through other protocols, such as transmission control protocol (transmission control protocol, TCP), etc., which are not limited here.

205. The server determines, according to the CPU occupancy rate reported by the terminal, that the power consumption of the terminal satisfies the first preset condition.

After receiving the CPU occupancy rate reported by the terminal, the server may determine the power consumption of the terminal according to the CPU occupancy rate, and when it is determined that the CPU occupancy rate meets the first preset condition, adjust the processing parameters to obtain a video stream with a bit rate lower than the first video stream. video stream.

In the embodiment of the present application, the power consumption of the terminal satisfies the first preset condition, indicating that the terminal is in a state of excessive power consumption, and the power consumption of the terminal needs to be reduced. Specifically, in this embodiment, the first preset condition may include that the CPU occupancy rate of the terminal is greater than or equal to the first preset value. In addition to the CPU occupancy rate of the terminal, other terminal power consumption information may also satisfy the first preset condition, for example, the remaining power of the terminal is less than or equal to the second preset value, etc., which is not limited here.

Specifically, in this embodiment, since the first power consumption related information is the CPU occupancy rate, the server may determine the CPU occupancy rate of the terminal according to the received CPU occupancy rate, and start when it is determined that the CPU occupancy rate is greater than or equal to 40% timing. The CPU usage of the terminal is recorded within 30 seconds from the timing. When the server determines that the average over 30 seconds is greater than or equal to 40%, the processing parameters are adjusted. That is to say, the power consumption of the terminal in this embodiment is the CPU occupancy rate of the terminal.

In this embodiment of the present application, the average value of the CPU occupancy rate of the terminal within 30 seconds is greater than or equal to 40%, and 40% is referred to as the first preset value. In this embodiment of the present application, the first preset value is a threshold of the terminal's CPU occupancy. When the terminal's CPU occupancy exceeds the threshold, it means that the terminal's CPU occupancy is too high, and the terminal's CPU occupancy needs to be reduced. Besides 40%, the first preset value may also be other values, such as 30%, 50%, 60%, 70%, 80% or 90%, etc., which are not limited here.

In this embodiment of the present application, the average value of the CPU occupancy rate of the terminal within 30 seconds is greater than or equal to 40%, which is the first preset condition. If the power consumption of the terminal satisfies the first preset condition, it means that the resources used by the current terminal for processing the video stream are insufficient to process the current video stream, or the current video stream is processed according to the current resources, and the effect is not good. In this case, the processing parameters are adjusted to reduce the The bitrate size of the video stream. In addition to the average CPU usage within 30 seconds being greater than or equal to 40%, the first preset condition may also be other conditions, such as the remaining power of the terminal is less than a certain threshold and is in a downward trend, which is not specifically limited here.

206. The server reduces the Fov angle size and the preset bit rate to obtain a second video stream.

When the server determines that the power consumption of the terminal meets the first preset condition, it determines that the power consumption of the terminal is too high, and needs to reduce the power consumption of the terminal.

Specifically, the server reduces the power consumption of the terminal by reducing the bit rate of the video stream, and adjusts the bit rate of the video stream by adjusting the processing parameters.

Specifically, the server reduces the Fov angle size and the preset bit rate, and processes the source data according to the adjusted Fov angle size and the preset bit rate to obtain the second video stream. The bit rate of the second video stream is smaller than the bit rate of the first video stream. For the processing method, refer to step 202, which will not be repeated here.

The reduced Fov angle and the reduced preset code rate are called the first target processing parameter.

Specifically, the size of the Fov angle can be set as 90*90, and the preset bit rate can be set as 20Mbps. That is, in this embodiment, the first target processing parameters are the Fov angle size of 90×90 and the preset bit rate of 20 Mbps. The server intercepts the VR spherical high-definition picture at 90×90, and then encodes the intercepted picture according to the preset bit rate of 20 Mbps to obtain the second video stream.

Since the Fov angle size of the first target processing parameter is smaller than the Fov angle size of the initial processing parameter, the second video stream contains less high-definition data than the first video stream. And the preset code rate of the first target processing parameter is smaller than the preset code rate of the initial processing parameter, then the code rate of the second video stream is smaller than the code rate of the first video stream.

In this embodiment of the present application, in addition to the Fov angle and the preset bit rate, other processing parameters can also be adjusted to adjust the bit rate of the video stream, such as peak-to-average ratio, key frame (intra picture, I) and reference frame (predictive frame) picture, P) ratio, frame rate, resolution, quantization parameter (quantization parameter, QP) or key frame period (Group of Pictures, GOP), etc., which are not limited here. The P frame is also referred to as a pre- and post-prediction coded frame, which is not limited here. For example, when the initial processing parameter is a frame rate of 120 frames per second, step 206 may reduce the frame rate for the server, and the first target processing parameter may be a frame rate of 100 frames per second, which is not limited here.

207. The server sends the second video stream to the terminal.

After acquiring the second video stream, the server can send the second video stream to the terminal.

For the encoding, encapsulation and transmission manner of the second video stream, refer to step 202, and details are not repeated here.

208. The terminal decodes the second video stream, and outputs playback data to the user.

For the process of the terminal decoding the second video stream and outputting the playback data to the user, refer to the process of the terminal decoding the first video stream and outputting the playback data to the user in step 203, and details are not repeated here.

Since the Fov angle size of the second video stream is smaller than that of the first video stream, the second video stream contains less high-definition data than the first video stream. The power consumption generated by the terminal performing rendering processing on the second video stream is smaller than the power consumption generated by performing rendering processing on the first video stream. Moreover, since the bit rate of the second video stream is lower than that of the first video stream, the power consumption of the terminal for processing the second video stream is smaller than the power consumption for processing the first video stream.

In the embodiment of the present application, through the interaction between the server and the terminal, the bit rate of the video stream sent to the terminal is reduced on the server side, thereby reducing the power consumption of the terminal for processing the video stream.

2. The processing parameter is the Fov angle size:

Next, it is explained that the first state information is the CPU occupancy rate of the terminal. When the adjusted processing parameter is the size of the Fov angle, a data processing method is provided in the embodiment of the present application. Please refer to FIG. 3. FIG. 3 is a schematic flowchart of a method for adjusting power consumption of a terminal provided by an embodiment of the present application. The flow of the method for adjusting power consumption of a terminal includes:

301-305.

Steps 301 to 305 refer to steps 201 to 205 in the embodiment shown in FIG. 2 , and details are not described herein again.

306. The server reduces the size of the Fov angle to obtain a second video stream.

When the first preset condition is met, the server may reduce the bit rate of the video stream by reducing the Fov angle size. In this embodiment, the reduced Fov angle is referred to as the first target processing parameter.

Specifically, the size of the Fov angle can be set as 90×90. That is, in this embodiment, the first target processing parameter is the Fov angle size of 90×90. The server intercepts the VR spherical high-definition picture at 90×90, and then performs corresponding processing to obtain the second video stream. The bit rate of the second video stream is smaller than the bit rate of the first video stream.

Since the Fov angle size of the first target processing parameter is smaller than the Fov angle size of the initial processing parameter, the second video stream contains less high-definition data than the first video stream.

In this embodiment of the present application, in addition to the Fov angle, other processing parameters can also be adjusted to adjust the bit rate of the video stream, such as preset bit rate, peak-to-average ratio, ratio of key frame I to reference frame P, frame rate, Resolution, quantization parameter QP or key frame period GOP, etc., are not limited here.

For the description of the first preset condition, refer to step 205 in the example implementation example in FIG. 2 , which will not be repeated here.

307. The server sends the second video stream to the terminal.

After acquiring the second video stream, the server sends the second video stream to the terminal.

For the encoding, encapsulation, and transmission manner of the second video stream, refer to step 202 in the embodiment shown in FIG. 2 , and details are not repeated here.

308. The terminal decodes the second video stream, and outputs playback data to the user.

For this step, refer to step 208 in the embodiment shown in FIG. 2 , and details are not repeated here.

Since the Fov angle size of the second video stream is smaller than that of the first video stream, the second video stream contains less high-definition data than the first video stream. The power consumption generated by the terminal performing rendering processing on the second video stream is smaller than the power consumption generated by performing rendering processing on the first video stream. Moreover, since the Fov angle size of the second video stream is smaller than that of the first video stream, under the condition of the same preset bit rate, the bit rate of the second video stream will also be smaller than that of the first video stream.

3. The processing parameter is the preset bit rate:

Next, it is explained that the first power consumption related information is the CPU occupancy rate of the terminal. When the adjusted processing parameter is a preset bit rate, a data processing method is provided in an embodiment of the present application. Please refer to FIG. 4. FIG. 4 is a schematic flowchart of a method for adjusting power consumption of a terminal provided by an embodiment of the present application. The flow of the method for adjusting power consumption of a terminal includes:

401-405.

For steps 401 to 405, reference may be made to steps 201 to 205 in the embodiment shown in FIG. 2, and details are not repeated here.

406. The server reduces the preset bit rate to obtain a second video stream.

When the first preset condition is met, the server may reduce the code rate of the video stream by reducing the preset code rate. In this embodiment, the reduced preset code rate is called the first target processing parameter.

Specifically, the preset bit rate may be set as 20Mbps. That is, in this embodiment, the first target processing parameter is a preset bit rate of 20 Mbps. The server encodes the film source data at a preset bit rate of 20 Mbps, and obtains the second video stream.

Since the preset bit rate of the first target processing parameter is smaller than the preset bit rate of the initial processing parameter, the bit rate of the second video stream is smaller than the bit rate of the first video stream.

In this embodiment of the present application, in addition to the Fov angle, other processing parameters can also be adjusted to adjust the bit rate of the video stream, such as the Fov angle, peak-to-average ratio, ratio of key frame I to reference frame P, frame rate, resolution rate, quantization parameter QP or key frame period GOP, etc., which are not limited here.

407. The server sends the second video stream to the terminal.

408. The terminal decodes the second video stream, and outputs playback data to the user.

Since the preset bit rate of the second video stream is smaller than that of the first video stream, the bit rate of the second video stream is smaller than that of the first video stream. The processing of the second video stream by the terminal consumes, requires or generates less power consumption than processing the first video stream.

In the embodiments of the present application, in addition to reducing the power consumption of the terminal, it is also possible to increase the bit rate of the video stream when the resources allow, so as to improve the video quality of the playback data.

4. The processing parameters are the Fov angle size and the preset bit rate, and the video quality can be improved after reducing the power consumption.

Please refer to FIG. 5 , which is a flowchart of a method for adjusting power consumption of a terminal in an embodiment of the present application. Based on the process of FIG. 2 , that is, when the first power consumption related information is the CPU occupancy rate, and the adjusted processing parameters are the Fov angle and the preset code rate, the process of the method for adjusting the power consumption of a terminal provided by an embodiment of the present application includes the following steps: :

501-508.

For steps 501 to 508, refer to steps 201 to 208 in the implementation example of FIG. 2, and details are not repeated here.

509. The terminal reports the CPU usage to the server.

Processing the received video stream will occupy the CPU running resources of the terminal. At this time, the terminal obtains the CPU occupancy rate, and the CPU occupancy rate represents the resources consumed by the terminal to process the received video stream. In this embodiment of the present application, the reported CPU occupancy rate at this time is the second power consumption related information.

Specifically, the terminal may report the second power consumption related information periodically, for example, once every 5 seconds. In addition to periodic reporting, it can also be reported in other ways, such as reporting when certain reporting conditions are met, which is not limited here.

Specifically, the reporting condition may be that the terminal determines that the CPU occupancy rate is less than 40%, or may be other forms of conditions, for example, the terminal determines that the remaining power is greater than 20%, etc., which is not limited here.

Specifically, the CPU usage reported here may be the CPU usage generated by the terminal processing the second video stream. It may also be the CPU occupancy rate generated by processing the video stream received before or after the second video stream, as long as the processed video stream is obtained according to the first target processing parameter, which is not limited here. For the terminal, the common point of these video streams is that the bit rate is the same.

Specifically, the terminal may report the second power consumption related information through a network protocol represented by HTTP. In addition to HTTP, the terminal can also report through other protocols, such as TCP, etc., which is not limited here.

510. The server determines, according to the CPU occupancy rate reported by the terminal, that the power consumption of the terminal satisfies the second preset condition.

After receiving the CPU occupancy rate reported by the terminal, the server may determine the power consumption of the terminal according to the CPU occupancy rate, and when it is determined that the CPU occupancy rate meets the second preset condition, adjust the processing parameters to obtain a video stream with a bit rate greater than that of the second video stream. video stream.

In the embodiment of the present application, the power consumption of the terminal satisfies the second preset condition, indicating that the terminal is not in a state of excessive power consumption, and the power consumption of the terminal can be improved. Specifically, in this embodiment, the second preset condition may include that the CPU occupancy rate of the terminal is less than or equal to the third preset value. In addition to the CPU occupancy rate of the terminal, other terminal power consumption information may also satisfy the second preset condition, for example, the remaining power of the terminal is greater than or equal to the second preset value, etc., which is not limited here.

Specifically, in this embodiment, since the second power consumption related information is the CPU occupancy rate, the server may determine the CPU occupancy rate of the terminal according to the received CPU occupancy rate. When it is more than one minute before the initial processing parameter is adjusted to the first target processing parameter, and it is determined that the CPU occupancy rate is less than or equal to 40%, the timing starts. The CPU usage of the terminal is recorded within 30 seconds from the timing. When the server determines that the average over 30 seconds is less than or equal to 40%, the processing parameters are adjusted. That is to say, the power consumption of the terminal in this embodiment is the CPU occupancy rate of the terminal.

In this embodiment of the present application, the average value of the CPU occupancy rate of the terminal within 30 seconds is less than or equal to 40%, and 40% is referred to as the third preset value. In this embodiment of the present application, the third preset value is a threshold of the CPU usage of the terminal. When the CPU usage of the terminal is less than the threshold, it means that the CPU of the terminal is not over-occupied, and the CPU of the terminal can be improved. Occupancy rate. Besides 40%, the third preset value can also be other values, such as 30%, 50%, 60%, 70%, 80% or 90%, etc., which are not limited here.

In the embodiment of the present application, the 30 seconds of timing is only an example of the timing time, and does not limit the timing time.

In this embodiment of the present application, the average value of the CPU occupancy rate of the terminal within 30 seconds is less than or equal to 40%, which is the second preset condition. When the second preset condition is met, the processing parameter is adjusted to increase the bit rate of the video stream. In addition to the average CPU occupancy rate within 30 seconds being less than or equal to 40%, the second preset condition may also be other conditions, such as the remaining power of the terminal is greater than a certain threshold or is in an upward trend, which is not specifically limited here.

511. The server increases the Fov angle size and the preset bit rate to obtain a third video stream.

When the server determines that the average CPU occupancy rate within 30 seconds is less than or equal to 40%, it determines that the resources of the terminal are sufficient to support the playback of a video stream with a higher bit rate, that is, the video quality of the playback data can be improved.

Specifically, the server increases the bit rate of the video stream by increasing the Fov angle size and the preset bit rate, thereby improving the video quality of the playback data.

Specifically, the server increases the Fov angle size and at the same time increases the preset bit rate, and processes the film source data according to the adjusted Fov angle size and the preset bit rate to obtain the third video stream. The bit rate of the third video stream is greater than the bit rate of the second video stream. For the processing method, refer to step 202 in the embodiment shown in FIG. 2 , and details are not repeated here.

The increased Fov angle and the preset code rate are called the second target processing parameter.

Specifically, the size of the Fov angle can be set as 120×120, and the preset bit rate can be set as 30Mbps. That is, in this embodiment, the second target processing parameters are the Fov angle size of 120×120 and the preset bit rate of 30 Mbps. The server intercepts the VR spherical high-definition picture at 120×120, and then encodes the intercepted picture according to the preset bit rate of 30 Mbps to obtain a third video stream.

Since the Fov angle size of the second target processing parameter is larger than the Fov angle size of the first target processing parameter, the third video stream contains more high-definition data than the second video stream. And the preset code rate of the second target processing parameter is greater than the preset code rate of the first target processing parameter, then the code rate of the third video stream is greater than the code rate of the second video stream, and the playback obtained according to the third video stream The data has better video quality than the playback data obtained from the second video stream.

In this embodiment of the present application, in addition to the Fov angle and the preset bit rate, other processing parameters can also be adjusted to adjust the quality of the playback data, such as peak-to-average ratio, ratio of key frame I to reference frame P, frame rate, resolution rate, quantization parameter QP or key frame period GOP, etc., which are not limited here. For example, when the first target processing parameter is a frame rate of 100 frames per second, step 511 may increase the frame rate for the server, and the second target processing parameter may be a frame rate of 120 frames per second, which is not limited here.

512. The server sends a third video stream to the terminal.

After acquiring the third video stream, the server can send the third video stream to the terminal.

For the encoding, encapsulation, and transmission methods of the third video stream, refer to step 202 in the embodiment shown in FIG. 2 , and details are not repeated here.

513. The terminal decodes the third video stream, and outputs playback data to the user.

For the process of the terminal decoding the third video stream and outputting the playback data to the user, refer to the process of the terminal decoding the first video stream and outputting the playback data to the user in step 203, and details are not repeated here.

Since the Fov angle size of the third video stream is larger than that of the second video stream, the third video stream contains more high-definition data than the second video stream. And the preset bit rate of the third video stream is larger than that of the second video stream, and the bit rate of the third video stream is greater than the bit rate of the second video stream.

Since the third video stream has a larger Fov angle size and preset bit rate than the second video stream, the playback data obtained by processing the third video stream is better than the playback data obtained by processing the second video stream. video quality.

In the embodiment of the present application, not only the power consumption of the terminal is reduced when the resources are insufficient, but also the video quality of the playback data is improved when the resources are sufficient.

5. The processing parameter is the size of the Fov angle, and the video quality is improved after reducing power consumption.

Please refer to FIG. 6 , which is a flowchart of a method for adjusting power consumption of a terminal in an embodiment of the present application. Based on the process of FIG. 3 , that is, when the first power consumption related information is the CPU occupancy rate, and the adjusted processing parameter is the Fov angle, the process of a method for adjusting the power consumption of a terminal provided by an embodiment of the present application includes:

601-608.

For steps 601 to 608, refer to steps 301 to 308 of the implementation example in FIG. 3, and details are not repeated here.

609. The terminal reports the CPU usage to the server.

610. The server determines, according to the CPU occupancy rate reported by the terminal, that the power consumption of the terminal satisfies the second preset condition.

For steps 609-610, refer to steps 509-510 in the embodiment shown in FIG. 5, and details are not repeated here.

611. The server increases the size of the Fov angle to obtain a third video stream.

Specifically, the server increases the bit rate of the video stream by increasing the Fov angle size, thereby improving the video quality of the playback data.

Specifically, the server increases the Fov angle size, and processes the film source data according to the adjusted Fov angle size to obtain the third video stream. The bit rate of the third video stream is greater than the bit rate of the second video stream. For the processing method, refer to step 202 in the embodiment shown in FIG. 2 , and details are not repeated here.

The increased Fov angle is called the second target processing parameter.

Specifically, the size of the Fov angle can be set as 120×120. That is, in this embodiment, the second target processing parameter is the Fov angle size of 120×120. The server performs 120×120 interception on the VR spherical high-definition picture, and then performs corresponding processing on the intercepted picture to obtain a third video stream.

Since the Fov angle size of the second target processing parameter is larger than the Fov angle size of the first target processing parameter, the third video stream contains more high-definition data than the second video stream. Even if the third video stream and the second video stream are obtained according to the same preset bit rate, the bit rate of the third video stream will be greater than the bit rate of the second video stream, and according to the playback data obtained from the third video stream, It has better video quality than the playback data obtained according to the second video stream.

In this embodiment of the present application, in addition to the Fov angle, other processing parameters can also be adjusted to adjust the quality of playback data, such as preset bit rate, peak-to-average ratio, ratio of key frame I to reference frame P, frame rate, resolution rate, quantization parameter QP or key frame period GOP, etc., which are not limited here. For example, when the first target processing parameter is a frame rate of 100 frames per second, step 611 may increase the frame rate for the server, and the second target processing parameter may be a frame rate of 120 frames per second, which is not limited here.

612. The server sends a third video stream to the terminal.

613. The terminal decodes the third video stream, and outputs playback data to the user.

For steps 612-613, refer to steps 512-513 in the embodiment shown in FIG. 5, and details are not repeated here.

Since the Fov angle of the third video stream is larger than that of the second video stream, the third video stream contains more high-definition data than the second video stream, and other processing parameters of the third video stream and the second video stream do not change. , so the bit rate of the third video stream is greater than the bit rate of the second video stream.

Since the third video stream has a larger Fov angle size than the second video stream, the playback data obtained by processing the third video stream has better video quality than the playback data obtained by processing the second video stream.

6. The processing parameter is the preset bit rate, and the video quality is improved after reducing power consumption.

Please refer to FIG. 7 , which is a flowchart of a method for adjusting power consumption of a terminal in an embodiment of the present application. Based on the process of FIG. 4 , that is, when the first state information is the CPU occupancy rate and the adjusted processing parameter is the preset code rate, the process of the method for adjusting the power consumption of a terminal provided by the embodiment of the present application includes:

701-708.

For steps 701 to 708, refer to steps 401 to 408 in the implementation example of FIG. 4, and details are not repeated here.

709. The terminal reports the CPU usage to the server.

710. The server determines, according to the CPU occupancy rate reported by the terminal, that the power consumption of the terminal satisfies the second preset condition.

For steps 709-710, refer to steps 509-510 in the implementation example of FIG. 5, and details are not repeated here.

711. The server increases the preset bit rate to obtain a third video stream.

Specifically, the server increases the bit rate of the video stream by increasing the preset bit rate, thereby improving the video quality of the playback data.

Specifically, the server increases the preset bit rate, and processes the slice source data according to the adjusted preset bit rate to obtain the third video stream. The bit rate of the third video stream is greater than the bit rate of the second video stream. For the processing method, refer to step 202 in the embodiment shown in FIG. 2 , and details are not repeated here.

The increased preset code rate is called the second target processing parameter.

Specifically, the preset bit rate may be set as 30Mbps. That is, in this embodiment, the second target processing parameter is a preset bit rate of 30 Mbps. The server encodes the film source data according to the preset bit rate of 30 Mbps, and obtains the third video stream.

Since the preset bit rate of the second target processing parameter is greater than the preset bit rate of the first target processing parameter, the bit rate of the third video stream is greater than that of the second video stream. The playback data obtained according to the third video stream has better video quality than the playback data obtained according to the second video stream.

In this embodiment of the present application, in addition to the Fov angle, other processing parameters can also be adjusted to adjust the quality of the playback data, such as the Fov angle, peak-to-average ratio, ratio of key frame I to reference frame P, frame rate, resolution , quantization parameter QP or key frame period GOP, etc., which are not limited here. For example, when the first target processing parameter is a frame rate of 100 frames per second, step 711 may increase the frame rate for the server, and the second target processing parameter may be a frame rate of 120 frames per second, which is not limited here.

712. The server sends a third video stream to the terminal.

713. The terminal decodes the third video stream, and outputs playback data to the user.

For steps 712-713, refer to steps 512-513 in the embodiment shown in FIG. 5, and details are not repeated here.

Since the preset bit rate of the third video stream is larger than that of the second video stream, the bit rate of the third video stream is greater than that of the second video stream.

Since the third video stream has a larger preset bit rate than the second video stream, the playback data obtained by processing the third video stream has better video quality than the playback data obtained by processing the second video stream.

Next, when the first state information is the remaining power, the data processing method provided by the embodiment of the present application will be described:

2. The status information is the remaining power:

1. The processing parameters are Fov angle size and preset bit rate:

Please refer to FIG. 8 , which is a flowchart of a method for adjusting power consumption of a terminal according to an embodiment of the present application. When the first power consumption related information is the remaining power, and the processing parameters are the Fov angle and the preset bit rate, the process of the method for adjusting the power consumption of the terminal provided by the embodiment of the present application includes:

801. The server obtains the data of the film source.

802. The server generates a first video stream, and sends the first video stream to the terminal.

803. The terminal decodes the first video stream, and outputs playback data to the user.

For steps 801-803, refer to steps 201-203 in the embodiment shown in FIG. 2, and details are not repeated here.

804. The terminal reports the remaining power to the server.

Processing the received video stream consumes the power of the terminal. At this time, the terminal acquires the remaining power of the terminal, and the remaining power represents the resources used by the terminal to process the received video stream. In the embodiment of the present application, the remaining power reported at this time is the first power consumption related information.

Optionally, the reporting condition may be that the terminal determines that the remaining power is less than or equal to 20%, or may be other forms of conditions, such as the terminal determining that the CPU occupancy rate is greater than or equal to 40%, etc., which is not limited here.

Specifically, the terminal may report the first power consumption related information through a network protocol represented by HTTP. In addition to HTTP, the terminal can also report through other protocols, such as TCP, etc., which is not limited here.

805. The server determines, according to the remaining power reported by the terminal, that the power consumption of the terminal satisfies the first preset condition.

After receiving the remaining power reported by the terminal, the server may determine the power consumption of the terminal according to the remaining power, and when determining that the remaining power meets the first preset condition, adjust processing parameters to obtain a video stream with a bit rate lower than the first video stream.

Specifically, in this embodiment, since the first power consumption related information is the remaining power, the server may determine the remaining power of the terminal according to the received remaining power, and start timing when it is determined that the remaining power is less than or equal to 20%. After 2 minutes from the timing, the remaining power of the terminal is recorded every 1 minute. The first time is earlier than the second time, and when the server determines that the remaining power at the second time is less than the remaining power at the first time, that is, when the power is decreasing, the processing parameter is adjusted. That is to say, the power consumption of the terminal in this embodiment is the remaining power of the terminal.

In this embodiment of the present application, the remaining power of the terminal is less than or equal to 20%, and 20% is referred to as the second preset value. In the embodiment of the present application, the second preset value is a threshold of the remaining power of the terminal. When the remaining power of the terminal is equal to or lower than the threshold, it means that the remaining power of the terminal is too low, and the power consumption of the terminal needs to be reduced. Besides 20%, the second preset value can also be other values, such as 10%, 15%, 25% or 30%, etc., which are not limited here.

In the embodiments of the present application, 2 minutes of timing and every one minute interval are recorded. Both 2 minutes and 1 minute are examples of time, and do not limit the timing time and interval time.

In this embodiment of the present application, the remaining power of the terminal is less than or equal to 20% and is decreasing, which is the first preset condition. If the power consumption of the terminal satisfies the first preset condition, it means that the resources used by the current terminal for processing the video stream are insufficient to process the current video stream, or the current video stream is processed according to the current resources, and the effect is not good. In this case, the processing parameters are adjusted to reduce the The bitrate size of the video stream. Except that the remaining power is less than or equal to 20% and is decreasing, the first preset condition may also be other conditions, for example, the CPU occupancy rate of the terminal is greater than or equal to a certain threshold, etc., which is not specifically limited here.

806. The server reduces the size of the Fov angle and the preset bit rate to obtain a second video stream.

807. The server sends the second video stream to the terminal.

808. The terminal decodes the second video stream, and outputs playback data to the user.

806-808 refer to steps 206-208 in the embodiment shown in FIG. 2, and details are not repeated here.

Since the Fov angle size of the second video stream is smaller than that of the first video stream, the second video stream contains less high-definition data than the first video stream. The power consumption generated by the terminal performing rendering processing on the second video stream is smaller than the power consumption generated by performing rendering processing on the first video stream. Moreover, since the bit rate of the second video stream is lower than that of the first video stream, the power consumption of the terminal for processing the second video stream is smaller than the power consumption for processing the first video stream. Under the condition that the remaining power is the same, the terminal can keep the terminal running for a longer time than processing the first video stream when processing the second video stream, thereby ensuring the viewing time.

2. The processing parameter is the Fov angle size:

Please refer to FIG. 9, which is a flowchart of a method for adjusting power consumption of a terminal according to an embodiment of the present application. When the first power consumption related information is the remaining power, and the processing parameter is the Fov angle, the process of the method for adjusting the power consumption of the terminal provided by the embodiment of the present application includes:

901-905.

For steps 901-905, refer to steps 801-805 in the embodiment shown in FIG. 8, and details are not repeated here.

906. The server reduces the size of the Fov angle to obtain a second video stream.

907. The server sends the second video stream to the terminal.

908. The terminal decodes the second video stream, and outputs playback data to the user.

For steps 906-908, refer to steps 306-308 in the embodiment shown in FIG. 3, and details are not repeated here.

Since the Fov angle size of the second video stream is smaller than that of the first video stream, the second video stream contains less high-definition data than the first video stream. The power consumption generated by the terminal performing rendering processing on the second video stream is smaller than the power consumption generated by performing rendering processing on the first video stream. Moreover, since the Fov angle size of the second video stream is smaller than that of the first video stream, under the condition of the same preset bit rate, the bit rate of the second video stream will also be smaller than that of the first video stream. The processing of the second video stream by the terminal consumes, requires or generates less power consumption than processing the first video stream.

3. The processing parameter is the preset bit rate:

Please refer to FIG. 10. FIG. 10 is a flowchart of a method for adjusting power consumption of a terminal according to an embodiment of the present application. When the first power consumption related information is the remaining power and the processing parameter is the preset bit rate, the process of the method for adjusting the power consumption of the terminal provided by the embodiment of the present application includes:

1001-1005.

For steps 1001-1005, refer to steps 801-805 in the embodiment shown in FIG. 8, and details are not repeated here.

1006. The server reduces the preset bit rate to obtain a second video stream.

1007. The server sends the second video stream to the terminal.

1008. The terminal decodes the second video stream, and outputs playback data to the user.

For steps 1006-1008, refer to steps 406-408 in the embodiment shown in FIG. 4, and details are not repeated here.

Please refer to FIG. 11 , which is a flowchart of a method for adjusting power consumption of a terminal in an embodiment of the present application. Based on the process of FIG. 8 , that is, when the first power consumption related information is the CPU occupancy rate, and the adjusted processing parameters are the Fov angle and the preset code rate, the process of the method for adjusting the power consumption of a terminal provided by an embodiment of the present application includes the following steps: :

1101-1108.

For steps 1101 to 1108, refer to steps 801 to 808 of the example implementation in FIG. 8, and details are not repeated here.

1109. The terminal reports the remaining power to the server.

Processing the received video stream consumes the power of the terminal. At this time, the terminal acquires the remaining power of the terminal, and the remaining power represents the resources used by the terminal to process the received video stream. In this embodiment of the present application, the remaining power reported at this time is the second power consumption related information.

Optionally, the reporting condition may be that the terminal determines that the remaining power is greater than or equal to 20%, or may be other forms of conditions, such as the terminal determining that the CPU occupancy rate is less than or equal to 40%, etc., which is not limited here.

1110. The server determines, according to the remaining power reported by the terminal, that the power consumption of the terminal satisfies the second preset condition.

After receiving the remaining power reported by the terminal, the server may determine the power consumption of the terminal according to the remaining power, and adjust processing parameters to obtain a video stream with a bit rate greater than the second video stream when determining that the remaining power meets the second preset condition.

Specifically, in this embodiment, since the second power consumption related information is the remaining power, the server may determine the remaining power of the terminal according to the received remaining power. When it is determined that the remaining power is greater than or equal to 20%, the processing parameters are adjusted. That is to say, the power consumption of the terminal in this embodiment is the remaining power of the terminal.

In this embodiment of the present application, the remaining power of the terminal is greater than or equal to 20%, and 20% is referred to as the fourth preset value. In the embodiment of the present application, the fourth preset value is a threshold value of the remaining power of the terminal. When the remaining power of the terminal is not lower than the threshold, it means that the remaining power of the terminal is not too low, and the function of the terminal can be improved. consumption. Besides 20%, the fourth preset value can also be other values, such as 10%, 15%, 25% or 30%, etc., which are not limited here.

In this embodiment of the present application, the remaining power of the terminal is greater than or equal to 20%, which is the second preset condition. When the second preset condition is met, the processing parameter is adjusted to increase the bit rate of the video stream. In addition to the remaining power being greater than or equal to 20%, the second preset condition may also be other conditions, for example, the remaining power of the terminal remains unchanged or is in an upward trend, which is not specifically limited here.

1111. The server increases the Fov angle size and the preset bit rate to obtain a third video stream.

1112. The server sends a third video stream to the terminal.

1113. The terminal decodes the third video stream, and outputs playback data to the user.

For steps 1111-1113, refer to steps 511-513 in the embodiment shown in FIG. 5, and details are not repeated here.

Please refer to FIG. 12 , which is a flowchart of a method for adjusting power consumption of a terminal in an embodiment of the present application. Based on the process of FIG. 9 , that is, when the first power consumption related information is the CPU occupancy rate and the adjusted processing parameter is the Fov angle, the process of a method for adjusting the power consumption of a terminal provided by an embodiment of the present application includes:

1201-1208.

Steps 1101 to 1108 refer to steps 901 to 908 in the example of implementation in FIG. 9 , and details are not repeated here.

1209. The terminal reports the remaining power to the server.

1210. The server determines, according to the remaining power reported by the terminal, that the power consumption of the terminal satisfies the second preset condition.

For steps 1209-1210, refer to steps 1109-1110 in the embodiment shown in FIG. 11, and details are not repeated here.

1211. The server increases the size of the Fov angle to obtain a third video stream.

1212. The server sends a third video stream to the terminal.

1213. The terminal decodes the third video stream, and outputs playback data to the user.

For steps 1211-1213, refer to steps 611-613 in the embodiment shown in FIG. 6, and details are not repeated here.

Please refer to FIG. 13 , which is a flowchart of a method for adjusting power consumption of a terminal in an embodiment of the present application. Based on the process of FIG. 10 , that is, when the first state information is the CPU occupancy rate and the adjusted processing parameter is the preset bit rate, the process of the method for adjusting the power consumption of a terminal provided by the embodiment of the present application includes:

1301-1308.

For steps 1301 to 1308, refer to steps 1001 to 1008 in the implementation example of FIG. 10, and details are not repeated here.

1309. The terminal reports the remaining power to the server.

1310. The server determines, according to the remaining power reported by the terminal, that the power consumption of the terminal satisfies the second preset condition.

For steps 1309-1310, refer to steps 1109-1110 in the embodiment shown in FIG. 11, and details are not repeated here.

1311. The server increases the preset bit rate to obtain a third video stream.

1312. The server sends a third video stream to the terminal.

1313. The terminal decodes the third video stream, and outputs playback data to the user.

For steps 1311-1313, refer to steps 711-713 in the embodiment shown in FIG. 7, and details are not repeated here.

3. Adjust the bit rate of the video stream according to the network bandwidth:

The video stream needs to occupy the network bandwidth to realize the transmission from the server to the terminal. When the network bandwidth is not enough to carry the transmission of the video stream, phenomena such as freezing will occur. The embodiment of the present application provides a data processing method, which adjusts the bit rate of the video stream according to the network bandwidth, so as to avoid the stuck phenomenon caused by the excessively large bit rate of the video stream.

In this embodiment of the present application, the server determines the network bandwidth according to the bandwidth information, and when the network bandwidth meets the third preset condition, triggers adjustment of the bit rate of the video stream. The first bandwidth information is used to represent the network bandwidth.

In the embodiment of the present application, the network bandwidth of the terminal satisfies the third preset condition, indicating that the transmission of the video stream may be greater than the carrying capacity of the network of the terminal, and therefore the bit rate of the video stream may need to be reduced. Specifically, in this embodiment of the present application, the third preset condition may include that the network bandwidth of the terminal is less than or equal to the fifth preset value. In addition to the network bandwidth of the terminal, other bandwidth information may also satisfy the third preset condition, for example, the average value of the network bandwidth of the terminal within a certain period is less than or equal to the fifth preset value, etc., which is not limited here.

1. The processing parameters are Fov angle size and preset bit rate:

Please refer to FIG. 14. FIG. 14 is a flowchart of a method for adjusting a code rate according to an embodiment of the present application. When the processing parameters are the Fov angle size and the preset code rate, the flow of the code rate adjustment method provided by the embodiment of the present application includes:

1401. The server obtains the data of the film source.

1402. The server generates a first video stream, and sends the first video stream to the terminal.

1403. The terminal decodes the first video stream, and outputs playback data to the user.

For steps 1401-1403, refer to steps 201-203 in the implementation example of FIG. 2, and details are not repeated here.

1404. The terminal reports the network bandwidth to the server.

Transmitting video streams will occupy network bandwidth. At this time, the terminal obtains the network bandwidth of the terminal, and the network bandwidth of the terminal represents the network resources of the terminal. In this embodiment of the present application, the network bandwidth reported at this time is the first bandwidth information.

Specifically, the terminal may report the first bandwidth information periodically, for example, once every 5 seconds. In addition to periodic reporting, it can also be reported in other ways, such as reporting when certain reporting conditions are met, which is not limited here.

Specifically, the reporting condition may be that the terminal determines that the network bandwidth is less than or equal to 30 Mbps, or may be other forms of conditions, such as the terminal determines that the network bandwidth fluctuates greatly, which is not limited here.

Specifically, the terminal may report the first bandwidth information through a network protocol represented by HTTP. In addition to HTTP, the terminal can also report through other protocols, such as TCP, etc., which is not limited here.

1405. The server determines, according to the network bandwidth reported by the terminal, that the network bandwidth of the terminal satisfies the third preset condition.

After receiving the network bandwidth reported by the terminal, the server may determine the network bandwidth of the terminal according to the received network bandwidth, and when it is determined that the network bandwidth of the terminal meets the third preset condition, adjust the processing parameters to obtain a bit rate less than the first video. streaming video stream.

Specifically, in this embodiment, the server may determine the network bandwidth of the terminal according to the received network bandwidth, and record the network bandwidth of the terminal when it is determined that the network bandwidth of the terminal is less than or equal to 30 Mbps. When the server determines that the average network bandwidth within 10 seconds is less than or equal to 30 Mbps, the processing parameters are adjusted.

In this embodiment of the present application, the average value of the network bandwidth of the terminal within 10 seconds is less than or equal to 30 Mbps, and 30 Mbps is referred to as the fifth preset value. Besides 30Mbps, the fifth preset value may also be other values, such as 20Mbps, 25Mbps, 35Mbps, or 40Mbps, etc., which is not limited here.

In this embodiment of the present application, the average value of the network bandwidth of the terminal within 10 seconds is less than or equal to 30 Mbps, which is the third preset condition. If the power consumption of the terminal satisfies the third preset condition, it means that the current network resources of the current terminal are insufficient to transmit the current video stream, or the current video stream is transmitted according to the current network resources, and the effect is not good. In this case, the processing parameters are adjusted to reduce the video stream. bit rate size. In addition to the average value of the terminal's network bandwidth within 10 seconds being less than or equal to 30 Mbps, the third preset condition may also be other conditions, for example, the terminal's network bandwidth is less than or equal to 30 Mbps, which is not specifically limited here.

In this embodiment of the present application, the average value of the network bandwidth of the terminal within 10 seconds is less than or equal to 30 Mbps, or the network bandwidth is less than or equal to 30 Mbps, and 30 Mbps is referred to as the fifth preset value. In the embodiment of the present application, the fifth preset value is a threshold of the network bandwidth of the terminal. When the network bandwidth of the terminal is not higher than the threshold, it means that the network bandwidth of the terminal is in a state of being too low, and it may be necessary to reduce the bandwidth of the video stream. code rate.

1406. The server reduces the Fov angle size and the preset bit rate to obtain a second video stream.

When the server determines that the power consumption of the terminal satisfies the third preset condition, it determines that the network bandwidth of the terminal is insufficient to transmit the current video stream, and needs to reduce the bit rate of the video stream to match the current network.

Specifically, the server reduces the Fov angle size, reduces the preset code rate, and processes the slice source data according to the adjusted Fov angle size and the preset code rate to obtain the second video stream. The bit rate of the second video stream is smaller than the bit rate of the first video stream. For the processing method, refer to step 202 in the implementation example of FIG. 2 , and details are not repeated here.

Specifically, the Fov angle may be set as 90×90, the preset code rate may be set as the first target code rate, and the size of the first target code rate is equal to the product of the first bandwidth information and the preset ratio. That is, in this embodiment, the first target processing parameter is the Fov angle size of 90×90 and the size is the preset code rate of the first target code rate. The server intercepts the VR spherical high-definition picture at 90×90, and then encodes the intercepted picture according to the first target bit rate to obtain the second video stream.

Alternatively, the average value of the first bandwidth information within 10 seconds may also be taken, and the product of the average value and the preset ratio may be taken as the first target code rate.

In this embodiment of the present application, the average value of the first bandwidth information within 10 seconds is referred to as the fourth time period. Besides 10 seconds, the fourth time period may also have other durations, such as 5 seconds, 8 seconds, 12 seconds, or 15 seconds. seconds, etc., which are not limited here.

In this embodiment of the present application, the average value of the first bandwidth information in the fourth time period is referred to as the first bandwidth average value.

Specifically, the preset ratio may be any value from 0 to 100%, such as 50%, 40% or 60%, which is not limited here.

Specifically, the first target bit rate may also be a fixed value, such as 20 Mbps, 25 Mbps, or 30 Mbps, which is not limited here.

Since the Fov angle size of the first target processing parameter is smaller than the Fov angle size of the initial processing parameter, the second video stream contains less high-definition data than the first video stream. And the preset bit rate of the first target processing parameter is smaller than the preset bit rate of the initial processing parameter, then the bit rate of the second video stream is smaller than the bit rate of the first video stream.

In this embodiment of the present application, in addition to the Fov angle and the preset bit rate, other processing parameters can also be adjusted to adjust the bit rate of the video stream, such as peak-to-average ratio, key frame (intra picture, I) and reference frame (predictive frame) picture, P) ratio, frame rate, resolution, quantization parameter (quantization parameter, QP) or key frame period (Group of Pictures, GOP), etc., which are not limited here. The P frame is also referred to as a pre- and post-prediction coded frame, which is not limited here. For example, when the initial processing parameter is a frame rate of 120 frames per second, step 1406 may reduce the frame rate for the server, and the first target processing parameter may be a frame rate of 100 frames per second, which is not limited here.

1407. The server sends the second video stream to the terminal.

1408. The terminal decodes the second video stream, and outputs playback data to the user.

For steps 1407-1408, refer to steps 207-208 in the embodiment shown in FIG. 2, and details are not repeated here.

Since the Fov angle size of the second video stream is smaller than that of the first video stream, the second video stream contains less high-definition data than the first video stream. And the preset bit rate of the second video stream is smaller than that of the first video stream, and the second video stream has a smaller bit rate than the first video stream.

In this embodiment of the present application, through the interaction between the server and the terminal, the bit rate of the video stream sent to the terminal is reduced on the server side, thereby realizing adaptation to the current network bandwidth.

2. The processing parameter is the Fov angle size:

Please refer to FIG. 15. FIG. 15 is a flowchart of a method for adjusting a code rate according to an embodiment of the present application. When the processing parameter is the size of the Fov angle, the flow of the method for adjusting the code rate provided by the embodiment of the present application includes:

1501-1505.

For steps 1501-1505, refer to steps 1401-1405 in the implementation example of FIG. 14, and details are not repeated here.

1506. The server reduces the size of the Fov angle to obtain a second video stream.

When the third preset condition is satisfied, the server may reduce the bit rate of the video stream by reducing the Fov angle size. In this embodiment, the reduced Fov angle is referred to as the first target processing parameter.

1507. The server sends the second video stream to the terminal.

1508. The terminal decodes the second video stream, and outputs playback data to the user.

For steps 1507-1508, refer to steps 207-208 in the embodiment shown in FIG. 2, and details are not repeated here.

Since the Fov angle size of the second video stream is smaller than that of the first video stream, the second video stream contains less high-definition data than the first video stream. Under other conditions being the same, the bit rate of the second video stream will be smaller than the bit rate of the first video stream.

3. The processing parameter is the preset bit rate:

Please refer to FIG. 16. FIG. 16 is a flowchart of a method for adjusting a code rate according to an embodiment of the present application. When the processing parameter is the preset code rate, the process of the method for adjusting the code rate provided by the embodiment of the present application includes:

1601-1605.

For steps 1601-1605, refer to steps 1401-1405 in the implementation example of FIG. 14, and details are not repeated here.

1606. The server reduces the preset bit rate to obtain a second video stream.

Specifically, the preset code rate may be set as the first target code rate, and the size of the first target code rate is equal to the product of the first bandwidth information and the preset rate. That is, in this embodiment, the first target processing parameter is a preset code rate whose size is the first target code rate. The server encodes the slice source data according to the first target bit rate, and obtains the second video stream.

Since the preset code rate of the first target processing parameter is smaller than the preset code rate of the initial processing parameter, the code rate of the second video stream is smaller than the code rate of the first video stream.

1607. The server sends the second video stream to the terminal.

1608. The terminal decodes the second video stream, and outputs playback data to the user.

For steps 1607-1608, refer to steps 207-208 in the embodiment shown in FIG. 2, and details are not repeated here.

Since the preset bit rate of the second video stream is smaller than that of the first video stream, under other conditions being the same, the bit rate of the second video stream will be smaller than that of the first video stream.

4. Match the bit rate of the video stream with the network bandwidth in real time:

Please refer to FIG. 17. FIG. 17 is a flowchart of a method for adjusting a code rate according to an embodiment of the present application. The flowchart of a method for adjusting a code rate provided by the embodiment of the present application includes:

1701-1705.

For steps 1701-1705, refer to steps 1401-1405 in the embodiment shown in FIG. 14, and details are not repeated here.

1706. The server obtains the second video stream according to the first bandwidth information.

The server may determine the first target code rate according to the first bandwidth information, and the size of the first target code rate is equal to the product of the first bandwidth information and a preset ratio.

When the first target code rate is less than or equal to 30 Mbps, the first target code rate is used as the preset code rate; when the first target code rate is greater than 30 Mbps, 30 Mbps is used as the preset code rate. The server encodes the slice source data according to the preset bit rate, and obtains the second video stream.

In this embodiment of the present application, 30 Mbps is used as a threshold for determining the preset bit rate. When the first target code rate exceeds the threshold, the preset code rate is the threshold; when the first target code rate is lower than the threshold, the preset code rate is the first target code rate. 30 Mbps is only an example of the threshold, and does not limit the threshold, which can also be 25 Mbps, 35 Mbps, etc., which is not limited here.

1707. The server sends the second video stream to the terminal.

1708. The terminal decodes the second video stream, and outputs playback data to the user.

1709. The terminal reports the second bandwidth information to the server.

The terminal acquires the network bandwidth of the terminal, and the network bandwidth of the terminal represents the network resources of the terminal. In this embodiment of the present application, the network bandwidth reported at this time is the second bandwidth information.

Specifically, the terminal may report the second bandwidth information periodically, for example, once every 5 seconds. In addition to periodic reporting, it can also be reported in other ways, such as reporting when certain reporting conditions are met, which is not limited here.

Specifically, the terminal may report the second bandwidth information through a network protocol represented by HTTP. In addition to HTTP, the terminal can also report through other protocols, such as TCP, etc., which is not limited here.

1710. The terminal determines a second target code rate according to the second bandwidth information.

The server may determine the second target code rate according to the second bandwidth information, and the size of the second target code rate is equal to the product of the second bandwidth information and the preset ratio.

Alternatively, the average value of the second bandwidth information within 10 seconds may also be taken, and the product of the average value and the preset ratio may be taken as the second target code rate.

In this embodiment of the present application, the average value of the second bandwidth information within 10 seconds, 10 seconds is called the fifth time period. Besides 10 seconds, the fifth time period may also have other durations, such as 5 seconds, 8 seconds, 12 seconds, or 15 seconds. seconds, etc., which are not limited here.

In this embodiment of the present application, the average value of the second bandwidth information in the fifth time period is referred to as the second bandwidth average value.

1711. The terminal obtains a third video stream according to the second target bit rate.

When the second target code rate is less than or equal to 30 Mbps, the second target code rate is used as the preset code rate; when the second target code rate is greater than 30 Mbps, 30 Mbps is used as the preset code rate. The server encodes the slice source data according to the preset bit rate, and obtains the second video stream.

In this embodiment of the present application, 30 Mbps is used as a threshold for determining the preset bit rate. When the second target code rate exceeds the threshold, the preset code rate is the threshold; when the second target code rate is lower than the threshold, the preset code rate is the second target code rate. 30 Mbps is only an example of the threshold, and does not limit the threshold, which can also be 25 Mbps, 35 Mbps, etc., which is not limited here.

1712. The server sends a third video stream to the terminal.

1713. The terminal decodes the third video stream, and outputs playback data to the user.

For steps 1712-1713, refer to steps 512-513 in the embodiment shown in FIG. 5, and details are not repeated here.

In the embodiment of the present application, the target bit rate can adjust the bandwidth of the video stream in real time according to the changing network bandwidth, so as to realize the real-time matching between the video stream bit rate and the network bandwidth, and fully ensure that the video stream transmission is not stuck in the early stage. utilizes network bandwidth.

The server in the embodiment of the present application is described below. FIG. 18 is a schematic structural diagram of a server provided by an embodiment of the present application. The server 1800 may include one or more central processing units (CPUs) 1801 and memory 1805 . The memory 1805 stores one or more application programs or data.

Among them, the memory 1805 may be volatile storage or persistent storage. A program stored in memory 1805 may include one or more modules, each of which may include a series of instructions to operate on the server. Furthermore, the central processing unit 1801 may be configured to communicate with the memory 1805 to execute a series of instruction operations in the memory 1805 on the server 1800 .

Server 1800 may also include one or more power supplies 1802, one or more wired or wireless network interfaces 1803, one or more transceiver interfaces 1804, and/or, one or more operating systems, such as Windows Server™, Mac OS X™ , UnixTM, LinuxTM, FreeBSDTM, etc.

The server 1800 may perform the operations performed by the servers in the foregoing embodiments shown in FIG. 2 to FIG. 17 , and details are not repeated here.

The terminal in the embodiment of the present application is described below. FIG. 19 is a schematic structural diagram of a terminal provided by an embodiment of the present application. The terminal 1900 may include one or more central processing units (CPUs) 1601 and memory 1905 . The memory 1905 stores one or more application programs or data.

Among them, the memory 1905 may be volatile storage or persistent storage. The program stored in the memory 1905 may include one or more modules, and each module may include a series of instruction operations on the terminal. Further, the central processing unit 1901 may be configured to communicate with the memory 1905 to execute a series of instruction operations in the memory 1905 on the server 1900.

Terminal 1900 may also include one or more power supplies 1902, one or more wired or wireless network interfaces 1903, one or more transceiver interfaces 1904, and/or, one or more operating systems, such as Windows Server™, Mac OS X™ , UnixTM, LinuxTM, FreeBSDTM, etc.

The terminal 1900 can perform the operations performed by the terminal in the foregoing embodiments shown in FIG. 2 to FIG. 17 , and details are not repeated here.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system, device and unit described above can refer to the corresponding process in the foregoing method embodiments, which is not repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.

The integrated unit, if implemented in the form of a software functional unit and sold or used as an independent product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, and the computer software products are stored in a storage medium , including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, read-only memory), random access memory (RAM, random access memory), magnetic disk or optical disk and other media that can store program codes .

Claims

A method for adjusting power consumption of a terminal, comprising:

The server sends the video stream to the terminal at the first bit rate;

receiving, by the server, first power consumption related information from the terminal, where the first power consumption related information is used to represent the power consumption of the terminal, and the power consumption of the terminal is related to the playback of the video stream;

The server determines, according to the first power consumption related information, that the power consumption of the terminal satisfies a first preset condition;

The server sends the video stream to the terminal at a second bit rate lower than the first bit rate.
The method of claim 1, wherein:

The first power consumption related information includes the CPU occupancy rate of the terminal, and the server determines, according to the first power consumption related information, that the power consumption of the terminal satisfies a first preset condition, including:

The server determines, according to the received CPU occupancy rate of the terminal, that the CPU occupancy rate of the terminal is greater than or equal to a first preset value.
The method according to claim 1, wherein the first power consumption related information includes the remaining power of the terminal, and the server determines, according to the first power consumption related information, that the power consumption of the terminal satisfies the first power consumption. a preset condition, including:

The server determines, according to the received remaining power of the terminal, that the remaining power of the terminal is less than or equal to a second preset value.
The method according to any one of claims 1 to 3, wherein before the server sends the video stream to the terminal at a second bit rate lower than the first bit rate, the method Also includes:

the server reduces the Fov angle size of the field of view; or

The server reduces the bit rate of the video stream.
The method according to any one of claims 1 to 4, wherein after the server sends the video stream to the terminal at a second bit rate lower than the first bit rate, the method Also includes:

receiving, by the server, second power consumption related information from the terminal, where the second power consumption related information is used to represent the power consumption of the terminal;

The server determines, according to the second power consumption related information, that the power consumption of the terminal satisfies a second preset condition;

The server sends the video stream to the terminal at a third bit rate higher than the second bit rate.
The method according to claim 5, wherein the second power consumption-related information includes a CPU occupancy rate of the terminal, and the server determines, according to the second power consumption-related information, that the power consumption of the terminal satisfies The second preset condition includes:

The server determines, according to the received CPU occupancy rate of the terminal, that the CPU occupancy rate of the terminal is less than or equal to a third preset value; or,

The server determines, according to the received CPU occupancy rate of the terminal, that the average value of the CPU occupancy rate of the terminal in the second period is less than or equal to the third preset value.
The method according to claim 5, wherein the second power consumption related information includes the remaining power of the terminal, and the server determines, according to the second power consumption related information, that the power consumption of the terminal satisfies the first power consumption. Two preset conditions, including:

The server determines, according to the received remaining power of the terminal, that the remaining power of the terminal is greater than or equal to a fourth preset value.
The method according to any one of claims 5 to 7, wherein before the server sends the video stream to the terminal at a third bit rate higher than the second bit rate, the method Also includes:

The server increases the Fov angle size of the field of view; or

The server increases the bit rate of the video stream.
A method for adjusting power consumption of a terminal, comprising:

The terminal receives the video stream from the server at the first bit rate;

The terminal sends first power consumption related information to the server, where the first power consumption related information is used to indicate the power consumption of the terminal, and the power consumption of the terminal is related to the playback of the video stream;

When the power consumption of the terminal satisfies the first preset condition, the terminal receives the video stream from the server at a second bit rate, and the second bit rate is lower than the first bit rate.
The method according to claim 9, wherein the first power consumption related information comprises the CPU occupancy rate of the terminal, and the power consumption of the terminal satisfying the first preset condition comprises:

The CPU occupancy rate of the terminal is greater than or equal to the first preset value; or,

The average value of the CPU occupancy rate of the terminal in the first time period is greater than or equal to the first preset value.
The method according to claim 9, wherein the first power consumption related information comprises the remaining power of the terminal, and the power consumption of the terminal satisfying the first preset condition comprises:

The remaining power of the terminal is less than or equal to the second preset value.
The method according to any one of claims 9 to 11, wherein the method further comprises:

sending, by the terminal, second power consumption related information to the server, where the second power consumption related information is used to indicate the power consumption of the terminal;

In the case that the power consumption of the terminal satisfies the second preset condition, the terminal receives the video stream from the server at a third code rate, and the third code rate is higher than the second code rate.
The method according to claim 12, wherein the second power consumption related information comprises the CPU occupancy rate of the terminal, and the power consumption of the terminal satisfying the second preset condition comprises:

The CPU occupancy rate of the terminal is less than or equal to the third preset value; or,

The average value of the CPU occupancy rate of the terminal in the second time period is less than or equal to the third preset value.
The method according to claim 12, wherein the second power consumption related information comprises the remaining power of the terminal, and the power consumption of the terminal satisfying the second preset condition comprises:

The remaining power of the terminal is greater than or equal to the fourth preset value.
A method for adjusting a code rate, comprising:

The server sends the video stream to the terminal at the first bit rate;

receiving, by the server, first bandwidth information from the terminal, where the first bandwidth information is used to indicate the network bandwidth of the terminal;

The server determines, according to the first bandwidth information, that the network bandwidth of the terminal satisfies a third preset condition;

The server sends the video stream to the terminal at a second bit rate lower than the first bit rate.
The method according to claim 15, wherein the first bandwidth information includes a network bandwidth of the terminal, and the server determines, according to the first bandwidth information, that the network bandwidth of the terminal satisfies a third preset condition ,include:

The server determines, according to the received network bandwidth of the terminal, that the network bandwidth of the terminal is less than or equal to a fifth preset value; or,

The server determines, according to the received network bandwidth of the terminal, that the average value of the network bandwidth of the terminal in the third time period is less than or equal to the fifth preset value.
The method according to claim 15 or 16, wherein before the server sends the video stream to the terminal at a second bit rate lower than the first bit rate, the method further comprises:

the server reduces the Fov angle size of the field of view; or

The server reduces the bit rate of the video stream.
The method according to any one of claims 15 to 17, wherein after the server sends the video stream to the terminal at a second bit rate lower than the first bit rate, the method Also includes:

The server receives second bandwidth information from the terminal, where the second bandwidth information is used to represent the network bandwidth of the terminal, and the value of the second bandwidth information is greater than the value of the first bandwidth information;

The server sends the video stream to the terminal at a third bit rate higher than the second bit rate according to the second bandwidth information.
A method for adjusting a code rate, comprising:

The terminal receives the video stream from the server at the first bit rate;

sending, by the terminal, first bandwidth information to the server, where the first bandwidth information is used to indicate the network bandwidth of the terminal;

When the network bandwidth of the terminal satisfies the third preset condition, the terminal receives the video stream from the server at a second bit rate, where the second bit rate is lower than the first bit rate.
The method according to claim 19, wherein the first bandwidth information includes a network bandwidth of the terminal, and the network bandwidth of the terminal satisfying a third preset condition comprises:

The network bandwidth of the terminal is less than or equal to the fifth preset value; or,

The average value of the network bandwidth of the terminal in the third time period is less than or equal to the fifth preset value.
The method according to claim 19 or 20, wherein after the terminal receives the video stream from the server at the second bit rate, the method further comprises:

The terminal sends second bandwidth information to the server, where the second bandwidth information is used to indicate the network bandwidth of the terminal, and the value of the second bandwidth information is greater than the value of the first bandwidth information;

The terminal receives the video stream from the server at a third code rate, and the third code rate is higher than the second code rate.
A device for adjusting a code rate, comprising:

a processor and a memory coupled to the processor;

The memory stores executable instructions executed by the processor, the executable instructions instructing the processor to perform the method of any one of claims 1 to 8 or claims 15 to 18.
A device for adjusting a code rate, comprising:

a processor and a memory coupled to the processor;

The memory stores executable instructions executed by the processor, the executable instructions instructing the processor to perform the method of any one of claims 9 to 14 or claims 19 to 21 .
A computer-readable storage medium, characterized in that a program is stored in the computer-readable storage medium, and when the computer executes the program, the method according to any one of claims 1 to 21 is executed.
A computer program product, characterized in that, when the computer program product is executed on a computer, the computer executes the method according to any one of claims 1 to 21 .