WO2021139300A1

WO2021139300A1 - Video bitrate matching method, storage medium and terminal device

Info

Publication number: WO2021139300A1
Application number: PCT/CN2020/121554
Authority: WO
Inventors: 李清; 王潮; 石婉欣; 江勇; 邹龙昊; 齐竹云
Original assignee: 鹏城实验室; 南方科技大学
Priority date: 2020-01-09
Filing date: 2020-10-16
Publication date: 2021-07-15
Also published as: CN111212301B; CN111212301A

Abstract

Disclosed are a video bitrate matching method, a storage medium and a terminal device. The video bitrate matching method comprises: when a caching server receives a downloading request sent by a playing end, acquiring a playing state corresponding to the playing end and a link state of a source server corresponding to the caching server; and according to the playing state and the link state, matching a downloading mode for a video block to be downloaded that corresponds to the downloading request, wherein the downloading mode comprises forwarding the downloading request to the source server or selecting a video block to be downloaded, at a selected bitrate, in the caching server. In the present invention, when a downloading request is received, according to a playing state and a link state, a corresponding bitrate file is matched with a video block to be downloaded, or the video block to be downloaded is downloaded from a source server, such that a cache hit rate can be increased, making same convenient for a user to use.

Description

Video bit rate matching method, storage medium and terminal equipment

Technical field

The present invention relates to the technical field of video transmission, in particular to a method for matching video bit rate, a storage medium and terminal equipment.

Background technique

At present, when the network cache server receives a download request from the playback end, it will trigger a cache hit only when the cached data matches the user request, otherwise it needs to forward the user request to the source server cluster. This method exacerbates the waste of cache resources in a multi-bitrate video transmission scenario. Due to the player's ignorance of cached resource information, the request for a bitrate that is not in the cache results in slow acquisition of video resources and a high probability of transmission failure.

Summary of the invention

The technical problem to be solved by the present invention is to provide a video bit rate matching method, storage medium and terminal equipment in view of the deficiencies of the prior art.

In order to solve the above technical problems, the technical solutions adopted by the present invention are as follows:

A video bit rate matching method, the method includes:

When the cache server receives the download request sent by the playback terminal, obtain the playback status corresponding to the playback terminal and the link status of the source server corresponding to the cache server;

According to the playback status and link status, the download mode of the video block to be downloaded corresponding to the download request is matched, wherein the download mode includes forwarding the download request to the source server or selecting a buffer server with a selected bit rate. Download video chunks.

In the method for matching the video bit rate, the download request includes the target requested bit rate of the video block to be downloaded; when the cache server receives the download request sent by the playback terminal, it obtains the playback status corresponding to the playback terminal and The link status of the source server corresponding to the cache server specifically includes:

When the cache server receives the download request sent by the player, it searches the cache server locally for the to-be-downloaded video block of the target requested bit rate;

If the video block to be downloaded of the target requested bit rate is not found, the playback status corresponding to the playback terminal and the link status of the source server corresponding to the cache server are acquired.

In the method for matching video bitrates, when the cache server receives the download request sent by the playback terminal, acquiring the playback status corresponding to the playback terminal and the link status of the source server corresponding to the cache server includes:

If the to-be-downloaded video block of the target requested bit rate is found, the video bit-rate matching is completed, and the to-be-downloaded video block of the target requested bit rate is sent to the player.

In the method for matching the video code rate, the downloading method of matching the video block to be downloaded corresponding to the download request according to the playback status and the link status specifically includes:

Inputting the playback status and link status to a pre-trained reinforcement learning model;

Outputting a probability set through the reinforcement learning model, where the probability set includes the selected probability of each preset code rate and the download probability of the source server;

The download mode corresponding to the download request is determined according to the probability set.

In the method for matching video bitrates, the determining the download mode corresponding to the download request according to the probability set specifically includes:

The maximum probability in the probability set is selected, and the download mode corresponding to the maximum probability is used as the download mode corresponding to the download request.

In the method for matching the video bit rate, after the method for matching the bit rate of the video block to be downloaded to the playback terminal according to the download mode, the method further includes:

The QoE corresponding to the playback terminal is acquired, and the QoE is reacted to the reinforcement learning model according to the QoE, so as to correct the reinforcement learning model.

The video bit rate matching method, wherein the method further includes:

Obtain all download requests received within the preset time interval every preset duration, and obtain the probability value of the bit rate corresponding to each download request and the video caching cost;

According to the obtained probability values of all the bit rates and the video caching cost, the revenue value corresponding to the bit rate is determined, and the video cache is performed in descending order of the revenue value.

The video bit rate matching method, wherein the playback status includes the target requested bit rate, the previous requested bit rate, the video duration buffered by the player, the buffer hit throughput of the previous video block of the video block to be downloaded, and the waiting rate. The cache miss throughput of the previous video block of the downloaded video block.

A computer-readable storage medium, the computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to realize the video code as described above Steps in the matching method of the rate.

A terminal device, which includes a processor, a memory, and a communication bus; the memory stores a computer readable program that can be executed by the processor;

The communication bus realizes connection and communication between the processor and the memory;

When the processor executes the computer-readable program, the steps in the video bit rate matching method described above are implemented.

Beneficial effects: Compared with the prior art, the present invention provides a method for matching video bitrates. When a cache server receives a download request sent by a playback terminal, it acquires the playback status corresponding to the playback terminal and the corresponding playback status of the cache server. The link status of the source server; according to the playback status and the link status, the download mode of the video block to be downloaded corresponding to the download request is matched, and the download mode includes forwarding the download request to the source server or selecting a cache server to select The bit rate of the video block to be downloaded. When receiving a download request, the present invention will match the corresponding code rate file for the video block to be downloaded or download it from the source server according to the playback status and the link status, thereby improving the cache hit rate and bringing convenience to the user.

Description of the drawings

Fig. 1 is a flowchart of a method for matching video bitrate provided by the present invention.

Figure 2 is a schematic diagram of the structure of the storage server in the video bit rate matching method provided by the present invention.

Fig. 3 is a schematic diagram of the enhanced agent learning module in the video bit rate matching method provided by the present invention.

Fig. 4 is a structural principle diagram of a terminal device provided by the present invention.

Detailed ways

The present invention provides a video bit rate matching method, storage medium, and terminal equipment. In order to make the objectives, technical solutions and effects of the present invention clearer and clearer, the following further describes the present invention in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, but not used to limit the present invention.

Those skilled in the art can understand that, unless specifically stated, the singular forms "a", "an", "said" and "the" used herein may also include plural forms. It should be further understood that the term "comprising" used in the specification of the present invention refers to the presence of the described features, integers, steps, operations, elements and/or components, but does not exclude the presence or addition of one or more other features, Integers, steps, operations, elements, components, and/or groups of them. It should be understood that when we refer to an element as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element, or intervening elements may also be present. In addition, “connected” or “coupled” used herein may include wireless connection or wireless coupling. The term "and/or" as used herein includes all or any unit and all combinations of one or more associated listed items.

Those skilled in the art can understand that, unless otherwise defined, all terms (including technical terms and scientific terms) used herein have the same meanings as those commonly understood by those of ordinary skill in the art to which the present invention belongs. It should also be understood that terms such as those defined in general dictionaries should be understood to have a meaning consistent with the meaning in the context of the prior art, and unless specifically defined as here, they will not be idealized or overly Explain the formal meaning.

In the following, the content of the invention will be further explained through the description of the embodiments in conjunction with the accompanying drawings.

This embodiment provides a method for matching video bitrates. This method can be executed by a matching device, and the device can be implemented by software or hardware, so that the device receives the download request sent by the playback terminal at the cache server, and obtains the playback status corresponding to the playback terminal and the cache The link state of the source server corresponding to the server; according to the playback state and the link state, the download mode of the video block to be downloaded corresponding to the download request is matched, wherein the download mode includes forwarding the download request to the source server or selecting The video block to be downloaded with the selected bit rate in the cache server. Wherein, the matching device can be applied to intelligent terminals such as PCs, servers, etc., which can be used as cache servers. Referring to Fig. 1, the video bit rate matching method provided in this embodiment specifically includes:

S10. When the cache server receives the download request sent by the playback terminal, acquire the playback status corresponding to the playback terminal and the link status of the source server corresponding to the cache server.

Specifically, the playback terminal is used to run a video playback program and send a video download request to the cache server, where the playback terminal can be a terminal that can connect to the Internet and has an image display function, such as a smart phone, a tablet computer, or a desktop computer. equipment. The cache server has cache capability, and part of the video files can be stored in the cache server, and the source server cluster stores all the video files. The cache server is geographically closer to the player than the source server. When the player requests a video file, the player sends the request to the cache server first. When the cache server cannot respond to the request from the player, the cache server forwards the request to the source. server.

Further, in an implementation manner of this embodiment, the download request includes the target request bit rate of the video block to be downloaded; when the cache server receives the download request sent by the player, it obtains the playback status corresponding to the player. And the link status of the source server corresponding to the cache server specifically includes:

S11. When the cache server receives the download request sent by the player, it searches the cache server locally for the to-be-downloaded video block of the target requested bit rate;

S12: If the to-be-downloaded video block of the target requested bit rate is not found, obtain the playback status corresponding to the playback terminal and the link status of the source server corresponding to the cache server;

S13. If the video block to be downloaded with the target requested bit rate is found, the video bit rate matching is completed, and the video block to be downloaded with the target requested bit rate is sent to the playback terminal.

Specifically, the download request is a request for obtaining a video file sent by the playback terminal to the cache server, and the download request is used to request the video block to be downloaded of the target requested bit rate in the cache server. The video block to be downloaded of the target requested bit rate may be stored in the cache server, or may not be stored in the cache server. Wherein, when the video block to be downloaded with the target requested bit rate is stored in the cache server, the cache server may directly respond to the download request to feed back the video block to be downloaded with the target requested bit rate to the player; when the target requests When the code rate of the video block to be downloaded is not stored in the cache server, the cache server needs to obtain the playback status corresponding to the player and the link status of the source server corresponding to the cache server, so as to determine whether it is based on the playback status and link status. Use the video file of other code rate corresponding to the video block to be downloaded stored in the cache server, or obtain the file to be downloaded of the target requested code rate from the source server.

Further, the playback status includes the target requested bit rate, the previous requested bit rate, the video duration buffered by the player, the cache hit throughput of the previous video block of the video block to be downloaded, and the previous video block of the video block to be downloaded. Cache miss throughput. Wherein, the target request code rate is the code rate carried in the download request, that is, the target request code rate is a request for a video with the code rate sent by the player but the video file has not been received. The previous requested bit rate refers to the requested bit rate of the video block file located before the to-be-downloaded video block corresponding to the download request and adjacent to the to-be-downloaded video block according to the playback order, and the previous requested bit rate corresponds to the video file It has been downloaded to the player. The video duration buffered by the playback terminal refers to the video duration that is buffered at the moment when the download request is sent in the buffer area of the playback terminal. The cache hit means that a video file is stored in the cache server, and the video file is sent from the cache server to the player. The cache miss refers to that the video file is not stored in the cache server and the video file is sent from the source server to the playback end. The difference between the cache hit and the cache miss lies in the different links through which the data passes.

Further, in an implementation of this embodiment, as shown in FIG. 2, the cache server may be provided with a playback status collection module 100, a throughput regression module 200, a source server direction network status collection module 300, and a reinforcement learning agent. Module 400 and cache management module 500. The player status collection module 100 is used to parse the download request sent by the player and extract player status data. The player status data needs to be carried by the download request sent by the player and sent to the cache server through the download request. The player status data may include the target requested bit rate, the previous requested bit rate, the video duration buffered by the player, and the throughput of the previous video block of the video block to be downloaded.

The throughput regression module 200 is used to calculate the cache hit throughput of the previous video of the to-be-downloaded video block or the cache miss throughput of the previous video of the to-be-downloaded video block, and the throughput regression module may be based on the playback end The computing power and the computing power of the cache server are determined to be placed on the player or cache server. It is understandable that the throughput regression model can be placed on the player or server; when the throughput regression module is deployed on the client, the download request carries , The cache hit throughput of the previous video block of the video block to be downloaded and the cache miss throughput of the previous video block of the video block to be downloaded; when the throughput regression module is deployed on the cache server, only the download request needs to be carried One of the cache hit throughput of the previous video block of the to-be-downloaded video block and the cache miss throughput of the previous video block of the to-be-downloaded video block, and the download request needs to carry the cache hit throughput or the cache used to calculate the The status information of the miss throughput, where the status information may include the RTT transmitted between the source server and the cache server, the amount of data transferred, and the link bandwidth between the source server and the cache server.

The source server-to-network state collection module 300 needs to continuously and periodically collect the network state of data transmitted from the source server to the cache server. The network status can be measured by sending probe packets or directly using the amount of missed request data. The former is more accurate but will take up part of the network bandwidth, and the latter is easy to obtain but not accurate enough. The reinforcement learning agent module 400 stores a reinforcement learning module, and the reinforcement learning module outputs the download mode of the to-be-downloaded video block corresponding to the download request. The cache management module 500 is used to manage the video files stored in the cache server.

Further, in an implementation manner of this embodiment, the cache hit throughput and the cache miss throughput are performed to obtain the cache hit throughput or the cache miss throughput. When the cache hit throughput is obtained, it needs to be based on the cache hit throughput. The hit throughput calculates the cache miss throughput; when the cache miss throughput is obtained, the cache hit throughput needs to be calculated according to the cache miss throughput. Among them, under the same conditions, the cache hit throughput is higher than the cache miss throughput. This is because the physical distance of video data transmission is short and the delay is small when the cache hits, and the difference between a cache hit and a cache miss is mainly It is that the cache miss needs to obtain the video file of the cache server from the source server, and then transfer the video file to the player through the cache server. Therefore, when calculating the cache miss throughput according to the cache hit throughput, or calculate the cache hit throughput according to the cache miss throughput, you only need to consider the impact of the link between the source server and the cache server on the throughput. Hit throughput finds miss throughput, and vice versa.

Further, in this embodiment, when the cache miss throughput is calculated according to the cache hit throughput, or the cache hit throughput is calculated according to the cache miss throughput, the known throughput data and the relationship between the source server and the cache server may be calculated according to the known throughput data. The transmission RTT, the amount of data transmitted, and the link bandwidth between the source server and the cache server are calculated accordingly. For example, a regression algorithm based on regression trees is used to calculate cache hit throughput or cache miss throughput. Of course, in the process of obtaining the regression tree model, in order to obtain the throughput of cache hits and cache misses at the same time, a throughput tag can be added to the video request header, so that the cache server can cache hits and cache misses according to the throughput tags. The videos are transmitted one after the other, and then the video files are received twice at the playback end to calculate the cache hit throughput and the cache miss throughput respectively.

S20: Match the download mode of the to-be-downloaded video block corresponding to the download request according to the playback status and the link status.

Specifically, the download method includes forwarding the download request to the source server or selecting the video block to be downloaded with the selected bit rate in the cache server. The forwarding of the download request to the source server refers to obtaining the video block to be downloaded with the target requested bit rate through the source server; the selecting the video block to be downloaded with the selected bit rate in the cache server refers to selecting the video block from the cache server The video block to be downloaded with the bit rate is used as the video file corresponding to the download request, and the video block to be downloaded with the selected bit rate is directly sent to the player. Among them, the to-be-downloaded video block of the selected bit rate and the to-be-downloaded video block of the target requested bit rate are different bit rate formats of the same video, that is, the to-be-downloaded video block of the selected bit rate and the to-be-downloaded video block of the target requested bit rate The only difference in the video content of the two videos is the bit rate collected by the two videos.

Further, in an implementation of this embodiment, as shown in FIG. 2, a reinforcement learning proxy module can be configured in the cache server, and the reinforcement learning proxy module can be inserted into an existing network caching process. When the download request of the playback end is searched for the video block to be downloaded with the target requested bit rate in the cache server, the playback status and link status can be input to the reinforcement learning agent module to determine the download request correspondence through the reinforcement learning agent module Download method. In addition, the reinforcement learning agent module can determine the download mode through reinforcement learning, that is, a reinforcement learning model can be configured in the reinforcement learning proxy module, and the download mode is determined by the reinforcement learning model. Correspondingly, in an implementation manner of this embodiment, the download manner of matching the to-be-downloaded video block corresponding to the download request according to the playback state and link state specifically includes:

Specifically, the reinforcement learning model is obtained by training based on preset training samples. The preset training samples include multiple training sample groups, and each training sample group includes a playback state and a link state. The output item of the reinforcement learning is a probability set, where the probability set includes code stream probabilities corresponding to several code rates and download probabilities of the source server, and the several code rates include all code rates at which the cache server can store video files. In the training process, after the probability set is obtained, the playback state and the download mode corresponding to the link state are determined according to the probability set, and the QoE generated after downloading according to the download mode is determined, and the reinforcement learning uses the QoE to update the model parameters so that The network updates in the direction that maximizes the accumulated QoE. It is understandable that the output item of the reinforcement learning model is a probability set, and when the reinforcement learning model is trained, the QoE generated by the download mode is determined according to the probability set to correct the model parameters of the reinforcement learning model.

Further, from the training process of the reinforcement learning model, as shown in FIG. 3, when the playback status and link status are input to the pre-trained reinforcement learning model, the reinforcement learning model outputs the playback status and link status. The corresponding probability set. The probability set includes the probability that the code rate in the cache is selected and the download probability of the source server, and the sum of the probability of the code rate in the cache being selected and the download probability of the source server is 1. In addition, because the cache server may only cache Video files with partial bitrates, so the output layer of the reinforcement learning model is set with a mask. The probability that the bitrate is not stored in the cache server through the mask is set to 0, so that when the download method is determined according to the probability set, the output will not be selected in the cache server. Set a bit rate that does not exist.

Further, in an implementation manner of this embodiment, the determining the download mode corresponding to the download request according to the probability set refers to selecting the maximum value in the probability set. If the maximum value corresponds to a bit rate in the cache server, then Use the bit rate as the selected bit rate, and send the video block to be downloaded of the selected bit rate to the playback end; if the maximum value corresponds to the source server download, the download request is forwarded to the source server through the source server Obtain the to-be-downloaded video block of the target requested bit rate, and send the obtained to-be-downloaded video block of the target requested bit rate to the player. In addition, in order to improve the accuracy of the reinforcement learning model, after the download mode corresponding to the download request is determined through the reinforcement learning model, the QoE corresponding to the download mode may be used to modify the reinforcement learning model. Correspondingly, after matching the code rate to be downloaded to the playback terminal according to the download mode, the method further includes: obtaining QoE corresponding to the playback terminal, and reacting to the reinforcement learning according to the QoE Model to modify the reinforcement learning model.

Further, in an implementation of this embodiment, in order to improve the hit rate of the cache server, the cache server may cache the video file of the corresponding bit rate according to the income of the video file corresponding to the received download request, so as to improve the QoE of the user. . Correspondingly, in an implementation manner of this embodiment, after the matching of the bit rate to be downloaded to the playback terminal according to the download manner, the method further includes:

Obtain all download requests received within the preset time interval every preset duration, and obtain the probability value of the bit rate corresponding to each download request and the video caching cost, where the probability value is when the download mode is determined according to the download request The probability set obtained is determined;

Specifically, after the probability set is input through the reinforcement learning module, the probability value of each bit rate output by the reinforcement learning is recorded, wherein the probability value is recorded in a record entry in the file list corresponding to the video block to be downloaded, so The file list corresponds to a video file, and the file list stores all the record entries of the bit rate corresponding to the video file. The entry identifier of the record entry is the video identifier of the video block to be downloaded and the bit rate, and the value of the record entry is the probability and the video caching cost, where the video caching cost may be the video file size. Of course, it is worth noting that when multiple probability values of a video file at a bit rate are recorded within the preset time period, multiple probability values are stored in the record entry corresponding to the bit rate.

In addition, after each preset time interval, all download requests received within the preset time period are obtained, and the corresponding video ID and bit rate can be determined according to the download request, and the probability value and the bit rate can be determined according to the video ID and bit rate. Video caching cost. After obtaining the probability value and the video caching cost, for a video file of the same bit rate, the profit value is calculated according to all the probability values corresponding to the video file of the bit rate, and the video caching is performed according to the profit value in descending order. In this embodiment, the profit value may be equal to the quotient of the sum of all probability values of video files with the same bit rate and the video caching cost. Of course, when video caching is performed in descending order of the revenue value, the storage space of the cache server needs to be determined. If the storage space cannot download a video file with a large revenue value, the video files that can be cached are determined sequentially in the order of the revenue value.

In summary, the present invention provides a method for matching video bitrates when a cache server receives a download request sent by a player, and acquires the playback status corresponding to the player and the link status of the source server corresponding to the cache server; Matching the download mode of the video block to be downloaded corresponding to the download request according to the playback status and link status, the download mode includes forwarding the download request to the source server or selecting the video block to be downloaded with the selected bit rate in the cache server . When receiving a download request, the present invention will match the corresponding code rate file for the video block to be downloaded or download it from the source server according to the playback status and the link status, thereby improving the cache hit rate and bringing convenience to the user.

Based on the above-mentioned video bit rate matching method, this embodiment provides a computer-readable storage medium, the computer-readable storage medium stores one or more programs, and the one or more programs can be used by one or more The processor executes to implement the steps in the video bit rate matching method described in the foregoing embodiment.

Based on the above-mentioned video bit rate matching method, the present invention also provides a terminal device, as shown in FIG. 4, which includes at least one processor (processor) 20; a display screen 21; and a memory (memory) 22, which may also include Communication Interface (Communications Interface) 23 and bus 24. Among them, the processor 20, the display screen 21, the memory 22, and the communication interface 23 can communicate with each other through the bus 24. The display screen 21 is set to display a user guide interface preset in the initial setting mode. The communication interface 23 can transmit information. The processor 20 can call the logic instructions in the memory 22 to execute the method in the foregoing embodiment.

In addition, the aforementioned logic instructions in the memory 22 can be implemented in the form of software functional units and when sold or used as independent products, they can be stored in a computer readable storage medium.

As a computer-readable storage medium, the memory 22 can be configured to store software programs and computer-executable programs, such as program instructions or modules corresponding to the methods in the embodiments of the present disclosure. The processor 20 executes functional applications and data processing by running software programs, instructions, or modules stored in the memory 22, that is, implements the methods in the foregoing embodiments.

The memory 22 may include a program storage area and a data storage area. The program storage area may store an operating system and an application program required by at least one function; the data storage area may store data created according to the use of the terminal device, and the like. In addition, the memory 22 may include a high-speed random access memory, and may also include a non-volatile memory. For example, U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or CD-ROM and other media that can store program code, or temporary State storage medium.

In addition, the specific process of loading and executing the multiple instruction processors in the foregoing storage medium and the terminal device has been described in detail in the foregoing method, and will not be described here.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: The technical solutions recorded in the foregoing embodiments are modified, or some of the technical features thereof are equivalently replaced; these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

A method for matching video bitrates, characterized in that the method includes:

When the cache server receives the download request sent by the playback terminal, obtain the playback status corresponding to the playback terminal and the link status of the source server corresponding to the cache server;

According to the playback status and link status, the download mode of the video block to be downloaded corresponding to the download request is matched, wherein the download mode includes forwarding the download request to the source server or selecting a buffer server with a selected bit rate. Download video chunks.
The method for matching video bitrates according to claim 1, wherein the download request includes the target requested bitrate of the video block to be downloaded; when the cache server receives the download request sent by the player, it obtains the playback The playback status corresponding to the end and the link status of the source server corresponding to the cache server specifically include:

When the cache server receives the download request sent by the player, it searches the cache server locally for the to-be-downloaded video block of the target requested bit rate;

If the video block to be downloaded of the target requested bit rate is not found, the playback status corresponding to the playback terminal and the link status of the source server corresponding to the cache server are acquired.
The method for matching video bitrates according to claim 1, wherein when the cache server receives the download request sent by the playback terminal, the playback status corresponding to the playback terminal and the source server information corresponding to the cache server are acquired. Link status includes:

If the to-be-downloaded video block of the target requested bit rate is found, the video bit-rate matching is completed, and the to-be-downloaded video block of the target requested bit rate is sent to the player.
The method for matching video bitrates according to claim 1, wherein the downloading method of matching the video block to be downloaded corresponding to the download request according to the playback status and the link status specifically comprises:

Inputting the playback status and link status to a pre-trained reinforcement learning model;

Outputting a probability set through the reinforcement learning model, where the probability set includes the selected probability of each preset code rate and the download probability of the source server;

The download mode corresponding to the download request is determined according to the probability set.
The method for matching video bitrates according to claim 4, wherein the determining the download mode corresponding to the download request according to the probability set is specifically:

The maximum probability in the probability set is selected, and the download mode corresponding to the maximum probability is used as the download mode corresponding to the download request.
The method for matching video code rate according to claim 4, wherein after the method for matching the code rate of the video block to be downloaded to the playback terminal according to the download mode, the method further comprises:

The QoE corresponding to the playback terminal is acquired, and the QoE is reacted to the reinforcement learning model according to the QoE, so as to correct the reinforcement learning model.
The method for matching video bitrates according to claim 4, wherein the method further comprises:

Obtain all download requests received within the preset time interval every preset duration, and obtain the probability value of the bit rate corresponding to each download request and the video caching cost;

According to the obtained probability values of all the bit rates and the video caching cost, the revenue value corresponding to the bit rate is determined, and the video cache is performed in descending order of the revenue value.
The method for matching video bitrates according to any one of claims 1-7, wherein the playback status includes the target requested bitrate, the previous requested bitrate, the length of the video buffered by the player, and the previous video block to be downloaded. The cache hit throughput of a video block and the cache miss throughput of the previous video block of the video block to be downloaded.
A computer-readable storage medium, wherein the computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to realize Steps in the video bit rate matching method described in any one of ~8.
A terminal device, characterized by comprising: a processor, a memory, and a communication bus; the memory stores a computer readable program that can be executed by the processor;

The communication bus realizes connection and communication between the processor and the memory;

When the processor executes the computer readable program, the steps in the video bit rate matching method according to any one of claims 1-8 are implemented.