CN117478934A - Video stream data transmission method and system - Google Patents

Abstract

The invention provides a video stream data transmission method and a system, wherein the method comprises the steps of determining the residual transmission space of a wireless transmission network based on the data characteristics of video stream data; transmitting video stream data to a waiting area of a wireless transmission network based on the residual transmission space and a preset transmission strategy; optimizing the bandwidth weight, and distributing corresponding transmission bandwidth for each video stream data based on the optimized bandwidth weight; determining a transmission state grade based on the transmission bandwidth of the video stream data and the available bandwidth of the receiver, and performing self-adaptive compression on the video stream data based on the transmission state grade; the invention optimizes the bandwidth of the video stream data, can improve the transmission speed and efficiency of the video stream data, and simultaneously carries out self-adaptive compression on the video stream data so as to achieve the purpose of minimizing transmission delay and further shorten the data transmission delay.

Description

A video stream data transmission method and system

Technical field

The invention belongs to the technical field of video stream transmission, and specifically relates to a video stream data transmission method and system.

Background technique

Video streaming refers to the transmission of video data that can be processed as a steady and continuous stream over the network. Because of the flow, the client browser or plug-in can display the multimedia data before the entire file has been transferred.

In the existing video stream data transmission process, there is a problem of unreasonable bandwidth allocation, which leads to congestion when multiple video stream data share the same transmission path, thus affecting the transmission speed and efficiency of video stream data. At the same time, problems in the existing technology include excessive video stream data, low available bandwidth, and large bandwidth fluctuations, which further affect the video stream data transmission process, resulting in an increase in transmission delay and affecting transmission efficiency.

Contents of the invention

In order to solve the above technical problems, the present invention provides a video stream data transmission method and system to solve the technical problems in the existing technology.

On the one hand, the present invention provides the following technical solution, a video stream data transmission method, including:

Obtain the video stream data to be transmitted sent by the sender, and determine the remaining transmission space of the wireless transmission network based on the data characteristics of the video stream data;

Transmit the video stream data to the waiting area of the wireless transmission network based on the remaining transmission space and the preset transmission strategy;

Pre-allocate a bandwidth weight to each of the video stream data and optimize the bandwidth weight to obtain an optimized bandwidth weight, and allocate a corresponding transmission bandwidth to each of the video stream data based on the optimized bandwidth weight;

Determine a transmission status level based on the transmission bandwidth of the video stream data and the available bandwidth of the receiver, and adaptively compress the video stream data based on the transmission status level to obtain compressed video stream data;

Update the definition of the compressed video stream data according to the remaining receiving capacity of the receiver, and transmit the updated compressed video stream data in the waiting area to the receiver based on the transmission bandwidth of the video stream data;

Wherein, the step of determining the remaining transmission space of the wireless transmission network based on the data characteristics of the video stream data includes:

Using a first preset formula and determining the remaining transmission space of the wireless transmission network based on the data characteristics of the video stream data , where the first preset formula is:

;

In the formula, is the number of packets still being transmitted,/> is the scaling factor,/> is the transmission delay from the sender to the wireless transmission network,/> is the average inter-arrival time.

Compared with the existing technology, the beneficial effects of the present invention are: the present invention first obtains the video stream data sent by the sender to be transmitted, and determines the remaining transmission space of the wireless transmission network based on the data characteristics of the video stream data; and then based on the The remaining transmission space and the preset transmission strategy are used to transmit the video stream data to the storage area of the wireless transmission network; and then a bandwidth weight is pre-allocated for each video stream data and the bandwidth weight is optimized, so as to Obtain the optimized bandwidth weight, allocate corresponding transmission bandwidth to each video stream data based on the optimized bandwidth weight; then determine the transmission status level based on the transmission bandwidth of the video stream data and the available bandwidth of the receiver, and determine the transmission status level based on the transmission bandwidth. The state level performs adaptive compression on the video stream data to obtain compressed video stream data; finally, the definition of the compressed video stream data is updated according to the remaining receiving capacity of the receiver, based on the transmission of the video stream data Bandwidth transmits the updated compressed video stream data in the waiting area to the receiver. The present invention optimizes the bandwidth of the video stream data so that each video stream data matches a reasonable bandwidth to improve the video stream data. The transmission speed and efficiency are high. At the same time, the present invention adaptively compresses the video stream data according to the bandwidth to achieve the purpose of minimizing the transmission delay and further shortening the data transmission delay.

Preferably, the step of transmitting the video stream data to the waiting area of the wireless transmission network based on the remaining transmission space and a preset transmission strategy includes:

Calculate the space occupied by the transmission of the video stream data :

;

In the formula, is the length of the last video frame in the video stream data,/> is the increment coefficient,/> is the frame rate of video stream data,/> is the transmission delay from the sender to the wireless transmission network;

Determine the space occupied by the transmission of the video stream data Is it less than the remaining transmission space of the wireless transmission network? ;

If the space occupied by the transmission of the video stream data Less than the remaining transmission space of the wireless transmission network/> , then determine the queuing delay difference/> Is it less than the judgment threshold/> , if the queuing delay difference/> Less than the judgment threshold/> , then the video quality of the video stream data is improved. If the queuing delay difference/> Not less than the judgment threshold/> , then maintain the video quality of the video stream data to transmit the video stream data to the storage area of the wireless transmission network;

If the space occupied by the transmission of the video stream data Not less than the remaining transmission space of the wireless transmission network/> , then the video quality of the video stream data is reduced to transmit the video stream data to the storage area of the wireless transmission network.

Preferably, the bandwidth weight is pre-allocated to each of the video stream data and the bandwidth weight is optimized to obtain an optimized bandwidth weight, and a corresponding bandwidth weight is allocated to each of the video stream data based on the optimized bandwidth weight. The steps to transfer bandwidth include:

Pre-allocate a corresponding bandwidth weight to each of the video stream data, and make a bit rate decision on the video stream data through a first preset algorithm to obtain the first feature information;

Calculate second feature information of each video stream data :

;

In the formula, ,/> Indicates the first/> No., No./> The perceived quality of video stream data,/> For the first/> video stream data rebuffering time,/> is the first penalty coefficient,/> is the second penalty coefficient;

Optimize the bandwidth weight through a second preset algorithm and according to the first feature information and the second feature information to obtain an optimized bandwidth weight;

A congestion control algorithm is used to allocate corresponding transmission bandwidth to each video stream data.

Preferably, the transmission status level is determined based on the transmission bandwidth of the video stream data and the available bandwidth of the receiver, and the video stream data is adaptively compressed based on the transmission status level to obtain the compressed video stream data. Steps include:

Determine the number of transmission links of the wireless transmission network , and based on the number of transmission links/> Calculate the available bandwidth at the receiver/> :

,/> ;

In the formula, For the first/> The transmission start time of each transmission link,/> For the first/> The transmission termination time of a transmission link,/> For the first/> The total transmission volume of each transmission link;

Transmission bandwidth based on the video stream data available bandwidth with the receiver/> Calculate bandwidth difference/> :

;

like , then the video stream data is compressed with a fixed compression amount at the first compression rate, if/> , then the video stream data is compressed with a fixed compression amount at the second compression rate, if , then the video stream data is compressed with a fixed compression amount at the third compression rate, if , then the video stream data is compressed with a fixed compression amount at the fourth compression rate, if , then the video stream data is compressed with a fixed compression amount at the fifth compression rate, where, is the bandwidth average.

Preferably, the definition of the compressed video stream data is updated according to the remaining receiving capacity of the receiver, and the updated compressed video stream data in the waiting area is transmitted based on the transmission bandwidth of the video stream data. The steps to the recipient include:

Store the compressed video stream data of the maximum definition level in the first video group, and store the remaining compressed video stream data in the second video group;

Pre-transmit the compressed video stream data in the second video group, and update the remaining receiving capacity of the receiver and computing power/> , to get the first remaining acceptance capacity/> with first computing power/> ;

Determine the first remaining acceptance capacity Whether it is greater than the capacity threshold and generate a judgment result, perform a definition update on the compressed video stream data based on the judgment result, and transmit the updated compressed video stream data in the waiting area to the storage area based on the transmission bandwidth of the video stream data. the recipient.

Preferably, the judgment of the first remaining accepting capacity is Whether it is greater than the capacity threshold and generate a judgment result, perform a definition update on the compressed video stream data based on the judgment result, and transmit the updated compressed video stream data in the waiting area to the storage area based on the transmission bandwidth of the video stream data. The steps on the receiving side include:

If the first remaining acceptance capacity is greater than the capacity threshold, select the first changed compressed video stream data from the second video group, perform an iterative upgrade process on the first changed compressed video stream data, and iteratively update the first remaining accepted capacity/> with first computing power/> ;

Determine whether the first changed compressed video stream data reaches the maximum definition level, and if the first changed compressed video stream data reaches the maximum definition level, then move the first changed compressed video stream data into the first video group until First remaining receiving capacity Not greater than the capacity threshold;

If the first remaining acceptance capacity is not greater than the capacity threshold, then determine the first computing capability after iterative update/> Whether it is greater than the calculation threshold;

If the first computing power after iterative update is not greater than the calculation threshold, then select the second changed compressed video stream data in the second video group, perform iterative degradation processing on the second changed compressed video stream data, and repeatedly iteratively update the first computing capability/> , up to the first computing power/> greater than the calculation threshold;

After the compressed video stream data in the second video group is updated, the updated compressed video stream data in the waiting area is transmitted to the receiver based on the transmission bandwidth of the video stream data.

In a second aspect, the present invention provides the following technical solution, a video stream data transmission system, the system includes:

A data acquisition module, used to acquire the video stream data to be transmitted sent by the sender, and determine the remaining transmission space of the wireless transmission network based on the data characteristics of the video stream data;

A transmission space determination module, configured to transmit the video stream data to the waiting area of the wireless transmission network based on the remaining transmission space and a preset transmission strategy;

A bandwidth optimization module, configured to pre-allocate a bandwidth weight to each of the video stream data and optimize the bandwidth weight to obtain an optimized bandwidth weight, and allocate a corresponding bandwidth to each of the video stream data based on the optimized bandwidth weight. transmission bandwidth;

A data compression module, configured to determine a transmission status level based on the transmission bandwidth of the video stream data and the available bandwidth of the receiver, and adaptively compress the video stream data based on the transmission status level to obtain compressed video stream data;

A data transmission module, configured to update the definition of the compressed video stream data according to the remaining receiving capacity of the receiver, and transmit the updated compressed video stream data in the waiting area based on the transmission bandwidth of the video stream data. to the recipient.

In a third aspect, the present invention provides the following technical solution: a computer, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program Implement the video stream data transmission method as described above.

In a fourth aspect, the present invention provides the following technical solution, a storage medium, a computer program is stored on the storage medium, and when the computer program is executed by a processor, the above video stream data transmission method is implemented.

Description of the drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments or prior art will be briefly introduced below. Obviously, the drawings in the following description are only illustrative of the present invention. For some embodiments, for those of ordinary skill in the art, other drawings can be obtained based on these drawings without exerting creative efforts.

Figure 1 is a flow chart of a video stream data transmission method provided by Embodiment 1 of the present invention;

Figure 2 is a detailed flow chart of step S2 in the video stream data transmission method provided by Embodiment 1 of the present invention;

Figure 3 is a detailed flow chart of step S3 in the video stream data transmission method provided by Embodiment 1 of the present invention;

Figure 4 is a detailed flow chart of step S4 in the video stream data transmission method provided by Embodiment 1 of the present invention;

Figure 5 is a detailed flow chart of step S5 in the video stream data transmission method provided by Embodiment 1 of the present invention;

Figure 6 is a detailed flow chart of step S53 in the video stream data transmission method provided by Embodiment 1 of the present invention;

Figure 7 is a structural block diagram of a video stream data transmission system provided by Embodiment 2 of the present invention;

FIG. 8 is a schematic diagram of the hardware structure of a computer provided by another embodiment of the present invention.

The embodiments of the present invention will be further described below with reference to the accompanying drawings.

Detailed ways

Embodiments of the present invention are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements with the same or similar functions. The embodiments described below with reference to the drawings are exemplary and are intended to explain the embodiments of the present invention and are not to be construed as limitations of the present invention.

In the description of the embodiments of the present invention, it should be understood that the terms "length", "width", "upper", "lower", "front", "back", "left", "right", "vertical" ", "horizontal", "top", "bottom", "inner", "outer", etc. indicate the orientation or positional relationship based on the orientation or positional relationship shown in the drawings, and are only for convenience and simplicity in describing the embodiments of the present invention. The description does not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operate in a specific orientation, and therefore is not to be construed as a limitation of the invention.

In addition, the terms “first” and “second” are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the quantity of indicated technical features. Therefore, features defined as "first" and "second" may explicitly or implicitly include one or more of these features. In the description of the embodiments of the present invention, "plurality" means two or more than two, unless otherwise explicitly and specifically limited.

In the embodiments of the present invention, unless otherwise expressly stipulated and limited, the terms "installation", "connection", "connection", "fixing" and other terms should be understood in a broad sense. For example, it can be a fixed connection or a removable connection. Disassembly and connection, or integration; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium; it can be an internal connection between two elements or an interaction between two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the embodiments of the present invention can be understood according to specific circumstances.

Embodiment 1

In Embodiment 1 of the present invention, as shown in Figure 1, a video stream data transmission method includes:

S1. Obtain the video stream data to be transmitted sent by the sender, and determine the remaining transmission space of the wireless transmission network based on the data characteristics of the video stream data;

Specifically, the video stream data to be transmitted is a series of video data, which can be specifically disassembled into a series of video frame data groups with inter-frame sequence obtained after a complete video frame processing. The wireless transmission network is specifically a wireless local area network. The remaining transmission space at is the difference between the total transmission space of the wireless transmission network minus the transmission space occupied by the video stream data that is still being transmitted;

Among them, the step S1 specifically includes:

Using a first preset formula and determining the remaining transmission space of the wireless transmission network based on the data characteristics of the video stream data , where the first preset formula is:

;

In the formula, is the number of packets still being transmitted,/> is the scaling factor,/> is the transmission delay from the sender to the wireless transmission network,/> is the average inter-arrival time;

Specifically, here is the number of bytes occupied by each packet, so/> is the total transmission space of the wireless transmission network,/> The transmission space occupied by the video stream data that is still being transmitted.

S2. Transmit the video stream data to the storage area of the wireless transmission network based on the remaining transmission space and the preset transmission strategy;

As shown in Figure 2, step S2 specifically includes:

S21. Calculate the space occupied by the transmission of the video stream data :

;

In the formula, is the length of the last video frame in the video stream data,/> is the increment coefficient,/> is the frame rate of video stream data,/> is the transmission delay from the sender to the wireless transmission network;

in, The value is 0.2.

S22. Determine the space occupied by the transmission of the video stream data. Is it less than the remaining transmission space of the wireless transmission network/> .

S23. If the space occupied by the transmission of the video stream data Less than the remaining transmission space of the wireless transmission network/> , then determine the queuing delay difference/> Is it less than the judgment threshold/> , if the queuing delay difference/> Less than the judgment threshold/> , then the video quality of the video stream data is improved. If the queuing delay difference/> Not less than the judgment threshold/> , then maintain the video quality of the video stream data to transmit the video stream data to the storage area of the wireless transmission network;

Specifically, when the space occupied by the transmission of the video stream data Less than the remaining transmission space of the wireless transmission network/> time, it means that there is enough transmission space to transmit the video stream data in the wireless transmission network, but there may be data arrangement at this time, so there will be a queuing delay, and the queuing delay difference/> That is, the difference between the queuing delay of the currently transmitted video stream data and the queuing delay of the next transmitted video stream data in the queuing sequence, so when the queuing delay difference/> Less than the judgment threshold/> When, it means that the queuing delay is within the normal range, so the video quality of the video stream data can be improved, and when the queuing delay difference/> Not less than the judgment threshold/> time, it means that the queuing delay is in a fluctuating state at this time, so the video quality of the video stream data needs to be maintained, thereby making the queuing delay more stable to facilitate data transmission.

S24. If the space occupied by the transmission of the video stream data Not less than the remaining transmission space of the wireless transmission network , then reduce the video quality of the video stream data to transmit the video stream data to the storage area of the wireless transmission network;

Specifically, if the space occupied by the transmission of the video stream data Not less than the remaining transmission space of the wireless transmission network/> , it means that the transmission space of the wireless transmission network is not enough to transmit the video stream data, or the remaining space is just enough for transmission. Therefore, by reducing the video quality of the video stream data, the transmission space occupied by the video stream transmission data is reduced. In order to prevent the video stream data from occupying the entire transmission space until the space occupied by the transmission of the video stream data/> Less than the remaining transmission space of the wireless transmission network/> .

S3. Pre-allocate a bandwidth weight to each of the video stream data and optimize the bandwidth weight to obtain an optimized bandwidth weight, and allocate a corresponding transmission bandwidth to each of the video stream data based on the optimized bandwidth weight;

As shown in Figure 3, step S3 includes:

S31. Pre-allocate a corresponding bandwidth weight to each of the video stream data, and make a bit rate decision on the video stream data through the first preset algorithm to obtain the first feature information;

Specifically, the pre-allocated bandwidth weight here can allocate the corresponding bandwidth weight to each video stream data through the congestion control protocol, and then make a bit rate decision on the video stream data through the ABS algorithm deployed on the wireless transmission network to obtain the video The observation value of the flow data is the first characteristic information.

S32. Calculate the second characteristic information of each video stream data :

;

In the formula, ,/> Indicates the first/> No., No./> The perceived quality of video stream data,/> For the first/> video stream data rebuffering time,/> is the first penalty coefficient,/> is the second penalty coefficient;

Specifically, the second feature information represents the fairness of the video stream data, which is used to represent the order and video feature information of each video stream data.

S33. Optimize the bandwidth weight through the second preset algorithm and according to the first feature information and the second feature information to obtain the optimized bandwidth weight;

Specifically, the second preset algorithm is a multi-agent deep reinforcement learning algorithm (DRL algorithm). The bandwidth weight can be calculated through the deep reinforcement learning algorithm and based on the first feature information and the second feature information. Optimize to get a new optimized bandwidth weight.

S34. Use a congestion control algorithm to allocate corresponding transmission bandwidth to each video stream data;

Specifically, after obtaining the optimized bandwidth weight, the corresponding transmission bandwidth can be allocated to each video stream data according to the congestion control algorithm.

S4. Determine the transmission status level based on the transmission bandwidth of the video stream data and the available bandwidth of the receiver, and adaptively compress the video stream data based on the transmission status level to obtain compressed video stream data;

As shown in Figure 4, step S4 includes:

S41. Determine the number of transmission links of the wireless transmission network , and based on the number of transmission links/> Calculate the available bandwidth at the receiver/> :

,/> ;

In the formula, For the first/> The transmission start time of each transmission link,/> For the first/> The transmission termination time of a transmission link,/> For the first/> The total transmission volume of each transmission link;

Specifically, in the actual video stream data transmission process, the video stream data is chain-transmitted through several transmission links, so the available bandwidth of the receiver Available via page/> The total transmission volume of the transmission link is the same as the The ratio of the total time required for each transmission link to complete transmission is determined.

S42. Transmission bandwidth based on the video stream data available bandwidth with the receiver/> Calculate bandwidth difference :

.

S43. If , then the video stream data is compressed with a fixed compression amount at the first compression rate, if/> , then the video stream data is compressed with a fixed compression amount at the second compression rate, if/> , then the video stream data is compressed with a fixed compression amount at the third compression rate, if , then the video stream data is compressed with a fixed compression amount at the fourth compression rate, if , then the video stream data is compressed with a fixed compression amount at the fifth compression rate, where, is the bandwidth average;

Specific, if At this time, the transmission network is in a full load state, so the video stream data is compressed using a first compression rate and a fixed compression amount. The first compression amount here is the maximum compression rate in the video stream data. If/> , the transmission network is in an overloaded state at this time, so the video stream data is compressed with a fixed compression amount at the second compression rate. The second compression rate here is 1.2 times the average compression rate. If , at this time the transmission network is in a medium load state, then the video stream data is compressed with a third compression rate and a fixed compression amount, where the third compression amount is 0.6 times the average compression amount, if/> , at this time the transmission network is in a light load state, then the video stream data is compressed with a fourth compression rate and a fixed compression amount, where the fourth compression amount is 0.2 times the average compression amount, if/> , when the transmission network is in an idle state, the video stream data is compressed with a fifth compression rate and a fixed compression amount, where the fifth compression amount is an arbitrary compression rate;

It should be noted that the compression here specifically targets the resolution and grid size of the video stream data.

S5. Update the definition of the compressed video stream data according to the remaining receiving capacity of the receiver, and transmit the updated compressed video stream data in the waiting area to the receiver based on the transmission bandwidth of the video stream data. square;

As shown in Figure 5, step S5 includes:

S51. Store the compressed video stream data of the maximum definition level into the first video group, and store the remaining compressed video stream data into the second video group;

Specifically, the first video group stores compressed video stream data with a maximum definition level, and the second video group stores compressed video stream data with a non-maximum definition level.

S52. Pre-transmit the compressed video stream data in the second video group, and update the remaining receiving capacity of the receiver. and computing power/> , to get the first remaining acceptance capacity/> with first computing power/> ;

Specifically, the first remaining acceptance capacity is the remaining receiving capacity of the receiver, and the first computing capability/> It is the computing power of the receiver. After the data in the second video group is pre-transmitted, the remaining receiving capacity of the receiver/> and computing power/> will change accordingly, so after pre-transmitting the compressed video stream data in the second video group, the remaining receiving capacity needs to be adjusted/> and computing power/> Update to get the first remaining acceptable capacity/> with first computing power/> .

S53. Determine the first remaining accepting capacity Whether it is greater than the capacity threshold and generate a judgment result, perform a definition update on the compressed video stream data based on the judgment result, and transmit the updated compressed video stream data in the waiting area to the storage area based on the transmission bandwidth of the video stream data. the receiving party;

As shown in Figure 6, step S53 includes:

S531. If the first remaining acceptable capacity is greater than the capacity threshold, select the first changed compressed video stream data from the second video group, perform an iterative upgrade process on the first changed compressed video stream data, and iteratively update the first remaining accepted capacity/> with first computing power/> ;

Specifically, the capacity threshold here is 0. When the first remaining accepted capacity After it is greater than 0, it means that the receiver can continue to accept video stream data, so the first changed compressed video stream data can be selected in the second video group, and the first changed compressed video stream data selection method is:

;

In the formula, To first change the compressed video stream data,/> For the second video group,/> For the first/> The priority of compressed video stream data,/> For the first/> Compressed video stream data retention,/> Indicates the first/> The bitrate level of a compressed video stream data is/> ,/> Indicates the first/> The bitrate level of a compressed video stream data is/> ;

Specifically, after the first changed compressed video stream data is determined, the first changed compressed video stream data can be upgraded and the first remaining accepted capacity can be updated at the same time. with first computing power/> , the updated first remaining accepted capacity is/> , the updated first computing power is , where,/> To convert the bitrate level of the first changed compressed video stream data to/> The price of level,/> For the first change the bitrate level of the compressed video stream data is converted to/> level price, Indicates that the bit rate level of the first changed compressed video stream data is/> ,/> Indicates that the bit rate level of the first changed compressed video stream data is/> .

S532. Determine whether the first changed compressed video stream data reaches the maximum definition level. If the first changed compressed video stream data reaches the maximum definition level, move the first changed compressed video stream data into the first video group. , until the first remaining accepting capacity Not greater than the capacity threshold;

Specifically, when the first changed compressed video stream data reaches the maximum definition level, then the first changed compressed video stream data can be removed from the second video group and moved into the first video group until the first remaining Accept capacity Not greater than 0.

S533. If the first remaining acceptable capacity is not greater than the capacity threshold, then determine the first computing capability after iterative update Whether it is greater than the calculation threshold;

Specifically, the calculation threshold here is 0;

S534. If the first computing power after iterative update is not greater than the calculation threshold, then select the second changed compressed video stream data in the second video group, perform iterative degradation processing on the second changed compressed video stream data, and repeatedly iteratively update the first computing capability/> , up to the first computing power/> Greater than the calculation threshold;

Specifically, after the second changed compressed video stream data is determined, the second changed compressed video stream data can be iteratively degraded, wherein the second changed compressed video stream data selection method is:

;

in, Indicates the first/> The bitrate level of a compressed video stream data is/> ;

Afterwards, iterative degradation processing is performed on the second changed compressed video stream data, and the first computing power Update is performed, and the updated first computing power is/> , and also need to accept the first remaining capacity/> Update is performed, and the first remaining accepted capacity after the update is/> , and then continue to judge the first computing ability/> Is it less than 0? If less, repeat step S534 until the first computing power/> is greater than the calculation threshold, where,/> To convert the bit rate level of the second changed compressed video stream data to/> level price, For a second change the bitrate level of the compressed video stream data is converted to/> The price of level,/> Indicates that the bit rate level of the second changed compressed video stream data is/> ,/> Indicates that the bit rate level of the second changed compressed video stream data is/> ;

S535. After the compressed video stream data in the second video group is updated, transmit the updated compressed video stream data in the waiting area to the receiver based on the transmission bandwidth of the video stream data.

The video stream data transmission method provided in Embodiment 1 of the present invention first obtains the video stream data sent by the sender to be transmitted, and determines the remaining transmission space of the wireless transmission network based on the data characteristics of the video stream data; and then based on the remaining The transmission space and the preset transmission strategy transmit the video stream data to the storage area of the wireless transmission network; and then pre-allocate a bandwidth weight to each of the video stream data and optimize the bandwidth weight to obtain optimization Bandwidth weight, allocate corresponding transmission bandwidth to each video stream data based on the optimized bandwidth weight; then determine the transmission status level based on the transmission bandwidth of the video flow data and the available bandwidth of the receiver, based on the transmission status level Adaptively compress the video stream data to obtain compressed video stream data; finally update the definition of the compressed video stream data according to the remaining receiving capacity of the receiver, and update the compressed video stream data based on the transmission bandwidth of the video stream data. The updated compressed video stream data in the waiting area is transmitted to the receiver. The present invention optimizes the bandwidth of the video stream data so that each video stream data matches a reasonable bandwidth to improve the transmission of video stream data. Speed and efficiency. At the same time, the present invention adaptively compresses the video stream data according to the bandwidth to achieve the purpose of minimizing the transmission delay and further shortening the data transmission delay.

Embodiment 2

As shown in Figure 7, a video stream data transmission system is provided in Embodiment 2 of the present invention. The system includes:

The data acquisition module 1 is used to acquire the video stream data to be transmitted sent by the sender, and determine the remaining transmission space of the wireless transmission network based on the data characteristics of the video stream data;

Transmission space determination module 2, configured to transmit the video stream data to the waiting area of the wireless transmission network based on the remaining transmission space and the preset transmission strategy;

Bandwidth optimization module 3, configured to pre-allocate a bandwidth weight to each of the video stream data and optimize the bandwidth weight to obtain an optimized bandwidth weight, and allocate a corresponding bandwidth to each of the video stream data based on the optimized bandwidth weight. transmission bandwidth;

Data compression module 4, configured to determine a transmission status level based on the transmission bandwidth of the video stream data and the available bandwidth of the receiver, and perform adaptive compression on the video stream data based on the transmission status level to obtain compressed video stream data. ;

Data transmission module 5, configured to update the definition of the compressed video stream data according to the remaining receiving capacity of the receiver, and store the updated compressed video stream data in the waiting area based on the transmission bandwidth of the video stream data. transmitted to the recipient.

The data acquisition module 1 is specifically used for:

Using a first preset formula and determining the remaining transmission space of the wireless transmission network based on the data characteristics of the video stream data , where the first preset formula is:

;

In the formula, is the number of packets still being transmitted,/> is the scaling factor,/> is the transmission delay from the sender to the wireless transmission network,/> is the average inter-arrival time.

The transmission space determination module 2 includes:

Space calculation submodule, used to calculate the space occupied by the transmission of the video stream data :

;

In the formula, is the length of the last video frame in the video stream data,/> is the increment coefficient,/> is the frame rate of video stream data,/> is the transmission delay from the sender to the wireless transmission network;

The first judgment sub-module is used to judge the space occupied by the transmission of the video stream data. Is it less than the remaining transmission space of the wireless transmission network/> ;

The first quality adjustment sub-module is used to adjust the space occupied by the transmission of the video stream data. Less than the remaining transmission space of the wireless transmission network/> , then determine the queuing delay difference/> Is it less than the judgment threshold/> , if the queuing delay difference Less than the judgment threshold/> , then the video quality of the video stream data is improved. If the queuing delay difference/> Not less than the judgment threshold/> , then maintain the video quality of the video stream data to transmit the video stream data to the storage area of the wireless transmission network;

The second quality adjustment sub-module is used to adjust the space occupied by the transmission of the video stream data. Not less than the remaining transmission space of the wireless transmission network/> , then the video quality of the video stream data is reduced to transmit the video stream data to the storage area of the wireless transmission network.

The bandwidth optimization module 3 includes:

A pre-allocation sub-module, used to pre-allocate a corresponding bandwidth weight to each of the video stream data, and make a bit rate decision on the video stream data through a first preset algorithm to obtain the first feature information;

Feature information submodule, used to calculate the second feature information of each video stream data :

;

In the formula, ,/> Indicates the first/> No., No./> The perceived quality of video stream data,/> For the first/> video stream data rebuffering time,/> is the first penalty coefficient,/> is the second penalty coefficient;

An optimization submodule configured to optimize the bandwidth weight through a second preset algorithm and according to the first feature information and the second feature information to obtain an optimized bandwidth weight;

An allocation submodule is configured to use a congestion control algorithm to allocate corresponding transmission bandwidth to each of the video stream data.

The data compression module 4 includes:

Bandwidth determination submodule, used to determine the number of transmission links of the wireless transmission network , and based on the number of transmission links/> Calculate the available bandwidth at the receiver/> :

,/> ;

In the formula, For the first/> The transmission start time of each transmission link,/> For the first/> The transmission termination time of a transmission link,/> For the first/> The total transmission volume of each transmission link;

Difference submodule, used for transmission bandwidth based on the video stream data available bandwidth with the receiver/> Calculate bandwidth difference/> :

;

Compression submodule, used if , then the video stream data is compressed with a fixed compression amount at the first compression rate, if/> , then the video stream data is compressed with a fixed compression amount at the second compression rate, if/> , then the video stream data is compressed with a fixed compression amount at the third compression rate, if/> , then the video stream data is compressed with a fixed compression amount at the fourth compression rate, if/> , then the video stream data is compressed with a fixed compression amount at the fifth compression rate, where,/> is the bandwidth average.

The data transmission module 5 includes:

The video group submodule is used to store the compressed video stream data of the maximum definition level into the first video group, and store the remaining compressed video stream data into the second video group;

Iterative sub-module, used to pre-transmit the compressed video stream data in the second video group and update the remaining receiving capacity of the receiver and computing power/> , to get the first remaining acceptance capacity/> with first computing power/> ;

The second judgment sub-module is used to judge the first remaining acceptance capacity Whether it is greater than the capacity threshold and generate a judgment result, perform a definition update on the compressed video stream data based on the judgment result, and transmit the updated compressed video stream data in the waiting area to the storage area based on the transmission bandwidth of the video stream data. the recipient.

The second judgment sub-module includes:

Upgrade unit for if the first remaining capacity is accepted is greater than the capacity threshold, select the first changed compressed video stream data from the second video group, perform an iterative upgrade process on the first changed compressed video stream data, and iteratively update the first remaining accepted capacity/> with first computing power/> ;

The first judgment unit is used to judge whether the first changed compressed video stream data reaches the maximum definition level, and if the first changed compressed video stream data reaches the maximum definition level, move the first changed compressed video stream data into The first video group, until the first remaining accepted capacity Not greater than the capacity threshold;

The second judgment unit is used to determine if the first remaining acceptance capacity is not greater than the capacity threshold, then determine the first computing capability after iterative update/> Whether it is greater than the calculation threshold;

Degraded unit, used for the first computing power after iterative update is not greater than the calculation threshold, then select the second changed compressed video stream data in the second video group, perform iterative degradation processing on the second changed compressed video stream data, and repeatedly iteratively update the first computing capability/> , up to the first computing power/> greater than the calculation threshold;

A transmission unit configured to transmit the updated compressed video stream data in the waiting area to the recipient based on the transmission bandwidth of the video stream data after the compressed video stream data in the second video group is updated.

In other embodiments of the present invention, embodiments of the present invention provide the following technical solution: a computer including a memory 102, a processor 101, and a computer stored on the memory 102 and capable of running on the processor 101 Program, when the processor 101 executes the computer program, the video stream data transmission method as described above is implemented.

Specifically, the above-mentioned processor 101 may include a central processing unit (CPU), or an Application Specific Integrated Circuit (ASIC for short), or may be configured to implement one or more integrated circuits according to the embodiments of the present application.

Among others, memory 102 may include mass storage for data or instructions. By way of example and not limitation, the memory 102 may include a hard disk drive (HDD), a floppy disk drive, a solid state drive (SSD), flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial drive. Bus (UniversalSerial Bus, USB for short) driver or a combination of two or more of these. Memory 102 may include removable or non-removable (or fixed) media, where appropriate. Where appropriate, memory 102 may be internal or external to the data processing device. In certain embodiments, memory 102 is Non-Volatile memory. In a specific embodiment, the memory 102 includes read-only memory (ROM) and random access memory (Random Access Memory, RAM). Under appropriate circumstances, the ROM can be a mask-programmed ROM, a programmable ROM (Programmable Read-Only Memory, referred to as PROM), an erasable PROM (ErasableProgrammable Read-Only Memory, referred to as EPROM), or an electrically erasable ROM. Except for PROM (Electrically Erasable Programmable Read-Only Memory, referred to as EEPROM), electrically rewritable ROM (Electrically Alterable Read-Only Memory, referred to as EAROM) or flash memory (FLASH) or a combination of two or more of these. Under appropriate circumstances, the RAM can be static random access memory (Static Random-Access Memory, referred to as SRAM) or dynamic random access memory (Dynamic Random Access Memory, referred to as DRAM), where DRAM can be in fast page mode Dynamic random access memory (Fast Page Mode DynamicRandom Access Memory, referred to as FPMDRAM), extended data output dynamic random access memory (ExtendedDate Out Dynamic Random Access Memory, referred to as EDODRAM), synchronous dynamic random access memory (Synchronous Dynamic Random- Access Memory (SDRAM for short), etc.

The memory 102 may be used to store or cache various data files required for processing and/or communication, as well as possible computer program instructions executed by the processor 101 .

The processor 101 reads and executes the computer program instructions stored in the memory 102 to implement the above video stream data transmission method.

In some of these embodiments, the computer may also include a communication interface 103 and a bus 100 . Among them, as shown in Figure 8, the processor 101, the memory 102, and the communication interface 103 are connected through the bus 100 and complete communication with each other.

The communication interface 103 is used to implement communication between various modules, devices, units and/or equipment in the embodiments of this application. The communication interface 103 can also implement data communication with other components such as: external devices, image/data acquisition equipment, databases, external storage, image/data processing workstations, etc.

Bus 100 includes hardware, software, or both, coupling components of a computer device to one another. The bus 100 includes but is not limited to at least one of the following: data bus (Data Bus), address bus (Address Bus), control bus (Control Bus), expansion bus (Expansion Bus), and local bus (Local Bus). By way of example, but not limitation, the bus 100 may include an Accelerated Graphics Port (AGP) or other graphics bus, an Extended Industry Standard Architecture (EISA) bus, or a Front Side Bus. , referred to as FSB), Hyper Transport (HT) interconnect, Industry Standard Architecture (ISA) bus, wireless bandwidth (InfiniBand) interconnect, Low Pin Count, LPC for short) bus, memory bus, Micro Channel Architecture (MCA for short) bus, Peripheral Component Interconnect (PCI for short) bus, PCI-Express (PCI-X) bus, Serial Advanced Technology Attachment (Serial Advanced Technology Attachment, referred to as SATA) bus, Video Electronics Standards Association Local Bus (referred to as VLB) bus or other suitable bus or a combination of two or more of these. Where appropriate, bus 100 may include one or more buses. Although the embodiments of this application describe and illustrate a specific bus, this application contemplates any suitable bus or interconnection.

The computer can execute the video stream data transmission method of the present application based on the obtained video stream data transmission system, thereby achieving target behavior recognition.

In some further embodiments of the present invention, combined with the above video stream data transmission method, embodiments of the present invention provide the following technical solution, a storage medium, a computer program is stored on the storage medium, and the computer program is processed by a processor. The above video stream data transmission method is implemented during execution.

It will be understood by those skilled in the art that the logic and/or steps represented in the flowchart diagrams or otherwise described herein may, for example, be considered a sequenced list of executable instructions for implementing the logical functions, which may be embodied in in any computer-readable medium for use by an instruction execution system, device, or device (such as a computer-based system, a system including a processor, or other system that can fetch and execute instructions from the instruction execution system, device, or device), or Used in connection with these instruction execution systems, devices or equipment. For the purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

More specific examples (non-exhaustive list) of readable media include the following: electrical connection with one or more wires (electronic device), portable computer disk case (magnetic device), random access memory (RAM), only read-only memory (ROM), erasable and programmable read-only memory (EPROM or flash memory), fiber optic devices, and portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium may even be paper or other suitable medium on which the program may be printed, as the paper or other medium may be optically scanned, for example, and subsequently edited, interpreted, or otherwise suitable as necessary. process to obtain the program electronically and then store it in computer memory.

It should be understood that various parts of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if it is implemented in hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or a combination thereof: a gate circuit with a logic gate circuit for implementing a logic function on a data signal; Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGA), field programmable gate arrays (FPGA), etc.

The technical features of the above-described embodiments can be combined in any way. To simplify the description, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, All should be considered to be within the scope of this manual.

The above-described embodiments only express several implementation modes of the present application, and their descriptions are relatively specific and detailed, but they should not be construed as limiting the scope of the invention patent. It should be noted that, for those of ordinary skill in the art, several modifications and improvements can be made without departing from the concept of the present application, and these all fall within the protection scope of the present application. Therefore, the protection scope of this patent application should be determined by the appended claims.

Claims (9)

1. A video stream data transmission method, comprising:

acquiring video stream data to be transmitted sent by a sender, and determining the residual transmission space of a wireless transmission network based on the data characteristics of the video stream data;

transmitting the video stream data to a waiting area of the wireless transmission network based on the residual transmission space and a preset transmission strategy;

Pre-distributing bandwidth weight for each video stream data and optimizing the bandwidth weight to obtain optimized bandwidth weight, and distributing corresponding transmission bandwidth for each video stream data based on the optimized bandwidth weight;

determining a transmission state grade based on the transmission bandwidth of the video stream data and the available bandwidth of a receiver, and adaptively compressing the video stream data based on the transmission state grade to obtain compressed video stream data;

the definition of the compressed video stream data is updated according to the residual receiving capacity of the receiver, and the updated compressed video stream data in the waiting area is transmitted to the receiver based on the transmission bandwidth of the video stream data;

wherein the step of determining a remaining transmission space of the wireless transmission network based on the data characteristics of the video stream data comprises:

determining the remaining transmission space of the wireless transmission network based on the data characteristics of the video stream data by using a first preset formulaThe first preset formula is as follows:

；

in the method, in the process of the invention,for the number of data packets still being transmitted, +.>Is a scale factor->For the transmission delay of the sender to the wireless transmission network, < > >Is the average inter-arrival time.

2. The video stream data transmission method according to claim 1, wherein the step of transmitting the video stream data to a standby area of the wireless transmission network based on the remaining transmission space and a preset transmission policy comprises:

calculating the space occupied by the transmission of the video stream data：

；

In the method, in the process of the invention,for the length of the last video frame in the video stream data, < >>For delta coefficient>For the frame rate of the video stream data, +.>A transmission delay from a sender to a wireless transmission network;

judging the space occupied by the transmission of the video stream dataWhether or not it is smaller than the remaining transmission space of the wireless transmission network +.>；

If the transmission of the video stream data takes up spaceLess than the remaining transmission space of the wireless transmission network +.>Judging the queuing delay difference value->Whether or not it is smaller than the judgment threshold->If the queuing delay is +.>Less than the judgment threshold->Improving the video quality of the video stream data, and if the queuing delay difference value is + ->Not less than the judgment threshold->Maintaining the video quality of the video stream data to transmit the video stream data to a standby area of the wireless transmission network;

if the transmission of the video stream data takes up space Not less than the remaining transmission space of the wireless transmission network->And reducing the video quality of the video stream data to transmit the video stream data to a standby area of the wireless transmission network.

3. The video stream data transmission method according to claim 1, wherein the step of pre-allocating a bandwidth weight to each of the video stream data and optimizing the bandwidth weight to obtain an optimized bandwidth weight, and allocating a corresponding transmission bandwidth to each of the video stream data based on the optimized bandwidth weight comprises:

pre-distributing corresponding bandwidth weight for each video stream data, and carrying out bit rate decision on the video stream data through a first preset algorithm to obtain first characteristic information;

calculating second characteristic information of each video stream data：

；

In the method, in the process of the invention,、/>indicate->Person, th->Perceptual quality of the individual video stream data, +.>Is->Time of rebuffering of individual video stream data, +.>For the first penalty factor, +.>Is a second penalty coefficient;

optimizing the bandwidth weight according to the first characteristic information and the second characteristic information through a second preset algorithm to obtain an optimized bandwidth weight;

And allocating corresponding transmission bandwidth for each video stream data by using a congestion control algorithm.

4. The video stream data transmission method according to claim 1, wherein the step of determining a transmission status level based on a transmission bandwidth of the video stream data and an available bandwidth of a receiving side, adaptively compressing the video stream data based on the transmission status level, to obtain compressed video stream data comprises:

determining a number of transmission links of the wireless transmission networkAnd based on the number of transmission links +.>Calculating available bandwidth of the receiver>：

，/>；

In the method, in the process of the invention,is->Transmission start time of each transmission link, +.>Is->Transmission termination for individual transmission linksTime (F)>Is->Total transmission capacity of the individual transmission links;

transmission bandwidth based on the video stream dataAvailable bandwidth to the receiver->Calculating bandwidth difference +.>：

；

If it isCompressing the video stream data with a first compression rate as a fixed compression amount, ifCompressing the video stream data with a second compression rate as a fixed compression amount, ifCompressing the video stream data with a third compression rate as a fixed compression amount, ifCompressing the video stream data with a fourth compression rate as a fixed compression amount, if Compressing the video stream data with a fifth compression rate as a fixed compression amount, wherein,is the bandwidth mean.

5. The video stream data transmission method according to claim 1, wherein the step of performing sharpness update on the compressed video stream data according to the remaining reception capacity of the receiving side, and transmitting the updated compressed video stream data in the waiting area to the receiving side based on the transmission bandwidth of the video stream data comprises:

storing the compressed video stream data of the maximum definition level into a first video group, and storing the rest of the compressed video stream data into a second video group;

pre-transmitting the compressed video stream data in the second video group and updating the residual receiving capacity of the receiverAnd computing power->To obtain a first remaining capacity +.>And first computing power->；

Judging the first remaining acceptable capacityAnd whether the compressed video stream data is larger than a capacity threshold value or not is judged, a judgment result is generated, the compressed video stream data is updated in definition based on the judgment result, and the updated compressed video stream data in the to-be-stored area is transmitted to the receiver based on the transmission bandwidth of the video stream data.

6. The video stream data transmission method according to claim 5, wherein the determination of the first remaining acceptable capacityWhether the compressed video stream data is larger than a capacity threshold value or not and generating a judging result, carrying out definition update on the compressed video stream data based on the judging result, and transmitting the updated compressed video stream data in a to-be-stored area to the receiver based on the transmission bandwidth of the video stream data, wherein the step of transmitting the updated compressed video stream data in the to-be-stored area to the receiver comprises the following steps:

if the first remaining acceptable capacityIf the capacity threshold value is larger than the capacity threshold value, selecting first changed compressed video stream data from the second video group, performing iterative upgrade processing on the first changed compressed video stream data, and iteratively updating a first residual receiving capacity->And first computing power->；

Judging whether the first changed compressed video stream data reaches the maximum definition level, if so, moving the first changed compressed video stream data into the first video group until the first residual receiving capacityNot greater than the capacity threshold;

if the first remaining acceptable capacityJudging the first computing capacity after iterative updating if the first computing capacity is not greater than the capacity threshold value>Whether greater than a calculated threshold;

If the first computing power is updated iterativelyIf the calculation threshold value is not greater than the calculation threshold value, selecting second changed compressed video stream data from the second video group, performing iterative degradation processing on the second changed compressed video stream data, and repeating iterative updating of the first calculation capability->Until the first computing power +.>Greater than a calculated threshold;

and after the compressed video stream data in the second video group is updated, transmitting the updated compressed video stream data in the to-be-stored area to the receiver based on the transmission bandwidth of the video stream data.

7. A video stream data transmission system, the system comprising:

the data acquisition module is used for acquiring video stream data to be transmitted sent by a sender, and determining the residual transmission space of the wireless transmission network based on the data characteristics of the video stream data;

the transmission space determining module is used for transmitting the video stream data to a waiting area of the wireless transmission network based on the residual transmission space and a preset transmission strategy;

the bandwidth optimization module is used for pre-distributing bandwidth weights for each video stream data and optimizing the bandwidth weights to obtain optimized bandwidth weights, and distributing corresponding transmission bandwidths for each video stream data based on the optimized bandwidth weights;

The data compression module is used for determining a transmission state grade based on the transmission bandwidth of the video stream data and the available bandwidth of a receiver, and carrying out self-adaptive compression on the video stream data based on the transmission state grade so as to obtain compressed video stream data;

and the data transmission module is used for carrying out definition update on the compressed video stream data according to the residual receiving capacity of the receiver and transmitting the updated compressed video stream data in the waiting area to the receiver based on the transmission bandwidth of the video stream data.

8. A computer comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the video stream data transmission method according to any one of claims 1 to 6 when executing the computer program.

9. A storage medium having stored thereon a computer program which, when executed by a processor, implements the video stream data transmission method according to any one of claims 1 to 6.