CN113747205A - Video stream fair transmission method based on user operation - Google Patents

Video stream fair transmission method based on user operation Download PDF

Info

Publication number
CN113747205A
CN113747205A CN202111081767.8A CN202111081767A CN113747205A CN 113747205 A CN113747205 A CN 113747205A CN 202111081767 A CN202111081767 A CN 202111081767A CN 113747205 A CN113747205 A CN 113747205A
Authority
CN
China
Prior art keywords
client
frequency
video block
video
user operation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111081767.8A
Other languages
Chinese (zh)
Other versions
CN113747205B (en
Inventor
张栋
罗佳昱
周政演
蔡嘉懿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fuzhou University
Original Assignee
Fuzhou University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fuzhou University filed Critical Fuzhou University
Priority to CN202111081767.8A priority Critical patent/CN113747205B/en
Publication of CN113747205A publication Critical patent/CN113747205A/en
Application granted granted Critical
Publication of CN113747205B publication Critical patent/CN113747205B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2387—Stream processing in response to a playback request from an end-user, e.g. for trick-play
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/23805—Controlling the feeding rate to the network, e.g. by controlling the video pump
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention provides a fair video stream transmission method based on user operation, which is used for online playing of video streams, maintains user experience fairness through frequency adjustment of a new video block requested by a client, combines and analyzes user operation and video stream flow characteristics, and avoids subjectivity of traditional video research based on user operation. According to the invention, the frequency of the client side for requesting the new video block is adjusted between the upper and lower boundaries obtained by calculation through the video stream algorithm deployed on the client side, so that the problems of unfairness of user experience and waste of network resource use caused by that the rule of periodic request of the client side is broken through by user operation are solved. The invention uses network resources more effectively and improves the fairness of user experience.

Description

Video stream fair transmission method based on user operation
Technical Field
The invention relates to the technical field of videos, in particular to a fair video stream transmission method based on user operation.
Background
With the continuous development of video stream traffic, multiple clients on the same link are likely to compete for limited network resources. The video downloading is divided into a buffering stage and a stabilizing stage, when the content of the video stored in the buffer area is less, the video downloading enters the buffering stage, and the client continuously requests to download new video blocks to fill the buffer area as soon as possible; when the buffer is full, the video downloading enters a stable stage, and the video stream flow has the characteristic of downloading-stopping downloading periodic request so as to ensure that the buffer can be kept in a dynamic full state during video playing. Some user actions may affect the video stream traffic characteristics, for example, when a user fast forwards, the content available in the buffer of the player will decrease, so that the player enters a longer downloading period, and during the period when other players stop downloading on the same link, the player will think that more resources are available and gradually occupy a large amount of network resources. How to ensure that video users on the same link can obtain similar user experience under the influence of user operation and realize the fairness of the user experience becomes a difficult point of video stream research, and the fairness of the user experience needs to be improved as much as possible on the premise of ensuring that the video is not blocked.
Existing video streaming algorithms involving user operations attempt to analyze user intent by including: user operation characteristics, prediction of user operation, understanding of user preferences, etc., pre-downloading of video block content (reducing user stutter due to fast forward or reverse) and reducing unnecessary video block downloads (e.g., a few seconds of video ending). However, the user operation has strong subjectivity and is difficult to be very accurate. The user operation is detectable and distinguishable, in addition, the user operation breaks the periodic characteristics of the client request frequency, and the influence of the user operation on the video stream flow characteristics can be accurately predicted and is objective. Therefore, the user operation and the flow characteristics of the video stream are considered in a combined mode, and the solution can be more objective, accurate and effective.
Because the size of the video block requested by the client each time is given according to the requirement and the estimation of the network condition, the size of the video block requested by the client each time is regarded as a fixed utility value, and the size of the video block can be obtained by calculating the downloading bandwidth and the downloading time of the client, so that the bandwidth resource occupied by the client can be reduced by prolonging the downloading time (namely reducing the request frequency of the client).
The invention sets frequency adjustment recursion by referring to the 'integral reduction' thought in the congestion control theory, and effectively adjusts the request frequency of the client. The invention provides a fair video stream transmission method based on user operation, which combines and analyzes the user operation and the video stream flow characteristics, and avoids the subjectivity of the traditional video research based on the user operation. After the user operation occurs, the video stream algorithm deployed at the client adjusts the frequency of the video block requested by the client between the upper and lower boundaries obtained by calculation according to the specific type of the user operation, so that the allocation of link resources is well balanced, and the fairness of the user experience of watching videos on the same link is improved.
Disclosure of Invention
The invention provides a user operation-based fair video stream transmission method, which can more effectively use network resources and improve the fairness of user experience.
The invention adopts the following technical scheme.
A fair transmission method of video stream based on user operation is used for online playing of video stream, the fairness of user experience is maintained by adjusting the frequency of a client requesting a new video block, when the user operation is fast forward or fast backward, the client of the video stream can finely adjust the frequency of requesting the new video block between an upper frequency boundary and a lower frequency boundary obtained by dynamic calculation, and the transmission method specifically comprises the following steps:
the client detects the user operation type and predicts the change of the flow characteristic of the future video stream from the objective angle. If the user operates as fast forward or fast backward, the client gradually adjusts the request frequency of the client according to the frequency adjustment recursion formula set by the reference 'product reduction' theory, so that the client which performs fast forward or fast backward does not excessively occupy network resources, and the idle resources can be reserved for other clients which are more needed, thereby achieving the purposes of improving the fairness of user experience and effectively utilizing the network resources.
The transmission method includes the steps of;
step S1, when the user operation is to start fast forward or start fast reverse and the player buffer of the client is not filled completely, go to step S2;
step S2, calculating the reasonable frequency range of the client requesting the new video block according to the network resource condition, responding to the user operation according to the frequency range, and leading the server to reasonably distribute the network resource to all the online clients on the premise of ensuring that the video is not blocked, thereby fairly improving the online user experience; if the frequency of use of the fast forward or fast backward function is too high to form an aggressive operation, the process goes to step S3;
step S3, the client responds to the user' S rapid operation on the fast forward or fast backward function according to the lower limit of the frequency range of the request new video block obtained in step S2;
step S4, when the client detects that the filling of the player buffer is completed, the method stops the intervention and initializes the request frequency.
When a user requests a new video block from a server through fast forward or fast backward operation, the video stream fair transmission method adopts a video stream fair transmission method based on user operation to carry out combined analysis on the user operation and the video stream flow characteristics so as to predict the corresponding video stream characteristics caused by the user operation. Compared with subjective analysis for guessing user intention by working in the prior traditional technology, the method is more objective, credible and predictable.
The method for maintaining user experience fairness through frequency adjustment of a new video block requested by a client uses a mathematical theory as support, and specifically comprises the following steps:
if the size of the video block requested to be downloaded by the client at one time is set as the utility value U (x), then
Figure BDA0003264319210000031
Wherein s isiRepresenting the size of the ith video block in a request;
the working parameters of the client comprise the number n of video blocks needing to be downloaded by one fast forward request or one fast backward request and the quality q of the ith video blockiThe number n of video blocks that the client needs to download at a time and the quality q of the ith video blockiIs a precise value, and si＝n×qi(ii) a Therefore, the utility value generated by the client to the network resource by each fast forward or fast backward request is a fixed value;
let f (t) be a function of throughput and download time, then
Figure BDA0003264319210000032
Converting the above formula into U (x) ═ x-0 f (xi) according to the integral median theorem, wherein xi is in the scope of 0, x, and f (xi) is the average throughput;
the average throughput reflects the condition of link resources occupied by the client in one request;
according to the above formula, when a user requests a new video block to a server through fast forward or fast backward operation, the amount of network resources occupied by the client can be reduced by prolonging the time x required by the client to complete the downloading; the fair video streaming transmission method based on user operation adjusts the frequency of the video block requested by the client to prolong the time x required by the client to finish the downloading, so as to reduce the network resources occupied by the client and maintain the fairness of other client players on the same link for obtaining user experience.
In step S2, when calculating the reasonable frequency range of the client requesting the new video block according to the network resource situation, the upper frequency bound is calculated by the method that the client requests the upper operating frequency bound f of the new video block because the client can request a plurality of video blocks at one timeupTending to infinity within the network resource tolerances.
The lower limit of the operation frequency of the fast forward or fast backward function, namely the lower limit of the frequency adjustment of the new video block manually requested by the client, is calculated by the following steps:
determination of the required parameters: let the download time of the ith video block be dowiThen, then
Figure BDA0003264319210000041
Let tlfFor the moment when the playing of the latest video block is completed, tlrThe duration is the time that a video block can be played for the time when the latest video block is requested, and is referred to as the duration, tnThe time when the next new video block is requested;
determination of the calculation method: the first condition is as follows: if dowi-1Or dowiIf the video block is too large and exceeds the playing time of the video block, initializing the client request frequency to dur-RTT by a video stream fair transmission method based on user operation;
case two: if dowi-1And dowiThe playing time of the video block is not exceeded, and the time t of requesting the next new video block can be obtainednSatisfy the relation: t is tn≤tlr+dur+dowi-1-dowiThen the client requests a lower bound on the frequency
Figure BDA0003264319210000042
The adjustment of the response frequency of the operation of the client in the steps S2 and S3, which is to adjust the frequency of the manual request of the new video block, is expressed as the following recursion,
i.f0＝fup＝flow+δ
ii.f1＝flow+δ×α
…
iii.fn＝flow+δ×αn
wherein δ can be derived from i ∈ (0,1), fnIndicates the frequency of client requests after the nth adjustment, and can guarantee limn→∞(fn+flow)＝flow，
If τ is an infinitely small number, limn→∞(δ×αn) τ, and thus α can also be calculated;
by adjusting the frequency of the video block requested by the client, the frequency of the video block requested by the client is gradually close to the lower frequency limit, the time for the client to continuously occupy network resources is shortened, and the video playing is prevented from being blocked due to the adjustment of the response frequency of the client.
When the user operates to start fast forward or fast backward, the video stream fair transmission method based on the user operation sets n equal to the number of video blocks lacking in the buffer area, so that the adjustment of the client request frequency can run through the whole process of refilling the buffer area by the client, and the client with the user operation can be ensured not to occupy network resources of other players. And after the buffer is filled up again, initializing the frequency of the video block requested by the client to dur-RTT by a video stream fair transmission method based on user operation, and stopping the adjustment of the requested frequency.
The invention provides a fair video stream transmission method based on user operation, which combines and analyzes the user operation and the video stream flow characteristics, and avoids the subjectivity of the traditional video research based on the user operation. After the user operation occurs, the video stream algorithm deployed at the client adjusts the frequency of the video block requested by the client between the upper and lower boundaries obtained by calculation according to the specific type of the user operation, so that the allocation of link resources is well balanced, and the fairness of the user experience of watching videos on the same link is improved.
The method of the invention can correspondingly adjust the client request frequency between the upper and lower frequency boundaries obtained by calculation according to the user operation type, more effectively use network resources and improve the fairness of user experience.
The scheme of the invention finely adjusts the frequency of the client requesting the new video block based on the 'product reduction' theory, effectively improves the fairness of user experience, and the algorithm of the scheme is deployed at the client, is simple and easy to realize, has stronger practicability and does not occupy the resources of the server.
According to the invention, the frequency of the client side for requesting the new video block is adjusted between the upper and lower boundaries obtained by calculation through the video stream algorithm deployed on the client side, so that the problems of unfairness of user experience and waste of network resource use caused by that the rule of periodic request of the client side is broken through by user operation are solved.
The method sets the size of the video block requested by the client as a utility value, finely adjusts the frequency of the client for requesting a new video block between the upper and lower frequency boundaries obtained by calculation according to the type of the generated user operation, and ensures that the adjustment of the requested frequency cannot cause video blocking; the video stream fair transmission method based on the user operation avoids the situation that the client side occupies link resources for a long time due to the user operation, improves the fairness of user experience, and can reduce the total usage amount of network resources.
Drawings
The invention is described in further detail below with reference to the following figures and detailed description:
FIG. 1 is a schematic diagram illustrating a calculation principle of a lower bound of frequency adjustment for a new video block requested by a client in a fair video stream transmission method based on user operation according to the present invention;
fig. 2 is a schematic diagram illustrating a client requesting to download a plurality of video blocks in a single request sent in a conventional technology;
fig. 3 is a schematic diagram illustrating a principle of distributing a request for downloading a plurality of blocks, which is uniformly transmitted at time T, to a plurality of times according to the present invention.
Detailed Description
As shown in the figure, a fair video stream transmission method based on user operation is used for online playing of video streams, maintains user experience fairness through frequency adjustment of a client requesting a new video block, and when the user operation is fast forward or fast backward, the client of the video streams can finely adjust the frequency of requesting the new video block between an upper frequency boundary and a lower frequency boundary obtained through dynamic calculation;
step S1, when the user operation is to start fast forward or start fast reverse and the player buffer of the client is not filled completely, go to step S2;
step S2, calculating the reasonable frequency range of the client requesting the new video block according to the network resource condition, responding to the user operation according to the frequency range, and leading the server to reasonably distribute the network resource to all the online clients on the premise of ensuring that the video is not blocked, thereby fairly improving the online user experience; if the frequency of use of the fast forward or fast backward function is too high to form an aggressive operation, the process goes to step S3;
step S3, the client responds to the user' S rapid operation on the fast forward or fast backward function according to the lower limit of the frequency range of the request new video block obtained in step S2;
step S4, when the client detects that the filling of the player buffer is completed, the method stops the intervention and initializes the request frequency.
When a user requests a new video block from a server through fast forward or fast backward operation, the video stream fair transmission method adopts a video stream fair transmission method based on user operation to carry out combined analysis on the user operation and the video stream flow characteristics so as to predict the corresponding video stream characteristics caused by the user operation. Compared with subjective analysis for guessing user intention by working in the prior traditional technology, the method is more objective, credible and predictable.
The method for maintaining user experience fairness through frequency adjustment of a new video block requested by a client uses a mathematical theory as support, and specifically comprises the following steps:
if the size of the video block requested to be downloaded by the client at one time is set as the utility value U (x), then
Figure BDA0003264319210000061
Wherein s isiRepresenting the size of the ith video block in a request;
the working parameters of the client comprise the number n of video blocks needing to be downloaded by one fast forward request or one fast backward request and the quality q of the ith video blockiThe number n of video blocks that the client needs to download at a time and the quality q of the ith video blockiIs a precise value, and si＝n×qi(ii) a Therefore, the utility of each fast forward or fast backward request of the client to the network resourceThe value is a constant value;
let f (t) be a function of throughput and download time, then
Figure BDA0003264319210000071
Converting the above formula into U (x) ═ x-0 f (xi) according to the integral median theorem, wherein xi is in the scope of 0, x, and f (xi) is the average throughput;
the average throughput reflects the condition of link resources occupied by the client in one request;
according to the above formula, when a user requests a new video block to a server through fast forward or fast backward operation, the amount of network resources occupied by the client can be reduced by prolonging the time x required by the client to complete the downloading; the fair video streaming transmission method based on user operation adjusts the frequency of the video block requested by the client to prolong the time x required by the client to finish the downloading, so as to reduce the network resources occupied by the client and maintain the fairness of other client players on the same link for obtaining user experience.
In step S2, when calculating the reasonable frequency range of the client requesting the new video block according to the network resource situation, the upper frequency bound is calculated by the method that the client requests the upper operating frequency bound f of the new video block because the client can request a plurality of video blocks at one timeupTending to infinity within the network resource tolerances.
The lower limit of the operation frequency of the fast forward or fast backward function, namely the lower limit of the frequency adjustment of the new video block manually requested by the client, is calculated by the following steps:
determination of the required parameters: let the download time of the ith video block be dowiThen, then
Figure BDA0003264319210000072
Let tlfFor the moment when the playing of the latest video block is completed, tlrThe duration is the time that a video block can be played for the time when the latest video block is requested, and is referred to as the duration, tnThe time when the next new video block is requested;
determination of the calculation method: the first condition is as follows: if dowi-1Or dowiIf the video block is too large and exceeds the playing time of the video block, initializing the client request frequency to dur-RTT by a video stream fair transmission method based on user operation;
case two: if dowi-1And dowiThe playing time of the video block is not exceeded, and the time t of requesting the next new video block can be obtainednSatisfy the relation: t is tn≤tlr+dur+dowi-1-dowiThen the client requests a lower bound on the frequency
Figure BDA0003264319210000081
The adjustment of the response frequency of the operation of the client in the steps S2 and S3, which is to adjust the frequency of the manual request of the new video block, is expressed as the following recursion,
i.f0＝fup＝flow+δ
ii.f1＝flow+δ×α
…
iii.fn＝flow+δ×αn
wherein δ can be derived from i ∈ (0,1), fnIndicates the frequency of client requests after the nth adjustment, and can guarantee limn→∞(fn+flow)＝flow，
If τ is an infinitely small number, limn→∞(δ×αn) τ, and thus α can also be calculated;
by adjusting the frequency of the video block requested by the client, the frequency of the video block requested by the client is gradually close to the lower frequency limit, the time for the client to continuously occupy network resources is shortened, and the video playing is prevented from being blocked due to the adjustment of the response frequency of the client.
When the user operates to start fast forward or fast backward, the video stream fair transmission method based on the user operation sets n equal to the number of video blocks lacking in the buffer area, so that the adjustment of the client request frequency can run through the whole process of refilling the buffer area by the client, and the client with the user operation can be ensured not to occupy network resources of other players. And after the buffer is filled up again, initializing the frequency of the video block requested by the client to dur-RTT by a video stream fair transmission method based on user operation, and stopping the adjustment of the requested frequency.
Example (b):
in this example, the processing manner of the present invention for a player that fast-forwards or fast-backwards occurs is different from the conventional client request algorithm shown in fig. 2 that requests to download multiple video blocks in one transmitted request.
Referring to fig. 3, in the fair video streaming transmission method based on user operation of the present invention, the requests for downloading multiple blocks, which are uniformly sent at time T in fig. 2, are dispersed to multiple times (T1, T2, T3 … Tn), and the frequency of requesting new video blocks by the client is finely adjusted according to the "integral reduction" theory, so that the intervals at which the client requests the video blocks are gradually close to the lower frequency bound, thereby reducing the time for the client to continuously download, which occurs fast forward or fast backward, and reducing the use of link resources.
In this example, the step S1 classifies the types of user operations as follows:
first, user operations can be roughly classified into seven types in total: (1) the video (2) is started, the video (3) is paused, then the video (4) is continuously played, the video (5) is closed, the unplayed content (fast forward) is watched in advance, the video (6) is replayed after the content (fast backward) which is played is watched, and the video (7) is replayed after the watching is finished.
The fair video streaming transmission method based on user operation classifies seven user operations into three categories again: fast forward, fast reverse, pause. (1) The four types of user operations (5), (6) and (7) can be classified into one type because they all cause the buffer contents to be consumed. The reason for dividing the fast forward and fast backward is that the client empties the buffer area during fast backward, and the remaining available contents of the buffer area are different according to the difference of the fast forward distance of the user during fast forward; (2) (3) and (4) these three types of user operations are classified as pause, because the video must continue to be played after the video is paused, so analysis (2) corresponds to analysis (3), and (4) corresponds to pause in which the video does not continue to be played, and therefore, these three types of user operations are classified as pause collectively in the end.
In this example, the process of calculating the upper and lower frequency bounds in step S2 is as follows:
first, the upper frequency bound for clients requesting new video chunks tends to be infinite, as clients can request multiple video chunks at once. The lower bound of the client request frequency is obtained by calculating the maximum time interval that the next video block can just be connected after the playing of the previous video block is finished.
Let the download time of the previous video block be dowi-1The download time of the current video block is dowiThe time that each video block can be played is dur, and a lower frequency bound can be obtained
Figure BDA0003264319210000091
In this example, the "product reduction" recursion of the adjustment of the request frequency for the client that has fast-forwarding or fast-rewinding is as follows, and lim can be guaranteedn→∞(fn+flow)＝flow
i.f0＝fup＝flow+δ
ii.f1＝flow+δ×α
…
iii.fn＝flow+δ×αn
Where δ is obtained by the equation i, whereas δ × α is due to the fact that when n goes to infinitynTherefore, α can also be calculated as 0.
In step S4 in this example, after the buffer of the player is filled, the video streaming fair transmission method based on the user operation stops the adjustment of the request frequency and initializes the request frequency.
The above description is only a preferred embodiment of the present invention, and all equivalent changes and modifications made in accordance with the claims of the present invention should be covered by the present invention.

Claims (7)

1. A fair video stream transmission method based on user operation is used for online playing of video streams, and maintains user experience fairness by requesting a client for frequency adjustment of a new video block, and is characterized in that: when the user operates to fast forward or fast backward, the client of the video stream can finely adjust the frequency of the request new video block between the upper and lower frequency boundaries obtained by dynamic calculation, and the transmission method comprises the following steps;
step S1, when the user operation is to start fast forward or start fast reverse and the player buffer of the client is not filled completely, go to step S2;
step S2, calculating the reasonable frequency range of the client requesting the new video block according to the network resource condition, responding to the user operation according to the frequency range, and leading the server to reasonably distribute the network resource to all the online clients on the premise of ensuring that the video is not blocked, thereby fairly improving the online user experience; if the frequency of use of the fast forward or fast backward function is too high to form an aggressive operation, the process goes to step S3;
step S3, the client responds to the user' S rapid operation on the fast forward or fast backward function according to the lower limit of the frequency range of the request new video block obtained in step S2;
step S4, when the client detects that the filling of the player buffer is completed, the method stops the intervention and initializes the request frequency.
2. The method for fair video streaming transmission based on user operation as claimed in claim 1, wherein: when a user requests a new video block from a server through fast forward or fast backward operation, the fair video stream transmission method performs combined analysis on user operation and video stream flow characteristics to predict corresponding video stream characteristics caused by the user operation.
3. The method for fair video streaming transmission based on user operation as claimed in claim 1, wherein: the method for maintaining user experience fairness through frequency adjustment of a new video block requested by a client uses a mathematical theory as support, and specifically comprises the following steps:
setting the size of the video block requested to be downloaded by the client side at one time as a utility value U (x),
then
Figure FDA0003264319200000011
Wherein s isiRepresenting the size of the ith video block in a request;
the working parameters of the client comprise the number n of video blocks needing to be downloaded by one fast forward request or one fast backward request and the quality q of the ith video blockiThe number n of video blocks that the client needs to download at a time and the quality q of the ith video blockiIs a precise value, and si＝n×qi(ii) a Therefore, the utility value generated by the client to the network resource by each fast forward or fast backward request is a fixed value;
let f (t) be a function of throughput and download time, then
Figure FDA0003264319200000021
Converting the above formula into U (x) ═ x-0 f (xi) according to the integral median theorem, wherein xi is in the scope of 0, x, and f (xi) is the average throughput;
the average throughput reflects the condition of link resources occupied by the client in one request;
according to the above formula, when a user requests a new video block to a server through fast forward or fast backward operation, the amount of network resources occupied by the client can be reduced by prolonging the time x required by the client to complete the downloading; the fair video streaming transmission method based on user operation adjusts the frequency of the video block requested by the client to prolong the time x required by the client to finish the downloading, so as to reduce the network resources occupied by the client and maintain the fairness of other client players on the same link for obtaining user experience.
4. A method as claimed in claim 1The video stream fair transmission method based on user operation is characterized in that: in step S2, when calculating the reasonable frequency range of the client requesting the new video block according to the network resource situation, the upper frequency bound is calculated by the method that the client requests the upper operating frequency bound f of the new video block because the client can request a plurality of video blocks at one timeupTending to infinity within the network resource tolerances.
5. The method for fair video streaming transmission based on user operation as claimed in claim 1, wherein: the lower limit of the operation frequency of the fast forward or fast backward function, namely the lower limit of the frequency adjustment of the new video block manually requested by the client, is calculated by the following steps:
determination of the required parameters: let the download time of the ith video block be dowiThen, then
Figure FDA0003264319200000022
Let tlfFor the moment when the playing of the latest video block is completed, tlrThe duration is the time that a video block can be played for the time when the latest video block is requested, and is referred to as the duration, tnThe time when the next new video block is requested;
determination of the calculation method: the first condition is as follows: if dowi-1Or dowiIf the video block is too large and exceeds the playing time of the video block, initializing the client request frequency to dur-RTT by a video stream fair transmission method based on user operation;
case two: if dowi-1And dowiThe playing time of the video block is not exceeded, and the time t of requesting the next new video block can be obtainednSatisfy the relation: t is tn≤tlr+dur+dowi-1-dowiThen the client requests a lower bound on the frequency
Figure FDA0003264319200000031
6. The method for fair transmission of video streams based on user operations as claimed in claim 5, wherein: the adjustment of the response frequency of the operation of the client in the steps S2 and S3, which is to adjust the frequency of the manual request of the new video block, is expressed as the following recursion,
i.f0＝fup＝flow+δ
ii.f1＝flow+δ×α
…
iii.fn＝flow+δ×αn
wherein δ can be derived from i ∈ (0,1), fnIndicates the frequency of client requests after the nth adjustment, and can guarantee limn→∞(fn+flow)＝flow，
If τ is an infinitely small number, limn→∞(δ×αn) τ, and thus α can also be calculated;
by adjusting the frequency of the video block requested by the client, the frequency of the video block requested by the client is gradually close to the lower frequency limit, the time for the client to continuously occupy network resources is shortened, and the video playing is prevented from being blocked due to the adjustment of the response frequency of the client.
7. The method for fair transmission of video streams based on user operations as claimed in claim 6, wherein: when the user operates to start fast forward or fast backward, the video stream fair transmission method based on the user operation sets n equal to the number of video blocks lacking in the buffer area, so that the adjustment of the client request frequency can run through the whole process of refilling the buffer area by the client, and the client with the user operation can be ensured not to occupy network resources of other players. And after the buffer is filled up again, initializing the frequency of the video block requested by the client to dur-RTT by a video stream fair transmission method based on user operation, and stopping the adjustment of the requested frequency.
CN202111081767.8A 2021-09-15 2021-09-15 Video stream fair transmission method based on user operation Active CN113747205B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111081767.8A CN113747205B (en) 2021-09-15 2021-09-15 Video stream fair transmission method based on user operation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111081767.8A CN113747205B (en) 2021-09-15 2021-09-15 Video stream fair transmission method based on user operation

Publications (2)

Publication Number Publication Date
CN113747205A true CN113747205A (en) 2021-12-03
CN113747205B CN113747205B (en) 2022-11-22

Family

ID=78739059

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111081767.8A Active CN113747205B (en) 2021-09-15 2021-09-15 Video stream fair transmission method based on user operation

Country Status (1)

Country Link
CN (1) CN113747205B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105245919A (en) * 2015-10-08 2016-01-13 清华大学 Energy-consumption-optimization adaptive streaming media distribution method for intelligent terminal
US20190306551A1 (en) * 2016-05-31 2019-10-03 The Trustees Of Princeton University System And Method For Improving Streaming Video Via Better Buffer Management
CN111225243A (en) * 2020-01-20 2020-06-02 中南大学 Video block scheduling method and system
CN112714353A (en) * 2020-12-28 2021-04-27 杭州电子科技大学 Distributed synchronization method for multimedia stream

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105245919A (en) * 2015-10-08 2016-01-13 清华大学 Energy-consumption-optimization adaptive streaming media distribution method for intelligent terminal
US20190306551A1 (en) * 2016-05-31 2019-10-03 The Trustees Of Princeton University System And Method For Improving Streaming Video Via Better Buffer Management
CN111225243A (en) * 2020-01-20 2020-06-02 中南大学 Video block scheduling method and system
CN112714353A (en) * 2020-12-28 2021-04-27 杭州电子科技大学 Distributed synchronization method for multimedia stream

Also Published As

Publication number Publication date
CN113747205B (en) 2022-11-22

Similar Documents

Publication Publication Date Title
CN108184152B (en) Two-stage client code rate selection method for DASH transmission system
US10178037B2 (en) Deadline driven content delivery
CA3135076C (en) Method to stream contents in a peer-to-peer network
Xing et al. A real-time adaptive algorithm for video streaming over multiple wireless access networks
Ramakrishnan et al. SDN based QoE optimization for HTTP-based adaptive video streaming
US20110270913A1 (en) Controlling an adaptive streaming of digital content
US10419507B2 (en) Method and device for reserving bandwidth for an adaptive streaming client
Taha et al. SDN-based throughput allocation in wireless networks for heterogeneous adaptive video streaming applications
Zhou et al. TFDASH: A fairness, stability, and efficiency aware rate control approach for multiple clients over DASH
CN107396207A (en) A kind of P2P data dispatching methods of feature based priority
ur Rahman et al. A novel adaptive logic for dynamic adaptive streaming over HTTP
Lin et al. Autotune: game-based adaptive bitrate streaming in P2P-assisted cloud-based vod systems
Rahman et al. A client side buffer management algorithm to improve QoE
Khan et al. Collaborative Methods to Reduce the Disastrous Effects of the Overlapping ON Problem in DASH
Rahman et al. SABA: Segment and buffer aware rate adaptation algorithm for streaming over HTTP
Koffka et al. A DASH Survey: the ON-OFF Traffic Problem and Contemporary Solutions
KR101837637B1 (en) Streaming method based on Client-side ACK-regulation and apparatus thereof
CN113747205B (en) Video stream fair transmission method based on user operation
CN111225243B (en) Video block scheduling method and system
Togou et al. An elastic dash-based bitrate adaptation scheme for smooth on-demand video streaming
Jabbar et al. Proposed an adaptive bitrate algorithm based on measuring bandwidth and video buffer occupancy for providing smoothly video streaming
CN113207015B (en) Task scheduling strategy generation method and device, storage medium and computer equipment
CN108881051B (en) Node load balancing method based on request queue in P2P streaming media on-demand system
Bezerra et al. DBuffer: A state machine oriented control system for DASH
Seufert et al. A fair share for all: Novel adaptation logic for qoe fairness of http adaptive video streaming

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant