CN113489745B - Video data transmission method, device, equipment and storage medium - Google Patents
Video data transmission method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN113489745B CN113489745B CN202110867221.9A CN202110867221A CN113489745B CN 113489745 B CN113489745 B CN 113489745B CN 202110867221 A CN202110867221 A CN 202110867221A CN 113489745 B CN113489745 B CN 113489745B
- Authority
- CN
- China
- Prior art keywords
- video
- code rate
- segment
- decision value
- parameter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 58
- 238000000034 method Methods 0.000 title claims abstract description 50
- 239000012634 fragment Substances 0.000 claims description 23
- 238000004364 calculation method Methods 0.000 claims description 16
- 238000009825 accumulation Methods 0.000 claims description 9
- 238000012545 processing Methods 0.000 abstract description 19
- 230000007246 mechanism Effects 0.000 abstract description 8
- 230000008569 process Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 238000013461 design Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/164—Feedback from the receiver or from the transmission channel
- H04N19/166—Feedback from the receiver or from the transmission channel concerning the amount of transmission errors, e.g. bit error rate [BER]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention discloses a video data sending method, a device, equipment and a storage medium, wherein the method comprises the following steps: acquiring a first video clip in the video data transmission process; calculating a decision value corresponding to the first video clip based on a preset algorithm model, wherein the algorithm model comprises a video code rate parameter and a video cartoon parameter; and determining whether to send the first video clip according to the decision value. According to the video data transmission method disclosed by the scheme, a video data transmission mechanism is optimized, and a data processing mode is more flexible.
Description
Technical Field
Embodiments of the present application relate to the field of computers, and in particular, to a method, an apparatus, a device, and a storage medium for sending video data.
Background
With the development of computer and network technologies, the transmission and presentation of data in the form of video is one of the currently mainstream multimedia interaction modes. Taking live video as an example, a video sending end sends video data, and a video receiving end receives the video data through a network and displays the video data.
In the prior art, in order to ensure low delay requirement during video data playing, a video frame loss technology is generally adopted. The video frame dropping technology refers to actively dropping video data to reduce network link congestion to control delay of a transmitting end and a receiving end when the video data is transmitted. However, most of the existing video frame loss technologies determine whether to perform frame loss processing according to the accumulation duration of video data, and the mode considers single factors, so that the processing effect is poor, and the duration of video clamping is long.
Disclosure of Invention
The embodiment of the invention provides a video data sending method, a device, equipment and a storage medium, solves the problems of single video data sending processing mode and poor adaptability in the prior art, reduces the duration of video clamping and optimizes a video data sending mechanism.
In a first aspect, an embodiment of the present invention provides a video data transmission method, including:
acquiring a first video clip in the video data transmission process;
calculating a decision value corresponding to the first video clip based on a preset algorithm model, wherein the algorithm model comprises a video code rate parameter and a video cartoon parameter;
and determining whether to send the first video clip according to the decision value.
In a second aspect, an embodiment of the present invention further provides a video data transmitting apparatus, including:
the information acquisition module is used for acquiring a first video clip in the video data transmission process;
the decision value calculation module is used for calculating a decision value corresponding to the first video clip based on a preset algorithm model, wherein the algorithm model comprises a video code rate parameter and a video cartoon parameter;
and the data transmission control module is used for determining whether to transmit the first video clip according to the decision value.
In a third aspect, an embodiment of the present invention further provides a video data transmission apparatus, including:
one or more processors;
storage means for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors implement the video data transmission method according to the embodiment of the present invention.
In a fourth aspect, embodiments of the present invention also provide a storage medium storing computer-executable instructions that, when executed by a computer processor, are configured to perform the video data transmission method according to the embodiments of the present invention.
In the embodiment of the invention, a first video segment is acquired in the video data transmission process, a decision value corresponding to the first video segment is calculated based on a preset algorithm model, wherein the algorithm model comprises a video code rate parameter and a video clamping parameter, whether the first video segment is transmitted or not is determined according to the decision value, the video code rate and the video clamping condition are synchronously referenced when whether to discard video data or not is determined by the processing method for video data transmission, the decision value is obtained through the preset algorithm model and is used for judging whether to transmit the video data or not, a video data transmission mechanism is optimized, and a data processing mode is more flexible.
Drawings
Fig. 1 is a flowchart of a video data transmission method according to an embodiment of the present invention;
fig. 2 is a flowchart of another video data transmission method according to an embodiment of the present invention;
fig. 2a is a schematic diagram of video data including a plurality of video clips according to an embodiment of the present invention;
fig. 3 is a flowchart of another video data transmission method according to an embodiment of the present invention;
fig. 4 is a flowchart of another video data transmission method according to an embodiment of the present invention;
fig. 5 is a flowchart of another video data transmission method according to an embodiment of the present invention;
fig. 6 is a flowchart of another video data transmission method according to an embodiment of the present invention;
fig. 7 is a block diagram of a video data transmitting apparatus according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of an apparatus according to an embodiment of the present invention.
Detailed Description
Embodiments of the present invention will be described in further detail below with reference to the drawings and examples. It should be understood that the particular embodiments described herein are illustrative only and are not limiting of embodiments of the invention. It should be further noted that, for convenience of description, only some, but not all of the structures related to the embodiments of the present invention are shown in the drawings.
The terms first, second and the like in the description and in the claims, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged, as appropriate, such that embodiments of the present application may be implemented in sequences other than those illustrated or described herein, and that the objects identified by "first," "second," etc. are generally of a type and not limited to the number of objects, e.g., the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.
Fig. 1 is a flowchart of a video data transmission method provided in an embodiment of the present invention, which is applicable to video data transmission, where the method may be performed by a computing device, such as a desktop computer, a notebook computer, a background server, a tablet computer, a mobile phone terminal, and the like, and specifically includes the following steps:
step S101, in the video data transmission process, a first video clip is acquired.
Video data is a common type of multimedia data, consisting of a sequence of successive images. In one embodiment, the video data is transmitted in the form of video clips during transmission. For example, taking video data as live video data as an example, when the background server transmits live video data, in order to adapt to reasonable playing of video data of a video data receiving end under various conditions, the video data is transcoded into video data versions with different code rates, and the video data versions with each code rate are correspondingly segmented into a plurality of video clips. The first video segment is one of a plurality of video segments and is used for referring to a video segment to be processed currently.
In one embodiment, if a piece of video data is split into 20 video segments, when the video segments are sequentially transmitted from the first video segment, it is periodically determined whether the current video segment is transmitted, i.e., whether to select to transmit the video segment or to discard the video segment. The period may be, for example, 100ms, i.e. the acquisition of video clips is performed every 100 ms.
Step S102, calculating a decision value corresponding to the first video clip based on a preset algorithm model, wherein the algorithm model comprises a video code rate parameter and a video clamping parameter.
After the first video segment is obtained, whether frame loss processing is needed or not is judged, namely whether the first video segment needs to be sent or not. In one embodiment, a preset algorithm model is used to calculate a decision value corresponding to the first video segment, and whether to discard the first video data is determined according to the decision value. Illustratively, greedy algorithm design considerations may be employed to design and determine the decision value for the first video segment. The greedy algorithm is used when solving the problem, and the greedy algorithm is the best choice currently seen. That is, the choice made is simply a locally optimal solution in a sense, not considered for overall optimization. For the scheme, in the video data sending process, a decision of whether to perform frame loss processing, namely discarding the video clips, can be properly and reasonably made. For each video segment, the decision value is independently calculated, and the designed model takes the higher the decision value, the more accurate and reasonable as an example, and the corresponding processing mode when the decision value is highest is selected to process the current video segment. Because each video clip selects the optimal solution equivalent to local rationality, the frame loss processing executed on the video data containing a plurality of video clips is the most reasonable processing mode. For example, for a first video segment, the decision value includes a first decision value calculated when the video segment is transmitted, and a second decision value calculated when the video segment is not transmitted, and of course, the decision value may also include a third decision value calculated when 1/3 of the video segment is transmitted (i.e., 2/3 of the length of the video segment is discarded).
The preset algorithm model comprises a video code rate parameter and a video clamping parameter, namely the algorithm model introduces the reference video code rate parameter and the video clamping parameter when determining the decision value of the first video segment. Rather than employing a single decision to send a video clip based on the length of the data pile-up. The video code rate parameter characterizes the playing code rate of the first video clip, and the video jamming parameter characterizes the jamming condition of the video data when played at the receiving end.
Step S103, determining whether to send the first video clip according to the decision value.
After determining the decision value of the first video segment, determining whether to send the first video segment according to the decision value. Taking an example that the decision value includes a first decision value corresponding to the first video segment and a second decision value corresponding to the first video segment not being sent, if the first decision value is greater than or equal to the second decision value, selecting to send the first video segment; if the first decision value is less than the second decision value, the first video segment is not transmitted.
According to the scheme, in the video data transmission process, the decision value of the current video clip is calculated by adopting the algorithm model to determine whether to transmit the current video clip, and in the concrete decision value calculation process, the decision value comprises the video code rate parameter and the video cartoon parameter, namely whether to transmit the video clip is related to the video code rate parameter and the video cartoon parameter, the existing video data transmission mechanism is optimized, and the data processing mode is more flexible.
Fig. 2 is a flowchart of another video data transmission method according to an embodiment of the present invention, which provides a specific scheme for determining whether to transmit video data according to a decision value. As shown in fig. 2, the technical scheme is as follows:
step S201, in the process of sending video data, a first video clip is acquired.
Fig. 2a is a schematic diagram of video data including a plurality of video clips according to an embodiment of the present invention. As shown in fig. 2a, a periodic determination is made as to whether the current video segment (the illustrated portion is a determination of the first video segment) needs to be transmitted. For the illustration of fig. 2a, the first video clip currently comprises a transmitted video clip and a video clip to be transmitted.
Step S202, calculating a first decision value corresponding to the first video segment based on a preset algorithm model, and not transmitting a second decision value corresponding to the first video segment.
Taking fig. 2a as an example, a first decision value corresponding to the first video segment is calculated and sent, and a second decision value corresponding to the first video segment is not sent. Wherein, sending the first video segment means continuing to send the video segment of the portion to be sent, and not sending the first video segment means performing frame loss processing on the video segment of the portion to be sent, that is, not sending the video segment of the portion.
For example, assuming that the first video clip is transmitted, the first decision value calculated by the preset algorithm model is denoted as QoE1; assuming that the first video clip is not transmitted, the second decision value calculated by the preset algorithm model is recorded as QoE2.
In one embodiment, the manner in which the QoE value is calculated may employ the formula: α.r+β.rebuf, where r is a video code rate parameter and rebuf is a video katon parameter; alpha is the code rate parameter weight corresponding to the video code rate parameter, and beta is the katon parameter weight corresponding to the video code rate parameter.
Step S203, if the first decision value is greater than or equal to the second decision value, the first video segment is transmitted, and if the first decision value is less than the second decision value, the first video segment is not transmitted.
If QoE1 is larger than QoE2, the processing mode of sending the first video segment is more reasonable, and the playing effect of the video data is better; if QoE1 is smaller than QoE2, the processing mode of not sending the first video clip is more reasonable, and the playing effect of the video data is better.
According to the scheme, in the process of transmitting video data, the score value of each video segment when the video segment is transmitted and the score value of each video segment when the video segment is not transmitted are determined in a form of calculating QoE scores, whether the video segment is transmitted or not is determined according to the score value condition, meanwhile, when the score values are calculated, video code rate parameters and video clamping parameters are jointly referred to, and different video code rate parameters and video clamping parameters participate in and influence the decision of whether the final video segment is transmitted or not, so that a video data transmission mechanism is optimized, and reference factors are more comprehensive.
Fig. 3 is a flowchart of another video data transmission method according to an embodiment of the present invention, and another specific scheme for calculating a decision value is provided. As shown in fig. 3, the technical scheme is as follows:
step S301, in the process of sending video data, a first video clip is acquired.
Step S302, determining a code rate score, a click score and a delay score corresponding to the first video segment, and calculating to obtain a decision value corresponding to the first video segment according to the code rate score, the click score and the delay score.
In one embodiment, the decision value for deciding whether to transmit the first video segment is determined by a code rate score, a katon score, and a delay score corresponding to the first video segment, where the delay score characterizes a delay constraint between a video data transmitting end and a video data receiving end. Namely, according to the code rate score, the katon score and the delay score, calculating to obtain a decision value corresponding to the first video clip. The method is calculated by adopting a formula alpha.r+beta.rebuf+gamma.d, wherein r is a video code rate parameter, rebuf is a video katon parameter, and d is a delay parameter; alpha is code rate parameter weight corresponding to the video code rate parameter, beta is katon parameter weight corresponding to the video code rate parameter, and gamma is delay parameter weight corresponding to the delay parameter. The result of α·r is the code rate score, the result of β·rebuf is the katon score, and the result of γ·d is the delay score. The delay score is introduced as a penalty term when calculating the decision value to finally influence the size of the decision value, thereby influencing the final decision whether the first video segment is transmitted or not.
Step S303, determining whether to send the first video clip according to the decision value.
According to the scheme, in the video data transmission process, the first video segment is obtained, the code rate score, the click-on score and the delay score corresponding to the first video segment are determined, and then the decision value corresponding to the first video segment is calculated according to the code rate score, the click-on score and the delay score so as to finally make a decision whether to transmit the first video segment, the video playing code rate, the video playing click-on condition of the receiving end and the end-to-end delay constraint are comprehensively considered, the video data transmission mechanism is optimized, the reference factors are more comprehensive, the video playing effect of the receiving end is better, and the user experience is better.
Fig. 4 is a flowchart of another video data transmission method according to an embodiment of the present invention, which provides a specific manner of determining a code rate score. As shown in fig. 4, the technical scheme is as follows:
step S401, in the process of sending video data, a first video clip is acquired.
Step S402, determining video code rate parameters of the first video clips based on a code rate self-adaptive algorithm, and calculating to obtain code rate scores according to the video code rate parameters of the first video clips and the set code rate parameter weights.
Taking live video data as an example, a live protocol mainly comprises RTMP, HLS, httpflv, dash and the like, and different code rate self-adaptive algorithms can be adopted for different protocols to obtain the current proper video code rate parameters. The code rate self-adaptive algorithm is mainly used for transmitting reasonable video code rate version data under the condition of network fluctuation. If the network condition is better, the 720P code rate version of video data is sent, and if the network condition is not better, the 480P code rate version of video data is sent, so that the video data receiving end can ensure the flow play of the video under the condition of sacrificing a certain video definition.
Specifically, the code rate adaptive algorithm used in this embodiment may be a method for selecting a code rate based on the buffer condition of the video receiving end, or a method for selecting a code rate based on the predicted bandwidth, or a method for selecting a code rate by considering both the buffer condition of the video receiving end and the predicted bandwidth.
After the video code rate parameter of the first video segment is obtained through the code rate self-adaptive algorithm, a code rate score is obtained through calculation according to a set code rate parameter weight, the value of the code rate parameter weight is greater than 0, and in order to ensure that the code rate score obtained through final calculation is an integer, the specific video code rate parameter is usually 480, 720 or 1440, and the code rate parameter weight value can be 1/480, 1/720 or 1/1440, etc.
Step S403, determining a click-on score and a delay score corresponding to the first video segment, and calculating to obtain a decision value corresponding to the first video segment according to the code rate score, the click-on score and the delay score.
Step S404, determining whether to send the first video clip according to the decision value.
According to the scheme, in the process of determining whether the video clip is transmitted, the video code rate parameters of the video clip are combined and considered, and whether frame loss processing is finally determined according to the accumulation condition of video data is not simple.
Fig. 5 is a flowchart of another video data transmission method according to an embodiment of the present invention, and a specific scheme for determining a katon score is provided. As shown in fig. 5, the technical scheme is specifically as follows:
step S501, in the process of sending video data, obtaining a total duration of a first video clip and a duration of the clip to be sent.
In the video data transmission process, a current video segment to be processed is periodically acquired to determine whether a first video segment is transmitted as an example, and a total segment duration and a segment to be transmitted duration of the first video segment are acquired, wherein the total segment duration can be denoted as tau, and the segment to be transmitted duration can be denoted as l.
Step S502, determining a video code rate parameter of the first video segment based on a code rate self-adaptive algorithm, and calculating to obtain a code rate score according to the video code rate parameter of the first video segment and the set code rate parameter weight.
Step S503, determining a frame loss ratio value of the first video segment according to a segment total duration and a segment to-be-transmitted duration of the first video segment, determining a video katon parameter according to the frame loss ratio value, the segment to-be-transmitted duration, the segment total duration, the video code rate parameter, a receiving end buffer zone duration and a network bandwidth, and calculating according to the video katon parameter and a set katon parameter weight to obtain a katon score.
In one embodiment, after the total duration of the segments and the duration of the segments to be sent of the first video segment are obtained, a frame loss ratio value of the first video segment is determined, where the frame loss ratio value is denoted as p and the value range is greater than or equal to 0 and less than or equal to l/τ. Taking the example of transmitting the part to be transmitted of the first video segment, the value of p is 0; taking discarding the portion to be transmitted of the first video segment, i.e. not transmitting, taking p as the value l/τ, i.e. taking the corresponding p value into an algorithm model for two different processing modes to determine decision values under different conditions.
Specifically, the manner of determining the video clip parameter according to the frame loss ratio value, the segment to-be-transmitted time length, the segment total time length, the video code rate parameter, the receiving end buffer zone time length and the network bandwidth can be calculated by adopting the following formula:
wherein rebuf is a video cartoon parameter, l is a time length to be sent of a segment, p is a frame loss proportion value, q is a time length of a buffer zone of a receiving end, τ is a total time length of the segment, r is a video code rate parameter, and bw is a network bandwidth. The buffer time length and the network bandwidth of the receiving end are respectively determined for obtaining the first video segment. The method includes that after a video data sending end establishes a communication link with a video data receiving end, the video data sending end can acquire a buffer zone duration of the video data receiving end in real time, and a network bandwidth set forth by a current network, wherein the buffer zone duration is a playing duration of video data which can be buffered by a buffer zone of the receiving end.
Wherein, the set weight of the katon parameter is a negative number smaller than 0, such as-1, -5, -10 or-100.
Step S504, determining a delay score corresponding to the first video segment, and calculating to obtain a decision value corresponding to the first video segment according to the code rate score, the katon score and the delay score.
Step S505, determining whether to transmit the first video clip according to the decision value.
According to the scheme, when the decision value of whether the video clip is transmitted is calculated, the katon score is introduced as the parameter description of the video playing katon condition, so that the katon score of the video receiving end corresponding to the current video clip transmitted or not transmitted is calculated in real time, and whether the video clip is transmitted is finally determined. The video sending processing method introduces the jamming condition of the video receiving end as one of the final judgment measurement standards, and can obviously reduce the jamming condition of the video receiving end when playing the video based on the execution strategy finally given by the processing mechanism.
Fig. 6 is a flowchart of another video data transmission method according to an embodiment of the present invention, and a specific scheme for determining a delay score is provided. As shown in fig. 6, the technical scheme is specifically as follows:
step S601, in the process of sending video data, obtaining a total duration of a first video clip and a duration of the clip to be sent.
Step S602, determining a video code rate parameter of the first video segment based on a code rate self-adaptive algorithm, and calculating to obtain a code rate score according to the video code rate parameter of the first video segment and the set code rate parameter weight.
Step S603, determining a frame loss ratio value of the first video segment according to a segment total duration and a segment to-be-transmitted duration of the first video segment, determining a video katon parameter according to the frame loss ratio value, the segment to-be-transmitted duration, the segment total duration, the video code rate parameter, a receiving end buffer zone duration and a network bandwidth, and calculating according to the video katon parameter and a set katon parameter weight to obtain a katon score.
And step S604, determining a delay parameter according to the time length to be transmitted of the fragment, the upper limit of the data accumulation time length and the total time length to be transmitted, and calculating to obtain a delay score for the first video pair according to the delay parameter and the set delay parameter weight.
Illustratively, the upper limit of the data stacking duration is denoted as D, and the total duration to be transmitted is denoted as a. The upper limit of the data accumulation time length is the upper limit of the time length of the video data to be transmitted accumulated by the set video data transmitting end, and the total time length to be transmitted is the sum of the time lengths of all the video fragments which are not transmitted yet in the current video data and the data part to be transmitted in the current video fragment. For example, the delay parameter is denoted as D, and for the case of discarding the current video segment, the delay parameter is specifically calculated in such a way that D is 0 if a is less than or equal to D, and D is a-D if a is greater than D. For the case that the current video clip is not discarded and needs to be sent, the specific calculation mode of the value of the delay parameter is that if a+l is smaller than or equal to D, D is 0, and if a+l is larger than D, D is a+l-D. Wherein, after obtaining the delay parameter value, the product of the value of the delay parameter and the delay parameter weight is taken as a delay score, the delay parameter weight is a negative number smaller than 0, and the value can be-1, -5, -10 or-100.
And step 605, calculating to obtain a decision value corresponding to the first video segment according to the code rate score, the katon score and the delay score.
In one embodiment, the decision value is the sum of the code rate score, the katon score, and the delay score. It should be noted that, when the code rate score, the katon score and the delay score are calculated specifically, the units of the video code rate parameter, the video katon parameter and the delay parameter can be canceled during calculation due to different dimensions of the video code rate parameter, the video katon parameter and the delay parameter, and the suitable scores can be matched by adjusting the values of the weights respectively due to the difference of the magnitudes of the values. Of course, the video code rate parameter, the video clip parameter and the delay parameter may be normalized to be processed into values in a preset range, such as [0,1], and then multiplied by the weights to finally calculate a decision value, which is not limited herein.
Step S606, determining whether to transmit the first video clip according to the decision value.
According to the scheme, when whether the video clips are transmitted or not is determined, the delay score is introduced to characterize the relation among the time length to be transmitted, the upper limit of the data accumulation time length and the total time length to be transmitted of the video data transmitting end, if the result of the time length to be transmitted of the clips plus the time length to be transmitted is larger than the upper limit of the data accumulation time length, the score of the decision value is finally reduced, otherwise, if the result of the time length to be transmitted of the clips plus the time length to be transmitted does not exceed the upper limit of the data accumulation time length, the delay score does not influence the final decision score, so that the final decision on the transmission of the video data is more reasonable and effective, the blocking phenomenon occurring when the video receiving end plays videos is reduced, and the user experience is optimized.
Fig. 7 is a block diagram of a video data transmitting apparatus according to an embodiment of the present invention, where the apparatus is configured to execute the video data transmitting method according to the foregoing embodiment, and the apparatus has functional modules and beneficial effects corresponding to the executing method. As shown in fig. 6, the apparatus specifically includes: an information acquisition module 101, a decision value calculation module 102, and a data transmission control module 103, wherein,
an information obtaining module 101, configured to obtain a first video clip during a video data transmission process;
the decision value calculation module 102 is configured to calculate a decision value corresponding to the first video clip based on a preset algorithm model, where the algorithm model includes a video code rate parameter and a video katon parameter;
and the data transmission control module 103 is configured to determine whether to transmit the first video segment according to the decision value.
According to the scheme, in the video data transmission process, the first video segment is acquired, the decision value corresponding to the first video segment is calculated based on the preset algorithm model, wherein the algorithm model comprises the video code rate parameter and the video clamping parameter, whether the first video segment is transmitted or not is determined according to the decision value, the video code rate and the video clamping condition are synchronously referred when whether the video data are discarded or not is determined, the decision value is obtained through the preset algorithm model and used for judging whether the video data are transmitted or not, the video data transmission mechanism is optimized, and the data processing mode is more flexible.
In one possible embodiment, the decision value calculation module 102 is specifically configured to:
calculating a first decision value corresponding to the first video segment based on a preset algorithm model, and not transmitting a second decision value corresponding to the first video segment;
the data transmission control module 103 is specifically configured to:
and if the first decision value is greater than or equal to the second decision value, transmitting the first video segment, and if the first decision value is less than the second decision value, not transmitting the first video segment.
In one possible embodiment, the decision value calculation module 102 is specifically configured to:
determining code rate scores, katon scores and delay scores corresponding to the first video clips;
and calculating to obtain a decision value corresponding to the first video segment according to the code rate score, the katon score and the delay score.
In one possible embodiment, the decision value calculation module 102 is specifically configured to:
determining a video code rate parameter of the first video clip based on a code rate self-adaptive algorithm;
and calculating according to the video code rate parameter of the first video clip and the set code rate parameter weight to obtain a code rate score.
In one possible embodiment, the information obtaining module 101 is specifically configured to:
acquiring the total duration of the first video segment and the duration of the segment to be transmitted;
the decision value calculation module 102 is specifically configured to:
determining a frame loss proportion value of the first video fragment according to the total fragment duration of the first video fragment and the fragment to-be-transmitted duration;
determining a video cartoon parameter according to the frame loss proportion value, the fragment to-be-transmitted time length, the fragment total time length, the video code rate parameter, a receiving end buffer zone time length and a network bandwidth, wherein the receiving end buffer zone time length and the network bandwidth are respectively determined for acquiring the first video fragment;
and calculating according to the video jamming parameters and the set jamming parameter weights to obtain the jamming scores.
In one possible embodiment, the decision value calculation module 102 is specifically configured to:
according to the formula
Calculating to obtain a video jamming parameter, wherein rebuf is the video jamming parameter, l is the time length of a fragment to be sent, p is a frame loss proportion value, q is the time length of a buffer zone of a receiving end, τ is the total time length of the fragment, r is the video code rate parameter, and bw is the network bandwidth.
In one possible embodiment, the decision value calculation module 102 is specifically configured to:
determining delay parameters according to the segment waiting time length, the upper limit of the data accumulation time length and the total waiting time length, wherein the segment waiting time length and the total waiting time length are respectively determined when the first video segment is acquired, and the total waiting time length is the total time length of the video to be transmitted after the first video segment;
and calculating to obtain the delay score for the first video pair according to the delay parameter and the set delay parameter weight.
Fig. 8 is a schematic structural diagram of a video data transmission apparatus according to an embodiment of the present invention, and as shown in fig. 8, the apparatus includes a processor 201, a memory 202, an input device 203, and an output device 204; the number of processors 201 in the device may be one or more, one processor 201 being taken as an example in fig. 8; the processor 201, memory 202, input devices 203, and output devices 204 in the apparatus may be connected by a bus or other means, for example in fig. 8. The memory 202 is a computer readable storage medium, and may be used to store a software program, a computer executable program, and modules, such as program instructions/modules corresponding to the video data transmission method in the embodiment of the present invention. The processor 201 executes various functional applications of the device and data processing, that is, implements the video data transmission method described above, by running software programs, instructions, and modules stored in the memory 202. The input means 203 may be used to receive entered numeric or character information and to generate key signal inputs related to user settings and function control of the device. The output device 204 may include a display device such as a display screen.
The embodiments of the present invention also provide a storage medium containing computer-executable instructions for performing a video data transmission method described in one of the above embodiments when executed by a computer processor.
It should be noted that, in the embodiment of the video data transmission apparatus, each unit and module included are only divided according to the functional logic, but not limited to the above-mentioned division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for distinguishing from each other, and are not used to limit the protection scope of the embodiments of the present invention.
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the embodiments of the present invention are not limited to the particular embodiments described herein, but are capable of numerous obvious changes, rearrangements and substitutions without departing from the scope of the embodiments of the present invention. Therefore, while the embodiments of the present invention have been described in connection with the above embodiments, the embodiments of the present invention are not limited to the above embodiments, but may include many other equivalent embodiments without departing from the spirit of the embodiments of the present invention, and the scope of the embodiments of the present invention is determined by the scope of the appended claims.
Claims (8)
1. A video data transmission method, comprising:
acquiring a first video clip in the video data transmission process;
calculating a first decision value corresponding to the first video segment and a second decision value corresponding to the first video segment which is not transmitted based on a preset algorithm model, wherein the algorithm model comprises a video code rate parameter and a video cartoon parameter;
transmitting the first video segment if the first decision value is greater than or equal to the second decision value, and not transmitting the first video segment if the first decision value is less than the second decision value;
the calculating the decision value corresponding to the first video segment based on the preset algorithm model includes: and determining a code rate score, a katon score and a delay score corresponding to the first video segment, and calculating to obtain a decision value corresponding to the first video segment according to the code rate score, the katon score and the delay score.
2. The method of transmitting video data according to claim 1, wherein determining a code rate score corresponding to the first video clip comprises:
determining a video code rate parameter of the first video clip based on a code rate self-adaptive algorithm;
and calculating according to the video code rate parameter of the first video clip and the set code rate parameter weight to obtain a code rate score.
3. The method for transmitting video data according to claim 2, wherein the acquiring the first video clip comprises:
acquiring the total duration of the first video segment and the duration of the segment to be transmitted;
determining a katon score corresponding to the first video clip includes:
determining a frame loss proportion value of the first video fragment according to the total fragment duration of the first video fragment and the fragment to-be-transmitted duration;
determining a video cartoon parameter according to the frame loss proportion value, the fragment to-be-transmitted time length, the fragment total time length, the video code rate parameter, a receiving end buffer zone time length and a network bandwidth, wherein the receiving end buffer zone time length and the network bandwidth are respectively determined for acquiring the first video fragment;
and calculating according to the video jamming parameters and the set jamming parameter weights to obtain the jamming scores.
4. The method for transmitting video data according to claim 3, wherein determining the video clip parameter according to the frame loss ratio value, the duration for which the segment is to be transmitted, the total duration of the segment, the video code rate parameter, the receiving end buffer duration, and the network bandwidth comprises:
according to the formula
Calculating to obtain a video jamming parameter, wherein rebuf is the video jamming parameter, l is the time length of a fragment to be sent, p is a frame loss proportion value, q is the time length of a buffer zone of a receiving end, τ is the total time length of the fragment, r is the video code rate parameter, and bw is the network bandwidth.
5. The video data transmission method of claim 3, wherein determining the delay score corresponding to the first video segment comprises:
determining delay parameters according to the segment waiting time length, the upper limit of the data accumulation time length and the total waiting time length, wherein the segment waiting time length and the total waiting time length are respectively determined when the first video segment is acquired, and the total waiting time length is the total time length of the video to be transmitted after the first video segment;
and calculating to obtain the delay score for the first video pair according to the delay parameter and the set delay parameter weight.
6. A video data transmission apparatus, comprising:
the information acquisition module is used for acquiring a first video clip in the video data transmission process;
the decision value calculation module is used for calculating and sending a first decision value corresponding to the first video segment and not sending a second decision value corresponding to the first video segment based on a preset algorithm model, wherein the algorithm model comprises a video code rate parameter and a video click-on parameter, and the decision value calculation module is specifically used for determining a code rate score, a click-on score and a delay score corresponding to the first video segment, and calculating and obtaining the decision value corresponding to the first video segment according to the code rate score, the click-on score and the delay score;
and the data transmission control module is used for transmitting the first video fragment if the first decision value is greater than or equal to the second decision value, and not transmitting the first video fragment if the first decision value is less than the second decision value.
7. A video data transmission apparatus, the apparatus comprising: one or more processors; storage means for storing one or more programs that when executed by the one or more processors cause the one or more processors to implement the video data transmission method of any of claims 1-5.
8. A storage medium storing computer executable instructions which, when executed by a computer processor, are for performing the video data transmission method of any of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110867221.9A CN113489745B (en) | 2021-07-29 | 2021-07-29 | Video data transmission method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110867221.9A CN113489745B (en) | 2021-07-29 | 2021-07-29 | Video data transmission method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113489745A CN113489745A (en) | 2021-10-08 |
| CN113489745B true CN113489745B (en) | 2024-04-05 |
Family
ID=77944654
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110867221.9A Active CN113489745B (en) | 2021-07-29 | 2021-07-29 | Video data transmission method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113489745B (en) |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107623851A (en) * | 2017-09-01 | 2018-01-23 | 苏州科达科技股份有限公司 | Video code flow transmission control unit and control method |
| WO2018058587A1 (en) * | 2016-09-30 | 2018-04-05 | 华为技术有限公司 | Video quality evaluation method, evaluation device and system |
| CN108933697A (en) * | 2018-06-30 | 2018-12-04 | 江苏有线数据网络有限责任公司 | A kind of broadband quality determining method |
| CN109660879A (en) * | 2018-12-20 | 2019-04-19 | 广州虎牙信息科技有限公司 | Frame losing method, system, computer equipment and storage medium is broadcast live |
| CN109996094A (en) * | 2017-12-29 | 2019-07-09 | 杭州海康威视系统技术有限公司 | Video broadcasting method, apparatus and system |
| CN111225387A (en) * | 2020-01-16 | 2020-06-02 | 广州万码科技有限公司 | Mobile network analysis method, system, device and medium based on video playing |
| CN111641858A (en) * | 2020-04-29 | 2020-09-08 | 上海推乐信息技术服务有限公司 | Audio and video synchronization method and system |
| CN111954001A (en) * | 2020-07-31 | 2020-11-17 | 西安万像电子科技有限公司 | Image coding method, device, coding end equipment and storage medium |
| CN112087627A (en) * | 2020-08-04 | 2020-12-15 | 西安万像电子科技有限公司 | Image coding control method, device, equipment and storage medium |
| CN112312229A (en) * | 2020-10-27 | 2021-02-02 | 唐桥科技(杭州)有限公司 | Video transmission method and device, electronic equipment and storage medium |
| CN112312137A (en) * | 2020-10-27 | 2021-02-02 | 唐桥科技(杭州)有限公司 | Video transmission method and device, electronic equipment and storage medium |
| CN112584189A (en) * | 2020-12-08 | 2021-03-30 | 深圳创维新世界科技有限公司 | Live broadcast data processing method, device and system and computer readable storage medium |
| CN113037697A (en) * | 2019-12-25 | 2021-06-25 | 深信服科技股份有限公司 | Video frame processing method and device, electronic equipment and readable storage medium |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8281356B2 (en) * | 2004-11-17 | 2012-10-02 | Sharp Kabushiki Kaisha | Transmitter |
| WO2008049425A1 (en) * | 2006-10-24 | 2008-05-02 | Medianet Innovations A/S | Method and system for firewall friendly real-time communication |
| CN109951722A (en) * | 2019-02-27 | 2019-06-28 | 腾讯科技（深圳）有限公司 | The transmission method and transmitting device of video data |
| CN110198495B (en) * | 2019-06-28 | 2022-03-22 | 广州市百果园信息技术有限公司 | Method, device, equipment and storage medium for downloading and playing video |
| CN110662114B (en) * | 2019-09-30 | 2021-11-23 | 广州方硅信息技术有限公司 | Video processing method and device, electronic equipment and storage medium |
| CN111107440B (en) * | 2019-12-26 | 2022-02-25 | 腾讯科技（深圳）有限公司 | Video transmission control method and device, equipment and storage medium |
-
2021
- 2021-07-29 CN CN202110867221.9A patent/CN113489745B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018058587A1 (en) * | 2016-09-30 | 2018-04-05 | 华为技术有限公司 | Video quality evaluation method, evaluation device and system |
| CN107623851A (en) * | 2017-09-01 | 2018-01-23 | 苏州科达科技股份有限公司 | Video code flow transmission control unit and control method |
| CN109996094A (en) * | 2017-12-29 | 2019-07-09 | 杭州海康威视系统技术有限公司 | Video broadcasting method, apparatus and system |
| CN108933697A (en) * | 2018-06-30 | 2018-12-04 | 江苏有线数据网络有限责任公司 | A kind of broadband quality determining method |
| CN109660879A (en) * | 2018-12-20 | 2019-04-19 | 广州虎牙信息科技有限公司 | Frame losing method, system, computer equipment and storage medium is broadcast live |
| CN113037697A (en) * | 2019-12-25 | 2021-06-25 | 深信服科技股份有限公司 | Video frame processing method and device, electronic equipment and readable storage medium |
| CN111225387A (en) * | 2020-01-16 | 2020-06-02 | 广州万码科技有限公司 | Mobile network analysis method, system, device and medium based on video playing |
| CN111641858A (en) * | 2020-04-29 | 2020-09-08 | 上海推乐信息技术服务有限公司 | Audio and video synchronization method and system |
| CN111954001A (en) * | 2020-07-31 | 2020-11-17 | 西安万像电子科技有限公司 | Image coding method, device, coding end equipment and storage medium |
| CN112087627A (en) * | 2020-08-04 | 2020-12-15 | 西安万像电子科技有限公司 | Image coding control method, device, equipment and storage medium |
| CN112312229A (en) * | 2020-10-27 | 2021-02-02 | 唐桥科技(杭州)有限公司 | Video transmission method and device, electronic equipment and storage medium |
| CN112312137A (en) * | 2020-10-27 | 2021-02-02 | 唐桥科技(杭州)有限公司 | Video transmission method and device, electronic equipment and storage medium |
| CN112584189A (en) * | 2020-12-08 | 2021-03-30 | 深圳创维新世界科技有限公司 | Live broadcast data processing method, device and system and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113489745A (en) | 2021-10-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9503491B2 (en) | Playback stall avoidance in adaptive media streaming | |
| CN113992967B (en) | Screen projection data transmission method and device, electronic equipment and storage medium | |
| US20050021827A1 (en) | Data processing device, data processing system, data processing method, data processing program and recording medium storing the program | |
| CN107612844B (en) | Method for relieving server pulse pressure, server and client | |
| JP2004266840A (en) | Controlling admission of data stream onto network based on end-to-end measurement | |
| CN112583529B (en) | Data processing method, device, equipment and storage medium | |
| CN112954402B (en) | Video display method, apparatus and storage medium | |
| CN108881955A (en) | A kind of method and system for realizing the output of distributed node equipment audio video synchronization | |
| US20150134846A1 (en) | Method and apparatus for media segment request retry control | |
| EP2634995A1 (en) | Apparatus and method of displaying contents using key frames in a terminal | |
| US20070271335A1 (en) | Electronic Conferencing System Latency Feedback | |
| CN113489745B (en) | Video data transmission method, device, equipment and storage medium | |
| CN114390006B (en) | Data packet transmission method, device, equipment and storage medium | |
| US11553224B1 (en) | Method and device for adjusting bit rate during live streaming | |
| CN115941907A (en) | RTP data packet sending method, system, electronic equipment and storage medium | |
| EP4038892B1 (en) | Methods, systems, and media for streaming video content using adaptive buffers | |
| CN113031895A (en) | Screen projection control method and device and electronic equipment | |
| JP2004186793A (en) | Streaming distributor, streaming terminal equipment, streaming distribution system, and streaming distribution method | |
| CN102272792A (en) | A data processing apparatus for segmental processing of input data, systems using the apparatus and methods for data transmittal | |
| CN115002527B (en) | Data transmission optimization method, device, equipment and storage medium | |
| US7301955B1 (en) | Method for smoothing the transmission of a time-sensitive file | |
| CN111966510B (en) | Method, system, device and medium for calculating data stream | |
| CN114510191B (en) | Screen projection method and device | |
| CN116916095B (en) | Smooth display method, device and equipment of cloud video and storage medium | |
| US20230125350A1 (en) | Video stream transmission control method and apparatus, device, and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |