CN112383791A - Media data processing method and device, electronic equipment and storage medium - Google Patents
Media data processing method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN112383791A CN112383791A CN202011263092.4A CN202011263092A CN112383791A CN 112383791 A CN112383791 A CN 112383791A CN 202011263092 A CN202011263092 A CN 202011263092A CN 112383791 A CN112383791 A CN 112383791A
- Authority
- CN
- China
- Prior art keywords
- media data
- information
- network
- playing
- played
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64723—Monitoring of network processes or resources, e.g. monitoring of network load
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64746—Control signals issued by the network directed to the server or the client
- H04N21/64761—Control signals issued by the network directed to the server or the client directed to the server
- H04N21/64769—Control signals issued by the network directed to the server or the client directed to the server for rate control
Abstract
The embodiment of the invention provides a media data processing method, a device, electronic equipment and a storage medium, wherein media parameters of media data to be played are determined according to playing information of the played media data and network transmission information of the transmitted media data. The playing information and the network transmission information respectively reflect the network state from the service layer and the network layer, and compared with the local network state of the client, the real network state can be more comprehensively reflected, so that the media parameters are adjusted according to the playing information and the network transmission information, the playing of the media data is favorably matched with the state allowed by the real network, and the utilization rate of network resources is improved.
Description
Technical Field
The present invention relates to the field of communication transmission technologies, and in particular, to a media data processing method and apparatus, an electronic device, and a storage medium.
Background
Media data (e.g., streaming media data) includes a variety of forms, e.g., video, audio, text, and so forth. The transmission of media data is influenced by the network, which causes problems of pause, delay and screen splash during actual broadcasting. In the prior art, there are some methods capable of adaptively adjusting media data and improving the playing quality of the media data, for example, HLS (HTTP Live Streaming) may be used for adjusting video playing (e.g., playing of a Live stream).
Currently, the HLS mainly uses live streaming to generate a fixed ts slice and an m3u8 index file at a streaming media source station according to a pre-bitrate template, and then stores the fixed ts slice and the m3u8 index file in a local manner. When a user watches a live event stream, a Content Delivery Network (CDN) requests a related index file and a media data slice ts resource, and if an edge cache node does not have the resource, the edge cache node returns to a source station layer by layer to obtain a specified resource. When the local network of the client is not good or the server cannot give the resources to the client on time, a pause phenomenon occurs. Later, in order to adapt to the condition of the client local network, the user terminal improves the watching experience of the user, when the condition of the client local network is good, ts with high code rate is requested, otherwise, ts with low code rate is requested, and therefore the purposes of reducing video blockage rate and improving the watching experience effect are achieved. However, since the interval and the number of ts slices of the m3u8 index file are fixed, once a delay occurs, the viewing delay of a user is increased along with the time advance, and the code rate self-adaption judgment basis of the terminal is only combined with the local part of the terminal.
It can be seen that, the existing HLS adjusts the bit rate of the media data according to the local network status of the client, and since the local network status of the client cannot reflect the real network status, the playing of the media data cannot be adjusted according to the status allowed by the real network, which is not beneficial to fully utilizing the network resources.
Disclosure of Invention
Embodiments of the present invention provide a media data processing method, an apparatus, an electronic device, and a storage medium, which are used to solve the problem that, in the conventional HLS, a bit rate of media data is adjusted according to a local network state of a client, because the local network state of the client cannot reflect a real network state, playing of the media data cannot reach an optimal state allowed by the real network, and network resources cannot be fully utilized.
In view of the foregoing technical problems, in a first aspect, an embodiment of the present invention provides a media data processing method, including:
acquiring playing information of played media data and network transmission information for transmitting the media data; wherein, the playing information is determined according to the playing phenomenon of the played media data; the network transmission information is determined according to network performance;
and determining media parameters for processing the media data to be played according to the acquired playing information and the network transmission information.
In a second aspect, an embodiment of the present invention provides a media data processing apparatus, including:
the acquisition module is used for acquiring the playing information of the played media data and the network transmission information of the transmitted media data; wherein, the playing information is determined according to the playing phenomenon of the played media data; the network transmission information is determined according to network performance;
and the determining module is used for determining the media parameters for processing the media data to be played according to the acquired playing information and the network transmission information.
In a third aspect, an embodiment of the present invention provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the steps of the media data processing method described above when executing the program.
In a fourth aspect, an embodiment of the present invention provides a non-transitory readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the media data processing method described in any one of the above.
The embodiment of the invention provides a media data processing method, a device, electronic equipment and a storage medium, wherein media parameters of media data to be played are determined according to playing information of the played media data and network transmission information of the transmitted media data. The playing information and the network transmission information respectively reflect the network state from the service layer and the network layer, and compared with the local network state of the client, the real network state can be more comprehensively reflected, so that the media parameters are adjusted according to the playing information and the network transmission information, the playing of the media data is favorably matched with the state allowed by the real network, and the utilization rate of network resources is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
Fig. 1 is a schematic flowchart of a media data processing method according to an embodiment of the present invention;
fig. 2 is a network topology diagram of media data transmission provided by another embodiment of the present invention;
fig. 3 is a block diagram of a media data processing apparatus according to another embodiment of the present invention;
fig. 4 is a schematic physical structure diagram of an electronic device according to another embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
To improve the utilization rate of network resources, fig. 1 is a schematic flow chart of a media data processing method provided in this embodiment. The media data processing method may be executed by a network node providing media data to be played, for example, by a source node of the media data, or by any cache service node between the source node and a terminal, or by a function module independent of the source node and the cache service node, which is not limited in this embodiment specifically. Referring to fig. 1, the media data processing method includes:
step 101: acquiring playing information of played media data and network transmission information for transmitting the media data; wherein, the playing information is determined according to the playing phenomenon of the played media data; the network transmission information is determined according to network performance;
step 102: and determining media parameters for processing the media data to be played according to the acquired playing information and the network transmission information.
Wherein, the playing phenomenon at least comprises one of the following phenomena: jamming, playing delay and screen blooming; the network performance includes at least one of: network delay, packet loss rate.
The media parameters are used for processing media data, and comprise at least one of the following: the slicing time interval of the media data slices, the index length of the slice index file of the slices and the code rate of the media data transmission.
It should be noted that the playing delay is a delay of a service layer, and generally refers to a time interval between a first time point when any terminal starts playing the played media data and a second time point when the cache service node pushes the played media data to the any terminal. I.e. the play delay is a total time period at least including the transmission of the played media data, buffering at any terminal, decoding, loading to the player, etc. The network delay refers to the time taken for transmission in a transmission medium, i.e., the time elapsed between a message from a sending end to a receiving end network. For the present embodiment, the network delay is a delay of a network layer, and generally refers to a time length for which played media data is transmitted from the cache service node to any terminal. The packet loss rate is the ratio of the loss part of the data packet to the total number of the transmitted data packets.
It can be understood that, after determining the media parameters for processing the media data to be played according to the acquired playing information and the network transmission information, the method may further include:
and pushing the media data to be played, which is processed according to the determined media parameters, to any terminal, playing through any terminal, and/or pushing the media data to be played, which is processed according to the determined media parameters, to a cache service node, reprocessing through the cache service node, and then pushing to the terminal for playing.
The broadcast information reflects the network status from the service layer and may be a score determined according to the broadcast phenomenon. The network transport information reflects the network state from the network layer and may be a score determined according to a network parameter.
The present embodiment provides a media data processing method, which determines a media parameter of media data to be played according to playing information of played media data and network transmission information of transmitted media data. The playing information and the network transmission information respectively reflect the network state from the service layer and the network layer, and compared with the local network state of the client, the real network state can be more comprehensively reflected, so that the media parameters are adjusted according to the playing information and the network transmission information, the playing of the media data is favorably matched with the state allowed by the real network, and the utilization rate of network resources is improved.
Generally, media data needs to be transmitted from a source node to a cache service node, and then transmitted to a terminal by the cache service node for playing. For example, live media data is transmitted through the CDN, the CDN serves as a multi-level cache delivery network, and pushes live broadcast resources of a point that a user needs to access to a cache service node (i.e., an edge cache service node) closest to the user in advance, so that the user accesses nearby, and the problem of delay caused by access of geographic distribution, across operators, and the like can be effectively solved.
Further, on the basis of the foregoing embodiment, the determining, according to the acquired play information and network transmission information, a media parameter for processing media data to be played includes:
determining a media parameter for processing media data to be played, which is pushed to any terminal by a cache service node, according to playing information of the played media data in any terminal and first network transmission information between the cache service node and any terminal;
and/or determining a media parameter for processing the media data to be played, which is pushed to the cache service node by the source node, according to the playing information of the played media data in each terminal connected with the cache service node and the second network transmission information between the source node and the cache service node.
A cache service node refers to a network node between a source node and a terminal. The first network transmission information is generally network delay and packet loss rate measured at the cache service node side after the media data is sent to any terminal. The second network transmission information is generally network delay and packet loss rate measured at the source node after the media data is sent to the cache service node.
Fig. 2 is a network topology diagram of media data transmission provided in this embodiment, and referring to fig. 2, media data is transmitted from a source node (streaming media source station) to each cache service node (edge cache service node) connected thereto through a back source acceleration gateway, and then the media data is pushed to each terminal through the cache service node. The source node is connected with a plurality of cache service nodes, and each cache service node is connected with a plurality of terminals. The media parameters of the media data are adjusted through the source node and/or the cache service node, and the playing effect of the subsequent terminal on the media data can be influenced.
The playing information of the played media data in any terminal and the first network transmission information can reflect the network state between any terminal and the cache service node from the service layer and the network layer, so that the media parameters pushed to any terminal are adjusted based on the playing information of any terminal and the first network transmission information, and the network resources between any terminal and the cache service node are fully and reasonably utilized.
The playing information of the played media data in each terminal connected by a certain cache service node can reflect the network state between the cache service node and the source node from the service layer to a certain extent, and the second network transmission information can reflect the network state between the cache service node and the source node from the network layer, so that the media parameters pushed to the cache service node are adjusted based on the playing information of each terminal connected by the cache service node and the second network transmission information, and the network resources between the source node and the cache service node are fully and reasonably utilized.
In this embodiment, the media parameters are adjusted by the cache service node and/or the source node, and the media parameters are adjusted from each node of the media data transmission, which is beneficial to fully and reasonably utilizing network resources among the nodes.
Further, on the basis of the foregoing embodiments, the determining, according to the playing information of the played media data in any terminal and the first network transmission information between the cache service node and any terminal, the media parameter for processing the to-be-played media data that is pushed to any terminal by the cache service node includes:
determining first network bearing information between the cache service node and any terminal according to the playing information of the played media data in any terminal and the first network transmission information;
determining a media parameter corresponding to the first network bearing information according to the first mapping relation, and taking the media parameter as a first media parameter; the first mapping relation comprises media parameters corresponding to different first network bearing information;
and processing the media data to be played pushed to any terminal by the cache service node according to the first media parameter.
Wherein, still include: and storing media parameters corresponding to different first network transmission information as the first mapping relation.
Further comprising: and processing the received media data to be played pushed by the source node according to the media parameters corresponding to each first network transmission information in the first mapping relation, and storing the processed media data to be played.
The first network bearer information is information indicating a network bearer capability determined in conjunction with the service layer and the network layer. The first network bearer information may be a score of the network quality according to the playing information of the played media data in any terminal and the first network transmission information.
Specifically, the first mapping relationship may be empirically determined in advance. For example, media parameters (e.g., combination information of "slicing time interval, index length, code rate") corresponding to different first network bearer information are predetermined. In the process of determining the first mapping relationship, different grades may be classified for the first network bearer information, so that after the first network bearer information is determined, the media parameter corresponding to the first network bearer information is determined according to the grade to which the first network bearer information belongs, and the media data to be played, which is pushed by the source node and is processed in advance according to the media parameter, is used as the media data to be played, which is pushed to any terminal.
In this embodiment, a first media parameter corresponding to the first network bearer information is determined in the cache service node through the first mapping relationship, and then the to-be-played media data processed according to the first media parameter is pushed to any terminal. The media parameters are quickly adjusted according to the playing information and the first network transmission information through the first mapping relation, so that the media data are pushed by being quickly adapted to the actual network condition, the playing quality is improved, and the utilization rate of network resources is optimized.
In a common network architecture such as a source node, a cache service node and a terminal, network transmission between the cache service node and the terminal is based on a TCP protocol, and network transmission between the source node and the cache service node is based on a UDP protocol. In the process of network transmission based on the TCP protocol, the establishment process of the network connection can reflect the network state to a certain extent.
Further, on the basis of the foregoing embodiments, the determining, according to the playing information of the played media data in any terminal and the first network transmission information, the first network bearer information between the cache service node and the any terminal includes:
determining first network bearing information between the cache service node and any terminal according to the playing information of the played media data in any terminal, the first network transmission information and the network connection information between the cache service node and any terminal;
and the network connection information is determined according to the process of establishing network connection between the cache service node and any terminal.
Specifically, the network connection information may include at least one of: the average duration of the connection established between the cache service node and any terminal, the average duration of the first byte response, the average duration of the response and the average number of bytes occupied by the transmitted files.
In this embodiment, the first network bearer information is determined by combining the playing information of the played media data in any terminal, the first network transmission information, and the network connection information, and the determined first network bearer information can more comprehensively reflect the real state of the network, which is beneficial to matching the adjusted media parameter with the real state of the network according to the first network bearer information and improving the utilization rate of network resources.
Further, on the basis of the foregoing embodiments, the determining, according to the playing information and the first network transmission information of the played media data in any terminal and the network connection information between the cache service node and any terminal, the first network bearer information between the cache service node and any terminal includes:
determining a first playing score according to playing information of played media data in any terminal; wherein the first playing score is determined according to at least one of the following playing phenomena: stuck, play delay;
determining a network transmission score according to the first network transmission information, and determining a network connection score according to the network connection information;
and determining first network bearing information between the cache service node and any one terminal according to the first playing score, the network transmission score and the network connection score.
In particular, the first network score may include a katon score and a play delay score; wherein the katon score may be determined based on at least one of: the time interval between the occurrence of the jamming of any terminal in the set time length, the occurrence of the jamming of any terminal in the set time length and the occurrence of the jamming of any terminal in the set time length; the playing delay score may be determined according to a first time point when the any terminal starts playing the played media data, and a second time point when the cache service node pushes the played media data to the any terminal.
The set duration is actually a statistical period and may be set to 2s or other durations.
The interval of the katon score is [1, 5], the katon score SQ can be calculated according to the following formula,
where Sd is a stuck duration (specifically, an average value of the stuck durations) in which the any terminal is stuck within a set duration, Sf is a number of times that the any terminal is stuck within the set duration (specifically, an average value of the number of times that the any terminal is stuck), Si is a time interval (specifically, an average value of time intervals between the occurrence of the stuck) between the occurrence of the any terminal within the set duration, s0-s6Is a correlation coefficient (which can be established according to the service condition).
The TB represents a currently played timestamp fed back by the client (i.e. a first time point corresponding to the start of playing the played media data by any terminal), the TS represents a latest timestamp for the source-back acceleration gateway to process the current stream (i.e. a second time point corresponding to the push of the played media data by the cache service node to any terminal), and the playing delay score TD may be a time difference between the two (TB and TS).
The network transmission score may be determined according to the formula F (Y, Z) ═ F (Y) + F (Z), where F (Y, Z) is the network transmission score, F (Y) is the score determined according to the network delay between the cache service node and any terminal, and F (Z) is the score determined according to the packet loss rate between the cache service node and any terminal.
F (Y) is scored at [1, max ], and f (Y) is determined according to the formula f (Y) Y1+ (Y2-Y) Y3, in conjunction with the network delay Y between said any terminal and the cache service node and table 1.
TABLE 1 network delay scoring rules comparison Table
F (Z) according to the formula f (Z) ═ Z1+ (Z2-Z) × Z3, f (y) is determined by combining packet loss rate Z between said any terminal and the cache service node and table 2.
Table 2 packet loss rate scoring rule comparison table
The net connection score may be determined according to the following formula FS ═ y × log (2) (FS/Ft) × (1+ (Fc + Ff)/(1+ Fc + Ff)). The FS is a network connection score, the Fc is an average duration for establishing connection between the cache service node and any terminal, the Ff is an average duration for responding to the first byte, the Ft is an average duration for responding, the Fs is an average number of bytes occupied by the transmitted file, and the y is a floating coefficient.
Specifically, determining the first network bearer information between the cache service node and the any terminal according to the first playing score, the network transmission score and the network connection score includes:
determining first network bearer information F [ U ] according to a formula:
in this embodiment, the calculation of the first network bearer information is realized through the first playing score (including the morton score and the playing delay score), the network transmission score and the network connection score, and then the media parameter of the media data to be played is adjusted according to the first network bearer information, so that the utilization rate of network resources is improved.
For the media data transmitted from the source node to the cache service node, further, on the basis of the foregoing embodiments, determining the media parameter for processing the media data to be played, which is pushed from the source node to the cache service node, according to the playing information of the played media data in each terminal connected to the cache service node and the second network transmission information between the source node and the cache service node includes:
determining a second playing score according to playing information of played media data in each terminal connected with the cache service node; wherein the second playing score is determined at least according to the following playing phenomena: screen printing;
and determining a media parameter for processing the media data to be played, which is pushed to the cache service node by the source node, according to the second playing score and the second network transmission information.
In particular, the second play score may be determined based on at least one of: the average value of the screen-splash times of the played media data in each terminal in a set time length, the average value of the damage rate of video frames, the average value of the damage rate of video streams and the video complexity;
the network transmission between the source node and the cache service node generally belongs to the network transmission between the computer rooms, and is based on a UDP protocol. In network transmission based on UDP, a screen is usually lost, which causes a terminal to display media data, and therefore, the screen is lost in the terminal may be considered for adjusting the media parameters at the source node. Therefore, the media data (the code rate can be adjusted) pushed to the cache service node by the source node can be adjusted through the second playing score and the second network transmission information, and the probability of screen splash during the playing of the media data is reduced.
Wherein, the interval of the second playing score (i.e. the screen splash score) is [1, 5], and the screen splash score VQ can be determined according to the following formula:
wherein Va is an average value of the damage rate of the video frame, Vr is an average value of the damage rate of the video stream, Vp is an average value of the number of times of screen splash of played media data in each terminal connected to the cache service node within a set duration, Vc is a video complexity, s0-s6Correlation coefficient (which can be made according to traffic situation).
In this embodiment, for data to be played, which is transmitted to a certain cache service node by a source node, a screen splash score may be determined according to playing information (for example, information determined according to a screen splash) in each terminal connected to the cache service node. Because data are transmitted between the cache service node and the terminal based on the TCP protocol usually, screen splash does not occur, and the screen splash playing information reported by each terminal connected with the cache service node reflects the network state of the source node and the cache service node in a service layer. The real network state between the source node and the cache service node can be further determined by combining the network state of the source node and the cache service node on the service layer and the second network transmission information, and then the media data pushed to the cache service node by the source node is adjusted, so that the probability of screen splash is reduced, and the playing quality is improved.
Further, on the basis of the foregoing embodiments, the determining, according to the second play score and the second network transmission information, a media parameter for processing to-be-played media data that is pushed by the source node to the cache service node includes:
determining second network bearing information between the source node and the cache service node according to the second playing score and the second network transmission information;
determining a second media parameter corresponding to the second network bearing information according to a second mapping relation; wherein the second mapping relation comprises media parameters corresponding to different second network bearer information;
and sending the second media parameter to the source node, so that the source node processes the media data to be played, which is pushed to the cache service node by the source node, according to the second media parameter.
Since the source node and the cache service node are usually network transmission based on the UDP protocol, and the network transmission based on the UDP protocol has a significant influence on whether the screen splash occurs in the playing process, the second playing score may be a score according to the screen splash playing phenomenon. In network transmission based on the UDP protocol, bitrate is an important factor for adjusting the screenings, and thus, the second media parameter may generally include bitrate. That is, the second mapping relationship may specifically be code rates corresponding to different second network bearer information. That is, the code rates corresponding to different second network bearer information may be stored as the second mapping relationship. The second mapping relationship may be set empirically, and this embodiment does not specifically limit this.
And determining second network bearing information between the source node and the cache service node according to the screen splash score and the second network transmission information.
Specifically, the second network bearer information F [ U ]', may be determined according to the following formula:
wherein F (Y, Z) 'is a network transmission score determined according to the second network transmission information, and is determined according to a formula F (Y, Z)' (F (Y) '+ F (Z)', where F (Y) 'is a score determined according to a network delay between the source node and the cache service node, and F (Z)' is a score determined according to a packet loss rate between the source node and the cache service node.
F (Y) ' has a score interval of [1, max ], and f (Y) ' is determined according to the formula f (Y) ' (Y1 + (Y2-Y ')) Y3 by combining the network delay Y ' between the source node and the cache service node with the above table 1.
F (Z) ' f (y) ' is determined according to the formula f (Z) ' (Z1 + (Z2-Z ')) Z3 by combining the packet loss rate Z ' between the source node and the cache service node and the above table 2.
It should be noted that, because network transmission between the machine room and the cache service node is performed between the source node and the cache service node, the network transmission quality is generally stable, and therefore, when the source node adjusts the media data to be played, which is pushed to the cache service node, the code rate pushed to the cache service node by the source node can be adjusted only according to the screenful score.
Accordingly, when the source node adjusts the code rate that the source node pushes to the cache service node only according to the screenful score, the second mapping relationship may include a correspondence relationship between the screenful score and the code rate.
In this embodiment, the adjustment of the media data to be played, which is pushed to the cache service node, at the source node is realized through the screen-splash score and the preset second mapping relationship, so that the transmission of the media data is matched with the real network bearing capacity between the source node and the cache service node, thereby being beneficial to improving the playing quality of the media data.
One specific embodiment is provided below:
based on the network topology shown in fig. 2, the process of streaming the ultra-high-definition live event can be adjusted by the following processes:
step 1, a streaming media source station pushes an ultra-high-definition live broadcast event stream to an edge cache service node through a private transmission protocol based on UDP optimization through a content distribution network, and dynamically adjusts the stream pushing code rate according to the screen-splash score of a terminal;
specifically, the stream media source station pushes the ultrahigh-definition live broadcast event stream through a private transmission protocol based on UDP (user Datagram protocol) protocol optimization, and forwards the ultrahigh-definition live broadcast event stream to a source return acceleration gateway of the edge cache service node through a secondary center;
step 2, slicing the ultra-high definition live broadcast event stream according to three dimensional combinations of multiple code rates, multiple slicing intervals and multiple index lengths by a source return acceleration gateway of the edge cache service node, generating a slice TS and an index file, injecting the slice TS and the index file into an edge cache memory, and synchronizing the information of a combination list to an edge service quality acquisition and analysis system;
specifically, a source return acceleration gateway of an edge cache service node injects a generated video file and an index into an edge cache service according to a multi-bit rate, multi-slice interval and multi-index length dimensional combination M for an ultra-high definition live broadcast event stream;
step 3, the quality acquisition analysis system generates a grading ladder requirement for the service carrying capacity of the terminal user according to the three dimensions of the code rate, the slice interval and the index length according to the combined list information;
specifically, the edge quality acquisition and analysis system generates a grading ladder requirement on the network transmission quality of the client according to the service combination information M of the ultra-high definition live broadcast event, the slice interval Mc, the code rate coefficient Md and the index list resource length Mg. According to a specified index rating standard (E ═ E1, E2, E3, E3, E5, E6}), the scoring interval is [1, max ], and the following is a function formula generated according to the combined information and required for the transmission quality score of the client network, wherein x is a floating coefficient:
F[M]＝Md*x*(1+Mc0(Mc) ((1 + 1/Mg)), according to index rating standard, mixing F [ M]The score is converted into a corresponding grade F [ E ]]；
Step 4, the terminal scores and counts the phenomena of video watching experience quality important indexes such as pause, screen splash and time delay, and the terminal is carried out on a parameter band through a request URL when interacting with the edge cache service;
when the client decodes, the timestamp in the real-time recording video stream is represented by TB, the latest TB is reserved, and when the client interacts with the server, the value is taken to be fed back in the request parameter;
step 5, the quality acquisition and analysis system acquires an edge cache log, calculates the average rate of ts in the statistical period according to the parameters such as host name, unique user identifier, file type, handle identifier, connection establishment time, first byte response time, file size, timestamp, client address and the like, and calculates according to a scoring formula; specifically, calculating a network connection score FS;
step 6, the quality acquisition analysis system calculates all users to perform screen-splash scoring on the live broadcast according to the statistical period, and informs the source station to perform stream pushing code rate adjustment so as to adapt to the network state from the source station to the return source acceleration gateway;
specifically, according to code rate rating standards (B { (B0, bt0), (B1, bt1), (B2, bt2), (B3, bt3), (B4, bt4), (B5, bt5) } corresponding to the screenplay scores, selecting the corresponding code rate according to a B score interval for stream pushing by using the screenplay scores VQ reported by the quality acquisition and analysis system;
step 7, the quality acquisition and analysis system acquires the quality of a network link from a server to a client, and scores according to delay and packet loss factors and a network quality score calculation rule;
specifically, a network transmission score F (Y, Z) is calculated;
step 8, carrying out comprehensive scoring according to the network quality from the server to the client, the weight value of the streaming service quality provided by the server to the client, and factors such as click scoring and delay of the terminal, so as to obtain the user network quality score, and provide the optimal ultra-high-definition live broadcast event service according to the user network quality score, the user watching experience score and the like;
specifically, FS represents a quality score for the server to provide streaming services to the client, and F (Y, Z) represents a score for the server to client network quality. The scoring interval is [1, max ], when the score of F (Y, Z) is higher, the network is better, and the forward influence on FS is realized; SQ represents the click score fed back by the terminal, and a higher score represents poorer user experience, which is a correction for scoring the quality acquisition analysis system.
The F U score may be converted to a corresponding level F E according to the index rating criteria (E ═ { E1, E2, E3, E3, E5, E6}), thereby determining the media parameters to be pushed to the terminal according to the index rating criteria specified in step 3.
Step 9, when a user requests an ultra-high-definition live broadcast event index file, the edge cache service acquires the combined information of the live broadcast service provided for the user from the quality acquisition system according to the session identifier, and provides a corresponding index file;
specifically, when a user requests an ultra-high-definition live event index, the edge cache service acquires live event service combination information provided by the user from the quality acquisition and analysis system according to the user unique identifier and the event stream unique identifier in the parameter, the quality acquisition and analysis system acquires matching combination information according to the service bearing capacity score of the terminal user and the corresponding score level of the path event stream template, and returns the matching combination information to the edge cache service, and the edge cache service returns an assigned index to the user side for playing according to the returned combination information, and so on.
Generally, the method provided by the above embodiment is as follows: in a statistical period, the quality acquisition and analysis system of the edge cache service node comprehensively scores the network quality from the server to the client, the streaming service quality of the client and the watching experience quality of the client by the server. When a user watches the ultra-high-definition live broadcast event to a server side to request for indexing, a quality acquisition and analysis system with an edge cache service to the node acquires the live broadcast service corresponding to the user according to the code rate, the slice interval and the index list combination, and provides the live broadcast service for the user. Because the edge cache service node provides the transmission service based on the HLS protocol for the user, the user watching experience quality is mainly embodied in video jamming; the private transmission protocol based on UDP optimization is adopted for pushing the stream from the source station to the edge back source acceleration gateway, and the quality of the user viewing experience is mainly reflected in the screen splash of the video stream. And the quality acquisition and analysis system informs the source station of the average scoring of the screen splash in the period, and the source station adjusts the flow pushing code rate according to the screen splash scoring condition.
The scheme is mainly characterized in that the edge quality acquisition and analysis system is used for comprehensively evaluating the stream bearing service of the user side and providing the symmetric ultra-high definition live broadcast event service for the user side. Meanwhile, the client performs feedback scoring on the service to influence the scoring result of the next period of the edge quality acquisition and analysis system, the feedback inner-pattern scoring can provide a basis for the source station to adjust the stream pushing code rate of the edge source return acceleration gateway, and the method is a low-delay and high-efficiency transmission and distribution live broadcast control method with a feedback mechanism from end (client) to end (source station).
This approach may have advantages including:
(1) in a passive source return or active injection mode adopted by the traditional HLS live transmission and distribution, a TCP (transmission control protocol) protocol is adopted for transmission, and when jitter or packet loss occurs in a public network in a transmission and distribution network, source return failure or cache can be caused, so that a user is seriously influenced to watch live broadcast events, especially ultra-high definition live broadcast events (large code rate). The method adopts a private protocol based on UDP optimization for transmission, has point-to-point safe encryption transmission, and can still achieve the effect of real-time transmission particularly under the condition of weak network transmission.
(2) In the traditional HLS transmission and distribution live broadcast, a source station can generate an m3u8 index and a ts file according to two dimensions of a code rate and a fixed slice interval in advance, a user terminal can only be limited to reduce the code rate to reduce the pause rate and improve the viewing experience, the accuracy is reduced due to no real-time feedback interaction with a server side, and the pause rate and the delay effect are poor. The method adopts the edge back-source acceleration gateway to select the optimal combination for the user terminal in real time according to dimension combination information such as code rate, slice interval, index list length and the like, and can better adapt to and solve the problems of terminal blockage and delay.
(3) The method adopts a mode that a service end actively scores the service carrying capacity of a user terminal, a quality acquisition and analysis system comprehensively scores the network quality from the service end to the terminal, the streaming service quality of the client end and feedback factors such as pause, splash screen and time delay fed back by the user terminal by combining the service end, the quality acquisition and analysis system and the feedback factors such as the user terminal, and adjusts in real time, so that the pause of playing by the user and the time delay of watching the ultra-high-definition live broadcast event by the user can be more accurately reduced, and the time delay is not affected by time and the network quality of the user side to cause the time to become.
Fig. 3 is a block diagram of a media data processing apparatus provided in this embodiment, and referring to fig. 3, the media data processing apparatus includes an obtaining module 301 and a determining module 302, wherein,
an obtaining module 301, configured to obtain playing information of played media data and network transmission information of transmitted media data; wherein, the playing information is determined according to the playing phenomenon of the played media data; the network transmission information is determined according to network performance;
a determining module 302, configured to determine a media parameter for processing media data to be played according to the obtained playing information and network transmission information
The media data processing apparatus provided in this embodiment is suitable for the media data processing method provided in each of the above embodiments, and will not be described herein again.
The embodiment provides a media data processing device, which determines media parameters of media data to be played according to playing information of played media data and network transmission information of transmitted media data. The playing information and the network transmission information respectively reflect the network state from the service layer and the network layer, and compared with the local network state of the client, the real network state can be more comprehensively reflected, so that the media parameters are adjusted according to the playing information and the network transmission information, the playing of the media data is favorably matched with the state allowed by the real network, and the utilization rate of network resources is improved.
Optionally, the determining, according to the acquired playing information and the network transmission information, a media parameter for processing media data to be played includes:
determining a media parameter for processing media data to be played, which is pushed to any terminal by a cache service node, according to playing information of the played media data in any terminal and first network transmission information between the cache service node and any terminal;
and/or determining a media parameter for processing the media data to be played, which is pushed to the cache service node by the source node, according to the playing information of the played media data in each terminal connected with the cache service node and the second network transmission information between the source node and the cache service node.
Optionally, the determining, according to playing information of media data already played in any terminal and first network transmission information between a cache service node and the any terminal, a media parameter for processing media data to be played, which is pushed to the any terminal by the cache service node, includes:
determining first network bearing information between the cache service node and any terminal according to the playing information of the played media data in any terminal and the first network transmission information;
determining a media parameter corresponding to the first network bearing information according to the first mapping relation, and taking the media parameter as a first media parameter; the first mapping relation comprises media parameters corresponding to different first network bearing information;
and processing the media data to be played pushed to any terminal by the cache service node according to the first media parameter.
Optionally, the determining, according to the playing information of the played media data in any terminal and the first network transmission information, first network bearer information between the cache service node and the any terminal includes:
determining first network bearing information between the cache service node and any terminal according to the playing information of the played media data in any terminal, the first network transmission information and the network connection information between the cache service node and any terminal;
and the network connection information is determined according to the process of establishing network connection between the cache service node and any terminal.
Optionally, the determining, according to the playing information of the played media data in any terminal, the first network transmission information, and the network connection information between the cache service node and the any terminal, first network bearer information between the cache service node and the any terminal includes:
determining a first playing score according to playing information of played media data in any terminal; wherein the first playing score is determined according to at least one of the following playing phenomena: stuck, play delay;
determining a network transmission score according to the first network transmission information, and determining a network connection score according to the network connection information;
and determining first network bearing information between the cache service node and any one terminal according to the first playing score, the network transmission score and the network connection score.
Optionally, the determining, according to playing information of media data already played in each terminal connected to the cache service node and second network transmission information between the source node and the cache service node, a media parameter for processing media data to be played, which is pushed to the cache service node by the source node, includes:
determining a second playing score according to playing information of played media data in each terminal connected with the cache service node; wherein the second playing score is determined at least according to the following playing phenomena: screen printing;
and determining a media parameter for processing the media data to be played, which is pushed to the cache service node by the source node, according to the second playing score and the second network transmission information.
Optionally, the determining, according to the second playing score and the second network transmission information, a media parameter for processing to-be-played media data that is pushed by the source node to the cache service node includes:
determining second network bearing information between the source node and the cache service node according to the second playing score and the second network transmission information;
determining a second media parameter corresponding to the second network bearing information according to a second mapping relation; wherein the second mapping relation comprises media parameters corresponding to different second network bearer information;
and sending the second media parameter to the source node, so that the source node processes the media data to be played, which is pushed to the cache service node by the source node, according to the second media parameter.
Fig. 4 illustrates a physical structure diagram of an electronic device, which may include, as shown in fig. 4: a processor (processor)401, a communication Interface (communication Interface)402, a memory (memory)403 and a communication bus 404, wherein the processor 401, the communication Interface 402 and the memory 403 complete communication with each other through the communication bus 404. Processor 401 may call logic instructions in memory 403 to perform the following method: acquiring playing information of played media data and network transmission information for transmitting the media data; wherein, the playing information is determined according to the playing phenomenon of the played media data; the network transmission information is determined according to network performance; and determining media parameters for processing the media data to be played according to the acquired playing information and the network transmission information.
In addition, the logic instructions in the memory 403 may be implemented in the form of software functional units and stored in a computer readable storage medium when the software functional units are sold or used as independent products. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Further, an embodiment of the present invention discloses a computer program product, the computer program product comprising a computer program stored on a non-transitory readable storage medium, the computer program comprising program instructions, which when executed by a computer, the computer is capable of performing the method provided by the above-mentioned method embodiments, for example, including: acquiring playing information of played media data and network transmission information for transmitting the media data; wherein, the playing information is determined according to the playing phenomenon of the played media data; the network transmission information is determined according to network performance; and determining media parameters for processing the media data to be played according to the acquired playing information and the network transmission information.
In another aspect, an embodiment of the present invention further provides a non-transitory readable storage medium, on which a computer program is stored, where the computer program is implemented to perform the transmission method provided in the foregoing embodiments when executed by a processor, for example, the method includes: acquiring playing information of played media data and network transmission information for transmitting the media data; wherein, the playing information is determined according to the playing phenomenon of the played media data; the network transmission information is determined according to network performance; and determining media parameters for processing the media data to be played according to the acquired playing information and the network transmission information.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding, the above technical solutions may be embodied in the form of a software product, which may be stored in a readable storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A method for media data processing, comprising:
acquiring playing information of played media data and network transmission information for transmitting the media data; wherein, the playing information is determined according to the playing phenomenon of the played media data; the network transmission information is determined according to network performance;
and determining media parameters for processing the media data to be played according to the acquired playing information and the network transmission information.
2. The media data processing method according to claim 1, wherein the determining the media parameter for processing the media data to be played according to the acquired playing information and the network transmission information comprises:
determining a media parameter for processing media data to be played, which is pushed to any terminal by a cache service node, according to playing information of the played media data in any terminal and first network transmission information between the cache service node and any terminal;
and/or determining a media parameter for processing the media data to be played, which is pushed to the cache service node by the source node, according to the playing information of the played media data in each terminal connected with the cache service node and the second network transmission information between the source node and the cache service node.
3. The method according to claim 2, wherein the determining the media parameter for processing the media data to be played, which is pushed to the any terminal by the cache service node, according to the playing information of the played media data in the any terminal and the first network transmission information between the cache service node and the any terminal comprises:
determining first network bearing information between the cache service node and any terminal according to the playing information of the played media data in any terminal and the first network transmission information;
determining a media parameter corresponding to the first network bearing information according to the first mapping relation, and taking the media parameter as a first media parameter; the first mapping relation comprises media parameters corresponding to different first network bearing information;
and processing the media data to be played pushed to any terminal by the cache service node according to the first media parameter.
4. The method according to claim 3, wherein the determining the first network bearer information between the cache service node and any terminal according to the playing information of the played media data in any terminal and the first network transmission information comprises:
determining first network bearing information between the cache service node and any terminal according to the playing information of the played media data in any terminal, the first network transmission information and the network connection information between the cache service node and any terminal;
and the network connection information is determined according to the process of establishing network connection between the cache service node and any terminal.
5. The media data processing method according to claim 4, wherein the determining the first network bearer information between the cache service node and the any terminal according to the playing information of the played media data in the any terminal and the first network transmission information, and the network connection information between the cache service node and the any terminal comprises:
determining a first playing score according to playing information of played media data in any terminal; wherein the first playing score is determined according to at least one of the following playing phenomena: stuck, play delay;
determining a network transmission score according to the first network transmission information, and determining a network connection score according to the network connection information;
and determining first network bearing information between the cache service node and any one terminal according to the first playing score, the network transmission score and the network connection score.
6. The method according to claim 2, wherein the determining the media parameter for processing the media data to be played, which is pushed to the cache service node by the source node, according to the playing information of the played media data in each terminal connected to the cache service node and the second network transmission information between the source node and the cache service node comprises:
determining a second playing score according to playing information of played media data in each terminal connected with the cache service node; wherein the second playing score is determined at least according to the following playing phenomena: screen printing;
and determining a media parameter for processing the media data to be played, which is pushed to the cache service node by the source node, according to the second playing score and the second network transmission information.
7. The media data processing method according to claim 6, wherein the determining, according to the second playing score and the second network transmission information, a media parameter for processing the media data to be played, which is pushed to the cache service node by the source node, comprises:
determining second network bearing information between the source node and the cache service node according to the second playing score and the second network transmission information;
determining a second media parameter corresponding to the second network bearing information according to a second mapping relation; wherein the second mapping relation comprises media parameters corresponding to different second network bearer information;
and sending the second media parameter to the source node, so that the source node processes the media data to be played, which is pushed to the cache service node by the source node, according to the second media parameter.
8. A media data processing apparatus, comprising:
the acquisition module is used for acquiring the playing information of the played media data and the network transmission information of the transmitted media data; wherein, the playing information is determined according to the playing phenomenon of the played media data; the network transmission information is determined according to network performance;
and the determining module is used for determining the media parameters for processing the media data to be played according to the acquired playing information and the network transmission information.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the media data processing method according to any of claims 1 to 7 are implemented by the processor when executing the program.
10. A non-transitory readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the media data processing method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011263092.4A CN112383791B (en) | 2020-11-12 | 2020-11-12 | Media data processing method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011263092.4A CN112383791B (en) | 2020-11-12 | 2020-11-12 | Media data processing method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112383791A true CN112383791A (en) | 2021-02-19 |
| CN112383791B CN112383791B (en) | 2023-07-21 |
Family
ID=74583442
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011263092.4A Active CN112383791B (en) | 2020-11-12 | 2020-11-12 | Media data processing method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112383791B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113573093A (en) * | 2021-08-02 | 2021-10-29 | 杭州米络星科技(集团)有限公司 | Live broadcast data analysis method and device, electronic equipment and storage medium |
| WO2022178824A1 (en) * | 2021-02-26 | 2022-09-01 | 华为技术有限公司 | Media parameter adjustment method and apparatus |
Citations (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060123445A1 (en) * | 2004-12-06 | 2006-06-08 | Sbc Knowledge Ventures, L.P. | System and method of displaying a video stream |
| JP2007274621A (en) * | 2006-03-31 | 2007-10-18 | Victor Co Of Japan Ltd | Image transmission system and image transmission method |
| JP2009044392A (en) * | 2007-08-08 | 2009-02-26 | Sony Corp | Video reproducing method and video reproducing device |
| CN101835029A (en) * | 2010-04-21 | 2010-09-15 | 深圳市紫云鑫软件技术有限公司 | Control method, system and client for playing streaming media |
| CN104065665A (en) * | 2014-07-02 | 2014-09-24 | 深圳深讯和科技有限公司 | Streaming media data processing method and streaming media data processing system |
| CN106657143A (en) * | 2017-01-20 | 2017-05-10 | 中兴通讯股份有限公司 | Streaming media transmission method and device, server and terminal |
| CN107071529A (en) * | 2017-03-29 | 2017-08-18 | 咪咕视讯科技有限公司 | A kind of HLS video broadcasting methods, terminal and server |
| CN108696772A (en) * | 2017-04-11 | 2018-10-23 | 上海谦问万答吧云计算科技有限公司 | A kind of transmission method and device of real-time video |
| CN109218759A (en) * | 2018-09-27 | 2019-01-15 | 广州酷狗计算机科技有限公司 | Push method, apparatus, server and the storage medium of Media Stream |
| CN109729437A (en) * | 2017-10-30 | 2019-05-07 | 中国电信股份有限公司 | Streaming media self-adapting transmission method, terminal and system |
| US20190182512A1 (en) * | 2017-12-08 | 2019-06-13 | Sling Media Pvt Ltd | Systems and methods for selecting an initial streaming bitrate |
| CN109982118A (en) * | 2019-03-27 | 2019-07-05 | 北京奇艺世纪科技有限公司 | A kind of video code rate self-adapting regulation method, device and electronic equipment |
| CN109996094A (en) * | 2017-12-29 | 2019-07-09 | 杭州海康威视系统技术有限公司 | Video broadcasting method, apparatus and system |
| CN110149299A (en) * | 2018-02-13 | 2019-08-20 | 中兴通讯股份有限公司 | A kind of method for optimizing video, device and system, terminal and the network equipment |
| CN110225420A (en) * | 2019-06-18 | 2019-09-10 | 亦非云互联网技术（上海）有限公司 | A kind of broadcasting/decision-making technique/system, plays end and server-side at medium |
| CN110290402A (en) * | 2019-07-31 | 2019-09-27 | 腾讯科技（深圳）有限公司 | A kind of video code rate method of adjustment, device, server and storage medium |
| CN111107440A (en) * | 2019-12-26 | 2020-05-05 | 腾讯科技（深圳）有限公司 | Video transmission control method and device, equipment and storage medium |
| CN111431941A (en) * | 2020-05-13 | 2020-07-17 | 南京工业大学 | Real-time video code rate self-adaption method based on mobile edge calculation |
| CN111683273A (en) * | 2020-06-02 | 2020-09-18 | 中国联合网络通信集团有限公司 | Method and device for determining video blockage information |
-
2020
- 2020-11-12 CN CN202011263092.4A patent/CN112383791B/en active Active
Patent Citations (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060123445A1 (en) * | 2004-12-06 | 2006-06-08 | Sbc Knowledge Ventures, L.P. | System and method of displaying a video stream |
| JP2007274621A (en) * | 2006-03-31 | 2007-10-18 | Victor Co Of Japan Ltd | Image transmission system and image transmission method |
| JP2009044392A (en) * | 2007-08-08 | 2009-02-26 | Sony Corp | Video reproducing method and video reproducing device |
| CN101835029A (en) * | 2010-04-21 | 2010-09-15 | 深圳市紫云鑫软件技术有限公司 | Control method, system and client for playing streaming media |
| CN104065665A (en) * | 2014-07-02 | 2014-09-24 | 深圳深讯和科技有限公司 | Streaming media data processing method and streaming media data processing system |
| CN106657143A (en) * | 2017-01-20 | 2017-05-10 | 中兴通讯股份有限公司 | Streaming media transmission method and device, server and terminal |
| CN107071529A (en) * | 2017-03-29 | 2017-08-18 | 咪咕视讯科技有限公司 | A kind of HLS video broadcasting methods, terminal and server |
| CN108696772A (en) * | 2017-04-11 | 2018-10-23 | 上海谦问万答吧云计算科技有限公司 | A kind of transmission method and device of real-time video |
| CN109729437A (en) * | 2017-10-30 | 2019-05-07 | 中国电信股份有限公司 | Streaming media self-adapting transmission method, terminal and system |
| US20190182512A1 (en) * | 2017-12-08 | 2019-06-13 | Sling Media Pvt Ltd | Systems and methods for selecting an initial streaming bitrate |
| CN109996094A (en) * | 2017-12-29 | 2019-07-09 | 杭州海康威视系统技术有限公司 | Video broadcasting method, apparatus and system |
| CN110149299A (en) * | 2018-02-13 | 2019-08-20 | 中兴通讯股份有限公司 | A kind of method for optimizing video, device and system, terminal and the network equipment |
| CN109218759A (en) * | 2018-09-27 | 2019-01-15 | 广州酷狗计算机科技有限公司 | Push method, apparatus, server and the storage medium of Media Stream |
| CN109982118A (en) * | 2019-03-27 | 2019-07-05 | 北京奇艺世纪科技有限公司 | A kind of video code rate self-adapting regulation method, device and electronic equipment |
| CN110225420A (en) * | 2019-06-18 | 2019-09-10 | 亦非云互联网技术（上海）有限公司 | A kind of broadcasting/decision-making technique/system, plays end and server-side at medium |
| CN110290402A (en) * | 2019-07-31 | 2019-09-27 | 腾讯科技（深圳）有限公司 | A kind of video code rate method of adjustment, device, server and storage medium |
| CN111107440A (en) * | 2019-12-26 | 2020-05-05 | 腾讯科技（深圳）有限公司 | Video transmission control method and device, equipment and storage medium |
| CN111431941A (en) * | 2020-05-13 | 2020-07-17 | 南京工业大学 | Real-time video code rate self-adaption method based on mobile edge calculation |
| CN111683273A (en) * | 2020-06-02 | 2020-09-18 | 中国联合网络通信集团有限公司 | Method and device for determining video blockage information |
Non-Patent Citations (1)
| Title |
|---|
| 李婵文;: "基于丢包率统计的无线流媒体码率动态适配技术的研究", 中国新通信 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022178824A1 (en) * | 2021-02-26 | 2022-09-01 | 华为技术有限公司 | Media parameter adjustment method and apparatus |
| EP4277289A4 (en) * | 2021-02-26 | 2024-01-03 | Huawei Tech Co Ltd | Media parameter adjustment method and apparatus |
| CN113573093A (en) * | 2021-08-02 | 2021-10-29 | 杭州米络星科技(集团)有限公司 | Live broadcast data analysis method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112383791B (en) | 2023-07-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107147919B (en) | Live broadcast quick starting method and system | |
| Bolot et al. | Scalable feedback control for multicast video distribution in the internet | |
| US10542064B2 (en) | Method, server side and system for computing bandwidth of network transmission of streaming media | |
| EP4224758A1 (en) | Data retransmission processing method and apparatus, computer device, and storage medium | |
| CN108696772B (en) | Real-time video transmission method and device | |
| EP2088731A1 (en) | Network communication data processing method, network communication system and client end | |
| US20150200992A1 (en) | Method for downloading, at a client terminal, an upcoming sequence of segments of a multimedia content, and corresponding terminal | |
| EP2466911B1 (en) | Method and device for fast pushing unicast stream in fast channel change | |
| KR101871303B1 (en) | Method for subscribing to streams from multicast clients | |
| CN101282281A (en) | Medium distributing system and apparatus as well as flow medium play method | |
| WO2017045528A1 (en) | Method, device and system for multicast transmission | |
| US9813742B2 (en) | Method, device and system for evaluating user experience value of video quality | |
| CN107465526B (en) | Internet video CDN server quality monitoring system and method | |
| CN112383791A (en) | Media data processing method and device, electronic equipment and storage medium | |
| CN107864402A (en) | Live video player method and device | |
| CN113891175B (en) | Live broadcast push flow method, device and system | |
| WO2023061060A1 (en) | Audio and video code stream scheduling method, system, medium and electronic apparatus | |
| CN107920072B (en) | Multimedia sharing method and system based on data characteristics | |
| Montagud et al. | Enhanced adaptive RTCP-based Inter-Destination Multimedia Synchronization approach for distributed applications | |
| CN111131843A (en) | Network live broadcast system and method | |
| CN104469538B (en) | RTP video streaming data packet recombination methods towards picture image quality compared with small loss | |
| Clayman et al. | The future of media streaming systems: transferring video over new IP | |
| Zhang et al. | The ACM multimedia 2021 meet deadline requirements grand challenge | |
| Clayman et al. | In-network scalable video adaption using big packet protocol | |
| JP3927486B2 (en) | Streaming distribution apparatus, streaming distribution system, and streaming distribution method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |