CN106791956B - Network live broadcast card pause processing method and device - Google Patents

Network live broadcast card pause processing method and device Download PDF

Info

Publication number
CN106791956B
CN106791956B CN201611051431.6A CN201611051431A CN106791956B CN 106791956 B CN106791956 B CN 106791956B CN 201611051431 A CN201611051431 A CN 201611051431A CN 106791956 B CN106791956 B CN 106791956B
Authority
CN
China
Prior art keywords
frame rate
network
level
stream
preset
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201611051431.6A
Other languages
Chinese (zh)
Other versions
CN106791956A (en
Inventor
丰志平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN201611051431.6A priority Critical patent/CN106791956B/en
Publication of CN106791956A publication Critical patent/CN106791956A/en
Application granted granted Critical
Publication of CN106791956B publication Critical patent/CN106791956B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/4425Monitoring of client processing errors or hardware failure
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2404Monitoring of server processing errors or hardware failure
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream

Abstract

The invention discloses a processing method of network live broadcast card pause and a corresponding device thereof. The processing method comprises the following steps: uploading the media stream to a network according to the streaming level; receiving live network broadcast pause information fed back by a client and a play frame rate for the client to play the media stream; and determining the reason of the live webcast pause according to the acquisition frame rate, the playing frame rate and the stream pushing level of the media stream, so that when the video playing of the client end is paused, the reason of the live webcast pause can be determined for subsequent processing, and the user experience is improved.

Description

Network live broadcast card pause processing method and device
[ technical field ] A method for producing a semiconductor device
The invention relates to the technical field of multimedia communication testing, in particular to a method and a device for processing network live broadcast card pause.
[ background of the invention ]
With the rapid development of fixed internet taking PC as a leading part and mobile internet taking smart phone as a leading part, internet television, mobile video and multi-screen interactive services based on OTT video technology are developing at an incredible speed. OTT is an abbreviation for "over the Top", which means that services are provided over a network, emphasizing the independence of the services from the physical network. The OTT video refers to a video service based on an HTTP protocol and an open internet, and a terminal thereof may be a smart television, a computer, a set-top box, a PAD, a smart phone, or the like. There are two main implementations of OTT video: HTTP Progressive Download (HPD) and HTTP Adaptive Streaming (HAS).
Conventional OTT video typically employs HPD techniques. The HPD-based client simply waits a short period of time to download and buffer the first portion of the data of the media file before beginning playback, and then can play the media file while downloading it. HPD OTT video has a number of limitations, such as: the method is not suitable for the transmission of live programs with higher real-time requirements; the waiting time delay of the initial playing is generally longer; when the network bandwidth is unstable, the card phenomenon is easy to occur; since the client continuously downloads the video file, when the user gives up viewing the program halfway, the downloaded file (consuming bandwidth) is wasted.
In order to overcome the limitations of the HPD OTT video technology, in recent years, the OTT video technology based on HAS is gradually widely adopted and popularized by the industry. HAS OTT employs video slicing and adaptive code rate (ABR) techniques. In HAS systems, a media stream splitter splits the video stream output by an encoder into a series of contiguous, equally long, small fragmented files, and stores them on a Web content distribution server. The HAS client device can automatically request the appropriate video quality (i.e., different resolutions and bit rates) of the fragmented files from the Web server based on the available bandwidth, thereby giving the best visual experience to the user.
In order to facilitate fast, real-time switching between different rate slices for HAS clients, HAS video typically employs a shorter slice length (e.g., 10 seconds). The HAS system can provide video segment files with suitable resolution to terminals with different screen sizes, and can realize smooth video playing under different network bandwidths, so the HAS is considered as a core technology of multi-screen interactive video which is ubiquitous in the future in the industry.
In the process of implementing the prior art, the inventor finds that at least the following problems exist in the prior art:
when the video playing card of the client end is paused, the user is not clear that the communication connection between the network and the client end is failed, and the communication connection between the network and the server is failed, so that the right of awareness of the user cannot be met, the user can take appropriate measures to process the failure, and the user experience is poor.
[ summary of the invention ]
The invention provides a processing method for network live broadcast card pause, which has the following specific technical scheme:
uploading the media stream to a network according to the streaming level;
receiving live network broadcast pause information fed back by a client and a play frame rate for the client to play the media stream;
and determining the reason for the pause of the live network according to the acquisition frame rate, the playing frame rate and the stream pushing level of the media stream.
The invention also provides another processing method for network live broadcast card pause, which comprises the following steps:
loading a media stream from a network, and playing the media stream at a playing frame rate;
analyzing the media stream to obtain the acquisition frame rate of the media stream and the stream pushing level of the media stream uploaded to the network by the server;
and determining the reason for the pause of the live network according to the acquisition frame rate, the play frame rate and the stream pushing level.
The invention also provides a processing device for the live webcast card pause, which comprises the following specific steps:
the pushing module is used for uploading the media stream to a network according to a pushing level;
the receiving module is used for receiving live webcast card pause information fed back by the client and the playing frame rate of the media stream played by the client;
and the calculation module is used for determining the cause of the live webcast pause according to the acquisition frame rate, the playing frame rate and the push stream level of the media stream.
The invention also provides another processing device for network live broadcast card pause, which comprises:
the loading module is used for loading the media stream from the network and playing the media stream at a playing frame rate;
the analysis module is used for analyzing the media stream to obtain the acquisition frame rate of the media stream and the stream pushing level of the media stream uploaded to the network by the server;
and the operation module is used for determining the cause of the pause of the live network according to the acquisition frame rate, the playing frame rate and the stream pushing level.
According to the technical scheme, the embodiment provided by the application has at least the following technical effects:
when the live network broadcast is paused, the reason for the pause of the live network broadcast is determined according to the acquisition frame rate, the playing frame rate and the stream pushing level so as to be processed subsequently, and therefore the user experience is improved.
[ description of the drawings ]
Fig. 1 is a flowchart of a processing method for network live broadcast mortgage disclosed in the present application.
Fig. 2 is a flowchart of another method for handling live network card pause disclosed in the present application.
Fig. 3 is a schematic structural diagram of a processing apparatus for network live mortgage disclosed in the present application.
Fig. 4 is a schematic structural diagram of a processing apparatus for network live mortgage disclosed in the present application.
[ detailed description ] embodiments
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in detail below with reference to the accompanying drawings and specific embodiments.
As shown in fig. 1, the present application discloses a processing method for network live broadcast, which includes:
s100: and uploading the media stream to the network according to the push stream level.
The media stream may be composed of an audio signal, a video signal, or a mixed signal of audio and video. The activity scenes may be recorded and propagated by the above-mentioned audiovisual signals stored in the medium. The recorded and propagated active scene is embodied as a series of dynamic updates of static scenes described by audio signals and video signals stored in a medium. These media may include tape, hard disk, and flash memory, among many other carriers. The update frequency of a static scene is represented by the frame rate. The frame rate in the recording process of the active scene may be represented by the acquisition frame rate, and correspondingly, the frame rate in the playing process of the active scene may be represented by the playing frame rate. The size of a segment of the media stream is generally considered to be on the order of milliseconds, considering that it is suitable for live webcasting. Frame rates can be generally considered to be in the range of 6 frames/second to 120 frames/second.
In the prior art live broadcast process, the above various signals stored in the medium are usually processed by encoding and decoding. Common encoding formats are CCIR 601, M-JPEG, MPEG-1, MPEG-2, MPEG-4, H.261, H.263, H.264/MPEG-4AVC, VC-1, etc. The principle of encoding is mainly by gridding the image into pixels. The pixels can be described by using RGB values, so that the digitization of images is realized, and the digitization of audio can be realized by using values such as sound pressure, decibel, frequency and the like for sound.
In the live broadcast process of the activity scene, various audio and video devices such as a camera and a recorder acquire audio and video signals of the devices. And the server encodes the acquired audio and video signals to form data resources. The client may request access to the data resources of the server over the network. The server can also actively push information of the data resources. The size of a segment of a media stream may be represented by the capacity of the data resource. The live webcasting process of the activity scene is reflected as a data transmission process, and the data transmission speed is expressed by a code rate (the unit is byte/second). Several segments of the media stream may form a buffer queue that is uploaded to the network. Each media stream in the buffer queue may be uploaded to the network in turn. In combination with the frame rate of the media stream, the encoding format, and the definition of the data resource, a plurality of stream pushing levels can be defined to reflect the fluency of the data resource when being uploaded to the network. The higher the class of the stream pushing level is, the smoother the data resource transmission is.
The application provides an implementation method for uploading a media stream by a server, specifically:
several levels of push-off may be set, for example, 5 levels of push-off are set, respectively 1-5 levels, with level 1 being the highest level and correspondingly, level 5 being the lowest level. Due to the limitation of the network bandwidth of the server, when the amount capacity of the buffer queue reaches the peak value allowed by the network bandwidth, the stream pushing level can be adjusted down, for example, from level 1 to level 2. The server sends out an instruction for reducing the acquisition frame rate, and under the instruction, the audio and video signal acquisition equipment reduces the acquisition frequency, so that the data capacity occupied by the activity scene in a period of live broadcast of the network can be reduced. In addition, the server can also send an instruction for changing the coding mode to reduce the number of grids, and under the instruction, the images are sparsely divided, so that the data capacity occupied by the activity scenes in a period of live broadcast of the network can be reduced. On the contrary, when the quantity capacity of the buffer queues reaches the valley value of the audio and video requirements of the network live broadcast, the stream pushing level can be increased so as to improve the audio and video quality of the network live broadcast. The server sends out an instruction for increasing the acquisition frame rate, and under the instruction, the audio and video signal acquisition equipment increases the acquisition frequency, so that the activity scene can be more vivid and fine. In addition, the server can also send an instruction for changing the coding mode to increase the number of grids, and under the instruction, the images are densely divided, so that the moving scene can be more vivid and fine. The server uploads the push stream level of the media stream, self-adaptive adjustment can be realized through software, and automatic switching is performed in a plurality of set push stream levels.
Further, in an embodiment provided by the present application, the media stream includes content frames for expressing content, and enhancement information frames for expressing the acquisition frame rate and the stream pushing level. The content frames and the enhanced information frames are integrated in the media stream, so that the timely checking is convenient. Here, the information in the enhanced information frame includes, but is not limited to, an acquisition frame rate, a stream pushing level, and may also include instant information such as a code rate during uploading.
S200: and receiving the live webcast pause information fed back by the client and the playing frame rate of the media stream played by the client.
The client can be an interface provided by various applications such as a smart television, a set-top box, video playing software and the like. The client downloads the media stream from the network, plays the media stream at a play frame rate, and displays the media stream on various screens for the user to watch.
The live webcast morton is mainly represented by image stillness, mosaic appearance, tone change and the like, and regarding the detection of the live webcast morton, detailed disclosure is provided in the prior art, and details are not repeated here.
And the server receives the live webcast pause information and the play frame rate of the media stream fed back by the client and performs subsequent processing.
Further, in another embodiment provided by the present application, the frame rate of playing is an average frame rate of playing the media stream by the client within a period of time, so as to improve the accuracy of the operation.
S300: and determining the reason for the pause of the live network according to the acquisition frame rate, the playing frame rate and the stream pushing level of the media stream.
Further, in another embodiment provided by the present application, the determining, according to the acquisition frame rate, the play frame rate, and the stream pushing level of the media stream, a cause of a live webcast pause specifically includes:
and when the playing frame rate is smaller than the acquisition frame rate and reaches a preset frame rate difference threshold value, and the stream pushing level is higher than a preset first stream pushing level, determining that the reason of the network live broadcast is the communication jam of the client.
Further, in an embodiment provided by the present application, the preset first push flow level is the lowest level.
The network live broadcast is smooth and is embodied as the consistency between the playing frame rate and the collecting frame rate. It can be understood that when the playing frame rate is less than the collection frame rate and reaches the preset frame rate difference threshold, it indicates that the live webcast may have communication non-smoothness, and the reason for the communication non-smoothness may come from the server or from the client. For example, the acquisition frame rate is 80 frames/second, while the playback frame rate is only 10 frames/second. The preset frame rate difference threshold value can be adaptively set according to a specific scene. In order to clarify the reason of the communication non-smoothness, the push flow level of the media flow uploaded by the server needs to be further detected. When the push flow level is higher than the preset first push flow level, the communication state of the media flow uploaded by the server is normal. The preset first push-flow level may be set to the lowest level. This may eliminate the factor of an obstructed communication between the server and the network. Of course, the preset first push flow level may also be set to other levels, for example, a certain level in the middle. Therefore, factors of communication between the server and the network which is not smooth can be fully eliminated, and the reason that the live broadcast of the network is blocked is the communication blockage of the client side.
Further, in another embodiment provided by the present application, the method further includes:
continuously uploading a plurality of segments of media streams to a network so as to be played by a client;
the number of the media streams with the playing frame rate smaller than the collection frame rate in the plurality of segments of media streams is not smaller than the preset threshold number.
Accidental factors exist in the live webcast, for example, some key frames are lost in the media stream, and the transient webcast disconnection may affect the judgment of the cause of the live webcast congestion. In order to improve the accuracy of the judgment of the cause of the network live broadcast pause, in this embodiment, multiple segments of media streams are considered comprehensively. And setting a preset threshold value quantity, and prompting that the reason of the live broadcast blockage is the communication blockage of the client when the quantity of the media streams with the playing frame rate smaller than the acquisition frame rate in the plurality of segments of media streams is not smaller than the preset threshold value quantity. That is to say, when the number of the media streams from the frame rate of playing of the plurality of segments of media streams to the frame rate difference threshold is not less than the preset threshold number, the reason that the live broadcast is blocked is prompted to be that the client terminal is blocked in communication.
Further, in another embodiment provided by the present application, determining a cause of a network live broadcast morton specifically includes:
and when the playing frame rate is greater than the acquisition frame rate and reaches a preset frame rate difference threshold value, and the stream pushing level is lower than a preset second stream pushing level, determining that the reason for the network live broadcast is server-side communication pause.
Further, in another embodiment provided by the present application, the preset second push flow level is the highest level.
The network live broadcast is smooth and is embodied as the consistency between the playing frame rate and the collecting frame rate. It can be understood that when the playing frame rate is greater than the collection frame rate and reaches the preset frame rate difference threshold, it indicates that the live webcast may have communication non-smoothness, and the reason for the communication non-smoothness may come from the server or from the client. For example, the acquisition frame rate is 10 frames/second, while the playback frame rate is up to 80 frames/second. The preset frame rate difference threshold value can be adaptively set according to a specific scene. In order to clarify the reason of the communication non-smoothness, the push flow level of the media flow uploaded by the server needs to be further detected. And when the push flow level is lower than a second preset push flow level, the communication state between the client and the network is normal. The preset second push flow level here may be set to the highest level. This may eliminate the factor of communication obstruction between the client and the network. Of course, the preset push flow level may also be set to other levels, for example, a certain level in the middle. Therefore, factors of communication between the client and the network which is not smooth can be fully eliminated, and the reason of the live broadcast blockage of the network is the communication blockage of the server side can be determined more accurately.
Further, in another embodiment provided by the present application, the method further includes:
continuously uploading a plurality of segments of media streams to a network so as to be played by a client;
the number of the media streams with the playing frame rate larger than the collection frame rate in the plurality of segments of media streams is not smaller than the preset threshold number.
Accidental factors exist in live network broadcast, such as overheating, false death and transient network disconnection of equipment for installing a client, which may affect the judgment of the cause of live network broadcast blockage. In order to improve the accuracy of the judgment of the cause of the network live broadcast pause, in this embodiment, multiple segments of media streams are considered comprehensively. And setting a preset threshold value quantity, and prompting that the reason of the pause of the live network is server communication pause when the quantity of the media streams with the playing frame rate larger than the acquisition frame rate in the plurality of segments of media streams is not smaller than the preset threshold value quantity. That is to say, when the number of the media streams from the frame rate of playing of the plurality of segments of media streams to the difference threshold of the preset frame rate is not less than the number of the preset threshold, it is determined that the cause of the network live broadcast is the communication pause at the server end.
In the embodiment provided by the application, when the live webcast card is paused, the reason for the live webcast card is determined according to the acquisition frame rate, the play frame rate and the stream pushing level, so that a live webcast card pause reason feedback mechanism can be established, and the user experience is improved.
Further, in another embodiment provided by the present application, the method further includes:
and prompting the determined reason for the live webcast card pause to the client.
Therefore, the user of the client can take measures according to the determined cause of the live webcast card pause. For example, the client changes the network to improve the client communication state, or switches the network live source to improve
As shown in fig. 2, the present application further provides another processing method for network live broadcast, which includes:
s101: and loading the media stream from the network to play the media stream at a play frame rate.
The client can request to access the data resource of the server through the network, so as to establish connection with the server and load the media stream from the network. The client can also receive the information of the data resources actively pushed by the server, and load the media stream from the network after agreeing to establish the connection with the server.
And after the client acquires the media stream, playing the media stream at a playing frame rate.
S102: and analyzing the media stream to obtain the acquisition frame rate of the media stream and the stream pushing level of the media stream uploaded to the network by the server.
The client analyzes the media stream to obtain the acquisition frame rate of the media stream and the stream pushing level of the media stream uploaded to the network by the server.
Further, in an embodiment provided by the present application, the media stream includes content frames for expressing content, and enhancement information frames for expressing the acquisition frame rate and the stream pushing level. The content frames and the enhanced information frames are integrated in the media stream, so that the timely checking is convenient. Here, the information in the enhanced information frame includes, but is not limited to, an acquisition frame rate, a stream pushing level, and may also include instant information such as a code rate during uploading. The client analyzes the media stream to obtain the information of the acquisition frame rate, the stream pushing level and the like contained in the enhanced information frame.
S103: and determining the reason for the pause of the live network according to the acquisition frame rate, the play frame rate and the stream pushing level.
Further, in another embodiment provided by the present application, determining a cause of a network live broadcast morton specifically includes:
and when the playing frame rate is smaller than the acquisition frame rate and reaches a preset frame rate difference threshold value, and the stream pushing level is higher than a preset first stream pushing level, determining that the reason of the network live broadcast is the communication jam of the client.
Further, in another embodiment provided by the present application, the preset first push flow level is the lowest level.
Further, in another embodiment provided by the present application, determining a cause of a network live broadcast morton specifically includes:
and when the playing frame rate is greater than the acquisition frame rate and reaches a preset frame rate difference threshold value, and the stream pushing level is lower than a preset second stream pushing level, determining that the reason for the network live broadcast is server-side communication pause.
Further, in another embodiment provided by the present application, the preset second push flow level is the highest level.
Further, in another embodiment provided by the present application, the determining, according to the acquisition frame rate, the play frame rate, and the stream pushing level of the media stream, a cause of a live webcast pause specifically includes:
when the playing frame rate is smaller than the acquisition frame rate and reaches a preset frame rate difference threshold value, and the push stream level is higher than the lowest push stream level, determining that the reason of the network live broadcast is the communication jam of the client;
and when the playing frame rate is greater than the acquisition frame rate and reaches a preset frame rate difference threshold value, and the plug flow level is lower than the highest level, determining that the reason of the live network broadcast is that the client communication card is a server communication card.
The network live broadcast is smooth and is embodied as the consistency between the playing frame rate and the collecting frame rate. It can be understood that when the playing frame rate is less than the collection frame rate and reaches the preset frame rate difference threshold, it indicates that the live webcast may have communication non-smoothness, and the reason for the communication non-smoothness may come from the server or from the client. For example, the acquisition frame rate is 80 frames/second, while the playback frame rate is only 10 frames/second. The preset frame rate difference threshold value can be adaptively set according to a specific scene. In order to clarify the reason of the communication non-smoothness, the push flow level of the media flow uploaded by the server needs to be further detected. When the push flow level is higher than the preset first push flow level, the communication state of the media flow uploaded by the server is normal. The preset first push-flow level may be set to the lowest level. This may eliminate the factor of an obstructed communication between the server and the network. Of course, the preset first push flow level may also be set to other levels, for example, a certain level in the middle. Therefore, factors of communication between the server and the network which is not smooth can be fully eliminated, and the reason that the live broadcast of the network is blocked is the communication blockage of the client side.
In contrast, when the playing frame rate is greater than the collection frame rate and reaches the preset frame rate difference threshold, it indicates that the network live broadcast may have communication non-smoothness, and the reason for the communication non-smoothness may come from the server or the client. For example, the acquisition frame rate is 10 frames/second, while the playback frame rate is up to 80 frames/second. The preset frame rate difference threshold value can be adaptively set according to a specific scene. In order to clarify the reason of the communication non-smoothness, the push flow level of the media flow uploaded by the server needs to be further detected. And when the push flow level is lower than a second preset push flow level, the communication state between the client and the network is normal. The preset second push flow level here may be set to the highest level. This may eliminate the factor of communication obstruction between the client and the network. Of course, the preset push flow level may also be set to other levels, for example, a certain level in the middle. Therefore, factors of communication between the client and the network which is not smooth can be fully eliminated, and the reason of the live broadcast blockage of the network is the communication blockage of the server side can be determined more accurately.
In the embodiment provided by the application, when the live webcast card is paused, the reason for the live webcast card is determined according to the acquisition frame rate, the play frame rate and the stream pushing level, so that a live webcast card pause reason feedback mechanism can be established, and the user experience is improved.
The application also provides a processing method for network live broadcast card pause, which comprises the following steps:
the server uploads the media stream to the network according to the stream pushing level;
a client loads a media stream from a network to play the media stream at a play frame rate;
when the live network broadcast is paused, at least one of the server or the client determines the reason of the pause of the live network broadcast according to the acquisition frame rate, the playing frame rate and the stream pushing level of the media stream.
After a channel of network live broadcast is established, the server uploads the media stream to the network according to a certain stream pushing level. The client loads the media stream from the network to play the media stream at a play frame rate. When the live network card pause, the server receives live network card pause information fed back by the client and the playing frame rate of the media stream played by the client. And the server determines the cause of the network live broadcast pause according to the acquisition frame rate, the playing frame rate and the stream pushing level of the media stream.
Or when the network live broadcast card pause, the client analyzes the media stream to obtain the acquisition frame rate of the media stream and the stream pushing level of the server for uploading the media stream to the network. And the client determines the cause of the network live broadcast card pause according to the acquisition frame rate, the play frame rate and the stream pushing level.
In the embodiment provided by the application, when the live webcast card is paused, the reason for the live webcast card is determined according to the acquisition frame rate, the play frame rate and the stream pushing level, so that a live webcast card pause reason feedback mechanism can be established, and the user experience is improved.
The specific manner of determining the cause of the network live broadcast card pause by the server or the client is already stated in detail above, and is not described herein again.
The above is a processing method for network live broadcast stuck, provided in this application, and referring to fig. 3 based on the same idea, the present application further provides a processing apparatus for network live broadcast stuck, including:
the push module 11 is configured to upload a media stream to a network according to a push level;
the receiving module 12 is configured to receive live webcast morton information fed back by the client and a play frame rate at which the client plays the media stream;
and the calculation module 13 is configured to determine a cause of a pause of the live network according to the acquisition frame rate, the play frame rate, and the stream pushing level of the media stream.
Further, in another embodiment provided in the present application, the calculating module 13 is specifically configured to:
and when the playing frame rate is smaller than the acquisition frame rate and reaches a preset frame rate difference threshold value, and the stream pushing level is higher than a preset first stream pushing level, determining that the reason of the network live broadcast is the communication jam of the client.
Further, in another embodiment provided by the present application, the preset first push flow level is the lowest level.
Further, in another embodiment provided in the present application, the pushing module 11 is specifically configured to continuously upload a plurality of segments of media streams to a network, so that a client plays the media streams;
the number of the media streams with the playing frame rate smaller than the collection frame rate in the plurality of segments of media streams is not smaller than the preset threshold number.
Further, in another embodiment provided in the present application, the calculating module 13 is specifically configured to:
and when the playing frame rate is greater than the acquisition frame rate and reaches a preset frame rate difference threshold value, and the stream pushing level is lower than a preset second stream pushing level, determining that the reason for the network live broadcast is server-side communication pause.
Further, in another embodiment provided by the present application, the preset second push flow level is the highest level.
Further, the pushing module 11 is specifically configured to continuously upload a plurality of segments of media streams to a network, so that a client plays the media streams;
the number of the media streams with the playing frame rate larger than the collection frame rate in the plurality of segments of media streams is not smaller than the preset threshold number.
In the embodiment provided by the application, when the live webcast card is paused, the reason for the live webcast card is determined according to the acquisition frame rate, the play frame rate and the stream pushing level, so that a live webcast card pause reason feedback mechanism can be established, and the user experience is improved.
Referring to fig. 4, the present application further provides a device for processing live webcast card pause, including:
a loading module 21, configured to load a media stream from a network, so as to play the media stream at a play frame rate;
the analysis module 22 is configured to analyze the media stream to obtain an acquisition frame rate of the media stream and a stream pushing level of the media stream uploaded to a network by a server;
and the operation module 23 is configured to determine a cause of the network live broadcast stuck according to the acquisition frame rate, the play frame rate, and the stream pushing level.
Further, in another embodiment provided in the present application, the operation module 23 is specifically configured to:
and when the playing frame rate is smaller than the acquisition frame rate and reaches a preset frame rate difference threshold value, and the stream pushing level is higher than a preset first stream pushing level, determining that the reason of the network live broadcast is the communication jam of the client.
Further, in another embodiment provided by the present application, the preset first push flow level is the lowest level.
Further, in another embodiment provided in the present application, the operation module 23 is specifically configured to:
and when the playing frame rate is greater than the acquisition frame rate and reaches a preset frame rate difference threshold value, and the stream pushing level is lower than a preset second stream pushing level, determining that the reason for the network live broadcast is server-side communication pause.
Further, in another embodiment provided by the present application, the preset second push flow level is the highest level.
Further, in another embodiment provided in the present application, the operation module 23 is specifically configured to:
when the playing frame rate is smaller than the acquisition frame rate and reaches a preset frame rate difference threshold value, and the push stream level is higher than the lowest push stream level, determining that the reason of the network live broadcast is the communication jam of the client;
and when the playing frame rate is greater than the acquisition frame rate and reaches a preset frame rate difference threshold value, and the plug flow level is lower than the highest level, determining that the reason of the live network broadcast is that the client communication card is a server communication card.
In the embodiment provided by the application, when the live webcast card is paused, the reason for the live webcast card is determined according to the acquisition frame rate, the play frame rate and the stream pushing level, so that a live webcast card pause reason feedback mechanism can be established, and the user experience is improved.
The application also provides a processing system that live network card is duned, includes:
the server is used for uploading the media stream to the network according to the stream pushing level;
the client is used for loading the media stream from the network and playing the media stream at a playing frame rate;
when the live network broadcast is paused, at least one of the server or the client determines the reason of the pause of the live network broadcast according to the acquisition frame rate, the playing frame rate and the stream pushing level of the media stream.
In the embodiment provided by the application, when the live webcast card is paused, the reason for the live webcast card is determined according to the acquisition frame rate, the play frame rate and the stream pushing level, so that a live webcast card pause reason feedback mechanism can be established, and the user experience is improved.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the scope of protection of the present application.

Claims (16)

1. A processing method for network live broadcast card pause is characterized by comprising the following steps:
uploading the media stream to a network according to the streaming level;
receiving live network broadcast pause information fed back by a client and a play frame rate for the client to play the media stream;
determining a cause of network live broadcast pause according to the acquisition frame rate, the playing frame rate and the stream pushing level of the media stream;
the method for determining the reason for the live webcast card pause comprises the following steps: and when the playing frame rate is smaller than the acquisition frame rate and reaches a preset frame rate difference threshold value, and the stream pushing level is higher than a preset first stream pushing level, determining that the reason of the network live broadcast is the communication jam of the client.
2. The method of claim 1, wherein the preset first push flow level is a lowest level.
3. The method of claim 1, further comprising:
continuously uploading a plurality of segments of media streams to a network so as to be played by a client;
the number of the media streams with the playing frame rate smaller than the collection frame rate in the plurality of segments of media streams is not smaller than the preset threshold number.
4. The method of claim 1, wherein determining a live webcast katton cause further comprises:
and when the playing frame rate is greater than the acquisition frame rate and reaches a preset frame rate difference threshold value, and the stream pushing level is lower than a preset second stream pushing level, determining that the reason for the network live broadcast is server-side communication pause.
5. The method of claim 4, wherein the predetermined second push flow level is a highest level.
6. The method of claim 4, further comprising:
continuously uploading a plurality of segments of media streams to a network so as to be played by a client;
the number of the media streams with the playing frame rate larger than the collection frame rate in the plurality of segments of media streams is not smaller than the preset threshold number.
7. A processing method for network live broadcast card pause is characterized by comprising the following steps:
loading a media stream from a network, and playing the media stream at a playing frame rate;
analyzing the media stream to obtain the acquisition frame rate of the media stream and the stream pushing level of the media stream uploaded to the network by the server;
determining the reason for the blockage of the live broadcast of the network according to the acquisition frame rate, the playing frame rate and the push stream level;
the determining of the cause of the network live broadcast blockage comprises the following steps: and when the playing frame rate is smaller than the acquisition frame rate and reaches a preset frame rate difference threshold value, and the push stream level is higher than the lowest push stream level, determining that the reason of the network live broadcast is the communication jam of the client.
8. The method of claim 7, wherein determining a live webcast katton cause further comprises:
and when the playing frame rate is greater than the acquisition frame rate and reaches a preset frame rate difference threshold value, and the stream pushing level is lower than the highest level, determining that the reason for the live network broadcast is communication pause at the server end.
9. A processing device for network live broadcast card pause is characterized by comprising:
the pushing module is used for uploading the media stream to a network according to a pushing level;
the receiving module is used for receiving live webcast card pause information fed back by the client and the playing frame rate of the media stream played by the client;
the calculation module is used for determining the cause of the blockage of the live network according to the acquisition frame rate, the playing frame rate and the push stream level of the media stream;
wherein the calculation module is specifically configured to: and when the playing frame rate is smaller than the acquisition frame rate and reaches a preset frame rate difference threshold value, and the stream pushing level is higher than a preset first stream pushing level, determining that the reason of the network live broadcast is the communication jam of the client.
10. The processing apparatus of claim 9, wherein the preset first push flow level is a lowest level.
11. The processing apparatus according to claim 9, wherein the push module is specifically configured to continuously upload a plurality of segments of media streams to a network for a client to play;
the number of the media streams with the playing frame rate smaller than the collection frame rate in the plurality of segments of media streams is not smaller than the preset threshold number.
12. The processing apparatus as in claim 9 wherein the computing module is further to:
and when the playing frame rate is greater than the acquisition frame rate and reaches a preset frame rate difference threshold value, and the stream pushing level is lower than a preset second stream pushing level, determining that the reason for the network live broadcast is server-side communication pause.
13. The processing apparatus of claim 12, wherein the preset second push flow level is a highest level.
14. The processing apparatus according to claim 12, wherein the push module is specifically configured to continuously upload a plurality of segments of media streams to a network for a client to play;
the number of the media streams with the playing frame rate larger than the collection frame rate in the plurality of segments of media streams is not smaller than the preset threshold number.
15. A processing device for network live broadcast card pause is characterized by comprising:
the loading module is used for loading the media stream from the network and playing the media stream at a playing frame rate;
the analysis module is used for analyzing the media stream to obtain the acquisition frame rate of the media stream and the stream pushing level of the media stream uploaded to the network by the server;
the operation module is used for determining the cause of the pause of the live webcast according to the acquisition frame rate, the playing frame rate and the stream pushing level;
wherein, the operation module is specifically configured to: and when the playing frame rate is smaller than the acquisition frame rate and reaches a preset frame rate difference threshold value, and the push stream level is higher than the lowest push stream level, determining that the reason of the network live broadcast is the communication jam of the client.
16. The processing apparatus of claim 15,
the operation module is further configured to: and when the playing frame rate is greater than the acquisition frame rate and reaches a preset frame rate difference threshold value, and the stream pushing level is lower than the highest level, determining that the reason for the live network broadcast is communication pause at the server end.
CN201611051431.6A 2016-11-25 2016-11-25 Network live broadcast card pause processing method and device Active CN106791956B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611051431.6A CN106791956B (en) 2016-11-25 2016-11-25 Network live broadcast card pause processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611051431.6A CN106791956B (en) 2016-11-25 2016-11-25 Network live broadcast card pause processing method and device

Publications (2)

Publication Number Publication Date
CN106791956A CN106791956A (en) 2017-05-31
CN106791956B true CN106791956B (en) 2020-01-21

Family

ID=58911208

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611051431.6A Active CN106791956B (en) 2016-11-25 2016-11-25 Network live broadcast card pause processing method and device

Country Status (1)

Country Link
CN (1) CN106791956B (en)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109391847B (en) * 2017-08-08 2021-10-12 中国电信股份有限公司 Monitoring method and monitoring device for blocking of streaming media
CN107864402A (en) * 2017-10-11 2018-03-30 湖南机友科技有限公司 Live video player method and device
CN109996110B (en) * 2017-12-29 2021-10-22 中兴通讯股份有限公司 Video playing method, terminal, server and storage medium
CN108347598B (en) * 2018-01-25 2021-03-09 晶晨半导体(上海)股份有限公司 Automatic detection and reporting system and method for audio and video card pause information
CN110113621B (en) * 2018-02-01 2023-03-03 腾讯科技(深圳)有限公司 Media information playing method and device, storage medium and electronic device
CN108616776B (en) * 2018-05-03 2021-05-14 广州酷狗计算机科技有限公司 Live broadcast analysis data acquisition method and device
CN108924578A (en) * 2018-08-24 2018-11-30 成都九洲电子信息系统股份有限公司 Emergent broadcast method based on Active Networks Streaming Media
CN110366035B (en) * 2019-07-19 2021-08-24 广州酷狗计算机科技有限公司 Frame rate control method, apparatus, computer device and computer-readable storage medium
CN110727340B (en) * 2019-09-26 2021-03-02 瑞芯微电子股份有限公司 Method, device and system for adapting dynamic bandwidth of image acquisition display
CN111083536B (en) * 2019-12-31 2022-02-22 广州酷狗计算机科技有限公司 Method and device for adjusting video code rate
CN111277846A (en) * 2020-01-15 2020-06-12 广州虎牙科技有限公司 Live broadcast abnormity positioning method and device, computer equipment and storage medium
CN111601102B (en) * 2020-04-30 2022-02-01 微梦创科网络科技(中国)有限公司 Live broadcast stuck detection method and system
CN113423008B (en) * 2021-08-20 2021-11-16 北京易真学思教育科技有限公司 Video data transmission method, server and viewer side equipment
CN114189700A (en) * 2021-11-23 2022-03-15 广州博冠信息科技有限公司 Live broadcast card pause prompting method and device, computer equipment and storage medium
CN115471926A (en) * 2022-08-17 2022-12-13 力神(青岛)新能源有限公司 Data analysis optimization method of electric vehicle battery management system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103024440A (en) * 2013-01-11 2013-04-03 德科仕通信(上海)有限公司 Video quality evaluation and fault diagnosis method aiming at HAS (HTTP Adaptive Streaming)
EP2615790A1 (en) * 2012-01-12 2013-07-17 Alcatel Lucent Method, system and devices for improved adaptive streaming of media content
CN104683866A (en) * 2013-11-29 2015-06-03 成都鼎桥通信技术有限公司 Playing processing method for received streaming video
CN104811751A (en) * 2015-04-28 2015-07-29 深圳市优网科技有限公司 Streaming media playing blockage pause recognition method and streaming media playing blockage pause recognition device
CN105323604A (en) * 2015-10-29 2016-02-10 西安交通大学 QoE (Quality of Experience) driven HTTP streaming media on demand buffer area control method
CN105553939A (en) * 2015-12-07 2016-05-04 中国联合网络通信集团有限公司 Method and device for determining blockage of streaming media
CN105893246A (en) * 2015-12-18 2016-08-24 乐视云计算有限公司 Player test method, device and system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2615790A1 (en) * 2012-01-12 2013-07-17 Alcatel Lucent Method, system and devices for improved adaptive streaming of media content
CN103024440A (en) * 2013-01-11 2013-04-03 德科仕通信(上海)有限公司 Video quality evaluation and fault diagnosis method aiming at HAS (HTTP Adaptive Streaming)
CN104683866A (en) * 2013-11-29 2015-06-03 成都鼎桥通信技术有限公司 Playing processing method for received streaming video
CN104811751A (en) * 2015-04-28 2015-07-29 深圳市优网科技有限公司 Streaming media playing blockage pause recognition method and streaming media playing blockage pause recognition device
CN105323604A (en) * 2015-10-29 2016-02-10 西安交通大学 QoE (Quality of Experience) driven HTTP streaming media on demand buffer area control method
CN105553939A (en) * 2015-12-07 2016-05-04 中国联合网络通信集团有限公司 Method and device for determining blockage of streaming media
CN105893246A (en) * 2015-12-18 2016-08-24 乐视云计算有限公司 Player test method, device and system

Also Published As

Publication number Publication date
CN106791956A (en) 2017-05-31

Similar Documents

Publication Publication Date Title
CN106791956B (en) Network live broadcast card pause processing method and device
US10419787B2 (en) Dynamic programming across multiple streams
US10567463B2 (en) Quality tagging in adaptive bitrate technologies
EP3493547B1 (en) Video streaming delivery
KR101569510B1 (en) Method for adaptive real-time transcoding, and streaming server thereof
CN110662114B (en) Video processing method and device, electronic equipment and storage medium
US20170142029A1 (en) Method for data rate adaption in online media services, electronic device, and non-transitory computer-readable storage medium
CN112752115A (en) Live broadcast data transmission method, device, equipment and medium
EP2941001B1 (en) Video management
EP4152755A1 (en) Methods, systems, and apparatuses for adaptive bitrate ladder construction based on dynamically adjustable neural networks
CN111970565A (en) Video data processing method and device, electronic equipment and storage medium
US9060184B2 (en) Systems and methods for adaptive streaming with augmented video stream transitions using a media server
EP2689395B1 (en) Method in streaming client for handling video streaming data, streaming client, computer programs and computer program products
US11943487B2 (en) Delivery and playback of content
CN113630576A (en) Adaptive video streaming system and method
CN111107387B (en) Video transcoding method and device and computer storage medium
US10531135B2 (en) Network recording apparatus
CA2881417A1 (en) System and method bridging cloud based user interfaces
US20220256215A1 (en) Systems and methods for adaptive output
US20220394073A1 (en) Method and apparatus for determining bitrate switch points
US9538215B2 (en) Maintaining continuity in media streaming
WO2021013558A1 (en) A media client with adaptive buffer size and the related method
WO2013163221A1 (en) Systems and methods for adaptive streaming with augmented video stream transitions
US20240031629A1 (en) Method for dynamic configuration of multimedia content encoder and apparatus for implementing the same
JP2017175597A (en) Moving image distribution system, distribution server, receiver, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant