WO2017084467A1

WO2017084467A1 - Method for processing video stream, device, and system

Info

Publication number: WO2017084467A1
Application number: PCT/CN2016/102664
Authority: WO
Inventors: 应玉龙
Original assignee: 腾讯科技（深圳）有限公司
Priority date: 2015-11-18
Filing date: 2016-10-20
Publication date: 2017-05-26
Also published as: CN105451071B; CN105451071A

Abstract

Disclosed in the embodiments of the present application are a method, a device and a system for processing a video stream. The embodiments of the present application comprises: after receiving a video playback request carrying a video stream identifier, acquiring, according to the video stream identifier, a video stream from a media server; when it is determined that an abnormality occurs in the acquisition of the video stream, determining whether the number of attempts for acquiring the video stream is below a preset value, and if so, returning to execute the step of acquiring the video stream from the media server, otherwise, if the number of attempts is not below the preset value, reporting an error. The described solution can provide improved stability and fluency when playing back a video.

Description

This application relates to

System.

Currently, users use mobile clients to watch live video, all based on streaming media.

(Streaming Media) protocol to achieve. The so-called streaming media refers to a media format that implements online playback by means of streaming. In specific implementation, the video website operator can package the program as a digital packet and send it to the network through the video delivery server. When the user needs to watch the video, the user can extract the data by decompressing the client and decompressing the data. Play. Currently, common streaming protocols mainly include real-time streaming based on hypertext transfer protocol.

(HLS, HTTP Live Streaming) protocol and Real Time Streaming Protocol (RTSP). Among them, RTSP is a more general-purpose real-time streaming media protocol, which can realize the live broadcast function of video, and requires a special media player (media player) and

The embodiment of the present application provides a method, a device, and a system for processing a video stream, which can improve stability and fluency when playing video.

An embodiment of the present application provides a method for processing a video stream, including:

Receiving a video play request, where the video play request carries a video stream identifier; and acquiring a video stream from the media server according to the video stream identifier;

When it is determined that the acquisition of the video stream is abnormal, it is determined whether the number of attempts to obtain the video stream is low. Pre-i殳 value;

If yes, returning to the step of acquiring a video stream from the media server;

Flow marker - ΐί

An acquiring unit, configured to acquire a video stream from the media server according to the video stream identifier, and a processing unit, configured to determine, when an abnormality occurs in the acquisition of the video stream, determining whether the number of attempts to obtain the video stream is lower than a preset value; if yes, The trigger acquisition unit performs an operation of acquiring a video stream from the media server; if not, the error processing is performed.

In addition, the embodiment of the present application further provides a processing system for a video stream, including a media server and a processing device for any video stream provided by the embodiment of the present application;

The media server is configured to provide a video stream to a processing device of the video stream.

After receiving the video play request carrying the video stream identifier, the embodiment of the present application obtains the video stream from the media server according to the video stream identifier, and determines whether the number of attempts to obtain the video stream is low when determining that the video stream is abnormally acquired. At the preset value, if yes, returning to perform the step of acquiring the video stream from the media server, otherwise, if the value is not lower than the preset value, the error processing is performed; because the scheme is abnormal when the video stream is abnormal, the corresponding abnormal attempt may be provided. Operation, to the maximum extent, the video can continue to play. Therefore, compared with the prior art, in the case of encountering an abnormality, the solution directly and incorrectly can provide stability and fluency when the video is played. BRIEF DESCRIPTION OF THE DRAWINGS

The following figures are only a few examples of the technical solutions of the present application, and the application is not limited to the features shown in the drawings. In the following figures, similar reference numerals indicate FIG. 1a is a schematic diagram of a process of processing a video stream according to an embodiment of the present disclosure; FIG. 1b is a flowchart of a method for processing a video stream according to an embodiment of the present application;

2 is another flowchart of a method for processing a video stream according to an embodiment of the present disclosure; FIG. 3 is a schematic diagram of a device for processing a video stream according to an embodiment of the present application;

FIG. 4 is a schematic diagram of a video stream processing apparatus according to an embodiment of the present application. Implementation. This application - clear way

For the sake of brevity and clarity in the description, the scheme of the present application will be explained below by describing a representative embodiment. However, not all embodiments are shown herein. A large number of the details in the embodiments are only used to help understand the solution of the present application, and the technical solutions of the present application may not be limited to these details. In order to avoid unnecessarily obscuring the aspects of the present application, some embodiments are not described in detail, but only the framework is given. In the following, "including" means "including but not limited to", "according to..." means "at least according to ..., but not limited to only based on ...". The word "comprising", as used in the specification and claims, is meant to include, to some extent, the meaning of the invention. When the number of one component is not specifically indicated below, it means that the component may be one or more, or may be understood to be at least one.

The embodiment of the present application provides a method, an apparatus, and a system for processing a video stream.

Referring to FIG. 1a, the processing system of the video stream may include any processing device of the frequency stream provided by the embodiment of the present application, where the processing device of the frequency stream may be integrated in the terminal, and further, the processing system of the video stream further A media server can be included for providing a video stream to the terminal.

When the user needs to watch the video, the video play request can be triggered by clicking or selecting the play trigger button. The video play request carries a video stream identifier. After receiving the video play request, the terminal may obtain a video stream from the media server according to the video stream identifier. For example, the root sends a download request of the video stream to the media server according to the video stream identifier, and then connects The receiving media media server server roots according to the downloading request to request the return of the video video stream, back to and so on. . Then, after that, the video stream can be played in the local terminal at the terminal end. .

In the process of playing and playing the RRTTSSPP video and video frequency, it is often encountered that the network will not be unstable due to the network network, or the media media server will not be unstable. However, the lead to the occasional situation is that there is no way to download the video stream stream normally. . According to the application, please refer to the application.

55. For example, if the terminal end determines that the video stream of the fixed-view video has been abnormally abnormal, then it may be possible to start the trial flow process with the start-up exception. If it is judged that the number of trial attempts to obtain the video stream stream is lower than the pre-set value. . If the answer is yes, then the return receipt execution line obtains the step of obtaining the video stream from the media server server. . Otherwise, if the number of attempts to try has exceeded the pre-preset value, for example, 33 times, then the line will report the error, for example, The release of the said video video stream source resource, and the suspension of the said RRTTSSPP session, and prompting the broadcast to play the wrong error message, Etc., etc. . Compared with the existing method in the existing existing solution, the problem is that the abnormality is directly and directly reported to the ttoo error processing method. The case can be increased and the playback of the RRTTSSPP video frequency is stabilized and stable, and the flow is smooth. .

The embodiment of the present embodiment will advance the angular angle of the processing and processing device from the video and video stream, and the processing of the video and video stream will be described. The physical device can be integrated into the device at the terminal end or the like. . The processing and processing device of the video video stream may be integrated into the device set in the terminal terminal or the like as a function module of the one-function function, and also It may be installed in the form of a soft body, installed at the terminal end, etc.

In 1155, it will not be described again here. .

A processing method for processing video frequency stream, the package includes: receiving and receiving a video broadcast, and requesting, and requesting the video broadcast The video stream stream identifier is identified; the root obtains the video stream from the media server server according to the stream identifier of the video stream; and determines the video stream stream. When the acquisition is abnormal, the number of trial attempts to obtain the video stream stream is determined to be lower than the pre-set value; if so, Then, the return receipt execution line obtains the step of obtaining the video frequency stream from the media server server; if not, the line 2200 reports the error processing. . .

As shown in FIG. 11b, the specific body flow process of the processing method of the video video stream may be as follows:

110011,, receiving and receiving video broadcasts, please request. .

For example, for example, it may be triggered by receiving and receiving the user account through a click through the video broadcast play button or by touching the ground address of the video frequency link.

2255, wherein the video video broadcast is requested to be requested to carry the video stream stream identification identifier and the like information. . Video frequency stream tag identification To identify the video stream. For example, the video stream identifier can be a name, a number, or a link address of the video stream.

The video stream may specifically be an RTSP video stream or a live video stream in other formats.

102. The video stream identifier is obtained from the media server according to the video stream identifier. For example, the details can be as follows:

(1) determining a link address of the video stream according to the video stream identifier.

The link address indicates where the video stream is stored in the media server.

(2) creating a video player based on the link address and initializing the video player;

For example, after the video player is created according to the link address, the player interface, the playback engine, the decoder, and the cache module can be initialized separately, as follows.

A, initialize the player interface

Create a player interface, including the configuration of the Activity component's layout (Layout), menus such as the Sliding Menu initialization, the underlying information bar initialization, and the Action bar initialization, etc. .

B, initialize the playback engine

The main task of the playback engine is to encapsulate the media resources, that is, the related functions of the video stream playback, and compile them into a dynamic link library to implement functions such as demultiplexing, decoding, and outputting the media resources. The playback engine also provides control interfaces such as play, pause, fast forward, and fast rewind, providing playback information such as decoding delay, audio and video format, resolution, screen scanning mode, code rate, and frame rate, and encapsulating media resource playback functions. Sex and reusability. Therefore, at this time, it is mainly to set parameters related to the above tasks of the playback engine. A decoder, a video decoder, refers to a program that can compress or decompress digital video. Initialization here refers to configuring the relevant parameters of the decoder. D, initialize the cache module

Cache module, refers to the cache file downloaded by the memory i, generally. applied to the cache

^Buy. A scene with a fast speed requirement. In the embodiment of the present application, the RTSP video stream uses a memory buffering module in the fragment cache module to create and initialize the cache module.

(3) According to the link address, the video stream is obtained from the media server through the initialized video player.

For example, the type of the video stream can be determined according to the link address, and the number (i.e., initialization of the transmission) is configured according to the type, so that the media server allocates the video stream resource according to the transmission parameter, and starts the RTSP session. The video stream is then retrieved from the media server based on the video stream resource and the RTSP session.

The transport protocol type may include a Transmission Control Protocol (TCP) and a User Datagram Protocol (UDP).

For example, taking the video stream as an RTSP video stream as an example, if the link address of the video stream starts with "rtsp", it can be determined that the transmission protocol type of the video stream is TCP, therefore, the transmission can be configured according to the 'TCP protocol. parameter. For example,

The TCP protocol transmits control information, and which network protocol the transport layer should use. If the link address of the video stream does not start with "rtsp", it can be determined that the transport protocol type of the video stream is UDP, then the UDP protocol can be used to configure the transmission parameters. For example, during transmission, the control layer can use the UDP protocol to transmit control information and which network protocol the transport layer should use.

After the transmission parameters are configured and the transmission is initialized, the media server can allocate video stream resources according to the transmission parameters, and start an RTSP session, thereby starting data transmission of the video stream. [For example, the terminal can be based on the video stream resources and RTSP session, to media service The server sends a download request for the video stream, and then receives the video stream returned by the media server.

After the terminal downloads the video stream, the video stream can be cached in the memory by the cache module for calling by the playback engine and the decoder, and played.

103. When it is determined that the acquisition of the video stream is abnormal, determine whether the number of attempts to obtain the video stream is lower than a preset value. If the number of attempts is lower than the preset value, returning to the step of acquiring the video stream from the media server, for example, returning to the step of acquiring the video stream from the media server through the initialized video player according to the link address. Otherwise, if the number of attempts is not lower than the preset value, step 104 is performed.

For example, it can be judged by two levels whether the "number of attempts to obtain a video stream" is at a preset value, as follows:

Determining whether the number of attempts of the transport layer network protocol is lower than a preset first threshold;

If the number of attempts is lower than the first threshold, returning to perform the step of acquiring a video stream from the media server based on the video stream resource and the RTSP session (see description in step 102);

If the number of attempts is not lower than the first alarm value, it is determined whether the number of attempts of the RTSP session is lower than a preset second threshold. If the number of attempts is below the second threshold, the video stream resource is placed and the RTSP session is stopped, and the step of configuring the transmission parameters according to the type of the transmission protocol is performed (see the description in step 102). If the number of attempts is not lower than the second threshold, step 104 is performed.

The preset value, the first threshold, and the second threshold may be set according to actual application requirements. For example, the first threshold and the second threshold may be set to 3 times, or other values.

An abnormality in the acquisition of the video stream refers to a situation in which the video stream cannot be downloaded normally due to unstable network or unstable media server or other reasons.

104. Perform error reporting when determining that the number of attempts to obtain the video stream is not lower than a preset value. For example, the video stream resource can be placed, and the RTSP session can be stopped, and an error message is displayed. Optionally, after the error processing is performed, in order to save resources, the corresponding space may be released, for example, the cache module is released.

In addition, if there is no abnormality in the video stream, the video stream can continue to be downloaded until the user exits the video player. After exiting the video player, the cache module, as well as the decoder, etc., can also be released to free up resources.

It can be seen that, after receiving the video play request carrying the video stream identifier, the embodiment obtains the video stream from the media server according to the video stream identifier, and determines the number of attempts to obtain the video stream when determining that the video stream is abnormally acquired. Whether it is lower than the preset value. If yes, the step of obtaining the video stream from the media server is returned, otherwise, if the value is not lower than the preset value, the error processing is performed. When the video stream is abnormal, the solution can provide corresponding abnormal operation, so as to ensure that the video can continue to play. Therefore, compared with the prior art, in the case of an error directly reporting an error, it is possible to improve the stability and fluency of playing a video, such as KTSP video, and greatly improve the user experience.

In some embodiments, the processing device of the video stream is specifically integrated in the terminal, and the video stream is specifically an RTSP video stream as an example.

As shown in FIG. 2, a method for processing a video stream may include the following steps.

201. The terminal receives a video play request triggered by a user.

For example, the terminal can receive a video play request triggered by the user clicking on a video play button or a video link address, and the like.

The video play request may carry information such as an RTSP video stream identifier, where the video stream identifier is used to identify the video stream. For example, the video stream identifier may be a name, a number, or a link address of the video stream.

202. The terminal determines, according to the RTSP video stream identifier, a link address of the RTSP video stream. Wherein the link address indicating the storage location of the RTSP video stream media server, t ^ dagger port ^{-5 Γ} be a uniform resource ^ stand. Fu (URL, Uniform Resource Locator) and the like. 203. The terminal creates a video player according to the link address, and initializes the player interface, the play engine, the decoder, and the cache ^fi block respectively, as follows:

(1) Initializing the player interface;

Create a player interface, including the configuration of the Activity component's Layout, menus such as the initial 4 of the SlidingMenu, the initial 4 of the bottom bar, and the initial 4 of the Aetionbar.

(2) Initializing the playback engine;

The main task of the playback engine is to encapsulate the media resources, that is, the related functions of the RTSP video stream playback, and compile them into a dynamic link library to implement functions such as demultiplexing, decoding, and output playback of media resources. The playback engine also provides control interfaces such as play, pause, fast forward, and fast rewind, providing playback information such as decoding delay, audio and video format, resolution, screen scanning mode, code rate, and frame rate, and encapsulating media resource playback functions. Sex and reusability. Therefore, at this time, it is mainly to set parameters related to the above tasks of the playback engine. For example, the video playback engine can be initialized by reading part of the video stream information from the video memory cache of the cache module.

(3) initializing the decoder;

A decoder, a video decoder, refers to a program that can compress or decompress digital video. Initialization here refers to configuring the relevant parameters of the decoder. For example, part of the video stream information can be read from the video memory buffer of the cache module to initialize the decoder.

(4) initializing the cache module;

Cache module, which refers to storing the downloaded cache file in memory. Generally, it is applied to scenes with less cache length, freed after use, and fast reading speed. In the embodiment of the present application, the RTSP video stream is downloaded from the network in the form of a video clip and managed by means of a memory buffer.

204. The terminal determines a link i of the RTSP video stream, such as whether the URL is "rtsp" At the beginning, if yes, the transmission parameters are configured according to the TCP protocol. If not, the UDP protocol is used to configure the transmission parameters, which can be as follows:

The terminal determines whether the link address of the RTSP video stream starts with "rtsp". If yes, it can be determined that the transport protocol type of the RTSP video stream is TCP. Therefore, the transmission parameters can be configured according to the TCP protocol. For example, during transmission, the control layer can use the TCP protocol to transmit control information, and use the specified port number, and transmit control information with the media server through the control layer to negotiate the transport layer (for the player and server to transfer control streaming media) Data) Which network protocol (such as UDP, RDP or TCP) is used. If the link address of the RTSP video stream does not start with "rtsp", it can be determined that the transport protocol type of the video stream is UDP. Then, the UDP protocol can be used to configure the transmission parameters. For example, during transmission, the control layer can use the UDP protocol to transmit control information, and use the specified port number, and transmit control information with the media server through the control layer to negotiate the transport layer (for the player and server to transfer control streaming media). Data) Which network protocol is used.

It should be noted that if the port number is empty or not specified, port 554 can be used. Among them, the negotiation with the media server which network protocol is used by the transport layer may also be referred to as the transmission initial.

205. The media server allocates a video stream resource according to the transmission parameter, and starts an RTSP session, thereby starting a digital transmission of the RTSP video stream.

206. The terminal acquires an RTSP video stream from the media server based on the video stream resource and the RTSP session, for example, downloading an RTSP video stream.

For example, the terminal may send a download request of the RTSP video stream to the media server based on the video stream resource and the RTSP session, and then receive the RTSP video stream returned by the media server.

For example, the transport layer network association (such as UDP, RDP, or TCP, etc.) determined in step 204 may be used to download the TSP video stream from the media server, and the downloaded TSP video stream is stored in the memory for video playback. Called by engine and decoder, etc. Put it.

Among them, the maximum number of RTSP video streams to be cached is determined by the video player in the terminal and the media server.

207. The terminal plays the RTSP video stream through the video player.

The video player's playback engine driver plays the RTSP video stream segment. For example, the RTSP video stream data can be read from the cache module's memory buffer, and the decoder can be used to decode, render, output the picture and sound. The played memory cache will be released immediately, and then the cache will continue to cache the RTSP video stream data.

The playback engine needs to communicate with the cache module to coordinate the work, so as to ensure that the video player always plays the RTSP video stream normally.

208. The terminal determines whether an abnormality occurs in the acquisition of the RTSP video stream. If an abnormality occurs, step 209 is performed. If no abnormality occurs, step 212 is performed.

The abnormality in the acquisition of the RTSP video stream refers to the fact that the RTSP video stream cannot be downloaded normally due to unstable network or unstable media server or other reasons.

209. When the terminal determines that the acquisition of the RTSP video stream is abnormal, determine whether the number of attempts of the transport layer network protocol is lower than a preset first threshold. If the number of attempts is lower than the first threshold, the original transport layer network protocol is used to attempt to re-download the RTSP video stream, and the process returns to step 206. If the number of attempts is not lower than the first threshold, it means that the number of consecutive attempts (first threshold) has not been successfully downloaded, therefore, step 210 is performed.

The first threshold may be set according to the requirements of the actual application, for example, may be set to 3 times, or other values.

210. The terminal determines whether the number of attempts of the RTSP session is lower than a preset second threshold. If the number of attempts is lower than the second threshold, the KTSP video stream resource is forwarded, and the RTSP session is stopped, and the transmission parameter is attempted to be re-downloaded to re-download the video stream, that is, the return is performed. The step of configuring the transmission parameters in step 204 is performed. If the number of attempts is not lower than the second threshold, it means that the consecutive attempts (second threshold) have not been successfully downloaded, and then step 211 is performed.

The second threshold may be set according to the requirements of the actual application, for example, may be set to 3 times, or other values.

211. The terminal processes the error, for example, releasing the video stream resource, stopping the RTSP session, and prompting to play an error message.

Optionally, after the error processing is performed, in order to save resources, the corresponding space may be released, for example, the cache module is released, and the process ends.

212. If the RTSP video stream is not abnormal, the terminal determines whether the user exits the video player. If the user exits the video player, the cache module, the decoder, and the like are released, and the process is terminated by putting resources and the like. If the user has not exited the video player, then the next video stream is downloaded, and the process returns to step 206.

As can be seen from the above, after receiving the video play request carrying the RTSP video stream identifier, the embodiment obtains the RTSP video stream from the media server according to the RTSP video stream identifier, and determines the acquisition of the RTSP frequency stream. And determining whether the number of attempts of the transport layer network protocol is lower than a first threshold. When the number of attempts is not lower than the first threshold, it is further determined whether the number of attempts of the RTSP session is lower than a preset second threshold, thereby determining whether to perform a corresponding abnormal attempt operation, and after performing the corresponding abnormal attempt operation, Perform error handling. When the video stream is abnormal, the scheme can provide corresponding abnormal attempt operation to ensure that the video can continue to play. Therefore, compared with the prior art, in the case of an error directly reporting an error, the stability and fluency of the RTSP video can be improved, and the user experience is greatly improved.

In order to better implement the above method, the embodiment of the present application further provides a video stream processing apparatus. As shown in FIG. 3, the video stream processing apparatus may include a receiving unit 301, an obtaining unit 302, and a processing unit 303. The receiving unit 301 can receive a video play request.

For example, the receiving unit 301 can be configured to receive a video play request triggered by the user by clicking a video play button or a video link address, and the like.

The video play request may carry information such as a video stream identifier, where the video stream identifier is used to identify a video stream. For example, the video stream identifier may be a name, a number, or a link address of the video stream.

The obtaining unit 302 can acquire a video stream from the media server according to the video stream identifier. The processing unit 303 may determine whether the number of attempts to obtain the video stream is lower than a preset value when the acquisition of the video stream is abnormal; if yes, the trigger acquiring unit 302 performs an operation of acquiring the video stream from the media server; if not, the error is reported. deal with.

For example, the processing unit 303 can determine whether the number of attempts of the transport layer network is lower than a preset first threshold;

If it is lower than the first threshold, returning to the trigger acquisition subunit to perform an operation of acquiring a video stream from the media server based on the video stream resource and the TSP session;

If the threshold is not lower than the first threshold, determine whether the number of attempts of the RTSP session is lower than a preset second threshold. If the threshold is lower than the second threshold, release the video stream resource, stop the RTSP session, and trigger the acquiring sub-unit to execute. The operation of configuring the transmission parameter according to the type of the transmission protocol; if not lower than the second threshold, the error processing is performed.

There may be multiple ways of error processing, for example, the video stream resource may be released, and the RTSP session is stopped, and an error message is prompted.

For example, the processing unit 303 may release the video stream resource, stop the RTSP session, and prompt the playback error message when determining that the number of attempts of the RTSP session is not lower than the preset second threshold.

Among them, the abnormality of the video stream refers to the instability of the network or the instability of the media server. For some reason, or for other reasons, the video stream cannot be downloaded normally.

In some cases, after the error processing, in order to save resources, the corresponding space can be released, for example, the release module is released.

In addition, if no abnormality occurs in the acquisition of the video stream, the obtaining unit 302 may continue to

5 Load the video stream until the user exits the video player. After exiting the video player, the cache module, decoder, etc. can also be released to free up resources.

The obtaining unit 302 may include a determining subunit, a creating subunit, and an obtaining subunit, as follows:

The determining subunit is configured to determine a link address of the video stream according to the video stream identifier. t o Create a subunit to create a video player based on the link address and initialize the video player.

For example, after the video player is created according to the link address, the creation subunit can initialize the player interface, the playback engine, the decoder, the cache module, and the like, respectively. For details, refer to the previous embodiment, which is not mentioned here.

15 Acquire a subunit for obtaining a video stream from the media server through the initialized video player according to the link address.

For example, the obtaining sub-unit may be specifically configured to determine a transmission protocol type of the video stream according to the link address, configure a transmission parameter according to the transmission protocol type, so that the media server allocates video stream resources according to the transmission parameter, and starts RTSP. Session, then, based on 0 the video stream resource and the RTSP session get the video stream from the media server.

Then, the processing unit 303 can determine the 视频 of the video stream. When an abnormality occurs, it is determined whether the number of attempts to acquire the frequency stream is lower than a preset value; if yes, the triggering acquisition sub-unit performs initialization according to the link address. After the video player obtains the video stream from the media server, if not, the error processing is performed.

5 where the transport protocol type may include a transmission control protocol (TCP , Transmission Control Protocol) and User Data Protocol (UDP, User Datagram Protocol). For example, if the video stream is an RTSP video stream, if the link address of the video stream starts with "rtsp", the obtaining sub-unit can determine that the transmission protocol type of the video stream is TCP, and therefore, can be configured according to the TCP protocol. Transfer parameters. For example, during transmission, the control layer can use the TCP protocol to transmit control information, and which network protocol the transport layer should use. If the link address of the video stream does not start with "rtsp", the obtaining subunit can determine that the transport protocol type of the video stream is UDP, then the UDP protocol can be used to configure the transmission parameters. For example, during transmission, the control layer can use the UDP protocol to transmit control information, and which network protocol the transport layer should use, and so on.

After the transmission parameters are configured, the media server can allocate video stream resources according to the transmission parameters, and start an RTSP session, thereby starting data transmission of the video stream. For example, the acquiring subunit can be based on the video stream resource. And the RTSP session, sending a download request of the video stream to the media server, and then receiving the video acquisition subunit returned by the media server and downloading the video stream to the video stream, the buffer stream may be cached in the memory for the playback engine and The decoder or the like makes a call and plays it.

In the specific implementation, the foregoing units may be implemented as a separate entity, and may be implemented in any combination, and may be implemented as the same entity or a plurality of entities. For the specific implementation of the foregoing, refer to the foregoing method embodiments, and details are not described herein.

The processing device of the video stream may be specifically integrated in a device such as a terminal. The terminal can be specifically a device such as a mobile phone, a tablet or a laptop.

It can be seen that, after receiving the video play request carrying the video stream identifier, the processing unit of the video stream of the embodiment may obtain the video stream from the media server according to the video stream identifier by the obtaining unit 301, and the processing unit 303 determines When the acquisition of the video stream is abnormal, it is determined whether the number of attempts to obtain the video stream is lower than a preset value, and if so, the acquisition unit 302 is triggered. Perform the operation of obtaining the video stream from the media server. Otherwise, if the error is not lower than the preset value, the error processing is performed. Because the solution is abnormal when the video stream is abnormal, the corresponding abnormal attempt operation can be provided to ensure that the video can continue to play. Going down, therefore, compared with the prior art, in the case of an error directly reporting an error, it can provide improved stability and fluency when playing video, such as RTSP video, and greatly improve the user experience.

Correspondingly, the embodiment of the present application further provides a processing system for a video stream, which may include a processing device for a video stream in each embodiment of the present application. The processing device of the video stream can be integrated in a device such as a terminal.

The video stream processing device may receive a video play request, where the video play request carries a video stream identifier; obtain a video stream from the media server according to the video stream identifier; and determine, when the video stream acquisition is abnormal, determine whether the number of attempts to obtain the video stream is It is lower than the preset value; if yes, it returns to the step of acquiring the video stream from the media server; if not, it enters the error processing.

For example, the processing device of the frequency stream may be configured to: determine a link address of the video stream according to the video stream identifier, create a video player according to the link address, and initialize the video player, according to the link address, The initialized video player obtains a video stream from the media server; determines whether the number of attempts of the transport layer network protocol is lower than a preset first threshold; if lower than the first threshold, returns to perform the media based on the video stream resource and the RTSP session The operation of the server to obtain the video stream; if not lower than the first threshold, determining whether the number of attempts of the RTSP session is lower than a preset second threshold, if the second threshold is lower, releasing the video stream resource, and stopping the RTSP session And returning to perform an operation of configuring a transmission parameter according to the type of the transmission protocol; if not lower than the second threshold, performing an error processing.

The first threshold and the second threshold may be set according to the requirements of the actual application. For example, the first threshold and the second threshold may be set to 3 times, and details are not described herein again.

In addition, the processing system of the video stream may further include other devices, for example, a media server. The media server can provide a video stream to the processing device of the video stream.

For the specific implementation of the above, refer to the foregoing embodiments, and details are not described herein again. The processing system of the video stream may include any processing device of the video stream provided by the embodiment of the present application. Therefore, the processing device of any video stream proposed by the embodiment of the present application may be implemented. For the effect, please refer to the previous embodiment, and details are not described herein again.

The embodiment of the present application further provides a processing device for a video stream. FIG. 4 is a schematic diagram of a video stream processing apparatus according to an embodiment of the present application. As shown in FIG. 4, the apparatus can include a processor 41, a communication interface 44, a storage device 46, and a bus 49. The storage device 46 includes a production system 47, a communication module 48, and a stream processing module 43.

The processor 41 may have one or more, may be in the same physical device, or be distributed among multiple physical devices.

The device can receive the video stream sent by the media server over a certain network using the communication interface 44.

The stream processing module 43 may include a receiving unit 431, an ear unit 432, and a processing unit 433.

The receiving unit 431 can receive a video play request.

The obtaining unit 432 can acquire the video stream from the media server according to the video stream identifier. The processing unit 433 may determine, when the acquisition of the video stream is abnormal, whether the number of attempts to acquire the video stream is lower than a preset value; if yes, the trigger obtaining unit 432 performs an operation of acquiring the video stream from the media server; if not, proceeding Error handling.

The functions of the receiving unit 431, the obtaining unit 432, and the processing unit 433 are similar to the receiving unit 301, the obtaining unit 302, and the processing unit 303, and are not described herein again.

It should be noted that not all the steps and modules in the foregoing processes and the various structural diagrams are necessary, and some steps or modules may be omitted according to actual needs. The order of execution of each step is not fixed and can be adjusted as needed. The division of each module is only for the convenience Describe the functional division of the application. In actual implementation, a module can be implemented by multiple modules. The functions of multiple modules can also be implemented by the same module. These modules can be located in the same device or in different In the device. In addition, the use of "first," and "second" in the above description merely for the convenience of distinguishing two objects having the same meaning does not mean that there is a substantial difference.

The hardware modules in the embodiments may be implemented in a hardware manner or a hardware platform plus software. The above software includes machine readable instructions stored in a volatile storage medium. Therefore, each embodiment can also be embodied as a soft product.

In each case, the hardware may be implemented by specialized hardware or hardware that executes machine readable instructions. For example, the hardware can be specially designed for permanent circuits or logic devices (such as dedicated processors such as FPGAs or ASICs) for performing specific operations. The hardware may also include programmable logic devices or circuits (such as including general purpose processors or other programmable processors) that are temporarily configured by software for performing particular operations.

The machine readable instructions corresponding to the modules in the figures may be implemented by a system or the like operating on a computer to perform some or all of the operations described herein. The non-transitory computer readable storage medium may be inserted into a memory provided in an expansion board within the computer or written to a memory provided in an expansion unit connected to the computer. The CPU or the like installed on the expansion board or expansion unit can perform some and all of the actual operations according to the instructions.

Non-transitory computer readable storage media include floppy disks, hard disks, magneto-optical disks, optical disks (eg, CD-ROM, CD-, CD-RW, DVD-ROM > DVD-RAM, DVD-RW, DVD+RW), magnetic tape, Non-volatile memory card and ROM. Alternatively, the program code can be downloaded from the server computer by the communication network.

In summary, the scope of the claims should not be limited to the embodiments in the examples described above, but the description should be taken as a whole and given the broadest explanation.

Claims

A method for processing a video stream, comprising:

When it is determined that the acquisition of the video stream is abnormal, it is determined whether the number of attempts to obtain the video stream is lower than a preset value;

If yes, returning to the step of obtaining a video stream from the media server;

If not, an error handling process is performed.

The method according to claim 1, wherein the acquiring the video stream from the media server according to the video stream identifier comprises:

Determining a link address of the video stream according to the video stream identifier;

Creating a video player according to the link address, and initializing the video broadcaster;

Obtaining a video stream from the media server by the initialized video player according to the link address;

The step of returning to obtain a video stream from the media server is specifically: returning to the step of acquiring a video stream from the media server by the initialized video player according to the link address.

3. The method according to claim 2, wherein the initializing the frequency player comprises:

The player interface, the playback engine, the decoder, and the cache module are initialized separately.

The method according to claim 2, wherein the obtaining, by the initialized video player, the video stream from the media server according to the link address comprises: determining the video according to the link address The type of transport protocol for the stream; And configuring a transmission parameter according to the transmission protocol type, so that the media server allocates a video stream resource according to the transmission parameter, and starts a real-time streaming protocol RTSP session; and acquires a video stream from the media server based on the video stream resource and the RTSP session.

The method according to claim 4, wherein the determining whether the number of attempts to acquire the video stream is lower than a preset value, and if yes, returning to the step of acquiring a video stream from the media server; if not, proceeding Wrong handling, including:

If it is lower than the first threshold, returning to perform the step of acquiring a video stream from the media server based on the video stream resource and the RTSP session;

If the value is not lower than the first threshold, it is determined whether the number of attempts of the RTSP session is lower than a preset second threshold. If the second threshold is lower, the video stream resource is released, and the RTSP session is stopped, and the execution is returned. And the step of configuring the transmission parameter according to the type of the transmission protocol; if not lower than the second threshold, performing an error processing.

The method according to claim 5, wherein the performing error processing includes:

The video stream resource is released, and the RTSP session is stopped, and an error message is prompted to be played.

A device for processing a video stream, comprising:

a receiving unit, configured to receive a video play request, where the video play_request carries a video stream identifier;

An obtaining unit, configured to: acquire a video stream from the media server according to the video stream identifier; and use, by the processing unit, to determine whether the number of attempts to acquire the 3⁄4 stream is lower than a preset value when the video stream is abnormally obtained by the $1; Then, the trigger acquisition unit performs an operation of acquiring a video stream from the media server; if not, the error processing is performed.

8. The apparatus according to claim 7, wherein the obtaining unit comprises a stator unit, a creation subunit, and an acquisition subunit;

Determining a subunit, configured to determine a link address of the video stream according to the video stream identifier; creating a subunit, configured to create a video player based on the link address, and initializing the video player;

Obtaining a subunit, configured to acquire a video stream from the media server by using the initialized video player according to the link address;

The processing unit is specifically configured to determine whether the number of attempts to obtain the video stream is lower than a preset value when the acquisition of the video stream is abnormal; if yes, trigger the acquiring sub-unit to execute the initialized video according to the link address. The player obtains the video stream from the media server, and if not, performs error processing.

9. Apparatus according to claim 8 wherein:

The creating subunit is specifically configured to create a video player according to the link address, and initialize the player interface, the playing engine, the decoder, and the buffer module respectively.

The device according to claim 8, wherein the acquiring subunit is specifically configured to:

Determining a transmission protocol type of the video stream according to the link address;

Configuring a transmission parameter according to the transmission protocol type, so that the media server allocates a video stream resource according to the transmission parameter, and starts a real-time streaming protocol RTSP session; acquiring a video stream from the media server based on the video stream resource and the RTSP session .

11. The apparatus according to claim 10, wherein the processing unit is specifically configured to:

If it is lower than the first idle value, returning to the trigger acquisition subunit to perform an operation of acquiring a video stream from the media server based on the video stream resource and the RTSP session;

If not lower than the first threshold, determine whether the number of attempts of the RTSP session is lower than a preset number a second threshold, if the second threshold is lower, releasing the video stream resource, and stopping the RTSP session, and triggering the acquiring subunit to perform an operation of configuring a transmission parameter according to the transport protocol type; If the threshold is two, the error processing is performed.

12. The method of claim 11 wherein:

The processing unit is specifically configured to: when determining that the number of attempts of the KTSP session is not lower than a preset second threshold, release the video stream resource, stop the RTSP session, and prompt to play the error information.

A processing system for a video stream, comprising: a media server and a processing device for the video stream according to any one of claims 7 to 12;