WO2018133601A1

WO2018133601A1 - Streaming media transmission method and apparatus, server, and terminal

Info

Publication number: WO2018133601A1
Application number: PCT/CN2017/116604
Authority: WO
Inventors: 陈光亮; 陈颖川
Original assignee: 中兴通讯股份有限公司
Priority date: 2017-01-20
Filing date: 2017-12-15
Publication date: 2018-07-26
Also published as: CN106657143A

Abstract

Disclosed are a streaming media transmission method and apparatus, a terminal, a server, and a storage medium. The method comprises: receiving a streaming media playing request sent by a client; sending streaming media data with a first code rate to the client in response to the streaming media playing request; when it is determined that code rate switching should be performed using a first parameter and a second parameter of the client during the process of playing the streaming media data with the first code rate, determining a second data unit corresponding to the streaming media data with a second code rate using a first data unit of the streaming media data with the first code rate; the first parameter characterizing a current network bandwidth of the client; the second parameter characterizing a current decoding capability of the client; the first data unit being a data unit that is currently being played by the client; the streaming media data with different code rates consisting of data of at least two data units; and after the first data unit completes sending, sending, starting from the second data unit, the streaming media data with the second code rate to the client.

Description

Stream media transmission method, device, server and terminal

Cross-reference to related applications

The present application is based on a Chinese patent application filed on Jan. 20, 2017, the entire disclosure of which is hereby incorporated by reference.

Technical field

The present application relates to multimedia technologies, and in particular, to a streaming media transmission method, apparatus, server, terminal, and storage medium.

Background technique

With the development of communication technology, the application of multimedia technology is becoming wider and wider. In the live broadcast process of multimedia data, the segmentation program is generally used for downloading. A segmented program refers to segmenting a program at the time of program production to generate a plurality of segmented programs and playlists. For the segmented program, the client uses the Hypertext Transfer Protocol (HLS, HTTP Live Streaming) protocol to first obtain the playlist, that is, the main M3U8, and then parse the main M3U8 to obtain the uniform resource locator (URL, Uniform) of the sub-M3U8. Resource Locator), then obtain the sub-M3U8 according to the URL of the sub-M3U8, and finally the parsing sub-M3U8 obtains the URL of the segmentation program, and sequentially acquires the segmentation program playback according to the URL of the segmentation program, which is compatible with the existing content distribution network ( CDN, Content Delivery NetWorks) system.

For the segmented program, when the playback is started, the client first downloads the segment file of the lower bit rate from the server, and then starts the playback. After downloading the segment file with the lower bit rate, if the network bandwidth is detected to be relatively high, Start downloading segment files with higher bitrates. In the process of downloading a segment file, if the network bandwidth changes, the client only waits for this segment file to be downloaded. After completion, request and download the segment file with the appropriate code rate according to the network bandwidth. This method of live bit rate switching lags behind the change of the client network bandwidth, thereby increasing the end-to-end delay.

Summary of the invention

To solve the existing technical problems, the embodiments of the present application provide a streaming media transmission method, device, server, terminal, and storage medium.

The technical solution of the embodiment of the present application is implemented as follows:

The embodiment of the present application provides a streaming media transmission method, including:

Receiving a streaming media play request sent by the client;

Responding to the streaming media play request, sending the streaming media data of the first code rate to the client;

In the process of playing the streaming media data of the first code rate, determining, by using the first parameter and the second parameter of the client, that the code rate switching is performed, determining, by using the first data unit of the streaming media data of the first code rate. a second data unit corresponding to the second bit rate of the streaming media data; the first parameter characterizing a current network bandwidth of the client; the second parameter characterizing a current decoding capability of the client; the first data unit is The data unit currently being played by the client; the streaming media data of different code rates is composed of data of at least two data units;

After the sending of the first data unit is completed, starting from the second data unit, the streaming media data of the second code rate is sent to the client.

In the foregoing solution, before the sending the streaming media data of the first bit rate to the client, the method further includes:

Adding a third parameter to the streaming media data for the streaming media data of each code rate; the third parameter characterizing the media data decoding information;

Correspondingly, before the sending, by the second data unit, the streaming media data of the second code rate to the client, the method further includes:

Obtaining a corresponding third parameter from the streaming media data of the second code rate;

Sending a third parameter to the client; sending the third parameter to indicate the client pair The decoder makes adjustments.

In the foregoing solution, the adding the third parameter to the streaming media data includes:

Adding a third parameter to each data unit;

Correspondingly, a corresponding third parameter is obtained from the second data unit.

In the above solution, the adding the third parameter in each data unit includes:

Add a third parameter at the beginning of each data unit;

Correspondingly, a corresponding third parameter is obtained from a starting position of the second data unit.

In the above solution, the method further includes:

The first parameter and the second parameter of the client are obtained during the process of playing the streaming media data of the first code rate.

In the foregoing solution, when determining the rate switching by using the first parameter and the second parameter of the client, the method further includes:

Using the first parameter and the second parameter of the client, and combining the fourth parameter of the server, determining to perform rate switching; the fourth parameter characterizing the current streaming media processing capability of the server.

When generating streaming media data of different code rates, the data units of the streaming media data of each code rate are aligned in time;

Correspondingly, the determining, by the first data unit of the streaming media data of the first code rate, the second data unit corresponding to the streaming media data of the second code rate comprises:

Determining a time corresponding to the first data unit from the streaming media data of the first code rate;

The second data unit is derived from the streaming media data of the second code rate using the determined time.

In the above solution, sending the streaming media data of the second bit rate to the client includes:

The second bit rate of streaming media data encapsulated in one of the following manners is transmitted by means of Hypertext Transfer Protocol (HTTP) Chunk:

Based on MPEGTS package;

Based on MPEGTS encapsulation and then based on Real Time Transport Protocol (RTP) encapsulation;

Based on MP4 package;

FLV-based label (Flag) package.

The embodiment of the present application further provides a streaming media transmission method, including:

Sending a streaming media play request to the server, and receiving streaming media data of the first code rate sent by the server;

Receiving streaming media data of the second code stream sent by the server in the process of playing the streaming media data of the first code rate; receiving the second code rate of the streaming media data is starting from the second data unit of the second code stream of;

The streamed data of the second code stream is decoded by the reset decoder and played.

The embodiment of the present application further provides a streaming media transmission device, including:

The first receiving unit is configured to receive a streaming media play request sent by the client;

The first sending unit is configured to send the streaming media data of the first code rate to the client in response to the streaming media play request;

The switching unit is configured to: when playing the streaming media data of the first code rate, determine, by using the first parameter and the second parameter of the client, to use the streaming media data of the first code rate when performing rate switching Determining, by the first data unit, a second data unit corresponding to the streaming media data of the second code rate; the first parameter characterizing a current network bandwidth of the client; and the second parameter characterizing a current decoding capability of the client; The first data unit is a data unit currently being played by the client; the streaming media data of different code rates is composed of data of at least two data units;

The first sending unit is further configured to: after the sending of the first data unit is completed, start sending, by the second data unit, streaming media data of a second code rate to the client.

In the above solution, the device further includes:

a generating unit configured to add streaming media data for each bit rate a third parameter; the third parameter characterizing media data decoding information;

The switching unit is further configured to obtain a corresponding third parameter from the streaming media data of the second code rate;

The first sending unit is further configured to: before starting, sending, by the second data unit, a third parameter to the client before sending the second bit rate of streaming media data to the client; sending the third parameter It is used to instruct the client to adjust the decoder.

In the above solution, the device further includes:

The acquiring unit is configured to acquire the first parameter and the second parameter of the client during the process of playing the streaming media data of the first code rate.

In the above solution, the switching unit is configured to use the first parameter and the second parameter of the client, and combine with the fourth parameter of the server to determine to perform code rate switching; the fourth parameter represents the current flow of the server. Media processing capabilities.

In the above solution, the device further includes:

Generating unit configured to generate data units of streaming media data of each code rate in time when generating streaming media data of different code rates;

The switching unit is specifically configured as follows:

The embodiment of the present application further provides a streaming media transmission apparatus, including:

a second sending unit, configured to send a streaming media play request to the server;

The second receiving unit is configured to receive the streaming media data of the first code rate sent by the server; and receive the streaming media data of the second code stream sent by the server during the process of playing the streaming media data of the first code rate Receiving the second code rate of the streaming media data from the second data unit of the second code stream;

The playing unit is configured to decode the streaming media data of the second code stream by using the reset decoder and play the same.

The embodiment of the present application further provides a server, including:

The first communication interface is configured to receive a streaming media play request sent by the client, and send the streaming media data of the first code rate to the client in response to the streaming media play request; and after the sending of the first data unit is completed, The second data unit starts to send streaming media data of a second code rate to the client;

The first processor is configured to use the first parameter and the second parameter of the client to determine the streaming media using the first code rate when the code rate is performed in the process of playing the streaming media data of the first bit rate. Determining, by the first data unit of the data, a second data unit corresponding to the streaming media data of the second code rate; the first parameter characterizing a current network bandwidth of the client; the second parameter characterizing a current decoding of the client Capability; the first data unit is a data unit currently being played by the client; and the streaming media data of different code rates is composed of data of at least two data units.

In the above solution, the first processor is further configured to: in response to the streaming media play request, send streaming media data of the first code rate to the client before the streaming media data for each code rate, in the streaming media data. Adding a third parameter; the third parameter characterizing the media data decoding information; and acquiring a corresponding third parameter from the streaming media data of the second code rate;

Correspondingly, the first communication interface is further configured to send, after the second data unit, the third parameter to the client before sending the second bit rate of the streaming media data to the client; The third parameter is used to instruct the client to adjust the decoder.

In the above solution, the first processor is further configured to: in response to the streaming media play request, generate streaming media data of different code rates before transmitting the streaming media data of the first bit rate to the client, each code is generated. The data units of the streaming media data are aligned in time;

The first processor is specifically configured to:

The embodiment of the present application further provides a terminal, including:

a second communication interface, configured to send a streaming media play request to the server, and receive the streaming media data of the first code rate sent by the server; and receive the sending by the server during the process of playing the streaming media data of the first code rate Streaming media data of the second code stream; the received stream media data of the second code rate is started from the second data unit of the second code stream;

The second processor is configured to decode the streaming media data of the second code stream by using the reset decoder and play the same.

The embodiment of the present application further provides a computer storage medium, where the computer-executable instructions are stored, and the computer-executable instructions are used to execute the streaming media transmission method according to the embodiment of the present application.

The streaming media transmission method, device, server and terminal provided by the embodiment of the present application receive a streaming media play request sent by the client, and send the streaming media data of the first bit rate to the client in response to the streaming media play request; In the process of streaming media data of the first code rate, when determining the code rate switching by using the first parameter and the second parameter of the client, determining, by using the first data unit of the streaming media data of the first code rate, a second data unit corresponding to the coded streaming media data; the first parameter characterizing a current network bandwidth of the client; the second parameter characterizing a current decoding capability of the client; the first data unit is the a data unit currently being played by the client; the streaming media data of different code rates is composed of data of at least two data units; after the sending of the first data unit is completed, starting from the second data unit, to the client Transmitting the streaming media data of the second bit rate, and determining, by the server, the code rate switching according to the first parameter and the second parameter of the client, so that According to the decoding capability of the network bandwidth and client timely switching rate, reducing-end delay. Moreover, the streaming media data is only divided into different data units, so that the server side is not required to prepare indexes and segment files, which reduces the buffering time of the streaming media data on the server side, and further reduces the end-to-end delay.

DRAWINGS

In the drawings, which are not necessarily to scale, like reference numerals may Similar parts are described in the view. Like reference numerals with different letter suffixes may indicate different examples of similar components. The drawings generally illustrate the various embodiments discussed herein by way of example and not limitation.

1 is a schematic flowchart of a method for first-class media transmission according to an embodiment of the present application;

2 is a schematic structural diagram of a streaming media transmission system according to Embodiment 2 of the present application;

3 is a schematic structural diagram of another streaming media transmission system according to Embodiment 2 of the present application;

4 is a schematic flowchart of interaction between a server and a client according to Embodiment 2 of the present application;

5 is a schematic diagram of a code stream structure of multiple code streams in the third embodiment of the present application;

6 is a schematic diagram of a code stream structure of multiple code streams in the fourth embodiment of the present application;

7 is a schematic diagram of a code stream structure of multiple code streams in the fifth embodiment of the present application;

8 is a schematic diagram of a code stream structure of multiple code streams in the sixth embodiment of the present application;

9 is a schematic structural diagram of a streaming media transmission apparatus according to Embodiment 7 of the present application;

10 is a schematic structural diagram of another streaming media transmission apparatus according to Embodiment 7 of the present application;

11 is a schematic structural diagram of a server according to an embodiment of the present application;

FIG. 12 is a schematic structural diagram of a terminal according to an embodiment of the present application.

detailed description

The present application will be further described in detail below with reference to the accompanying drawings and embodiments.

During the current live broadcast rate switching method, when detecting that the network bandwidth changes, the client can request and download the segment file with the appropriate code rate according to the network bandwidth only after the current segment file download is completed. The switching mode is lagging behind the change of the bandwidth of the client network, and the real-time performance of the code rate switching is poor. On the other hand, since the file is downloaded in units of segments, the server needs to cache at least one minute according to the request of the client. The segment file can be sent to the client. This also requires the server to consume a certain amount of time to get the segment file. The reason for the client is that the live broadcast is extended and the user experience is poor. In the actual HLS delay measurement test, it was found that even if the playback time is 1 second for a segment file, the clear stream transmission is used. Under the experimental conditions, the end-to-end delay of the measurement is also more than 5 seconds, which greatly affects the user experience.

Based on this, in various embodiments of the present application, a streaming media play request sent by a client is received; in response to the streaming media play request, streaming media data of a first code rate is sent to the client; and the first code rate is played. In the process of streaming media data, when the first parameter and the second parameter of the client are used to determine that the code rate switching is performed, the first data unit of the streaming media data of the first code rate is used to determine the flow of the second code rate. a second data unit corresponding to the media data; the first parameter characterizing a current network bandwidth of the client; the second parameter characterizing a current decoding capability of the client; the first data unit is that the client is currently a data unit that is played; the streaming media data of different code rates is composed of data of at least two data units; after the first data unit is sent, starting from the second data unit, sending the second code to the client Rate of streaming media data.

Embodiment 1

The streaming media transmission method in the embodiment of the present application is applied to a server, specifically a media server. As shown in FIG. 1 , the method includes the following steps:

Step 101: Receive a streaming media play request sent by the client.

Step 102: Send, according to the streaming media play request, streaming media data of a first code rate to a client.

Step 103: In the process of playing the streaming media data of the first code rate, using the first parameter and the second parameter of the client, determining, by using the first parameter and the second parameter of the client, that the streaming media data of the first code rate is used when performing code rate switching The data unit determines a second data unit corresponding to the streaming media data of the second code rate;

Here, the first parameter represents a current network bandwidth of the client; the second parameter represents a current decoding capability of the client.

The actual parameter may be a system resource of the client, including: a CPU, a memory usage, and the like. The second parameter is not limited in the embodiment of the present application, as long as it can reflect the decoding capability of the client.

Here, in actual application, the server acquires the first parameter and the second parameter of the client in the process of playing the streaming media data of the first bit rate, so as to be able to make a decision on whether to perform the code rate switching in time, and reduce the end-to-end time. Delay.

The server can obtain the first parameter and the second parameter in one of the following ways:

The client reports the first parameter and the second parameter of the client to the network side device, and the network side device reports the first parameter and the second parameter of the client to the server;

The server obtains the first parameter by simulating the network state of the client, and obtains the second parameter by simulating the state of the client ticket.

The first data unit is a data unit currently being played by the client; the streaming media data of different code rates is composed of data of at least two data units.

In other words, the streaming media data of different code rates is composed of data of a plurality of data units. In actual application, the number of data units of the streaming media data may be determined according to the specific requirements of the delay.

In this step, when determining the code rate switching by using the first parameter and the second parameter of the client, the server may further determine the first parameter and the second parameter of the client, and determine the fourth parameter of the server. Performing rate switching; the fourth parameter characterizing the current streaming processing capability of the server. In the rate switching decision process, both the network bandwidth and the decoding capability of the client are considered, and the processing capability of the server side is considered, so that the end-to-end delay can be further reduced.

Here, the fourth parameter may be a CPU, a memory usage, or the like. The embodiment of the present application does not limit this, as long as it can reflect the streaming media processing capability of the server.

In actual application, the server uses the first parameter and the second parameter of the client to perform a code rate switching decision, or uses the first parameter and the second parameter of the client, and combines the fourth parameter of the server to perform rate switching. When making a decision, there may be a plurality of decision modes, which are not limited by the embodiment of the present application. For example, when the server utilizes the first parameter of the client When the number and the second parameter are combined with the fourth parameter of the server for the rate switching decision, the CPU usage of the server may be considered first. When the CPU is idle more than 30%, the first parameter and the second parameter are compared. When the network bandwidth of the client is 10M, the CPU is idle more than 90%, and the memory usage is less than 50%, it is decided to perform rate switching, that is, the code rate is switched to a high code rate, such as high definition.

Step 104: After the sending of the first data unit is completed, starting from the second data unit, sending the streaming media data of the second code rate to the client.

In actual application, before performing step 102, the server may further generate streaming media data of different code rates according to the obtained streaming media data, and add a third parameter to the streaming media data for the streaming media data of each code rate. The third parameter characterizing media data decoding information;

Correspondingly, before performing step 104, the method may further include:

Sending a third parameter to the client; the third parameter sent is used to instruct the client to adjust the decoder.

The third parameter is added to the streaming media data. When the server determines to perform the code rate switching, the server can quickly obtain the decoding information of the streaming media data corresponding to the code rate, and notify the client, thereby enabling the client to The decoder resets the decoder as soon as possible, thereby reducing the playback delay.

Here, the adding the third parameter to the streaming media data includes:

Adding a third parameter to each data unit;

Wherein, since the third parameter is added in each data unit, the third parameter can be directly obtained from the second data unit as long as the server determines the second data unit, and there is no need to go to another location to obtain the third parameter. In this way, the third parameter corresponding to the streaming media data of the second code rate can be quickly obtained.

In an embodiment, a third parameter may be added at the beginning of each data unit; And the server acquires a corresponding third parameter from a starting position of the second data unit.

Here, the third parameter is added at the beginning of the data unit, and thus, the third parameter corresponding to the streaming media data of the second code rate can be further quickly obtained.

In an embodiment, when the server generates streaming media data of different code rates according to the obtained streaming media data, the data units of the streaming media data of each code rate may be aligned in time;

Correspondingly, the determining, by the first data unit of the streaming media data of the first code rate, the second data unit corresponding to the streaming media data of the second code rate, specifically includes:

The data units of the streaming media data for each code rate are aligned in time such that the server can quickly obtain the second data unit based on the first data unit.

In actual application, when sending the streaming media data of the second bit rate to the client, the server may send the streaming media data of the second bit rate based on the MPEGTS encapsulation by using HTTP Chunk, and may also send the method by using HTTP Chunk. Firstly, based on the MPEGTS encapsulation and then based on the RTP-encapsulated second-rate streaming media data, HTTP Chunk may also be used to transmit the streaming media data of the second bit rate based on the MP4 encapsulation, and may also be sent based on the FLV by HTTP Chunk. The Flag encapsulates the second bit rate of streaming media data to meet the transmission needs.

It can be seen from the above description that the solution provided by the embodiment of the present application is a solution for transmitting streaming media data to a client based on a streaming media playback request, and is a transmission scheme of streaming media data based on HTTP.

Correspondingly, the embodiment of the present application further provides a streaming media transmission method, which is applied to a client, specifically a client located at a terminal, and includes the following steps:

Receiving the second code sent by the server during the process of playing the streaming media data of the first code rate Flowing streaming media data; the received second rate of streaming media data is from a second data unit of the second codestream;

The reset decoder refers to: resetting a decoder that decodes streaming media data of a first code rate to decode the streaming media data of the second code stream by using the reset decoder.

The solution provided by the embodiment of the present application is particularly applicable to a live broadcast scenario. In this case, the data stream of the server is injected in real time, that is, the streaming media data sent to the client is the streaming media data received by the server in real time. Of course, in the actual application, the solution provided by the embodiment of the present application can also be applied to an on-demand scenario.

The streaming media transmission method provided by the embodiment of the present application receives a streaming media play request sent by the client, and sends the streaming media data of the first code rate to the client in response to the streaming media play request; In the media data process, when the first parameter and the second parameter of the client are used to determine that the code rate switching is performed, the first data unit of the streaming media data of the first code rate is used to determine the streaming media data of the second code rate. Corresponding second data unit; the first parameter characterizing a current network bandwidth of the client; the second parameter characterizing a current decoding capability of the client; the first data unit is currently playing by the client Data unit; the streaming media data of different code rates is composed of data of at least two data units; after the first data unit is sent, starting from the second data unit, sending the second code rate to the client Streaming media data, the server determines to perform rate switching according to the first parameter and the second parameter of the client, and thus, according to the network bandwidth of the client Decoding capability timely switching rate, reduces the end to end delay. Moreover, the streaming media data is only divided into different data units, so that the server side is not required to prepare indexes and segment files, which reduces the buffering time of the streaming media data on the server side, and further reduces the end-to-end delay.

Embodiment 2

Based on the first embodiment, this embodiment describes the process of rate switching in detail.

In this embodiment, as shown in FIG. 2 or 3, the media server can generate high definition (high code rate), standard definition (medium code rate), and smooth three-way code stream (low code rate). The terminal sends an HTTP GET request to the media server. After receiving the request, the media server may select the appropriate bit rate of the streaming media data in the three streams according to the network bandwidth and system resources of the terminal, and send the response to the HTTP GET response. terminal. In the process, as shown in FIG. 2, the terminal reports its network bandwidth to the network server in real time, and reports its own system resources to the status server in real time. The network server sends the network bandwidth of the terminal to the media server in real time, and the status server will The system resources of the terminal are sent to the media server, so that the media server can obtain the network bandwidth and system resources of the terminal in real time. Of course, as shown in FIG. 3, the media server can also obtain the network bandwidth and system resources of the terminal in real time by simulating the network state and terminal state of the terminal.

The process of interacting between the server and the client in this embodiment, as shown in FIG. 4, includes the following steps:

Step 401: The media server generates the high-definition, standard-definition, and smooth three-way code streams by using the acquired media stream data.

Here, the three-way code stream is composed of a plurality of data units.

Step 402: Add media data decoding information at a starting position of each data unit of each code stream;

In this way, at each data unit of each code stream, the media data decoding information can be known, so that the rate switching can be performed quickly.

Step 403: When starting playback, the client obtains an HTTP URL of the code stream;

Here, the client receives an operation of the user, and obtains an HTTP URL of the code stream from the webpage in response to the user's operation.

Step 404: Send an HTTP GET request to the media server according to the HTTP URL of the code stream, to obtain the streaming media data from the media server.

Here, after receiving the HTTP GET request, the media server can obtain the network bandwidth and system resources of the terminal where the client is located in real time, and can obtain the network bandwidth and system resources of the terminal where the client is located by using the method described in FIG. 2 or FIG. 3 .

Step 405: After receiving the HTTP GET request, the media server first sends a smooth code stream to the client, so that the client can start normally:

Step 406: After receiving the fluent code stream, the client decodes the fluent code stream by using the corresponding decoder, and plays the same.

Step 407: During the playing process, the media server determines whether to perform rate switching according to the network bandwidth of the terminal where the client is located, the system resource, and the streaming media processing capability of the terminal, and when determining that the code rate is to be switched, Sending media data decoding information to the client;

Here, the media server determines the location of the data unit corresponding to the another code rate according to the data unit being transmitted, and then obtains the media data decoding information from the data unit corresponding to the other code rate, and sends the information to the client.

It is assumed that the media server determines that the code rate can be switched to the standard definition code rate according to the network bandwidth of the terminal where the client is located in real time, the system resource, and its own streaming media processing capability. At this time, the media server according to the data of the smooth code stream being transmitted. The unit determines the data unit corresponding to the code stream of the standard definition code rate, and obtains the data decoding information from the data unit corresponding to the code stream of the standard definition code rate, and sends the data decoding information to the client.

Step 408: The client resets the decoder based on the received media data decoding information.

Step 409: The media server sends a code stream corresponding to the code rate after the code rate switching to the client.

Step 410: The client decodes the corresponding code stream by using the reset decoder and plays the same.

For the above example, in step 408, the client resets the decoder based on the media data decoding information corresponding to the standard definition code rate; in step 409, the media server sends the standard definition code stream to the client; in step 410, the client utilizes the weight The set decoder decodes the standard definition code stream and plays it.

As can be seen from the above description, the solution provided by the embodiment of the present application, the media server and The client uses HTTP for streaming, and the media server performs rate switching, which avoids the use of index files and fragment files, thereby reducing the end-to-end transmission delay of the code stream.

Embodiment 3

Based on the first and second embodiments, this embodiment describes in detail the process of interaction between the media server and the client. The process includes the following steps:

Step A1: The media server generates a code stream of multiple code rates;

Specifically, media decoding information is added at the data unit of the code stream of each code rate, and as shown in FIG. 5, the data units of the code stream of each code rate are aligned in time. Each bit rate of audio and video is encapsulated using MPEGTS. Assume three low, medium, and high code rates.

Step B1: During the process of starting the play, the client first obtains the HTTP URL of the media stream, and then sends an HTTP request to obtain the code stream from the media server;

Specifically, the obtained HTTP URL includes the name of the channel, and then sends an HTTP GET request to the media server according to the HTTP URL.

Step C1: After receiving the request, the media server first sends a code stream with a low code rate, so that the client starts normally;

Here, the media server first sends an HTTP response header, and then transmits the low bit rate PAT, PMT, IDR, and TS packets by HTTP Chunk.

Step D1: The media server acquires network bandwidth and system resources of the client end in real time;

Step E1: The media server may send a code stream with a higher code rate according to the network bandwidth and system resource of the client, and the media server calculates the location of the data unit corresponding to the higher code rate at the data unit, and obtains the corresponding media decoding. Information and send it to the client for resetting of the decoder;

Step F1: Then the media server immediately performs rate switching, and sends a code stream with a higher code rate;

Specifically, the media server sends the PAT, PMT, IDR, and TS data packets of the new media stream to the client, starting from the calculated location of the data unit corresponding to the higher code rate.

Step H1: The client receives the media decoding information in the process of receiving the code stream, finds that the code rate is switched, uses the received media decoding information to reset the decoder, and then receives the code stream with a higher code rate for playing.

Embodiment 4

Step A2: The media server generates a code stream of multiple code rates;

Specifically, media decoding information is added at the data unit of the code stream of each code rate, and as shown in FIG. 6, the data units of the code stream of each code rate are aligned in time. Each bit rate of audio and video is encapsulated in MPEGTS and then encapsulated in an RTP package. Assume three low, medium, and high code rates.

Step B2: In the process of starting the playing, the client first obtains the HTTP URL of the media stream, and then sends an HTTP request to obtain the code stream from the media server;

Step C2: After receiving the request, the media server first sends a code stream with a low code rate, so that the client starts normally;

Here, the media server first sends an HTTP response header, and then sends a low bit rate RTP packet by HTTP Chunk.

Step D2: The media server obtains the network bandwidth and system resources of the client in real time;

Step E2: The media server may send a code stream with a higher code rate according to the network bandwidth and system resource of the client, and the media server calculates the location of the data unit corresponding to the higher code rate at the data unit, and obtains the corresponding media decoding. Information and send it to the client for resetting of the decoder;

Step F2: the media server immediately performs rate switching, and sends a code stream with a higher code rate;

Specifically, the media server sends the RTP data packet of the new media stream to the client, starting from the calculated location of the data unit corresponding to the higher code rate.

Step H2: The client receives the media decoding information in the process of receiving the code stream, finds that the code rate is switched, uses the received media decoding information to reset the decoder, and then receives the code stream with a higher code rate for playing.

Embodiment 5

Step A3: The media server generates a code stream of multiple code rates;

Specifically, media decoding information is added at the data unit of the code stream of each code rate, and as shown in FIG. 7, the data units of the code stream of each code rate are aligned in time. Each type of audio and video is packaged in MP4. Assume three low, medium, and high code rates.

Step B3: During the process of starting the play, the client first obtains the HTTP URL of the media stream, and then sends an HTTP request to obtain the code stream from the media server;

Step C3: After receiving the request, the media server first sends a code stream with a low code rate, so that the client starts normally;

Here, the media server first sends an HTTP response header, and then sends a low bit rate MP4 packet using HTTP Chunk.

Step D3: The media server acquires network bandwidth and system resources of the client end in real time;

Step E3: The media server can send a code stream with a higher code rate according to the network bandwidth and system resource of the client, and the media server calculates the location of the data unit corresponding to the higher code rate at the data unit, and obtains the corresponding media decoding. Information and send it to the client for resetting of the decoder;

Step F3: the media server immediately performs rate switching, and sends a code stream with a higher code rate;

Specifically, the media server sends the MP4 data packet of the new media stream to the client, starting from the calculated location of the data unit corresponding to the higher code rate.

Step H3: The client receives the media decoding information in the process of receiving the code stream, finds that the code rate is switched, uses the received media decoding information to reset the decoder, and then receives the code stream with a higher code rate for playing.

Embodiment 6

Step A4: The media server generates a code stream of multiple code rates;

Specifically, media decoding information is added at the data unit of the code stream of each code rate, and as shown in FIG. 8, the data units of the code stream of each code rate are aligned in time. The audio and video of each bit rate is encapsulated by the FLV Flag. Assume three low, medium, and high code rates.

Step B4: In the process of starting the playing, the client first obtains the HTTP URL of the media stream, and then sends an HTTP request to obtain the code stream from the media server;

Step C4: After receiving the request, the media server first sends a code stream with a low code rate, so that the client starts normally;

Here, the media server first sends an HTTP response header, and then sends the low-rate FLVHeader (header), PreviousTagSize0, and Tag packets by HTTP Chunk.

Step D4: The media server acquires network bandwidth and system resources of the client end in real time;

Step E4: The media server may send a code stream with a higher code rate according to the network bandwidth and system resource of the client, and the media server calculates the location of the data unit corresponding to the higher code rate at the data unit, and obtains the corresponding media decoding. Information and send it to the client for solution Reset of the encoder;

Step F4: Then the media server immediately performs rate switching, and sends a code stream with a higher code rate;

Specifically, the media server sends a Tag packet data packet of the new media stream to the client, starting from the calculated location of the data unit corresponding to the higher code rate.

Step H4: The client receives the media decoding information in the process of receiving the code stream, finds that the code rate is switched, uses the received media decoding information to reset the decoder, and then receives the code stream with a higher code rate for playing.

It should be noted that in the second to sixth embodiments, in practical applications, the high, medium, and low code rates can be distinguished according to the required code rate. For example, in general, a code stream with a code rate of 8M can be called a code stream with a high code rate, and a code rate with a code rate of 4M can be called a code stream with a medium code rate, and the code rate can be 2M. The code stream is called a low code rate code stream.

Example 7

To implement the method in the embodiment of the present application, the embodiment provides a streaming media transmission device, which is disposed in a server, specifically a media server. As shown in FIG. 9, the device includes:

The first receiving unit 91 is configured to receive a streaming media play request sent by the client;

The first sending unit 92 is configured to send the streaming media data of the first code rate to the client in response to the streaming media play request;

The switching unit 93 is configured to: when playing the streaming media data of the first code rate, determine, by using the first parameter and the second parameter of the client, to use the streaming media data of the first code rate when performing rate switching The first data unit determines a second data unit corresponding to the streaming media data of the second code rate; the first parameter represents a current network bandwidth of the client; and the second parameter represents a current decoding capability of the client The first data unit is a data unit currently being played by the client; the streaming media data of different code rates is composed of data of at least two data units;

The first sending unit 92 is further configured to: after the sending of the first data unit is completed, The second data unit begins by transmitting streaming media data of a second code rate to the client.

In an embodiment, the apparatus may further include:

The acquiring unit is configured to acquire the first parameter and the second parameter of the client in the process of playing the streaming media data of the first bit rate, so as to be able to make a decision on whether to perform rate switching, and reduce the end-to-end delay.

The acquiring unit may obtain the first parameter and the second parameter by using one of the following methods:

The client reports the first parameter and the second parameter of the client to the network device, and the network device reports the first parameter and the second parameter of the client to the acquiring unit.

The obtaining unit obtains the first parameter by simulating the network state of the client, and obtains the second parameter by simulating the state of the customer ticket.

Streaming media data of different code rates is composed of data of at least two data units. In other words, the streaming media data of different code rates is composed of data of a plurality of data units. In actual application, the number of data units of the streaming media data may be determined according to the specific requirements of the delay.

In an embodiment, the switching unit 93 may further determine, by using the first parameter and the second parameter of the client, in combination with the fourth parameter of the server, performing code rate switching; the fourth parameter characterizing the current server. Streaming media processing capabilities. In the rate switching decision process, both the network bandwidth and the decoding capability of the client are considered, and the processing capability of the server side is considered, so that the end-to-end delay can be further reduced.

In practical application, the switching unit 93 utilizes the first parameter and the second parameter of the client, When the rate switching decision is made, or the first parameter and the second parameter of the client are used, and the rate switching decision is performed in combination with the fourth parameter of the server, there may be many decision modes, which are not performed by the embodiment of the present application. For example, when the switching unit 93 uses the first parameter and the second parameter of the client and combines the fourth parameter of the server to perform a code rate switching decision, the CPU usage of the server may be considered first. When the CPU idles more than 30%, the first parameter and the second parameter are compared. When the network bandwidth of the client is 10M, the CPU idles more than 90%, and the memory usage is less than 50%, the code rate switching is decided. The code rate is switched to a high code rate, such as HD.

In practical applications, the device may further include:

a generating unit, configured to generate streaming media data of different code rates according to the obtained streaming media data, and adding a third parameter to the streaming media data for the streaming media data of each code rate; the third parameter characterizing the media data decoding information;

Correspondingly, the switching unit 93 is further configured to acquire a corresponding third parameter from the streaming media data of the second code rate;

The first sending unit 92 is further configured to: before starting, sending, by the second data unit, a third parameter to the client before sending the media data of the second code rate to the client; sending the third parameter; The parameter is used to instruct the client to adjust the decoder.

Here, the adding the third parameter to the streaming media data includes:

The generating unit adds a third parameter in each data unit;

Correspondingly, the switching unit 93 acquires a corresponding third parameter from the second data unit.

Wherein, since the third parameter is added in each data unit, the third parameter can be directly obtained from the second data unit as long as the switching unit 83 determines the second data unit, without further Going back to other locations to obtain the third parameter, so that the third parameter corresponding to the streaming media data of the second code rate can be quickly obtained.

In an embodiment, the generating unit may add a third parameter at a starting position of each data unit; correspondingly, the switching unit 93 acquires a corresponding third parameter from a starting position of the second data unit. .

In actual application, when the generating unit generates streaming media data of different code rates according to the obtained streaming media data, the data units of the streaming media data of each code rate may be aligned in time;

Correspondingly, the switching unit 93 is specifically configured to:

In actual application, when the streaming media data of the second bit rate is sent to the client, the first sending unit 92 may send the streaming media data of the second bit rate based on the MPEGTS encapsulation by using an HTTP Chunk manner, and may also HTTP Chunk is used to send streaming media data based on the second bit rate of the RTP encapsulation based on MPEGTS encapsulation. HTTP Chunk can also be used to send streaming media data based on the second bit rate of the MP4 encapsulation. HTTP can also be used. The Chunk mode sends the streaming media data of the second bit rate based on the FLV-based Flag encapsulation to meet the transmission requirements.

In practical applications, the first receiving unit 91 and the first sending unit 92 may be implemented by a communication chip in the streaming media transmission device; the switching unit 93 and the generating unit may be implemented by a processor in the streaming media transmission device, and the obtaining unit may be a streaming media transmission device. The processor in the middle is implemented in combination with a communication chip.

As can be seen from the above description, the solution provided by the embodiment of the present application is based on a primary flow. A scheme for media streaming request to transmit streaming media data to a client is a transmission scheme of streaming media data based on HTTP.

Correspondingly, in order to implement the method of the embodiment of the present application, the embodiment further provides a streaming media transmission device, which is disposed in the terminal. As shown in FIG. 10, the device includes:

The second sending unit 101 is configured to send a streaming media play request to the server;

The second receiving unit 102 is configured to receive the streaming media data of the first code rate sent by the server, and receive the streaming media of the second code stream sent by the server during the process of playing the streaming media data of the first code rate. Data; the received second rate of streaming media data is from a second data unit of the second code stream;

The playing unit 103 is configured to decode the streaming media data of the second code stream by using the reset decoder and play the same.

In practical applications, the second transmitting unit 101 and the second receiving unit 102 may be implemented by a communication chip in the streaming media transmission device; the playback unit 103 may be implemented by a processor in the streaming media transmission device.

In the streaming media transmission device provided by the embodiment of the present application, the first receiving unit 91 receives the streaming media playback request sent by the client, and the first sending unit 92 sends the streaming media of the first code rate to the client in response to the streaming media playback request. In the process of playing the streaming media data of the first code rate, the switching unit 93 determines, by using the first parameter and the second parameter of the client, that the streaming media data of the first code rate is used when performing code rate switching. Determining, by the first data unit, a second data unit corresponding to the streaming media data of the second code rate; the first parameter characterizing a current network bandwidth of the client; The second parameter represents a current decoding capability of the client; the first data unit is a data unit currently being played by the client; and the streaming media data of different code rates is composed of data of at least two data units; After the first data unit is sent, the first sending unit 92 starts from the second data unit, and sends the second bit rate of streaming media data to the client, where the server determines the first parameter according to the client and the first parameter. The second parameter determines the code rate switching, so that the code rate can be switched in time according to the network bandwidth and decoding capability of the client, and the end-to-end delay is reduced. Moreover, the streaming media data is only divided into different data units, so that the server side is not required to prepare indexes and segment files, which reduces the buffering time of the streaming media data on the server side, and further reduces the end-to-end delay.

Based on the foregoing device, the embodiment of the present application further provides a server. As shown in FIG. 11, the server includes:

The first communication interface 111 is configured to receive a streaming media play request sent by the client, and send the streaming media data of the first code rate to the client in response to the streaming media play request; and after the sending of the first data unit is completed, Transmitting, according to the second data unit, streaming media data of a second code rate to the client;

The first processor 112 is configured to determine, by using the first parameter and the second parameter of the client, the flow of the first code rate when performing the code rate switching in the process of playing the streaming media data of the first code rate. Determining, by the first data unit of the media data, a second data unit corresponding to the streaming media data of the second code rate; the first parameter characterizing a current network bandwidth of the client; the second parameter characterizing a current current of the client Decoding capability; the first data unit is a data unit currently being played by the client; and the streaming media data of different code rates is composed of data of at least two data units.

In an embodiment, the first processor 112 is further configured to acquire the first parameter and the second parameter of the client by using the first communication interface 111 during the process of playing the streaming media data of the first code rate.

In an embodiment, the first processor 112 may further utilize the first parameter of the client. The number and the second parameter are combined with the fourth parameter of the server to determine a code rate switching; the fourth parameter characterizes the current streaming media processing capability of the server.

In an embodiment, the first processor 112 is further configured to, in response to the streaming media play request, send streaming media data of the first bit rate to the client before streaming media data for each code rate. Adding a third parameter to the media data; the third parameter characterizing the media data decoding information; and acquiring a corresponding third parameter from the streaming media data of the second code rate;

Correspondingly, the first communication interface 111 is further configured to: before starting, sending, by the second data unit, a third parameter to the client before sending the second code rate of streaming media data to the client; sending The third parameter is used to instruct the client to adjust the decoder.

The first processor 112 is further configured to respond to the streaming media play request, before sending the streaming media data of the first bit rate to the client, and generate streaming media of different code rates when the streaming media data of different code rates is generated. The data units of the media data are aligned in time;

The first processor 112 is specifically configured to:

The implementation functions of the first communication interface 111 and the first processor 112 can be understood by referring to the related descriptions of the foregoing methods and devices, and details are not described herein again.

Based on the foregoing device, the embodiment of the present application further provides a terminal. As shown in FIG. 12, the terminal includes:

The second communication interface 121 is configured to send a streaming media play request to the server, and receive the streaming media data of the first code rate sent by the server; and receive the server during the process of playing the streaming media data of the first code rate. Transmitting the stream data of the second code stream; the received stream data of the second code rate is started from the second data unit of the second code stream;

The second processor 122 is configured to decode the streaming media data of the second code stream by using the reset decoder and play the same.

Those skilled in the art will appreciate that embodiments of the present application can be provided as a method, system, or computer program product. Accordingly, the application can take the form of a hardware embodiment, a software embodiment, or an embodiment in combination with software and hardware. Moreover, the application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the present application. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

The above is only the preferred embodiment of the present application and is not intended to limit the scope of the present application.

Industrial applicability

In the embodiment of the present application, the streaming media play request sent by the client is received; in response to the streaming media play request, the streaming media data of the first bit rate is sent to the client; in the process of playing the streaming media data of the first bit rate, Determining, by using the first parameter and the second parameter of the client, that the first data unit of the streaming media data of the first code rate is used to determine the second data corresponding to the streaming media data of the second code rate. The first parameter represents a current network bandwidth of the client; the second parameter represents a current decoding capability of the client; the first data unit is a data unit currently being played by the client; different codes The streaming media data of the rate is composed of data of at least two data units; after the sending of the first data unit is completed, starting from the second data unit, sending the streaming media data of the second code rate to the client, by The server determines to perform rate switching according to the first parameter and the second parameter of the client, so that the network bandwidth and decoding capability of the client can be timely according to the client. Line switching rate and reduce the end to end delay. Moreover, the streaming media data is only divided into different data units, so that the server side is not required to prepare indexes and segment files, which reduces the buffering time of the streaming media data on the server side, and further reduces the end-to-end delay.

Claims

A streaming media transmission method, the method comprising:

Receiving a streaming media play request sent by the client;

Responding to the streaming media play request, sending the streaming media data of the first code rate to the client;

In the process of playing the streaming media data of the first code rate, determining, by using the first parameter and the second parameter of the client, that the code rate switching is performed, determining, by using the first data unit of the streaming media data of the first code rate. a second data unit corresponding to the second bit rate of the streaming media data; the first parameter characterizing a current network bandwidth of the client; the second parameter characterizing a current decoding capability of the client; the first data unit is The data unit currently being played by the client; the streaming media data of different code rates is composed of data of at least two data units;

After the sending of the first data unit is completed, starting from the second data unit, the streaming media data of the second code rate is sent to the client.
The method of claim 1, wherein the method further comprises: before transmitting the streaming media data of the first bit rate to the client in response to the streaming media play request, the method further comprising:

Adding a third parameter to the streaming media data for the streaming media data of each code rate; the third parameter characterizing the media data decoding information;

Correspondingly, before the sending, by the second data unit, the streaming media data of the second code rate to the client, the method further includes:

Obtaining a corresponding third parameter from the streaming media data of the second code rate;

Sending a third parameter to the client; the third parameter sent is used to instruct the client to adjust the decoder.
The method of claim 2, wherein the adding the third parameter to the streaming media data comprises:

Adding a third parameter to each data unit;

Correspondingly, a corresponding third parameter is obtained from the second data unit.
The method of claim 3 wherein said adding a third parameter in each data unit comprises:

Add a third parameter at the beginning of each data unit;

Correspondingly, a corresponding third parameter is obtained from a starting position of the second data unit.
The method of claim 1 wherein the method further comprises:

The first parameter and the second parameter of the client are obtained during the process of playing the streaming media data of the first code rate.
The method according to claim 1, wherein when the rate switching is performed by using the first parameter and the second parameter of the client, the method further includes:

Using the first parameter and the second parameter of the client, and combining the fourth parameter of the server, determining to perform rate switching; the fourth parameter characterizing the current streaming media processing capability of the server.
The method of claim 1, wherein the method further comprises: before transmitting the streaming media data of the first bit rate to the client in response to the streaming media play request, the method further comprising:

When generating streaming media data of different code rates, the data units of the streaming media data of each code rate are aligned in time;

Correspondingly, the determining, by the first data unit of the streaming media data of the first code rate, the second data unit corresponding to the streaming media data of the second code rate comprises:

Determining a time corresponding to the first data unit from the streaming media data of the first code rate;

The second data unit is derived from the streaming media data of the second code rate using the determined time.
The method according to any one of claims 1 to 7, wherein the sending the streaming media data of the second code rate to the client comprises:

The second bit rate of streaming media data encapsulated in one of the following manners is sent by using a hypertext transfer protocol HTTP block transfer Chunk:

Based on MPEGTS package;

Based on MPEGTS encapsulation and then based on real-time transport protocol RTP encapsulation;

Based on MP4 package;

FLV-based tag Flag package.
A streaming media transmission method, the method comprising:

Sending a streaming media play request to the server, and receiving streaming media data of the first code rate sent by the server;

Receiving streaming media data of the second code stream sent by the server in the process of playing the streaming media data of the first code rate; receiving the second code rate of the streaming media data is starting from the second data unit of the second code stream of;

The streamed data of the second code stream is decoded by the reset decoder and played.
A streaming media transmission device, the device comprising:

The first receiving unit is configured to receive a streaming media play request sent by the client;

The first sending unit is configured to send the streaming media data of the first code rate to the client in response to the streaming media play request;

The switching unit is configured to: when playing the streaming media data of the first code rate, determine, by using the first parameter and the second parameter of the client, to use the streaming media data of the first code rate when performing rate switching Determining, by the first data unit, a second data unit corresponding to the streaming media data of the second code rate; the first parameter characterizing a current network bandwidth of the client; and the second parameter characterizing a current decoding capability of the client; The first data unit is a data unit currently being played by the client; the streaming media data of different code rates is composed of data of at least two data units;

The first sending unit is further configured to: after the sending of the first data unit is completed, start sending, by the second data unit, streaming media data of a second code rate to the client.
The device of claim 10, wherein the device further comprises:

a generating unit, configured to add a third parameter to the streaming media data for the streaming media data of each code rate; the third parameter characterizing the media data decoding information;

The switching unit is further configured to obtain a corresponding third parameter from the streaming media data of the second code rate;

The first sending unit is further configured to: before starting, sending, by the second data unit, a third parameter to the client before sending the second bit rate of streaming media data to the client; sending the third parameter It is used to instruct the client to adjust the decoder.
The device of claim 10, wherein the device further comprises:

The acquiring unit is configured to acquire the first parameter and the second parameter of the client during the process of playing the streaming media data of the first code rate.
The apparatus according to claim 10, wherein the switching unit is configured to determine a code rate switching by using a first parameter and a second parameter of the client, and in combination with a fourth parameter of the server; Characterizing the current streaming media processing capabilities of the server.
The device of claim 10, wherein the device further comprises:

Generating unit configured to generate data units of streaming media data of each code rate in time when generating streaming media data of different code rates;

The switching unit is specifically configured as follows:

Determining a time corresponding to the first data unit from the streaming media data of the first code rate;

The second data unit is derived from the streaming media data of the second code rate using the determined time.
A streaming media transmission device, the device comprising:

a second sending unit, configured to send a streaming media play request to the server;

The second receiving unit is configured to receive the streaming media data of the first code rate sent by the server; and receive the streaming media data of the second code stream sent by the server during the process of playing the streaming media data of the first code rate Receiving the second code rate of the streaming media data from the second data unit of the second code stream;

The playing unit is configured to decode the streaming media data of the second code stream by using the reset decoder and play the same.
A server, the server comprising:

a first communication interface, configured to receive a streaming media play request sent by the client; a streaming media play request, sending the streaming media data of the first bit rate to the client; and after the sending of the first data unit is completed, starting from the second data unit, sending a flow of the second code rate to the client Media data;

The first processor is configured to use the first parameter and the second parameter of the client to determine the streaming media using the first code rate when the code rate is performed in the process of playing the streaming media data of the first bit rate. Determining, by the first data unit of the data, a second data unit corresponding to the streaming media data of the second code rate; the first parameter characterizing a current network bandwidth of the client; the second parameter characterizing a current decoding of the client Capability; the first data unit is a data unit currently being played by the client; and the streaming media data of different code rates is composed of data of at least two data units.
The server according to claim 16, wherein the first processor is further configured to: before the streaming media data of the first bit rate is sent to the client, the streaming media for each code rate in response to the streaming media play request Data, adding a third parameter to the streaming media data; the third parameter characterizing the media data decoding information; and acquiring a corresponding third parameter from the streaming media data of the second code rate;

Correspondingly, the first communication interface is further configured to send, after the second data unit, the third parameter to the client before sending the second bit rate of the streaming media data to the client; The third parameter is used to instruct the client to adjust the decoder.
The server according to claim 16, wherein the first processor is further configured to generate streaming media of different code rates before transmitting the streaming media data of the first code rate to the client in response to the streaming media play request. Data, the data units of the streaming media data of each code rate are aligned in time;

The first processor is specifically configured to:

Determining a time corresponding to the first data unit from the streaming media data of the first code rate;

The second data unit is derived from the streaming media data of the second code rate using the determined time.
A terminal, the terminal comprising:

a second communication interface, configured to send a streaming media play request to the server, and receive the streaming media data of the first code rate sent by the server; and receive the sending by the server during the process of playing the streaming media data of the first code rate Streaming media data of the second code stream; the received stream media data of the second code rate is started from the second data unit of the second code stream;

The second processor is configured to decode the streaming media data of the second code stream by using the reset decoder and play the same.
A storage medium storing computer executable instructions for performing the streaming media transmission method according to the above claims 1-8 and 9.