WO2017071604A1

WO2017071604A1 - Playback method, device and storage medium

Info

Publication number: WO2017071604A1
Application number: PCT/CN2016/103479
Authority: WO
Inventors: 程子乾; 陈洲; 易鹤声
Original assignee: 中兴通讯股份有限公司
Priority date: 2015-10-28
Filing date: 2016-10-27
Publication date: 2017-05-04
Also published as: CN106658226B; CN106658226A

Abstract

Provided is a playback method. The method comprises: after the request addresses of various secondary index files are obtained according to the parsing of first level index files of multimedia data, downloading a secondary index file corresponding to any code rate and parsing same, and obtaining the addresses of various media fragments of the code rate; and downloading and playing back starting from the first media fragment of the code rate. Also provided is a playback device and a computer storage medium.

Description

Play method, device and storage medium

Technical field

The present invention relates to the field of audio and video playback technologies for multimedia terminals, and in particular, to a playback method, device, and storage medium.

Background technique

With the rapid development of the mobile Internet, the promotion of various application services (Over The Top, OTT) technology and the emergence of various intelligent terminal devices are provided to users through the Internet, and video is watched online through video terminals such as mobile phones, PDAs, and set-top boxes. Become a more and more popular way of entertainment. In view of the fact that the current bandwidth of the network bandwidth does not reach the perfect fit of the bit rate, Apple has introduced a protocol specification for real-time streaming (HLS) transmission, which uses a different source rate to distinguish between different sources. The stream slicing technique cuts a complete source into a number of small slices, usually 10 seconds per slice, with different code rate sources, and cuts into the same number of slices. The same slice order in different bitrates corresponds to the same video content. At the same time, the m3u8 format is used to generate a playlist file for each bit rate to describe the index information of each slice in detail, which is used to guide the player how to play the file slice. In this way, during the playback process, the slice-by-slice download play mode can be realized. When the network is detected to change, the code rate is updated in time to download the corresponding optimal slice rate, and the playback fluency and picture clarity are the most. Good playback effect.

Because the HLS specification uses the primary and secondary index files to do index navigation of specific media fragments. Therefore, the downloading process at the beginning of playback is a great performance consumption for the download resolution process of the primary index secondary index. In particular, the more the bit rate, the more secondary index files that need to be downloaded and parsed, and the more performance is consumed, the more time consuming.

Summary of the invention

The invention provides a playing method, a device and a storage medium, which realize fast start of multimedia data.

To solve the above technical problem, the present invention provides a playing method, and the method includes:

After obtaining the request address of each secondary index file according to the primary index file of the multimedia data, downloading the secondary index file corresponding to any code rate and parsing, and obtaining the address of each media fragment of the code rate;

Download playback starts from the first media slice of the code rate.

In the above solution, after the downloading and playing starts from the first media segment of the code rate, the method further includes:

After the current media slice is played, before downloading the next media slice, it is determined whether the code rate needs to be switched according to the download rate of the played media slice and the current code rate;

If the code rate needs to be switched, it is determined whether the address of the media slice to be switched has been stored, and if not, the secondary index file corresponding to the code rate to be switched is downloaded and parsed, and the code rate to be switched is obtained. The address of the media slice, download and play the corresponding media slice of the code rate to be switched; if it exists, download and play the corresponding media slice of the code rate to be switched;

If the switching rate is not required, the next media slice is downloaded and played.

In the above solution, determining whether to switch the code rate according to the download rate of the played media slice and the current code rate includes:

If the download rate of the predetermined number of media slices that are played recently is less than the current code rate, and the current code rate is not the minimum code rate, it is determined that the code rate needs to be switched, and the code rate to be switched is smaller than the current code rate.

If the download rate of the predetermined number of media fragments that are played recently is greater than the current code rate, and the current code rate is not the maximum code rate, it is determined that the code rate needs to be switched, and the to-be-switched code rate is greater than the current Code rate.

If the download rate of the predetermined number of media segments played recently is not less than the current code rate, and the download rate of the recently played media segments is not greater than the current code rate, it is determined that the switching code rate is not required.

In the foregoing solution, the downloading and parsing the secondary index file corresponding to any code rate includes:

Download the secondary index file corresponding to the minimum bit rate and parse it.

The invention also provides a playback device, the device comprising:

The parsing module is configured to: after obtaining the request address of each secondary index file according to the primary index file of the multimedia data, downloading and parsing the secondary index file corresponding to any code rate; and configuring to obtain the code rate The address of the media slice;

The processing module is configured to perform download playback from the first media slice of the code rate.

In the above solution, the device further includes a determining module, where the determining module includes:

The first determining sub-module is configured to determine, according to the download rate of the played media segment and the current code rate, whether to switch the code rate after the current media segment is played, before downloading the next media segment;

The second determining sub-module is configured to determine, if the code rate needs to be switched, whether there is an address of the media fragment of the to-be-switched code rate, and if not, download the secondary index file corresponding to the to-be-switched code rate. Parsing, obtaining the address of the media fragment to be switched, and downloading and playing the corresponding media fragment of the to-be-switched code rate; and configuring, if yes, downloading and playing the corresponding media fragment of the to-be-switched code rate;

The third determining sub-module is configured to download and play the next media slice if the switching code rate is not required.

In the above solution, the first determining submodule is configured to be based on the media segment that has been played. The load rate and the current code rate determine whether the need to switch the code rate specifically means:

In the above solution, the first determining sub-module is configured to determine whether the need to switch the code rate according to the download rate of the played media slice and the current code rate, specifically:

If the download rate of the predetermined number of media segments that are played recently is greater than the current code rate, and the current code rate is not the maximum code rate, it is determined that the code rate needs to be switched, and the code rate to be switched is greater than the current code rate.

In the above solution, the parsing module is configured to download and parse the secondary index file corresponding to any code rate.

The embodiment of the invention further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the above playing method.

The above solution realizes fast start-up of multimedia data and reduces performance consumption. At the same time, adaptive switching can be performed according to the download rate of two consecutive media segments, ensuring the validity of the real-time network condition, and avoiding the unexpected network rate switching resulting in inappropriate rate switching.

DRAWINGS

1 is a schematic diagram showing a processing flow of a playing method in Embodiment 1;

FIG. 2 is a schematic structural diagram of a playback apparatus in Embodiment 1.

detailed description

In order to make the objects, technical solutions and advantages of the present application more clear, the embodiments of the present application will be described in detail below with reference to the accompanying drawings. It should be noted that, in the case of no conflict, the features in the embodiments and the embodiments in the present application may be arbitrarily combined with each other.

Embodiment 1

As shown in FIG. 1 , this embodiment provides a playback method, where the method includes:

Step S11: After obtaining the request address of each secondary index file according to the primary index file of the multimedia data, download the secondary index file corresponding to any code rate and parse the file to obtain the address of each media fragment of the code rate. ;

Step S12: downloading and playing starts from the first media slice of the code rate.

In the above solution, after step S12, the following steps are further included:

Step S13: After the current media slice is played, before downloading the next media slice, determine whether the code rate needs to be switched according to the download rate of the played media slice and the current code rate;

Step S14: If the code rate needs to be switched, it is determined whether the address of the media fragment of the to-be-switched code rate exists, and if not, the secondary index file corresponding to the to-be-switched code rate is downloaded and parsed, and the to-be-switched is obtained. The address of the media slice of the code rate, download and play the corresponding media slice of the code rate to be switched; if it exists, download and play the corresponding media slice of the code rate to be switched;

Specifically, determining whether to switch the code rate according to the download rate of the played media slice and the current code rate can be implemented by:

If the download rate of the predetermined number of media segments played recently is greater than the current code rate, and If the current code rate is not the maximum code rate, it is determined that the code rate needs to be switched, and the code rate to be switched is greater than the current code rate.

In the above solution, in this embodiment, the secondary index file corresponding to the minimum bit rate is first downloaded and parsed.

As shown in FIG. 2, the embodiment further provides a playback device, where the device includes:

The parsing module 11 is configured to: after obtaining the request address of each secondary index file according to the primary index file of the multimedia data, downloading and parsing the secondary index file corresponding to any code rate; and configuring the code rate to be obtained. The address of each media segment;

The processing module 12 is configured to perform download playback from the first media slice of the code rate.

In the above solution, the device further includes a determining module 13, and the determining module 13 includes:

The first determining sub-module 131 is configured to determine, according to the download rate of the played media segment and the current code rate, whether to switch the code rate after the current media slice is played, before downloading the next media slice;

The second determining sub-module 132 is configured to determine, if the code rate needs to be switched, whether there is an address of the media fragment of the to-be-switched code rate, and if not, download the secondary index file corresponding to the to-be-switched code rate. And parsing, obtaining the address of the media fragment of the to-be-switched code rate, downloading and playing the corresponding media fragment of the to-be-switched code rate; and configuring, if yes, downloading and playing the corresponding media fragment of the to-be-switched code rate;

The third determining sub-module 133 is configured to download and play the next media slice if the switching code rate is not required.

In the above solution, the first determining sub-module 131 is configured to determine whether the need to switch the code rate according to the download rate of the played media slice and the current code rate, specifically:

In the above solution, the parsing module 11 is configured to download and analyze the secondary index file corresponding to any code rate.

Embodiment 2

First, briefly explain the overall strategy of the HLS specification:

Strategy 1: HLS (HTTP Live Streaming, Dynamic Rate Adaptation Technology) specification requires the cooperation of terminal devices and streaming media. For a single source, the organization of adaptive streaming media content is as shown in Figure 1. The content is composed of an adaptive stream. A media content level index and a plurality of adaptive streaming media content secondary indexes and adaptive streaming media content segments. The adaptive streaming media first level index records the adaptive streaming media content secondary index of different code rates, and the adaptive streaming media content secondary index records the media fragment file corresponding to the code rate.

Strategy 2: When the terminal plays adaptive streaming media content, the terminal first passes the original Url (Uniform Resoure Locator) obtains a first-level index of adaptive streaming media content, and the first-level index of the terminal adaptive streaming media content includes content bandwidth information of each code rate, and a secondary index corresponding to the adaptive streaming media content. Request path. Then, the terminal may initiate a request for the secondary index, where the secondary index includes the media fragment file information of the corresponding code rate, for example, the fragmentation request path URL; and finally, the video content of the relevant code rate is requested by the fragmentation URL in the index.

Strategy 3: When the terminal detects the bandwidth status and the load condition of the computing resource changes during the playing, the terminal reselects the appropriate code rate content from the previously acquired index for playing.

The technical solution of the present invention is further explained below.

1. First download and parse the index file index.m3u8 of the adaptive streaming media level and parse it. Suppose there are five different code rates. Parsing the first-level index file to obtain five different secondary index file request addresses from low to high -1.m3u8, 2.m3u8, 3.m3u8, 4.m3u8, 5.m3u8, respectively corresponding to the code rate , code rate two, code rate three, code rate four, code rate five.

2. Then request a secondary index file of a certain bit rate, such as downloading the code rate of 1.m3u8 first, parsing the 1.m3u8 file after the download request is completed, and obtaining the media fragment address information of the current bit rate. Such as 1.ts, 2.ts, 3.ts. It should be noted that other code rates may also be downloaded first in other embodiments.

3. The next conventional practice is to continue to download and parse 2.m3u8, 3.m3u8, 4.m3u8, and 5.m3u8, and then start downloading and playing the first starting media segment of the selected bitrate.

In the present invention, after downloading and parsing the 1.m3u8 index file, skip the download analysis of 2.m3u8, 3.m3u8, 4.m3u8, and 5.m3u8, directly to the first media of the code rate one. Fragment 1.ts starts the request. After the broadcast, when it is detected that the switching code rate needs to be switched, then according to the need, 2.m3u8, 3.m3u8, 4.m3u8, 5.m3u8 download and parse, so that the secondary index can be downloaded in stages according to the demand, avoiding the centralized operation of the energy-consuming operation at the beginning of the playback, to improve the optimization of the starting speed. For example, after the 1.ts broadcast, it is detected that it needs to switch to the code rate two. At this time, the download analysis of 2.m3u8 is performed, and after the media slices of 2.m3u8 are played, the code rate can be switched again. 2.ts continue to play.

In addition, when judging whether it is necessary to perform rate switching, firstly, the download rate of each fragment is counted, and the download rate of the latest two fragments is compared with the current playback rate, and then it is decided to increase the code rate or reduce the code rate. In the present invention, a method can be employed:

Slice download rate = download fragment data reception total length / data reception time;

When the latest shard is to be downloaded, whether the shard downloading rate of the two shards and the current playing tempo rate are downloaded as the metrics, whether the rate switching is performed. The download rate of the penultimate download slice is recorded as "download rate one", and the download rate of the first countdown download slice is recorded as "download rate two".

The basic algorithm uses the following two expressions:

Expression one:

If ((current play rate > download rate one) && (current play rate > download rate two))

{

Reduce the playback bit rate until it is reduced to the lowest code rate;

}

Expression two:

If ((current play rate <download rate one) && (current play rate <download rate two))

{

Increase the playback rate until it reaches the highest code rate;

}

The following two statements are briefly explained:

For expression one, when the latest slice is to be downloaded, when the first and second fragments are When the download rate is less than the current playback bit rate, it indicates that it is currently in a low bandwidth for a while. At this time, you choose to reduce the bit rate and adapt to the low bandwidth to ensure smooth playback.

For the second expression, when the latest fragment is to be downloaded, when the download rate of the first and second fragments is greater than the current playback rate, it indicates that the current high bandwidth has been in the current period. This is the choice of elevated bit rate, high definition video clarity.

This rate switching algorithm is based on the download rate of two consecutive slices, which ensures the validity of the network condition at all times. Avoiding sudden network effects leads to inappropriate rate switching. At the same time, it is more flexible to choose the download fragment rate as the basis for the reflection of the time bandwidth.

The parsing module 11, the processing module 12, and the judging module 13 in the data receiving apparatus provided in the embodiment of the present invention may be implemented by a processor, and may also be implemented by a specific logic circuit; in practical applications, the processor may be Central processing unit (CPU), microprocessor (MPU), digital signal processor (DSP) or field programmable gate array (FPGA).

In the embodiment of the present invention, if the above playing method is implemented in the form of a software function module and sold or used as a stand-alone product, it may also be stored in a computer readable storage medium. Based on such understanding, the technical solution of the embodiments of the present invention may be embodied in the form of a software product in essence or in the form of a software product stored in a storage medium, including a plurality of instructions. A computer device (which may be a personal computer, server, or network device, etc.) is caused to perform all or part of the methods described in various embodiments of the present invention. The foregoing storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read only memory (ROM), a magnetic disk, or an optical disk. Thus, embodiments of the invention are not limited to any specific combination of hardware and software.

Correspondingly, an embodiment of the present invention further provides a computer storage medium, and the computer storage medium A computer program for performing the above-described playback method of the embodiment of the present invention is stored in the medium.

The above is only the preferred embodiment of the present invention and is not intended to limit the scope of the present invention.

Claims

A playing method, the method comprising:

After obtaining the request address of each secondary index file according to the primary index file of the multimedia data, downloading the secondary index file corresponding to any code rate and parsing, and obtaining the address of each media fragment of the code rate;

Download playback starts from the first media slice of the code rate.
The method of claim 1, wherein after the downloading of the first media segment of the code rate, the method further comprises:

After the current media slice is played, before downloading the next media slice, it is determined whether the code rate needs to be switched according to the download rate of the played media slice and the current code rate;

If the code rate needs to be switched, it is determined whether the address of the media slice to be switched has been stored, and if not, the secondary index file corresponding to the code rate to be switched is downloaded and parsed, and the code rate to be switched is obtained. The address of the media slice, download and play the corresponding media slice of the code rate to be switched; if it exists, download and play the corresponding media slice of the code rate to be switched;

If the switching rate is not required, the next media slice is downloaded and played.
The method of claim 2, wherein the determining whether the code rate needs to be switched according to the download rate of the played media slice and the current code rate comprises:

If the download rate of the predetermined number of media slices that are played recently is less than the current code rate, and the current code rate is not the minimum code rate, it is determined that the code rate needs to be switched, and the code rate to be switched is smaller than the current code rate.
The method of claim 2, wherein the determining whether the code rate needs to be switched according to the download rate of the played media slice and the current code rate comprises:

If the download rate of the predetermined number of media segments that are played recently is greater than the current code rate, and the current code rate is not the maximum code rate, it is determined that the code rate needs to be switched, and the code rate to be switched is greater than the current code rate.
The method of claim 2 wherein said sub-segment based on played media The load rate and the current code rate determine whether the code rate needs to be switched, including:

If the download rate of the predetermined number of media segments played recently is not less than the current code rate, and the download rate of the recently played media segments is not greater than the current code rate, it is determined that the switching code rate is not required.
The method according to any one of claims 1 to 5, wherein the downloading and parsing the secondary index file corresponding to any code rate comprises:

Download the secondary index file corresponding to the minimum bit rate and parse it.
A playback device, the device comprising: a parsing module and a processing module, wherein

The parsing module is configured to: after obtaining the request address of each secondary index file according to the primary index file of the multimedia data, downloading and parsing the secondary index file corresponding to any code rate; and configuring to obtain the code rate The address of each media segment;

The processing module is configured to perform download playback from the first media slice of the code rate.
The device of claim 7, wherein the device further comprises a determining module, the determining module comprising:

The first determining sub-module is configured to determine, according to the download rate of the played media segment and the current code rate, whether to switch the code rate after the current media segment is played, before downloading the next media segment;

The second determining sub-module is configured to determine, if the code rate needs to be switched, whether there is an address of the media fragment of the to-be-switched code rate, and if not, download the secondary index file corresponding to the to-be-switched code rate. Parsing, obtaining the address of the media fragment to be switched, and downloading and playing the corresponding media fragment of the to-be-switched code rate; and configuring, if yes, downloading and playing the corresponding media fragment of the to-be-switched code rate;

The third determining sub-module is configured to download and play the next media slice if the switching code rate is not required.
The apparatus according to claim 8, wherein the first determining sub-module is configured to determine whether the need to switch the code rate according to the download rate of the played media slice and the current code rate, specifically:

If the download rate of the predetermined number of media segments played recently is less than the current code rate, and If the current code rate is not the minimum code rate, it is determined that the code rate needs to be switched, and the code rate to be switched is smaller than the current code rate.
The apparatus according to claim 8, wherein the first determining sub-module is configured to determine whether the need to switch the code rate according to the download rate of the played media slice and the current code rate, specifically:

If the download rate of the predetermined number of media segments that are played recently is greater than the current code rate, and the current code rate is not the maximum code rate, it is determined that the code rate needs to be switched, and the code rate to be switched is greater than the current code rate.
The apparatus according to claim 8, wherein the first determining sub-module is configured to determine whether the need to switch the code rate according to the download rate of the played media slice and the current code rate, specifically:

If the download rate of the predetermined number of media segments played recently is not less than the current code rate, and the download rate of the recently played media segments is not greater than the current code rate, it is determined that the switching code rate is not required.
The device according to any one of claims 7 to 11, wherein the parsing module is configured to download and analyze the secondary index file corresponding to any code rate.

Download the secondary index file corresponding to the minimum bit rate and parse it.
A computer storage medium having stored therein computer executable instructions for performing the playback method of any one of claims 1 to 6.