WO2011110117A2

WO2011110117A2 - Method, device and system for positioning playing of multi-code rate based on hypertext transfer protocol

Info

Publication number: WO2011110117A2
Application number: PCT/CN2011/073138
Authority: WO
Inventors: 王志兵
Original assignee: 华为技术有限公司
Priority date: 2011-04-21
Filing date: 2011-04-21
Publication date: 2011-09-15
Also published as: CN102845041B; WO2011110117A3; CN102845041A

Abstract

A method, device and system for positioning playing of multi-code rate based on a Hypertext Transfer Protocol (HTTP) are provided in the present invention. The method is that: a terminal requests to obtain a fragment index of a film from a server according to a received positioning playing operation, wherein the request carries a time point of the positioning playing operation; the terminal receives a fragment index, which is regenerated from a key frame by the server after finding the key frame according to the time point; the terminal performs decoding and playing process after obtaining the fragments of the film according to the regenerated fragment index. The terminal comprises: a request module, a reception module and a playing module. The server comprises: a reception module, an obtaining module, a generation module and a sending module. The system comprises the terminal and the server.

Description

Multi-code rate positioning and playing method, device and system based on hypertext transfer protocol

The embodiments of the present invention relate to the field of communications technologies, and in particular, to a multi-code rate positioning and playing method, device and system based on a hypertext transfer protocol. Background technique

In the prior art, Internet video service providers use a multi-code rate to provide users with diverse services. Early Microsoft, ADOBE and other companies introduced a proprietary multi-rate video service solution that uses vendor proprietary protocols to communicate and select the appropriate bit rate for video services based on current access bandwidth. However, if you use the proprietary protocol of this vendor to complete the multi-rate video service, you must use the vendor's dedicated media server in the network deployment, and you can't use the content delivery network (The Content Delivery Network, CDN for short). Acceleration capability, difficult to deploy on a large scale in the Internet environment.

In order to overcome this problem, a multi-rate video service solution based on the HyperText Transfer Protocol (abbreviated as: HTTP) came into being. This service solution enables the terminal and the server to communicate using the standard HTTP protocol, and utilizes the existing CDN acceleration capability of the Internet to perform large-scale deployment and provide video services. Specifically, in the multi-rate video service scheme based on the HTTP protocol, the media file is logically divided into small fragments according to the duration, and a corresponding fragment index is generated (the fragmentation time points of multiple code rates are required to be aligned). The user terminal obtains the fragment index through the HTTP protocol, and downloads the fragment according to the fragment index. The terminal measures the current access bandwidth in real time when downloading the fragment, and determines the code of the next fragment according to the download rate of the current fragment. rate. If the terminal user performs positioning and playback during playback, the terminal searches for the most recent slice according to the user's drag position to download and play.

In the process of implementing the present invention, the inventors have found that at least the following problems exist in the prior art: There are conflicts in the roles of the two aspects of the fragmentation index. If the slice length is shorter, the positioning is played. The accuracy is high, but the terminal interacts frequently with the server during sequence playback, resulting in poor performance of the server and the terminal. If the fragmentation duration is long, the terminal interacts less with the server during sequential playback, but the positioning and playback accuracy is low. Summary of the invention

The embodiment of the invention provides a multi-code rate positioning and playing method, device and system based on the hypertext transfer protocol, which is used to solve the conflict between the functions of the two aspects of the fragment index in the prior art, so that the method is long. In the case of fragmentation duration, high-precision positioning playback is supported.

The embodiment of the present invention provides a multi-code rate positioning and playing method based on a hypertext transfer protocol, including: the terminal requests, according to the received positioning and playing operation, a fragment index of the movie to be acquired by the server, where the request carries the positioning and playing Point in time of operation;

a fragmentation index regenerated by the receiving server from the key frame after the key frame is found according to the time point;

The slice of the movie is obtained according to the received regenerated fragment index and then decoded and played.

The embodiment of the invention further provides a multi-code rate positioning and playing method based on a hypertext transfer protocol, which comprises:

The server receives a request sent by the terminal to obtain a fragment index of the movie, where the request carries a time point of the positioning play operation;

Obtaining a corresponding movie key frame according to the time point of the positioning playback operation;

Regenerating the slice index from the key frame;

Sending the regenerated fragment index to the terminal, so that the terminal acquires a slice of the movie according to the regenerated fragment index, and then performs decoding and playing.

An embodiment of the present invention provides a terminal, including:

a requesting module, configured to, according to the received positioning and playing operation, request a server to obtain a fragment index of the movie, where the request carries the time point of the positioning and playing operation;

a receiving module, configured to receive, by the server, the key frame after searching for a key frame according to the time point The re-generated fragment index;

The playing module is configured to obtain a slice of the movie according to the received regenerated fragment index, and then perform decoding and playing.

The embodiment of the invention further provides a server, including:

a receiving module, configured to receive a fragmentation index sent by the terminal to obtain a movie, where the request carries a time point of the positioning playing operation;

Obtaining a module, configured to obtain a corresponding movie key frame according to the time point of the positioning operation; and a generating module, configured to regenerate the slice index from the key frame;

And a sending module, configured to send the regenerated fragment index to the terminal, so that the terminal acquires a slice of the movie according to the regenerated fragment index, and then performs decoding and playing.

The embodiment of the invention further provides a multi-code rate positioning and playing system based on a hypertext transfer protocol, comprising the terminal and the server as described above.

The multi-code rate positioning and playing method, device and system based on the hypertext protocol in the embodiment of the present invention obtains the time point of the positioning and playing by the terminal, and requests the server to obtain the time index of the film's fragment index to carry the positioning and playing, and the receiving server according to the receiving server The fragment index regenerated by the key frame information corresponding to the time point of the positioning is requested, and the film fragment is requested according to the regenerated fragment index, which effectively solves the problem that the multi-rate video server solution has a long duration of fragmentation. The problem of low precision. DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, a brief description of the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.

FIG. 1 is a flowchart of a multi-rate positioning playback method based on a hypertext transfer protocol according to an embodiment of the present invention;

2 is a multi-code rate positioning and playing based on a hypertext transfer protocol according to another embodiment of the present invention. Method flow chart;

FIG. 3 is a schematic structural diagram of a terminal according to an embodiment of the present invention;

4 is a schematic structural diagram of a server according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of a multi-code rate positioning and playing system based on a hypertext transfer protocol according to an embodiment of the present invention. detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is a partial embodiment of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

FIG. 1 is a flowchart of a multi-code rate positioning and playing method based on a hypertext transfer protocol according to an embodiment of the present invention. As shown in FIG. 1, the method includes:

Step 101: The terminal requests, according to the received positioning and playing operation, the server to obtain a fragment index of the movie, where the request carries a time point of the positioning and playing operation;

Step 102: The terminal receives a fragment index that is regenerated by the server from the key frame after the key frame is found according to the time point of the positioning and playing operation;

After receiving the request for obtaining the slice index of the movie and the time point of the positioning and playing operation, the server obtains the corresponding movie key frame according to the time point of the positioning operation operation, regenerates the fragment index from the key frame, and re-creates the fragment index. The generated fragment index is sent to the terminal. Specifically, the first fragmentation duration of the regenerated fragment index is: The time point at which the key frame ends the original fragment minus the time point of the key frame, and the other fragment durations of the fragment index remain unchanged from the original duration. The point in time at which the original fragment ends refers to the point in time at which the fragment of the key frame ends before the fragment index is regenerated. The original length refers to the length of the corresponding fragment before the fragment index is regenerated.

Step 103: The terminal acquires a slice of the movie according to the received regenerated fragment index, and then performs a solution. Code playback.

FIG. 2 is a flowchart of a multi-code rate positioning and playing method based on a hypertext transfer protocol according to another embodiment of the present invention. As shown in FIG. 2, the method includes:

Step 201: The terminal receives a positioning and playing operation performed by the user.

The user can perform the positioning operation through the progress bar displayed by the terminal during the playing process. Of course, it is also suitable for the playback function under the bookmark settings. The terminal can perform playback operations according to the bookmark time point set by the user. Specifically, the terminal may be a mobile phone, a personal computer, or the like.

Step 202: The terminal requests the server to obtain a fragment index of the movie, and carries the time point of the user positioning playback operation in the request.

The terminal can carry the time point of the user positioning playback operation in the following manner: a Uniform Resource Locator (URL) parameter, a URL path, an extended HTTP protocol field, and the like.

Step 203: The server searches for key frame information corresponding to the time point of the positioning and playing operation according to the received time point of the positioning and playing operation, and regenerates the fragment index from the key frame.

The length of the first fragment of the regenerated fragment index = the end time of the original fragment of the key frame minus the time point of the key frame, and the duration of other fragments remains unchanged. At the same time, in order to ensure the validity of the device cache such as CDN acceleration, the first fragment ID of the regenerated fragment index is not cacheable, and the remaining fragments are cacheable.

An example of a specific server-generated slice index is provided below. Assume that the key frame interval of the media file is 1 second, and the duration of one slice is 10 seconds, that is, one slice contains 10 key frames. For example, slice 1 (Frag-l.ts) contains keyframes 1 to 10, slice 2 (Frag-2.ts) contains keyframes 11 to 20, and slice 3 (Frag-3.ts) contains keyframe 21 ~30, Fragment 4 (Frag-4.ts) contains keyframes 31~40. When the user locates the playback to 14 seconds, the fragment index generated by the server can be as follows (using the Apple HTTP stream specification as an example):

#EXTM3U

#EXT-X-TARGETDURATION: 10 #EXTINF:7,

Frag-2.ts?playseek=14

#EXTINF:10,

Frag-3.ts

#EXTINF:10,

Frag-4.ts

#EXT-X-ENDLIST

Compared with the fragment index generated by the server when the following user starts playing, it can be seen that the fragmentation duration of the first fragment index = the original fragment end time point of the key frame minus the key frame time point, other fragments. The duration remains the same.

#EXTM3U

#EXT-X-TARGETDURATION: 10

#EXTINF:10,

Frag-l.ts

#EXTINF:10,

Frag-2.ts

#EXTINF:10,

Frag-3.ts

#EXTINF:10,

Frag-4.ts

#EXT-X-ENDLIST

Step 204: The server returns a regenerated fragment index to the terminal.

Step 205: The terminal requests fragmentation of the movie according to the new fragment index.

Step 206: The server returns a slice of the movie to the terminal.

Step 207: The terminal performs decoding and decoding of the fragment, dynamically measures the access bandwidth in the fragment downloading process, and switches the code rate of the fragment according to the access bandwidth.

An embodiment of the present invention provides a multi-code rate positioning and playing method based on a hypertext protocol, which acquires a time point of a positioning and playing operation by using a terminal, and requests a server to obtain a segment index of the movie and carries the fixed index. At the time of the bit playback operation, the receiving server re-generates the slice index according to the key frame information obtained at the time point of the positioning playback operation, and requests the film segmentation according to the regenerated fragment index, thereby effectively solving the multi-rate video server solution. The problem that the positioning playback accuracy is not high when the middle slice length is long.

FIG. 3 is a schematic structural diagram of a terminal according to an embodiment of the present invention. As shown in FIG. 3, the terminal includes: a requesting module 301, a receiving module 302, and a playing module 303. The requesting module 301 is configured to, according to the received positioning and playing operation, request the server to obtain a fragment index of the movie, where the request carries a time point of the positioning playing operation. The receiving module 302 is configured to receive a fragment index that is regenerated by the server from the key frame after the key frame is found according to the time point of the positioning playback operation. The playing module 303 is configured to obtain a slice of the movie according to the received regenerated allocation index, and then perform decoding and playing.

In an embodiment, the requesting module 301 includes: a receiving unit, configured to receive a positioning operation during a movie playing, or to receive a bookmark playing operation.

FIG. 4 is a schematic structural diagram of a server according to an embodiment of the present invention. As shown in FIG. 4, the server includes: a receiving module 401, an obtaining module 402, a generating module 403, and a sending module 404. The receiving module 401 is configured to receive a fragment index that is sent by the terminal to obtain a movie, where the request carries a time point of the positioning playing operation, and the obtaining module 402 is configured to obtain a corresponding movie key frame according to the time point of the positioning playing operation. The generating module 403 is configured to regenerate the fragment index from the obtained key frame; the sending module 404 is configured to send the regenerated fragment index to the terminal, so that the terminal obtains the fragment of the movie according to the regenerated fragment index. Perform decoding playback.

In an embodiment, the generating module 403 includes: a first generating unit and a second generating unit. The first generating unit is configured to regenerate an index corresponding to the first fragment in the fragment index, where the fragmentation duration of the first fragment is: a time point at which the original fragment ends the key frame minus the key frame Time point. The second generating unit is configured to regenerate an index of the fragment index corresponding to the other fragments except the first fragment, wherein the fragmentation duration and the original duration of the other fragment remain unchanged.

FIG. 5 is a schematic structural diagram of a multi-code rate positioning and playing system based on a hypertext transfer protocol according to an embodiment of the present invention. The system may include the terminal 501 provided in the foregoing embodiment and the server 502 provided in the foregoing embodiment. The embodiment of the present invention provides a multi-code rate positioning and playing system based on a hypertext transfer protocol, obtains a time point of positioning and playing by the terminal, and requests a server to obtain a segment index of the movie and carries a time point of the positioning and playing operation, and the receiving server according to the receiving server Positioning the key frame information obtained at the time of the playback operation to start the regenerated fragment index, and requesting the movie fragment according to the regenerated fragment index, effectively solving the case where the fragmentation duration is long in the multi-rate video server solution. The problem of positioning playback is not high.

A person skilled in the art can understand that all or part of the steps of implementing the above method embodiments may be completed by using hardware related to program instructions, and the foregoing program may be stored in a computer readable storage medium, and the program is executed when executed. The method includes the steps of the foregoing method embodiments; and the foregoing storage medium includes: a medium that can store program codes, such as a ROM, a RAM, a magnetic disk, or an optical disk.

It should be noted that the above embodiments are only for explaining the technical solutions of the present invention, and are not intended to be limiting; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those skilled in the art that: The technical solutions described in the foregoing embodiments are modified, or some of the technical features are equivalently replaced. The modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

Rights request

A multi-code rate positioning and playing method based on a hypertext transfer protocol, comprising: receiving, by the terminal, a fragment index of a movie according to the received positioning and playing operation, wherein the request carries the positioning The time point of the playback operation;

2. The method according to claim 1, wherein the received positioning and playing operation comprises:

A positioning operation or a bookmark playback operation received during movie playback.

A multi-rate positioning and playing method based on a hypertext transfer protocol, comprising: receiving, by a server, a fragment index of a request for acquiring a movie, wherein the request carries a time point of a positioning play operation;

Regenerating the slice index from the key frame;

The method according to claim 3, wherein the fragmentation duration of the first fragment of the regenerated fragment index is: a time point at which the key frame ends the end of the original fragment minus the key frame time

5. A terminal, comprising:

a receiving module, configured to receive, by the server, a fragment index that is regenerated from the key frame after the key frame is found according to the time point;

a playing module, configured to obtain a slice of the movie according to the received regenerated fragment index Decode playback.

The terminal according to claim 5, wherein the requesting module comprises: a receiving unit, configured to receive a positioning operation during a movie playing process, or to receive a bookmark playing operation.

7. A server, comprising:

Obtaining a module, configured to obtain a corresponding movie key frame according to the time point of the positioning playback operation; and a generating module, configured to regenerate the fragmentation index from the key frame;

The server according to claim 7, wherein the generating module comprises: a first generating unit, configured to regenerate an index of a corresponding first fragment in the fragment index, wherein the first part The slice duration of the slice is: a time point at which the key frame ends the original slice minus the time point of the key frame;

The second generating unit is configured to regenerate an index corresponding to the other fragments except the first fragment in the fragment index, where the fragmentation duration and the original duration of the other fragments remain unchanged.

A multi-rate positioning playback system based on a hypertext transfer protocol, comprising the terminal according to claim 5 or 6, and the server according to claim 7 or 8.