WO2012010714A1 - Method for transferring video chunks, server entity, client entity and intermediate network entity realizing such a method - Google Patents

Method for transferring video chunks, server entity, client entity and intermediate network entity realizing such a method Download PDF

Info

Publication number
WO2012010714A1
WO2012010714A1 PCT/EP2011/062765 EP2011062765W WO2012010714A1 WO 2012010714 A1 WO2012010714 A1 WO 2012010714A1 EP 2011062765 W EP2011062765 W EP 2011062765W WO 2012010714 A1 WO2012010714 A1 WO 2012010714A1
Authority
WO
WIPO (PCT)
Prior art keywords
entity
encoded
chunks
client
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/EP2011/062765
Other languages
French (fr)
Inventor
Rafaël Huysegems
Stefan Custers
Bart De Vleeschauwer
Werner Van Leekwijck
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alcatel Lucent SAS
Original Assignee
Alcatel Lucent SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alcatel Lucent SAS filed Critical Alcatel Lucent SAS
Priority to US13/811,470 priority Critical patent/US20130185759A1/en
Priority to KR1020137004467A priority patent/KR101446450B1/en
Priority to CN2011800359930A priority patent/CN103026727A/en
Priority to JP2013520167A priority patent/JP2013535892A/en
Publication of WO2012010714A1 publication Critical patent/WO2012010714A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808—Management of client data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/24—Systems for the transmission of television signals using pulse code modulation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/612—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/752—Media network packet handling adapting media to network capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80—Responding to QoS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management e.g. creating a master electronic programme guide from data received from the Internet and a Head-end or controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4621—Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments

Definitions

  • the invention relates to a method for providing video chunks to a client entity using a request-response protocol, each video chunk being available at a server entity as a plurality of encoded video chunks encoded according to respective quality levels said method including the steps of :
  • said client entity making a selection of one quality level of said different quality levels based on criteria related to local transfer bandwidth related parameters
  • HTTP adaptive streaming known for instance from the “HTTP -Based Adapting Streaming” part of the "IIS Smooth Streaming Technical Overview” by Alex Zambelli (Microsoft Silverlight).
  • HAS relies on the availability at a server or at an intermediate or caching element of video files in different qualities and segmented time slots, also called chunks, of for instance 2 seconds duration.
  • Time segments of different qualities can be combined when viewing the video.
  • HTTP adaptive streaming enables the client entity to view the video in the highest quality estimated possible, and to request lower quality segments when the available bandwidth in the network is insufficient, or at start-up of a new video in order to enable quick start through downloading initial segments of lower quality.
  • the client entity shall try to keep its buffer filled to a certain level, e.g. 20 to 30 seconds playback time. When the buffer depletes, the client starts requesting lower quality segments of the video file in order to fill up the buffer more quickly and avoid freezing of the video.
  • Bandwidth fluctuations can have several causes such as :
  • Chunk caching by intermediate HTTP-proxies can have the same effect on the perceived bandwidth. Chunks that are cached close to the client (including the internal cache of the client) can be retrieved very fast, indicating a high available bandwidth. Chunks that are not cached must be fetched from the server and are retrieved relatively slowly compared to the cached segments. From the perspective of the client the available bandwidth on the link will strongly fluctuate and this will influence the quality level decision taking.
  • the method according to the invention realizes this object in that it includes the additional steps of said server entity sending to said client entity additional information related to a transfer time of said encoded chunks from said server entity to said client entity and said client entity in making said selection of said one quality level taking into account also said additional information.
  • the additional information received from the server entity enables the client (within some margin of accuracy) to 'calculate' the highest quality level that can be achieved without causing a buffer under-run.
  • An additional feature of an embodiment of the method according to the invention is that said server entity sends said additional information upon request from said client entity. In this way the client entity determines the timing and frequency of the quality selection.
  • Another additional feature of an embodiment of the method according to the invention is that communication between said server entity and said client entity is performed via an intermediate network element and that said method includes the additional step of said intermediate network element updating said additional information to take into account local information available at said intermediate network element such as, but not limited to possibly cached chunks or transfer time needed to transfer video chunks from said intermediate network element to said client entity or profile information of said client entity or any combination thereof.
  • the invention also relates to a server entity, to a client entity and to an intermediate network entity realizing the method according to the invention.
  • Embodiments of a server entity, of a client entity and of an intermediate network element realizing the present invention are hereafter described, by way of example only, and with reference to the accompanying Figure that represents a network where a server entity S communicates with a client entity C via the Web either directly or via an intermediate network element IN. S also communicates with a Network management module NM.
  • S contains a server storage entity SSTE, a server receiving entity SRE, a server sending entity SSE, a server processing entity SPE and a server manager SM.
  • S uses the Hypertext Transfer Protocol (HTTP) to provide video streams to C either directly or via IN that acts as a caching entity.
  • HTTP Hypertext Transfer Protocol
  • the video source is cut in chunks of typically 2 to 4 seconds long that are encoded using the desired delivery code format. How this is done is not desribed in detail as it is not the subject of this invention.
  • the coding can be done by S or by an external encoder.
  • the chunks are stored in S by SSTE and are delivered by means of adaptive streaming. To this end the chunks are encoded using different bit rates corresponding to different quality levels.
  • IN contains a receiving part INRE, a processing part INPE, a sending part INSE and a storage part INSE. It functions as caching element for video chunks to be sent to C to reduce the transmission time of these chunks and to reduce the load on the network.
  • C contains a receiving part CRE, a sending part CSE and a processing part
  • C In order to have video chunks sent to it, C, or more specifically CSE in C, in a first instance sends a request to S to get information on the available quality levels this is a so called manifest request. In the shown embodiment this request is sent directly to S, but this can equally well be done via IN.
  • S receives this request via SRE and transmits it to SPE.
  • SPE is adapted to retrieve the information on the available quality levels from SSTE.
  • SM Is adapted to obtain from a network manager module NM via the network, bandwidth related information on parameters that can influence the time needed to transfer video chunks to C, such as network load and bandwidth reserved for C. This information is forwarded to SPE that is adapted to evaluate this transfer time based on the bandwidth related information, on the size of the available chunks and on local information such as the load of the server.
  • bandwidth related information on parameters that can influence the time needed to transfer video chunks to C, such as network load and bandwidth reserved for C.
  • t estimated transfer time
  • BW bandwidth available from server to client
  • s size of the segment
  • RTT round trip time (client-server-client)
  • Ts processing time needed by the server to handle the request.
  • Information on t is then, together with the information on the available quality levels, sent to SSE in the form of a so called manifest message, for transmission to C.
  • This transmission is done via IN.
  • IN receives the message in INRE that transmits it to INPE where the information on the evaluated transfer time in the manifest message is possibly adapted based on what chunks are cached by IN, on the quality levels available in IN and on how this availability near to C can influence the transfer time.
  • the updated manifest message is then forwarded to INSE for transmission to C.
  • IN is a caching unit.
  • IN can however also be an access node such as a DSLAM node.
  • the evaluated download time is adapted in function of the type of access link (ADSL, VDSL, fiber ).
  • C receives the manifest message via CSE that passes it on to CPE.
  • CPE uses the estimated download times and the locally available information on the size of its local buffers (not shown in the figure) that are used to buffer the chunks before displaying them to a user (also not shown) to calculate the highest quality level that can be achieved for the transfer without causing a buffer over/under-run.
  • Information on this calculated quality level is inserted in a chunk request message that is forwarded to CRE for transfer to S via IN, in order to obtain video chunks with the requested quality level. This request is then handled either by IN if the requested chunks are cached or is forwarded to S by IN if they are not available at IN and the requested chunks are sent to C.
  • C periodically sends out such manifest requests in order to become aware of changes in the evaluated transfer time due to changes in the network or in S, such as fluctuations of the network load, changes in the caching conditions, changes in the load of S.
  • SPE in S periodically checks via SM if there are no sudden changes in the network conditions that could have a relevant impact on the evaluated transfer time. If they occur the evaluated transfer time is recalculated and a new manifest message is sent to C. In alternative embodiments this checking is done by SM, or triggers are received from the network whenever changes in the network conditions occur.
  • the described functions may be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software.
  • the functions may be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which may be shared.
  • Other hardware, conventional and/or custom, may also be included.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Computer Graphics (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

Method to provide video chunks to a client entity (C) using a request-response protocol. Each video chunk is available at a server entity (S) as a plurality of encoded video chunks encoded according to respective quality levels. The method includes the steps of : -the server entity sending to the client entity information on the different quality levels, -the client entity making a selection of one quality level of the different quality levels based on criteria related to local transfer bandwidth related parameters, -the client entity requesting the server entity to transfer to it encoded chunks encoded in that one chunk quality level and -the server entity sending the encoded chunks encoded according to that one chunk quality level to said client entity, -the server entity sending to the client entity additional information related to a transfer time of the encoded chunks from the server entity to the client entity, and -the client entity in making the selection of the one quality level taking into account also the additional information.

Description

METHOD FOR TRANSFERRING VIDEO CHUNKS, SERVER ENTITY,
CLIENT ENTITY AND INTERMEDIATE NETWORK ENTITY REALIZING
SUCH A METHOD
The invention relates to a method for providing video chunks to a client entity using a request-response protocol, each video chunk being available at a server entity as a plurality of encoded video chunks encoded according to respective quality levels said method including the steps of :
- said server entity sending to said client entity information on said different quality levels,
- said client entity making a selection of one quality level of said different quality levels based on criteria related to local transfer bandwidth related parameters,
- said client entity requesting said server entity to transfer to it encoded chunks encoded in said one chunk quality level and
- said server entity sending said encoded chunks encoded according to said one chunk quality level to said client entity,
For efficient delivery of video files over the Internet, real-time protocols such as RTP (Real-time Transport Protocol) and UDP (User Diagram Protocol) have been developed. Due to the availability Content Delivery Networks (CDNs) with HTTP caching nodes for popular web pages, the familiarity of webpage developers with HTTP technology, and the more easy firewall traversal of HTTP/TCP since firewalls are configured to pass websites that are accessed through the web browser, there is a tendency to use non real-time protocols such as HTTP/TCP increasingly for delivery of video files over the Internet. There exist different categories of solutions for delivering video files over the Internet via non real-time protocols such as HTTP/TCP. One of them is adaptive streaming. HTTP adaptive streaming (HAS), known for instance from the "HTTP -Based Adapting Streaming" part of the "IIS Smooth Streaming Technical Overview" by Alex Zambelli (Microsoft Silverlight). HAS relies on the availability at a server or at an intermediate or caching element of video files in different qualities and segmented time slots, also called chunks, of for instance 2 seconds duration.
Time segments of different qualities can be combined when viewing the video. HTTP adaptive streaming enables the client entity to view the video in the highest quality estimated possible, and to request lower quality segments when the available bandwidth in the network is insufficient, or at start-up of a new video in order to enable quick start through downloading initial segments of lower quality. Typically, the client entity shall try to keep its buffer filled to a certain level, e.g. 20 to 30 seconds playback time. When the buffer depletes, the client starts requesting lower quality segments of the video file in order to fill up the buffer more quickly and avoid freezing of the video.
Since the choice of the quality level influences the required bandwidth to download the corresponding encoded chunks, sudden fluctuations in the available network bandwidth are challenging for the selection of the chunk quality. In case a number of subsequent chunks can be downloaded at a high speed, it can be decided to go to a higher video quality level and as long as chunks can be transferred quickly, it will be decided to further increase the quality level for the viewer. If the bandwidth suddenly drops, the high-quality chunk that is at that moment downloaded must be finished completely at the lower bandwidth. This has a severe impact on the filling level of the buffer at the client entity that stores the chunks before displaying them to a client's user. This can even lead to complete buffer starvation, resulting in a video freeze for the viewer.
Bandwidth fluctuations can have several causes such as :
- Transfer of chunks over a wireless link where the proximity to the nearest base-station antenna together with interference effects can play an important role.
- Chunk caching by intermediate HTTP-proxies can have the same effect on the perceived bandwidth. Chunks that are cached close to the client (including the internal cache of the client) can be retrieved very fast, indicating a high available bandwidth. Chunks that are not cached must be fetched from the server and are retrieved relatively slowly compared to the cached segments. From the perspective of the client the available bandwidth on the link will strongly fluctuate and this will influence the quality level decision taking.
- Transfer of chunks over a shared link. Depending on the load generated by other users, the available bandwidth for one client can drastically change.
At any time, a balance has to be found when selecting a quality level. If the selection is adapted too quickly, this will result in a lot of unnecessary quality variations which can be disturbing for the viewer. If the decision taking is not reactive enough, this will result in a more constant display quality at the risk of invoking a buffer under-run.
Because it is not possible on the client side to make solid predictions in case of strong bandwidth fluctuations, the achieved quality is sub-optimal. On top, there is a risk for buffer starvation.
It is an object of the invention to overcome the above shortcomings of the known method.
The method according to the invention realizes this object in that it includes the additional steps of said server entity sending to said client entity additional information related to a transfer time of said encoded chunks from said server entity to said client entity and said client entity in making said selection of said one quality level taking into account also said additional information.
In this way, instead of following a pure 'trial and error/recovery' style of prediction of the optimal quality level , the additional information received from the server entity enables the client (within some margin of accuracy) to 'calculate' the highest quality level that can be achieved without causing a buffer under-run.
An additional feature of an embodiment of the method according to the invention is that said server entity sends said additional information upon request from said client entity. In this way the client entity determines the timing and frequency of the quality selection.
Another additional feature of an embodiment of the method according to the invention is that said additional information is sent together with said information on said quality levels. In this way the above additional feature is realized whilst in the same time limiting the number of transfers of information. Still another additional feature of an embodiment of the method according to the invention is that said server entity sends said additional information whenever a predetermined relevant change in said transfer time occurs. In this way, in a system where the additional information is provided upon request from the client entity, this client entity will be made aware of relevant changes in the transfer time occuring between two information requests.
Another additional feature of an embodiment of the method according to the invention is that communication between said server entity and said client entity is performed via an intermediate network element and that said method includes the additional step of said intermediate network element updating said additional information to take into account local information available at said intermediate network element such as, but not limited to possibly cached chunks or transfer time needed to transfer video chunks from said intermediate network element to said client entity or profile information of said client entity or any combination thereof.
Intermediate network elements could influence the transfer time of the chunks. F.i. caches could reduce that estimated transfer time. Also, the bandwidth available to or needed by a client can be dependent on the client's profile f.i. on its subscription agreement or on its viewing behavior respectively. This additional feature makes it possible to inform the client entity thereof.
The invention also relates to a server entity, to a client entity and to an intermediate network entity realizing the method according to the invention.
Embodiments of a server entity, of a client entity and of an intermediate network element realizing the present invention are hereafter described, by way of example only, and with reference to the accompanying Figure that represents a network where a server entity S communicates with a client entity C via the Web either directly or via an intermediate network element IN. S also communicates with a Network management module NM.
For the sake of clarity the web connections between S, NM, IN and C are represented by single lines.
S contains a server storage entity SSTE, a server receiving entity SRE, a server sending entity SSE, a server processing entity SPE and a server manager SM. S uses the Hypertext Transfer Protocol (HTTP) to provide video streams to C either directly or via IN that acts as a caching entity. The video source is cut in chunks of typically 2 to 4 seconds long that are encoded using the desired delivery code format. How this is done is not desribed in detail as it is not the subject of this invention. The coding can be done by S or by an external encoder. The chunks are stored in S by SSTE and are delivered by means of adaptive streaming. To this end the chunks are encoded using different bit rates corresponding to different quality levels.
IN contains a receiving part INRE, a processing part INPE, a sending part INSE and a storage part INSE. It functions as caching element for video chunks to be sent to C to reduce the transmission time of these chunks and to reduce the load on the network.
C contains a receiving part CRE, a sending part CSE and a processing part
CPE.
In order to have video chunks sent to it, C, or more specifically CSE in C, in a first instance sends a request to S to get information on the available quality levels this is a so called manifest request. In the shown embodiment this request is sent directly to S, but this can equally well be done via IN.
S receives this request via SRE and transmits it to SPE. SPE is adapted to retrieve the information on the available quality levels from SSTE. SM Is adapted to obtain from a network manager module NM via the network, bandwidth related information on parameters that can influence the time needed to transfer video chunks to C, such as network load and bandwidth reserved for C. This information is forwarded to SPE that is adapted to evaluate this transfer time based on the bandwidth related information, on the size of the available chunks and on local information such as the load of the server. For the calculation following formula is used in the considered implementation, but other formulas can be used as well :
(t = BW/s + RTT + Ts)
with t = estimated transfer time, BW = bandwidth available from server to client, s = size of the segment, RTT = round trip time (client-server-client), Ts = processing time needed by the server to handle the request. Information on t is then, together with the information on the available quality levels, sent to SSE in the form of a so called manifest message, for transmission to C. This transmission is done via IN. IN receives the message in INRE that transmits it to INPE where the information on the evaluated transfer time in the manifest message is possibly adapted based on what chunks are cached by IN, on the quality levels available in IN and on how this availability near to C can influence the transfer time. In the considered embodiment
IN modifies the time to
tu = BWI/s + RTTI + Tsl if the chunk is available in the cache,
with tu = updated estimated transfer time, BWI = bandwidth available from IN to client, s = size of the segment, RTTI = round trip time (client-IN-client), Tsl = processing time needed by the IN to handle the request. Again in alternative embodiments other formulas could be used as well. The updated manifest message is then forwarded to INSE for transmission to C.
It has to be noted that in the considered embodiment IN is a caching unit. In an alternative embodiment IN can however also be an access node such as a DSLAM node. In this case the evaluated download time is adapted in function of the type of access link (ADSL, VDSL, fiber ...).
C receives the manifest message via CSE that passes it on to CPE. CPE uses the estimated download times and the locally available information on the size of its local buffers (not shown in the figure) that are used to buffer the chunks before displaying them to a user (also not shown) to calculate the highest quality level that can be achieved for the transfer without causing a buffer over/under-run. Information on this calculated quality level is inserted in a chunk request message that is forwarded to CRE for transfer to S via IN, in order to obtain video chunks with the requested quality level. This request is then handled either by IN if the requested chunks are cached or is forwarded to S by IN if they are not available at IN and the requested chunks are sent to C.
C periodically sends out such manifest requests in order to become aware of changes in the evaluated transfer time due to changes in the network or in S, such as fluctuations of the network load, changes in the caching conditions, changes in the load of S.
In addition, SPE in S periodically checks via SM if there are no sudden changes in the network conditions that could have a relevant impact on the evaluated transfer time. If they occur the evaluated transfer time is recalculated and a new manifest message is sent to C. In alternative embodiments this checking is done by SM, or triggers are received from the network whenever changes in the network conditions occur.
How the video chunks are encoded and decoded and how they are streamed to the user is not described herein since this is not the subject of the invention.
Also, the implementation of the functional blocks in S, IN and C is not described in details as this implementation should be quite straightforward for a person skilled in the art based on the above functional descriptions.
In addition it should be noted that the described functions may be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software. When provided by a processor, the functions may be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which may be shared. Other hardware, conventional and/or custom, may also be included.
The above description and drawing merely illustrate the principles of the invention. It will thus be appreciated that, based on this description, those skilled in the art will be able to devise various arrangements that, although not explicitly described or shown herein, embody the principles of the invention and are included within its spirit and scope. Furthermore, the examples recited herein are principally intended expressly to be only for pedagogical purposes to aid the reader in understanding the principles of the invention and the concepts contributed by the inventor(s) to furthering the art, and are to be construed as being without limitation to such specifically recited example and conditions and all statements herein reciting principles, aspects, and embodiments of the invention, as well as specific example thereof, are intended to encompass equivalents thereof.

Claims

1. Method for providing video chunks to a client entity (C) using a request-response protocol, each video chunk being available at a server entity (S) as a plurality of encoded video chunks encoded according to respective quality levels said method including the steps of :
- said server entity sending to said client entity information on said different quality levels,
- said client entity making a selection of one quality level of said different quality levels based on criteria related to local transfer bandwidth related parameters,
- said client entity requesting said server entity to transfer to it encoded chunks encoded in said one chunk quality level and
- said server entity sending said encoded chunks encoded according to said one chunk quality level to said client entity,
characterized in that said method includes the aditional steps of :
said server entity sending to said client entity additional information related to a transfer time of said encoded chunks from said server entity to said client entity
said client entity in making said selection of said one quality level taking into account also said additional information.
2. Method according to claim 1, characterized in that said server entity (S) derives said additional information from at least one of a list of parameters said list including but not being limited to the size of said encoded chunks, the load of said server, the load of a network over which said encoded chunks are transferred, bandwidth reserved on said network for said client entity.
3. Method according to claim 1, characterized in that said server entity (S) sends said additional information upon request from said client entity (C).
4. Method according to claim 3, characterized in that said additional information is sent together with said information on said quality levels.
5. Method according to claim 1, characterized in that said server entity (S) sends said additional information whenever a predetermined relevant change in said transfer time occurs.
6. Method according to claim 1, characterized in that communication between said server entity (S) and said client entity (C) is performed via an intermediate network element and that said method includes the additional step of said intermediate network element (EST) updating said additional information to take into account local information available at said intermediate network element (EST) such as, but not limited to possibly cached chunks or transfer time needed to transfer video chunks from said intermediate network element (EST) to said client entity (C) or profile information of said client entity (C) or any combination thereof.
7. Server entity (S) to realize a method according to claim 1, said server entity (S) including a storage entity (SSTE) adapted to store video chunks, each video chunk being stored as a plurality of encoded video chunks each encoded according to respective quality levels, a transmission entity (SSE) adapted to send to a client entity (C) information on said different quality levels, a receiving entity (SRE) adapted to receive from said client entity (C) a request to transfer to it encoded chunks encoded in a selected chunk quality level, said transmission entity (SSE) being additionally adapted to send said encoded chunks encoded in said selected quality level to said client entity (C) , characterized in that said server entity (S) also includes a processing entity (SPE) adapted to generate additional information related to a transfer time of said encoded chunks from said server entity (S) to said client entity (C), said transmission entity being adapted to transfer said additional information to said client entity (C).
8. Server entity (S) according to claim 7, characterized in that said processing entity (SPE) is adapted to generate said additional information from at least one of a list of parameters including but not being limited to the size of said encoded chunks, the load of said server (S), the load of a network over which said encoded chunks are transferred, bandwidth reserved on said network for said client entity (C).
9. Server entity (S) according to claim 7, characterized in that said receiving entity
(SRE) is adapted to receive from said client entity (C) a request to send said additional information on said different quality levels and said transmission entity (SSE) being adapted to transfer said additional information to said client entity (C) upon receipt of said request.
10. Server entity (S) according to claim 9, characterized in that said transmission entity (SSE) is adapted to send said additional information together with said information on said different quality levels.
11. Server entity (S) according to claim 7 characterized in that said processing entity
(SPE) is adapted to generate said additional information upon detection of a predetermined relevant change in said transfer time and to then trigger said transmission entity to send said additional information.
12. Client entity (C) for realizing a method according to claim 1, said client entity
(C) including a receiving entity (CRE) adapted to receive information on possible quality levels of encoded video chunks, a selection entity (CPE) adapted to make a selection of one chunk quality level of said possible quality levels based on criteria related to locally available information on bandwidth needed to transfer said encoded video chunks, a sending entity (CSE) adapted to send to a server entity (S) a request to transfer to it encoded video chunks encoded in said one chunk quality level, said receiving entity (CRE) being adapted to receive said encoded video chunks, characterized in that said receiving entity (CRE) is also adapted to receive additional information related to a transfer time of said encoded chunks from said server entity (S) to said client entity (C) and that said selection entity (CPE) is additionally adapted to make said selection of said one quality level taking into account also said additional information.
13. Intermediate network entity (IN) for realizing a method according to claim 6, characterized in that said intermediate network entity (IN) includes a receiving module (INRE) adapted to receive information related to a transfer time for sending encoded video chunks from a server entity (S) to a client entity (C), a processing module (INPE) adapted to generate updated additional information, said updated additional information being an update of said additional information to take into account local information such as but not limited to information related to transfer time of video chunks from said intermediate network element (IN) to said client entity (C) or information on cached video chunks or profile information of said client entity (C) or any combination thereof, and a sending module (INSE) to send said updated additional information to said client entity.
PCT/EP2011/062765 2010-07-23 2011-07-25 Method for transferring video chunks, server entity, client entity and intermediate network entity realizing such a method Ceased WO2012010714A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US13/811,470 US20130185759A1 (en) 2010-07-23 2011-07-25 Method for transferring video chunks, server entity, client entity and intermediate network entity realizing such a method
KR1020137004467A KR101446450B1 (en) 2010-07-23 2011-07-25 Method for transferring video chunks, server entity, client entity and intermediate network entity realizing such a method
CN2011800359930A CN103026727A (en) 2010-07-23 2011-07-25 Method for transferring video chunks, server entity, client entity and intermediate network entity realizing such a method
JP2013520167A JP2013535892A (en) 2010-07-23 2011-07-25 Method for transmitting video chunks, server entity, client entity and intermediate network entity implementing such a method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP10305816A EP2410743A1 (en) 2010-07-23 2010-07-23 Method for transferring video chunks, server entity, client entity and intermediate network entity realizing such a method
EP10305816.0 2010-07-23

Publications (1)

Publication Number Publication Date
WO2012010714A1 true WO2012010714A1 (en) 2012-01-26

Family

ID=43447765

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2011/062765 Ceased WO2012010714A1 (en) 2010-07-23 2011-07-25 Method for transferring video chunks, server entity, client entity and intermediate network entity realizing such a method

Country Status (6)

Country Link
US (1) US20130185759A1 (en)
EP (1) EP2410743A1 (en)
JP (1) JP2013535892A (en)
KR (1) KR101446450B1 (en)
CN (1) CN103026727A (en)
WO (1) WO2012010714A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016502351A (en) * 2013-01-14 2016-01-21 ▲ホア▼▲ウェイ▼技術有限公司 Method, player, and terminal for selecting a bitstream segment based on streaming media
JP2018029392A (en) * 2012-10-19 2018-02-22 インターデイジタル パテント ホールディングス インコーポレイテッド Multi-hypothesis rate adaptation for HTTP streaming
US10523723B2 (en) 2014-06-06 2019-12-31 Koninklijke Kpn N.V. Method, system and various components of such a system for selecting a chunk identifier
US10609101B2 (en) 2013-07-03 2020-03-31 Koninklijke Kpn N.V. Streaming of segmented content
US11477262B2 (en) 2014-02-13 2022-10-18 Koninklijke Kpn N.V. Requesting multiple chunks from a network node on the basis of a single request message

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10142390B2 (en) 2013-02-15 2018-11-27 Nec Corporation Method and system for providing content in content delivery networks
US20140282792A1 (en) * 2013-03-15 2014-09-18 Cygnus Broadband, Inc. Video streaming with buffer occupancy prediction based quality adaptation
EP2819379A1 (en) 2013-06-28 2014-12-31 Thomson Licensing Method for adapting the downloading behavior of a client terminal configured to receive multimedia content, and corresponding terminal
US9386308B2 (en) * 2013-07-16 2016-07-05 Cisco Technology, Inc. Quality optimization with buffer and horizon constraints in adaptive streaming
KR101548501B1 (en) * 2014-04-07 2015-09-01 주식회사 바른기술 Chunk based seamless stream transmitting and receiving apparatus and the method thereof
WO2015198135A1 (en) * 2014-06-27 2015-12-30 Orange Method for method for estimating a transfer time of an electronic content prior to the transferring of the electronic content
US10033824B2 (en) * 2014-06-30 2018-07-24 Samsung Electronics Co., Ltd. Cache manifest for efficient peer assisted streaming
EP2993910A1 (en) * 2014-09-04 2016-03-09 Thomson Licensing Method and client terminal for receiving a multimedia content split into at least two successive segments, and corresponding computer program product and computer-readable medium.
US11818100B2 (en) * 2017-12-04 2023-11-14 Telefonaktiebolaget Lm Ericsson (Publ) Automatic provisioning of streaming policies for video streaming control in CDN

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040064573A1 (en) * 2000-12-15 2004-04-01 Leaning Anthony R Transmission and reception of audio and/or video material

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1132020A (en) * 1997-07-08 1999-02-02 Matsushita Electric Ind Co Ltd Data transmission system and data broadcasting system
JP4596693B2 (en) * 2000-07-06 2010-12-08 パナソニック株式会社 Streaming method and system for executing the same
WO2002049343A1 (en) * 2000-12-15 2002-06-20 British Telecommunications Public Limited Company Transmission and reception of audio and/or video material
US20030074379A1 (en) * 2001-10-11 2003-04-17 International Business Machines Corporation Apparatus and method of predicting file download time based on historical data
JP2004088621A (en) * 2002-08-28 2004-03-18 Ntt Docomo Inc Multimedia communication control method, multimedia communication control server, and multimedia communication system
JP4288994B2 (en) * 2003-04-10 2009-07-01 株式会社日立製作所 Terminal device, distribution server, video data receiving method, and video data transmitting method
JP2007194680A (en) * 2006-01-17 2007-08-02 Sharp Corp Video viewing method, communication terminal and program
US8379851B2 (en) * 2008-05-12 2013-02-19 Microsoft Corporation Optimized client side rate control and indexed file layout for streaming media
US8265140B2 (en) * 2008-09-30 2012-09-11 Microsoft Corporation Fine-grained client-side control of scalable media delivery
US9166711B2 (en) * 2008-11-19 2015-10-20 Qurio Holdings, Inc. Method and system to influence a viewer to select a feed
US9565239B2 (en) * 2009-05-29 2017-02-07 Orions Digital Systems, Inc. Selective access of multi-rate data from a server and/or peer
US8555163B2 (en) * 2010-06-09 2013-10-08 Microsoft Corporation Smooth streaming client component

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040064573A1 (en) * 2000-12-15 2004-04-01 Leaning Anthony R Transmission and reception of audio and/or video material

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
ALEX ZAMBELLI: "IIS Smooth Streaming Technical Overview", 23 March 2009 (2009-03-23), pages 1 - 17, XP002617719, Retrieved from the Internet <URL:http://www.microsoft.com/downloads/en/details.aspx?displaylang=en&FamilyID=03d22583-3ed6-44da-8464-b1b4b5ca7520> [retrieved on 20110124] *
DAVY VAN DEURSEN ET AL: "On media delivery protocols in the Web", IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2010, 19 July 2010 (2010-07-19), IEEE, PISCATAWAY, NJ, USA, pages 1028 - 1033, XP031760994, ISBN: 978-1-4244-7491-2 *
JARNIKOV D ET AL: "Client intelligence for adaptive streaming solutions", IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2010, 19 July 2010 (2010-07-19), IEEE, PISCATAWAY, NJ, USA, pages 1499 - 1504, XP031761591, ISBN: 978-1-4244-7491-2 *
NIKOLAUS FÄRBER ET AL: "Adaptive progressive download based on the MPEG-4 file format", JOURNAL OF ZHEJIANG UNIVERSITY SCIENCE A; AN INTERNATIONAL APPLIED PHYSICS & ENGINEERING JOURNAL, vol. 7, no. 1, 1 January 2006 (2006-01-01), SPRINGER, BERLIN, DE, pages 106 - 111, XP019385056, ISSN: 1862-1775, DOI: 10.1631/JZUS.2006.AS0106 *
RESEARCH IN MOTION UK LIMITED: "Use of Metadata for Client Controlled Adaptation of HTTP Streaming", 3GPP DRAFT; 3RD GENERATION PARTNERSHIP PROJECT, no. S4-090648, 12 August 2009 (2009-08-12), MOBILE COMPETENCE CENTRE; SOPHIA-ANTIPOLIS CEDEX; FRANCE, XP050356925 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018029392A (en) * 2012-10-19 2018-02-22 インターデイジタル パテント ホールディングス インコーポレイテッド Multi-hypothesis rate adaptation for HTTP streaming
JP2016502351A (en) * 2013-01-14 2016-01-21 ▲ホア▼▲ウェイ▼技術有限公司 Method, player, and terminal for selecting a bitstream segment based on streaming media
US10609101B2 (en) 2013-07-03 2020-03-31 Koninklijke Kpn N.V. Streaming of segmented content
US11477262B2 (en) 2014-02-13 2022-10-18 Koninklijke Kpn N.V. Requesting multiple chunks from a network node on the basis of a single request message
US10523723B2 (en) 2014-06-06 2019-12-31 Koninklijke Kpn N.V. Method, system and various components of such a system for selecting a chunk identifier

Also Published As

Publication number Publication date
EP2410743A1 (en) 2012-01-25
US20130185759A1 (en) 2013-07-18
JP2013535892A (en) 2013-09-12
KR20130028979A (en) 2013-03-20
CN103026727A (en) 2013-04-03
KR101446450B1 (en) 2014-10-01

Similar Documents

Publication Publication Date Title
EP2410743A1 (en) Method for transferring video chunks, server entity, client entity and intermediate network entity realizing such a method
US11477262B2 (en) Requesting multiple chunks from a network node on the basis of a single request message
US9197677B2 (en) Multi-tiered scalable media streaming systems and methods
US20170093949A1 (en) Adaptive variable fidelity media distribution system and method
US10531134B2 (en) Determining a time budget for transcoding of video
US20150319214A1 (en) Enhancing dash-like content streaming for content-centric networks
EP2999187A1 (en) Method, computer program product and server for streaming media content from a server to a client
CN104780199A (en) Method for downloading, at a client terminal, an upcoming sequence of segments of a multimedia content, and corresponding terminal
CN105191334A (en) A scheduler-based network virtual player for adaptive bitrate video playback
EP3238406B1 (en) Treatment method of application data delivery
CN107113332B (en) Apparatus, method and computer-readable medium for distributing media streams
CN102457486A (en) Method and device for transmitting media content
EP2410744A1 (en) Method for transferring video segments, client entity and proxy entity realizing such a method
JP2017510873A (en) Network information acquisition method by a client terminal configured to receive multimedia content divided into segments
CN106716962A (en) Server, method and computer program product for adaptive streaming of media content to a client
Bouten et al. A multicast-enabled delivery framework for QoE assurance of over-the-top services in multimedia access networks
Evensen et al. Adaptive media streaming to mobile devices: challenges, enhancements, and recommendations
KR102212973B1 (en) Method for providing a content part of a multimedia content to a client terminal, corresponding cache
US20140101330A1 (en) Method and apparatus for streaming multimedia contents
EP2819368A1 (en) Method for providing a content part of a multimedia content to a client terminal, corresponding cache
EP3014835B1 (en) Method for retrieving, by a client terminal, a content part of a multimedia content
CN112823527A (en) Method implemented at a device capable of running an adaptive streaming session and corresponding device
US20240298051A1 (en) Data relay apparatus, distribution system, data relay method, and computer-readable medium
Iacono et al. Efficient and adaptive web-native live video streaming

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201180035993.0

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11737946

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2013520167

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 20137004467

Country of ref document: KR

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 13811470

Country of ref document: US

122 Ep: pct application non-entry in european phase

Ref document number: 11737946

Country of ref document: EP

Kind code of ref document: A1