EP2543189A1 - Ajustement du débit binaire dans un système de flux de données adaptatif - Google Patents

Ajustement du débit binaire dans un système de flux de données adaptatif

Info

Publication number
EP2543189A1
EP2543189A1 EP11708597A EP11708597A EP2543189A1 EP 2543189 A1 EP2543189 A1 EP 2543189A1 EP 11708597 A EP11708597 A EP 11708597A EP 11708597 A EP11708597 A EP 11708597A EP 2543189 A1 EP2543189 A1 EP 2543189A1
Authority
EP
European Patent Office
Prior art keywords
bit stream
content
bit rate
bit
response
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP11708597A
Other languages
German (de)
English (en)
Inventor
Zhenyu Wu
Li Hua Zhu, (Eric)
Gad Moshe Berger
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thomson Licensing SAS
Original Assignee
Thomson Licensing SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing SAS filed Critical Thomson Licensing SAS
Publication of EP2543189A1 publication Critical patent/EP2543189A1/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/637—Control signals issued by the client directed to the server or network components
    • H04N21/6377—Control signals issued by the client directed to the server or network components directed to server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/612—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/613—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for the control of the source by the destination
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/752—Media network packet handling adapting media to network capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/756—Media network packet handling adapting media to device capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/762—Media network packet handling at the source 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80—Responding to QoS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2365—Multiplexing of several video streams
    • H04N21/23655—Statistical multiplexing, e.g. by controlling the encoder to alter its bitrate to optimize the bandwidth utilization
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2385—Channel allocation; Bandwidth allocation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44209—Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/637—Control signals issued by the client directed to the server or network components
    • H04N21/6373—Control signals issued by the client directed to the server or network components for rate control, e.g. request to the server to modify its transmission rate
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server

Definitions

  • the invention relates to a method and apparatus for adaptively streaming multiple video bit streams through a network node.
  • the apparatus may be in the form of a set top box for use with multiple television displays or other viewing devices.
  • the invention concerns methods and apparatuses for adaptively streaming multiple video bit streams through a network node is disclosed.
  • a system is taught where at least one of the video bit streams is scaled in response to a bandwidth limitation or availability, where the selection of the bit stream selected for scaling in made in response to at least one of a user defined, service provider defined, and usage analysis defined priority list.
  • the present invention generally relates to an apparatus and methods for streaming multiple video streams through a network node, where the network or network node has a limited bandwidth.
  • the system is operative to adjust the bit rates of multiple video bit streams when the system has insufficient or extra bandwidth capacity.
  • the methods and associated apparatus are suitable for use in a home, educational, or business environment where multiple video streams are networked and processed, and intelligent selection of playback quality for some video streams over other video streams is desired.
  • multiple video bit streams can share the bandwidth at a network node. It is possible that their aggregated bit rate either exceeds or is below the bandwidth capacity of the node. In the former case, network congestion can occur, which leads to packet drops or long packet delays. Playback quality can be severely impacted by those factors. In the latter case, the bandwidth resource is under utilization at the node and thus the viewing experience is not at its optimum.
  • Adaptive Bit rate Streaming (or Adaptive Streaming) is a technique used in streaming multimedia over computer networks. While in the past most video streaming technologies utilized streaming protocols such RTSP, today's adaptive streaming technologies are almost exclusively based on HTTP and designed to work efficiently over large distributed HTTP networks such as the Internet. It works by detecting a user's bandwidth and CPU capacity in real time and adjusting the quality of a video stream accordingly. It requires the use of an encoder which can encode a single source video at multiple bit rates. The player client switches between streaming the different encodings depending on available resources. Resulting in reduced buffering, fast start time and a good experience for both high-end and low-end connections.
  • An adaptive streaming system can address the above problem by informing the content servers to adjust the sending bit rates.
  • the node can reduce the bit rate of one or several video programs in case of bandwidth insufficiency, or increase the bit rate in the case of bandwidth surplus.
  • Adaptive bit rate streaming systems work by determining a network node's bandwidth and adjusting the quality of the video stream in response to that determination.
  • the system requires an encoder which can encode a single source video at multiple bit rates.
  • the node requests or selects one of the different encodings depending on its available resources. This results in the desirable qualities of little or no buffering, fast start times, and optimal experience for both speed end and low speed connections.
  • the network node can inform the server and let it make the decision on which content to scale.
  • the server may also reallocate the available bit rate among multiple video bit streams accordingly.
  • the network node can take another commonly used approach. With this approach, the node equally divides the available bandwidth among multiple video sources. As an example, the node can allocate 2 Mbps for each of the two video sources for a total available bandwidth of 4 Mbps. Then the node informs the corresponding servers about the updated rate allocation, and each server in turn adjusts its sending video bit rate.
  • One problem with the above approach is that it does not take the video content into account.
  • the system may arbitrarily choose a video bit stream to adjust in order to optimize its bandwidth usage, but this practice can lead to suboptimal performance or cause unfavorable user viewing experience. It would be desirable for a network node to intelligently choose a video bit stream to adjust bit rate based on predetermined criteria.
  • the invention described herein addresses this and/or other problems.
  • the present invention concerns an apparatus associated methods for receiving multiple streams of video content and providing it to network devices, as well as adaptively adjusting the bit rate of the video streams in response to a predetermined criteria.
  • a method comprising the steps of receiving a first bit stream having a first bit rate, receiving a second bit stream having a second bit rate, determining a total bit rate of said first bit stream and said second bit stream, determining a first content of said first bit stream and a second content of said second bit stream in response to said total bit stream
  • Additional aspects of the present invention concern when the priority may be determined by at least one of a user, a service provider, and in response to a usage analysis.
  • an apparatus comprising a source of a first bit stream, said first bit stream having a first bit rate, a source of a second bit stream, said second bit stream having a second bit rate, a processor for determining a first content of said first bit stream and a second content of said second bit stream in response to said total bit stream exceeding a threshold and requesting an adjustment of said first bit rate of said first bit stream in response to determining that said first content has a lower priority than said second content.
  • the invention may comprise a method in response to when an adjustment of said first bit rate is requested in response to a network node having available bandwidth in order to increase the video quality of said first bit stream and said lower priority indicates a requirement for higher quality video.
  • Another aspect of the invention may include a method comprising the steps of receiving a first bit stream having a first bit rate, receiving a second bit stream having a second bit rate, determining a total bit rate of said first bit stream and said second bit stream, determining a first content of said first bit stream and a second content of said second bit stream in response to said total bit stream being less than a threshold, and requesting an adjustment of said first bit rate of said first bit stream in response to determining that said first content has a higher priority than said second content.
  • Another aspect of the invention may comprise an apparatus comprising a source of a first bit stream, said first bit stream having a first bit rate, a source of a second bit stream, said second bit stream having a second bit rate, a processor for determining a first content of said first bit stream and a second content of said second bit stream in response to said total bit stream being less than a threshold and requesting an adjustment of said first bit rate of said first bit stream in response to determining that said first content has a higher priority than said second content.
  • FIG. 1 is a diagram of an embodiment of a system embodying aspects of the present invention
  • FIG. 2 is a flow chart of an exemplary method according to the present invention.
  • FIG. 3 is a flow chart of an exemplary method according to the present invention.
  • the exemplifications set out herein illustrate preferred embodiments of the invention, and such exemplifications are not to be construed as limiting the scope of the invention in any manner.
  • the present invention provides an apparatus and associated methods for receiving compressed video content and adjusting the compression ratio of the content in response to available bandwidth of the network or a portion of the network, such as a network node or network gateway device. Furthermore the invention describes a high-level modification to facilitate the implementation of this functionality within an adaptive streaming application, recognizing the lack of support for this feature from many existing media transport formats,
  • multiple video bit streams can share the bandwidth at some network node, e.g. a home gateway where multiple viewers in a house can watch different streaming video programs at the same time.
  • some network node e.g. a home gateway where multiple viewers in a house can watch different streaming video programs at the same time.
  • network congestion can occur.
  • the aggregated bit rate is below the node's bandwidth capacity, the available resource is under-utilized.
  • both problems can be solved by dynamically changing the bit rates of some video sources. The question remains as how to choose the appropriate video source to adjust bit rate.
  • Such a device may include advanced features, such as advanced user interfaces, the ability to receive and decoder content encoding in one of a plurality of coding formats, the ability to transmit requests onto a network in response to a bandwidth determination, as well as to receive web pages, audio content and other digital programming. While this invention has been described as having a preferred design, the present invention can be further modified within the spirit and scope of this disclosure. This application is therefore intended to cover any variations, uses, or adaptations of the invention using its general principles. For example, while the primary embodiment described receives and processes video content, this invention may be applied to audio, data, or multimedia content with equally desirable results.
  • FIG. 1 A diagram of an embodiment of a system embodying aspects of the present invention (100) is shown in Figure 1.
  • the system may receive a number of video streams (pA, pB, pC) from a number of servers (110, 120, 130). These video streams (pA, pB, pC) are transmitted over a network (140) to a home gateway (160).
  • the home gateway (160) can operate as a gateway to a home network (150) and is operative to process and couple these program streams to a variety of devices, including televisions (1 0), personal computers (180), set top boxes (190), and other network enabled devices.
  • a home gateway (160) or similar device has a limited bandwidth, for example 4 mbit per second.
  • the home gateway is capable of receiving and routing 2, 2 mbit per second video bit streams (pA, pB).
  • the home gateway (160) has no available bandwidth to process the 3 rd requested bit stream (pC).
  • the home gateway (160) must request, for example, that server sB (120) begin providing a 1 mbit bit stream, so that the home gateway can receive a 1 mbit bit stream sC from server sC (130).
  • a service provider or user may wish to prioritize which bit streams will start being received at a lower bit rate. For example, a user may wish to receive movies or sporting events at a higher bit rate, and therefore higher video quality, than news programming or children's programming.
  • a service provider may recognize that certain video content compresses better with less quality reduction than other types of content. For example, animated programs may compress better than sporting events.
  • the home gateway (160) can be a network router, a fiber optic multiplexer or the like.
  • the home gateway is operative to receive a first video stream (pA) from the network (140) and a second video stream (pB) from the network. These video streams may be sent by the same server or different server. Video streams may originate from the same server provider or different service providers.
  • the home gateway determines the total bandwidth utilized by the first video stream and the second video stream. If the total bandwidth utilized is greater than the maximum bandwidth allowed, at least one of the bit rates of at least one of the signals must be reduced.
  • the maximum bandwidth allowed can be a hard limit, such as the maximum bandwidth that can be facilitated by the home gateway (160), or it could be a soft limit, such as the maximum bandwidth allowed for video bit streams, leaving some available bandwidth for data, administrative, or auxiliary information. If the home gateway (160) determines that the maximum bandwidth has been exceeded, or would be exceeding if a bit stream was accepted, the home gateway (160) determines the content of the first bit stream and the content of the second bit stream. For example, the content of the first bit stream may be sports programming, and the content of the second bit stream may be animated programming. The home gateway compares each of these program types against a user defined priority list. The user creates a list where the types of programs are rated on a desirability scale.
  • the home gateway (160) uses this information to determine that the second bit stream, carrying the animated programming, should be reduced in bit rate.
  • the home gateway (160) sends a request to the server transmitting the second bit stream to reduce the bit rate of the second bit stream or to provide another version of the second bit stream with a lower bit rate.
  • the server may be transmitting the program in a number of bit streams with different bit rates, and the home gateway (160) may just need to switch to a different bit stream carrying that program.
  • the home gateway (160) may transmit the desired bitrate to the server, or the server may just step down the bit rate in predetermined increments.
  • a service provide may desire to scale certain types of programming over others. For example, a service provider may know from past experience that viewers describe an undesirable viewing experience when prime time network television or sporting events are scaled, as opposed to music programs or children's programming. In addition, the service provider may recognize that animated programming is easily compressed with little or no undesirable artifacts, where fast paced sport programming, such as ice hockey, does not compress easily and is subject to easily recognized artifacts. The service provider may provide a list of programming rankings to the home gateway (160), where the provided list is used to compare and request bit rate reductions or increases, according to criteria determined by the service provider.
  • the list may be automatically generated by the home gateway (160).
  • the home gateway may examine the type of content being viewed over the home network and generate usage statistics. If a user watches considerably more movies that children's programming, the home gateway may assume that the user desires higher quality movie bit streams that that of children's programming. Thus, when a reduction of bit rate is required, children's programming has a lower priority than movies.
  • This list may be altered or influenced by the user. For example, if a user is watching a certain program that has a lower priority, and the user desires a higher quality video, a user input can be received and the current programming will be moved higher on the priority list, either temporarily or permanently. Different video content exhibit different characteristics in terms of compression
  • each content server is capable of adaptive streaming in that it can switch between different copies of encoded video bit streams of the same video content and stream out a version with the average bit rate that matches best to the requested network bit rate.
  • the gateway can selectively scale back or boost the bit rate of one or multiple video sources. It can do so by following two criteria:
  • the viewers instruct the gateway about their video content type preferences.
  • a possible preference list can be: sports > movie > news > cartoon > sit-com
  • the gateway can automatically build a preference list, possibly over time, by analyzing the viewers' viewing habits. For example, more watched content types are given higher preference.
  • the gateway node can select video sources for rate adjustment more intelligently.
  • the node can first choose the video source with the least preferred content type to scale back its bit rate, followed by the next least one, and so on, until the bandwidth constraint is met.
  • the node can first choose the video source that has the most preferred content type to increase its bit rate, followed by the next preferred one, and so on, until the available bandwidth is fully occupied.
  • the user may also define a minimum bit rate for programming. In this instance, the lowest priority program is reduced to the minimum bit rate and the second lowest priority program's bit rate is reduced to meet the bandwidth requirements.
  • Statistical multiplexing is a commonly used technique at the encoding stage to exploit this diversity, when multiple video sequences are encoded to have a combined constant bit rate.
  • Statmux conceptually bit rate is allocated unevenly across video sequences according to their "easiness” measure, such that each time available bit rate is only given to the sequence that can most improve its visual quality.
  • the coding gain thus obtained is often called “Statmux gain”.
  • the Statmux principle can be similarly adopted by the gateway node to improve the overall (average) playback quality across all the video bit streams.
  • the gateway node can perform intelligent source selection. a. When the available bandwidth is not sufficient, the node can choose the bit stream with the "easiest” level to scale back its bit rate, so that its quality is least affected by the amount of rate cut among all the sources. Each time the node follows this rule until the adjusted total bit rate is within its bandwidth capacity.
  • the node can choose the the bit stream with the "hardest" level to increase its bit rate, so that its quality improves the most among all the sources. Each time the node follows this rule until the available bandwidth is fully occupied.
  • the network node there are a number of ways for the network node to obtain the "easiness" information of a video bit stream: (1 ) At client side, where a video bit stream is fully parsed and decoded, such information is most conveniently available. So it is possible for the gateway node to collect the information from clients. (2) The gateway partially parses and analyses a video bit stream to get an estimate. (3) Content serve provides the information. It is worth noting that Statmux gains become bigger with a more diverse video content set. In the future, it is expected that more video content types will be deployed and thus coexist, for example, MPEG-2, H.264, SVC, MVC, UltraHD, etc. That will make the video content diversity larger, and in turn increases the Statmux gain in the use case. To support existing standards, a field could be added in a transport packet header that contains a value that indicates the rate vs. visual distortion ratio for the video bit stream at its current bit rate, where the video bit stream is carried by transport stream that the packet belongs to.
  • a device may be receiving a video bit stream with errors indicating insufficient network bandwidth. These indications may include lost packets, delays, excessive buffering, or the like.
  • the device may then pole the other network devices to determined if the other network devices are receiving video bit streams and at what bit rate and what content.
  • the device may then compare this information to a priority list to determine which bit stream should be reduced.
  • the device may then request that the server transmitting the lowest priority bit stream lower the bit rate of that bit stream. Alternately, the device may request that the other network device receiving the lower priority bit stream request the reduction from the server.
  • the subroutine commences after detecting at least one bit stream session (205). After the subroutine commences (205), and then calculates the current total bit rate of all incoming video bit streams (210), if the sum exceeds an available bandwidth (215), a bit rate reduction amount is determined (230). If the available bandwidth is not exceeded, the system determines if all streaming sessions have ended (220). If so, the subroutine ends (225), waiting for another bit stream session. If there remains at least one bit stream session, the subroutine returns to step (210). Once the bit rate reduction amount is determined, in one example, the system queries a preference list to determine the least preferred bit stream (235).
  • the system checks the packet header to find the video with the smallest rate vs. visual distortion ratio 240 to determine the bit stream to be reduced (240). The subroutine then determines if all the video sessions have ended (245). If so, the subroutine ends (225), waiting for another bit stream session. If there remains at least one bit stream session, the subroutine sends a request to the video content server to reduce the bit rate of the selected bit stream by the calculated bit rate reduction amount (250). The subroutine then returns to step (210).
  • Figure 3 shows the operations it follows when the network or network gateway has bandwidth surplus.
  • an exemplary embodiment of the operation of the network node when it has a bandwidth surplus is shown (300).
  • the subroutine commences after detecting at least one bit stream session (305). After the subroutine commences (305), and then calculates the current total bit rate of all incoming video bit streams (310), if the sum is less than an available bandwidth threshold (315), a bit rate increase amount is determined (330). If the available bandwidth is not exceeded, the system determines if all streaming sessions have ended (320). If so, the subroutine ends (325), waiting for another bit stream session. If there remains at least one bit stream session, the subroutine returns to step (310).
  • the system queries a preference list to determine the most preferred bit stream (335).
  • the system checks the packet header to find the video with the greatest rate vs. visual distortion ratio (340) to determine the bit stream to be increased (340).
  • the subroutine determines if all the video sessions have ended (345). If so, the subroutine ends (325), waiting for another bit stream session. If there remains at least one bit stream session, the subroutine sends a request to the video content server to reduce the bit rate of the selected bit stream by the calculated bit rate reduction amount (350). The subroutine then returns to step (310).

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

La présente invention concerne un procédé et un appareil permettant une diffusion adaptative en continu de multiples flux de données binaires vidéo à travers un nœud de réseau. En particulier, un système est soumis à un apprentissage au cours duquel au moins un des flux de données binaires vidéo est mis à l'échelle en réponse à une limitation ou une disponibilité de largeur de bande, la sélection du flux de données binaires sélectionné pour la mise à l'échelle est faite en réponse à un utilisateur défini et/ou un fournisseur de services défini et/ou une liste définie de priorités d'analyse d'utilisation.
EP11708597A 2010-03-05 2011-03-02 Ajustement du débit binaire dans un système de flux de données adaptatif Withdrawn EP2543189A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US31097510P 2010-03-05 2010-03-05
PCT/US2011/000408 WO2011109101A1 (fr) 2010-03-05 2011-03-02 Ajustement du débit binaire dans un système de flux de données adaptatif

Publications (1)

Publication Number Publication Date
EP2543189A1 true EP2543189A1 (fr) 2013-01-09

Family

ID=43856146

Family Applications (1)

Application Number Title Priority Date Filing Date
EP11708597A Withdrawn EP2543189A1 (fr) 2010-03-05 2011-03-02 Ajustement du débit binaire dans un système de flux de données adaptatif

Country Status (6)

Country Link
US (1) US20130007831A1 (fr)
EP (1) EP2543189A1 (fr)
JP (1) JP2013521743A (fr)
KR (1) KR101478656B1 (fr)
CN (1) CN102783170A (fr)
WO (1) WO2011109101A1 (fr)

Families Citing this family (53)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100149301A1 (en) * 2008-12-15 2010-06-17 Microsoft Corporation Video Conferencing Subscription Using Multiple Bit Rate Streams
US8947492B2 (en) * 2010-06-18 2015-02-03 Microsoft Corporation Combining multiple bit rate and scalable video coding
EP2638682A4 (fr) * 2010-11-12 2014-07-23 Realnetworks Inc Gestion de trafic dans des protocoles de diffusion en flux adaptative
US20120278495A1 (en) * 2011-04-26 2012-11-01 Research In Motion Limited Representation grouping for http streaming
GB2495469B (en) 2011-09-02 2017-12-13 Skype Video coding
GB2495467B (en) * 2011-09-02 2017-12-13 Skype Video coding
GB2495468B (en) 2011-09-02 2017-12-13 Skype Video coding
EP2573997A1 (fr) * 2011-09-26 2013-03-27 Thomson Licensing Procédé de contrôle de la bande passante et dispositif correspondant
US8699333B2 (en) * 2011-09-29 2014-04-15 Cisco Technology, Inc. Congestion-based traffic shaping for distributed queuing in shared-media communication networks
EP2575302A1 (fr) 2011-09-30 2013-04-03 British Telecommunications Public Limited Company Procédé de gestion de bande passante pour la livraison de contenu et aspects correspondants
EP2605469A1 (fr) 2011-12-13 2013-06-19 Thomson Licensing Procédé et appareil pour contrôler une session de diffusion continue adaptative à trajets multiples
EP2608558A1 (fr) * 2011-12-22 2013-06-26 Thomson Licensing Système et procédé pour la diffusion adaptative dans un environnement à voies multiples
US8396983B1 (en) * 2012-03-13 2013-03-12 Google Inc. Predictive adaptive media streaming
US9660922B2 (en) * 2012-03-23 2017-05-23 Cisco Technology, Inc. Network assisted rate shifting for adaptive bit rate streaming
US20140068097A1 (en) * 2012-08-31 2014-03-06 Samsung Electronics Co., Ltd. Device of controlling streaming of media, server, receiver and method of controlling thereof
US9154854B1 (en) * 2012-09-19 2015-10-06 Time Warner Cable Enterprises Llc Notification in a network environment
US20140089467A1 (en) * 2012-09-27 2014-03-27 Andre Beck Content stream delivery using pre-loaded segments
US9967768B2 (en) 2012-10-01 2018-05-08 Telefonaktiebolaget Lm Ericsson (Publ) Apparatus and method relating to the streaming of content to one or more user devices
US9516078B2 (en) 2012-10-26 2016-12-06 Cisco Technology, Inc. System and method for providing intelligent chunk duration
US10708335B2 (en) 2012-11-16 2020-07-07 Time Warner Cable Enterprises Llc Situation-dependent dynamic bit rate encoding and distribution of content
US20140189760A1 (en) * 2012-12-31 2014-07-03 Charles R. Payette Method and system for allocating wireless resources
US9357215B2 (en) * 2013-02-12 2016-05-31 Michael Boden Audio output distribution
US9948573B2 (en) * 2013-03-14 2018-04-17 Comcast Cable Communications, Llc Delivery of multimedia components according to user activity
WO2014139052A1 (fr) * 2013-03-15 2014-09-18 Yahoo! Inc. Sélection de modalité de publicité adaptable au réseau
WO2014142295A1 (fr) * 2013-03-15 2014-09-18 日本電気株式会社 Système de communication multimédia, procédé de contrôle de débit binaire et support d'enregistrement d'information lisible par ordinateur
US10326805B2 (en) * 2013-05-31 2019-06-18 Avago Technologies International Sales Pte. Limited Distributed adaptive bit rate proxy system
US9386308B2 (en) * 2013-07-16 2016-07-05 Cisco Technology, Inc. Quality optimization with buffer and horizon constraints in adaptive streaming
US20150052236A1 (en) * 2013-08-14 2015-02-19 Cisco Technology, Inc. Load based target alteration in streaming environments
US9455932B2 (en) * 2014-03-03 2016-09-27 Ericsson Ab Conflict detection and resolution in an ABR network using client interactivity
US10142259B2 (en) 2014-03-03 2018-11-27 Ericsson Ab Conflict detection and resolution in an ABR network
US11570114B2 (en) * 2014-03-04 2023-01-31 Mobophiles, Inc. System and method of adaptive rate control and traffic management
CN106416239B (zh) * 2014-05-29 2019-04-09 奈克斯特Vr股份有限公司 用于交付内容和/或回放内容的方法和装置
US20150346812A1 (en) 2014-05-29 2015-12-03 Nextvr Inc. Methods and apparatus for receiving content and/or playing back content
CN104394441B (zh) * 2014-11-27 2019-06-14 北京奇艺世纪科技有限公司 一种视频内容分发的调度方法、装置及系统
US10681479B2 (en) * 2015-01-30 2020-06-09 Cassia Networks Inc. Methods, devices and systems for bluetooth audio transmission
US9769594B2 (en) 2015-01-30 2017-09-19 Cassia Networks Inc. Methods, devices and systems for increasing wireless communication range
US9756112B2 (en) 2015-02-11 2017-09-05 At&T Intellectual Property I, L.P. Method and system for managing service quality according to network status predictions
US10200725B2 (en) * 2015-06-15 2019-02-05 Intel Corporation Adaptive data streaming based on virtual screen size
US10009655B2 (en) * 2015-09-25 2018-06-26 Verizon Patent And Licensing Inc. Dynamic content provisioning for multimedia broadcast multicast service operation on-demand
CN107438187B (zh) * 2015-09-28 2020-06-30 苏州踪视通信息技术有限公司 实时视频传输的带宽调整
US10200288B2 (en) * 2015-12-18 2019-02-05 Xerox Corporation Shaping data traffic within a local area network
GB2549772B (en) * 2016-04-28 2018-11-14 Samsung Electronics Co Ltd Apparatus and method for transmitting a channel in a private network
EP3520421B1 (fr) * 2016-09-30 2023-03-22 British Telecommunications public limited company Adaptation du débit de tranport selon l'importance attribuée par le spectateur
CN108093298A (zh) * 2016-11-21 2018-05-29 松下知识产权经营株式会社 影像传输系统
CN108989905B (zh) * 2018-06-28 2021-05-28 腾讯科技（深圳）有限公司 媒体流控制方法、装置、计算设备及存储介质
US10693575B2 (en) 2018-08-31 2020-06-23 At&T Intellectual Property I, L.P. System and method for throughput prediction for cellular networks
US10868726B2 (en) 2018-12-07 2020-12-15 At&T Intellectual Property I, L.P. Apparatus and method for selecting a bandwidth prediction source
CN111385463B (zh) * 2018-12-29 2021-12-28 华为技术有限公司 用于控制摄像头的方法、控制装置、网络设备及摄像头
US11490149B2 (en) * 2019-03-15 2022-11-01 At&T Intellectual Property I, L.P. Cap-based client-network interaction for improved streaming experience
CN111510735B (zh) * 2020-04-21 2022-11-01 新石器慧通（北京）科技有限公司 弱网环境下多路视频的编码传输方法、装置及无人车辆
US11355139B2 (en) * 2020-09-22 2022-06-07 International Business Machines Corporation Real-time vs non-real time audio streaming
WO2022139961A1 (fr) * 2020-12-23 2022-06-30 Arris Enterprises Llc Système et procédé de gestion de diffusion en continu adaptative
CN113709524B (zh) * 2021-08-25 2023-12-19 三星电子（中国）研发中心 选择音视频流的比特率的方法及其装置

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10111761A (ja) * 1995-10-26 1998-04-28 Matsushita Electric Ind Co Ltd ファイルシステム
JP3582979B2 (ja) * 1997-02-26 2004-10-27 株式会社東芝 通信装置、通信方法及び記録媒体
JP2000115113A (ja) * 1998-10-08 2000-04-21 Sony Corp 多重化装置及び方法、受信装置及び方法並びにデジタル放送システム
US7292602B1 (en) * 2001-12-27 2007-11-06 Cisco Techonology, Inc. Efficient available bandwidth usage in transmission of compressed video data
JP2003309598A (ja) * 2002-04-17 2003-10-31 Nippon Telegr & Teleph Corp <Ntt> ストリーム配信方法、装置、プログラム、および同プログラムを記録した記録媒体
JP3852761B2 (ja) * 2002-05-14 2006-12-06 インターナショナル・ビジネス・マシーンズ・コーポレーション ネットワークシステム、コンテンツ提供システム、端末装置及びコンテンツ送信方法並びにプログラム
JP4135876B2 (ja) * 2002-06-19 2008-08-20 日本電信電話株式会社 コンテンツ先読み装置およびコンテンツ先読みプログラム
US7092693B2 (en) * 2003-08-29 2006-08-15 Sony Corporation Ultra-wide band wireless / power-line communication system for delivering audio/video content
US9325998B2 (en) * 2003-09-30 2016-04-26 Sharp Laboratories Of America, Inc. Wireless video transmission system
JP2005204157A (ja) * 2004-01-16 2005-07-28 Nippon Telegr & Teleph Corp <Ntt> ストリームフィルタリングシステムとコンテンツ配信システムおよびストリームフィルタリング方法ならびにプログラム
JP4033152B2 (ja) * 2004-03-10 2008-01-16 Ｋｄｄｉ株式会社 時分割多重装置及び方法
US9544602B2 (en) * 2005-12-30 2017-01-10 Sharp Laboratories Of America, Inc. Wireless video transmission system
US7912040B2 (en) * 2006-02-27 2011-03-22 At&T Intellectual Property I, Lp Systems and methods for dynamically allocating bandwidth of a subscriber line that carries voice over Internet Protocol (VoIP) telephone calls and Internet Protocol Telephone (IPTV) transmissions
US8606966B2 (en) * 2006-08-28 2013-12-10 Allot Communications Ltd. Network adaptation of digital content
US9124767B2 (en) * 2006-10-25 2015-09-01 Microsoft Technology Licensing, Llc Multi-DVR media content arbitration
US8484349B2 (en) * 2008-02-08 2013-07-09 Cisco Technology, Inc. Dynamic DSL line bandwidth management with the subscriber's consent
GB0813203D0 (en) * 2008-07-18 2008-08-27 Eldon Technology Ltd Dynamic QoS in a network distributing audio visual content
JP4888459B2 (ja) * 2008-08-29 2012-02-29 三菱電機株式会社 データ送出装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2011109101A1 *

Also Published As

Publication number Publication date
JP2013521743A (ja) 2013-06-10
KR101478656B1 (ko) 2015-01-02
CN102783170A (zh) 2012-11-14
KR20130014508A (ko) 2013-02-07
US20130007831A1 (en) 2013-01-03
WO2011109101A1 (fr) 2011-09-09

Similar Documents

Publication Publication Date Title
US20130007831A1 (en) Bit rate adjustment in an adaptive streaming system
EP3210385B1 (fr) Programmation dynamique sur de multiples flux
US8578432B2 (en) Policy control over switched delivery networks
US7093028B1 (en) User and content aware object-based data stream transmission methods and arrangements
AU2012314756B2 (en) Method for controlling bandwidth and corresponding device
EP3172862B1 (fr) Gestion de qualité commune sur de multiples flux
US20070039028A1 (en) Real time bit rate switching for internet protocol television
US10680911B2 (en) Quality of experience based network resource management
US20120300854A1 (en) Utilizing multi-dimensional resource allocation metrics for concurrent decoding of time-sensitive and non-time-sensitive content
JP5314825B2 (ja) Ｃｐｕの負荷を安定させるためにスケーラブルビデオを動的に適応復号化するためのシステム及び方法
WO2018165487A1 (fr) Distribution de débit binaire en excès basée sur un gain de qualité dans un serveur sabr
US20100202509A1 (en) Near real time delivery of variable bit rate media streams
KR20100037659A (ko) 디지털 방송에서 계층적인 전송/수신을 위한 방법 및 장치
EP3172861B1 (fr) Production et utilisation d&#39;une analyse de réseau contextuelle
EP3162081A1 (fr) Arbitrage de fourniture de segments de données adaptatif pour l&#39;optimisation de la largeur de bande
AU783202B2 (en) Adaptive bandwidth system and method for broadcast data
Yao et al. Video streaming adaptation strategy for multiview navigation over DASH
US20100232383A1 (en) Method and apparatus for allocating channel bandwidth in wireless internet protocol television systems
US11805290B2 (en) Method for managing zapping of digital multimedia contents obtained by HTTP adaptive streaming (HAS), and corresponding management device, multimedia stream reader and computer program
Uno et al. Simple and efficient video-on-demand scheme with segment transmission over high speed network
Khan et al. Bandwidth Estimation Techniques for Relative'Fair'Sharing in DASH
US11178206B2 (en) Method for managing progressive and adaptive streaming of digital content by a multimedia stream player terminal connected to a communication network, and associated management device, multimedia stream player terminal and computer program
JP2002084238A (ja) 多重放送方法および装置
US11778009B2 (en) Method for rendering a multimedia content and a navigation interface on a screen
KR20230121950A (ko) 다중 네트워크 환경 적응형 미디어 스트리밍 전송방법 및 그 장치

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20120911

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20130808

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20161001