Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
  • H04N21/23805—Controlling the feeding rate to the network, e.g. by controlling the video pump
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
  • H04L65/60—Network streaming of media packets
  • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
  • H04L65/612—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
  • H04L65/60—Network streaming of media packets
  • H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
  • H04L65/80—Responding to QoS
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
  • H04N21/2401—Monitoring of the client buffer
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
  • H04N21/2402—Monitoring of the downstream path of the transmission network, e.g. bandwidth available
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
  • H04N21/65—Transmission of management data between client and server
  • H04N21/658—Transmission by the client directed to the server
  • H04N21/6581—Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
  • H04N21/65—Transmission of management data between client and server
  • H04N21/658—Transmission by the client directed to the server
  • H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L67/00—Network arrangements or protocols for supporting network services or applications
  • H04L67/01—Protocols
  • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]

Definitions

• the invention generally relates to communication networks, and more specifically to integral controller based pacing for Hypertext Transfer Protocol (HTTP) pseudo- streaming.
• HTTP Hypertext Transfer Protocol
• HTTP pseudo- streaming combines the advantages of straight HTTP downloads (e.g., it passes any firewall, viewers on bad connections can simply wait for the download) with the ability to seek to non-downloaded parts.
• HTTP pseudo-streaming uses Transmission Control Protocol (TCP), designed originally for bulk data transfers, as transport protocol.
• TCP does not explicitly indicate the timing information of the media in the payload.
• TCP is used to merely transfer a media clip (such as, e.g., .flv or .mp4 files).
• the media time information is implicitly sent within the media clip format, and the player simply plays back the clip as portions of it are downloaded.
• HTTP pseudo-streaming uses HTTP to control the streaming media download over TCP.
• the streaming clients often provide the desired media seek position information as an URL option in the HTTP request, which is handed over to the pseudo-streaming server by the HTTP.
• the pseudo-streaming server uses the information to prepare a media clip that plays from the desired seek position and transmit via HTTP.
• HTTP pseudo-streaming relying the streaming media transmission solely on TCP, is incapable of maintaining a desirable target streaming bitrate, but often delivers the media to the client at the available link speed that is often much higher than the target bitrate. This could result in waste of the bandwidth when the viewer lost interest in the media and stop the transmission.
• a transmission pacing mechanism to control the media transmission rate to a desirable bitrate is highly desirable for HTTP pseudo-streaming.
• rate control is essential for media streaming over packet networks.
• the challenge in delivering bandwidth-intensive content like multimedia over capacity- limited, shared links is to quickly respond to changes in network conditions by adjusting the bitrate and the media encoding scheme to optimize the viewing and listening experience of the user.
• a network buffer may overflow, resulting in packet loss causing garbled video or audio playback, or a media player buffer may underflow resulting in playback stall.
• the present invention provides methods and apparatus, including computer program products, for integral controller based pacing for HTTP pseudo-streaming.
• the invention features a method including, in a network including user equipment linked to an integral controller based pacing for Hypertext Transfer Protocol (HTTP) streaming manager and a content server, receiving a request portions of a multimedia clip residing in the content server from a media player residing in the user equipment and delivering the requested portions of the multimedia clip to the media player while maintaining a target bitrate in a presence of control noises in the network.
• Delivering the requested portions of the multimedia clip can include estimating a target transmission rate, determining a target elasticity buffer, and estimating a number of bytes to send in a current transmission epoch.
• FIG. 1 is a block diagram.
• FIG. 2 is a block diagram.
• FIG. 3 is a flow diagram.
• a component can be, but is not limited to being, a process running on a processor, a processor, an object, an executable, a thread of execution, a program, and/or a computer.
• a component may be, but is not limited to being, a process running on a processor, a processor, an object, an executable, a thread of execution, a program, and/or a computer.
• an application running on a server and the server can be a component.
• One or more components may reside within a process and/or thread of execution and a component may be localized on one computer and/or distributed between two or more computers.
• these components can execute from various computer readable media having various data structures stored thereon.
• the components may communicate via local and/or remote processes such as in accordance with a signal having one or more data packets (e.g., data from one component interacting with another component in a local system, distributed system, and/or across a network such as the Internet with other systems via the signal).
• terms like "user equipment,” “mobile station,” “mobile,” “subscriber station,” “communication device,” “access terminal,” “terminal,” “handset,” and similar terminology refer to a wireless device (e.g., cellular phone, smart phone, computer, personal digital assistant (PDA), set-top box, Internet Protocol Television (IPTV), electronic gaming device, printer, etc.) utilized by a subscriber or user of a wireless communication service to receive or convey data, control, voice, video, sound, gaming, or substantially any data-stream or signaling- stream.
• PDA personal digital assistant
• IPTV Internet Protocol Television
• access point refers to a wireless network component or appliance that serves and receives data, control, voice, video, sound, gaming, or substantially any data-stream or signaling- stream from a set of subscriber stations.
• Data and signaling streams can be packetized or frame-based flows.
• an exemplary system 100 includes, among other things, a terminal 102, a gateway 104, one or more networks 106, 110, an integral controller based pacing manager 108, and one or more content servers 112-114.
• Terminal 102 is a hardware component including software applications that enable terminal 102 to communicate and receive packets corresponding to streaming media.
• Terminal 102 provides a display and one or more software applications, such as a media player, for displaying streaming media to a user of terminal 102.
• terminal 102 has the capability of requesting and receiving data packets, such as data packets of streaming media, from the Internet.
• terminal 102 can send request data to content servers 112-114 for a particular file or object data of a web page by its universal resource locator (URL), and the content server of the web page can query the object data in a database and send the corresponding response data to terminal 102.
• response data may be routed through integral controller based pacing manager 108.
• terminal 102 can be a wired terminal
• embodiments of the invention may include using a mobile terminal because mobile terminals are more likely to be in networks that would benefit more from the integral controller based pacing manager 108.
• the network connection in a mobile network tends to be less stable as compared to wired network connection due to, for example, the changing position of the mobile terminal where data rate transmissions between the mobile terminal and the network can fluctuate, in some cases quite dramatically.
• Gateway 104 is a device that converts formatted data provided in one type of network to a particular format required for another type of network.
• Gateway 106 may be a server, a router, a firewall server, a host, or a proxy server.
• Gateway 104 has the ability to transform the signals received from terminal 102 into a signal that network 106 can understand and vice versa.
• Gateway 104 may be capable of processing audio, video, and T.120 transmissions alone or in any combination, and is capable of full duplex media translations.
• Networks 106 and 110 can include any combination of wide area networks (WANs), local area networks (LANs), or wireless networks suitable for packet-type communications (e.g., GSM, CDMA, LTE, WiMAX, and so forth), such as Internet communications. Further, networks 106 and 110 can include buffers for storing packets prior to transmitting them to their intended destination.
• WANs wide area networks
• LANs local area networks
• wireless networks suitable for packet-type communications e.g., GSM, CDMA, LTE, WiMAX, and so forth
• GSM Global System for Mobile communications
• CDMA Code Division Multiple Access
• LTE Long Term Evolution
• WiMAX Worldwide Interoperability for Mobile communications
• Integral controller based pacing manager 108 is a server that provides
• Integral controller based pacing manager 108 maintains a target bitrate in average in presence of control noises such as transient network congestion or ⁇ scheduling epoch at the content servers 112-114.
• the integral controller based pacing manager 108 is implemented in AN-3000 Proxy Cache manufactured by Affirmed Networks, Inc., of Acton, Massachusetts.
• Content servers 112-114 are servers that receive the request data from terminal 102, process the request data accordingly, and return the response data back to terminal 102 through, in some embodiments, integral controller based pacing manager 108.
• content servers 112-114 can be a web server, an enterprise server, or any other type of server.
• Content servers 112-114 can be a computer or a computer program responsible for accepting requests (e.g., HTTP, RTSP, or other protocols that can initiate a media session) from terminal 102 and serving terminal 102 with streaming media.
• terminal 102 may include, among other things, a media player 202 and a buffer 204.
• Integral controller based pacing manager 108 can include, among other things, a processor 210 and a memory 212.
• Memory 212 can include an operating system 214, such as Linux®, Unix® or Windows®, and a integral controller based pacing for HTTP pseudo-streaming process 300.
• Media player 202 is computer software for playing multimedia files (such as streaming media) including video and/or audio media files.
• Examples of media player 202 can include Microsoft® Windows Media Player, Apple® Quicktime® Player, RealOne® Player, and Adobe® Flash Plugin for web-embedded video.
• media player 202 decompresses the streaming video or audio using a codec and plays it back on a display of terminal 102.
• Media player 202 can be used as a standalone application or embedded in a web page to create a video application interacting with HTML content.
• media player 202 can provide feedback on media reception to the integral controller based pacing manager 108 in the form of media receiver reports.
• Media receiver reports can include RTCP packets for an RTP streaming session, or TCP ACKs for a pseudo-streaming session.
• Buffer 204 (also known as terminal buffer 204) is a software program and/or a hardware device that temporarily stores multimedia packets before providing the multimedia packets to media player 202.
• buffer 204 receives the multimedia packets from integral controller based pacing manager 108 via network 106.
• buffer 204 receives ckets from a device other than integral controller based pacing manager 108.
• terminal buffer 204 and media player 202 are shown as separate components, in other implementations the terminal buffer 204 can be a part of media player 202. Further, while only a single buffer, implementations may include multiple buffers, for example, one or more buffers for audio media packets and one or more buffers for video media packets.
• HTTP Pseudo- streaming refers to a transmission technic wherein an audio/video content that can be played before the entire content is transmitted as a single HTTP object. It is desirable to pace the media transmission at a certain bitrate close to the encoded bitrate of the media after initial media buffering period especially for wireless networks, since airlink resource is expensive and it is likely that the media presentations may be cancelled by the user as he/she loses interest in the content before the end of the presentation.
• the integral controller based pacing for HTTP pseudo-streaming process 300 is a packet transmission pacing technique that can be used by a media server or proxy to maintain a target bitrate in average in presence of control noises such as transient network congestion or inconsistent packet scheduling epoch at the server.
• process 300 includes estimating (310) a target transmission rate.
• Target transmission rate estimation requires information about a size and time duration of the multimedia content, which can be obtained by parsing the media container. In case the size or time duration is not available (as for live contents), the media encoding bitrate informed in the container header can be used as the target transmission rate.
• the target transmission rate may be calibrated by applying a factor greater than 1 to make the transmission of the media slightly faster than the presentation speed to avoid halt in the media presentation due to unstable network conditions.
• Process 300 determines (312) a target elasticity buffer.
• the amount of content as measured in display time that has been acknowledged by a client minus a wall clock time required to deliver it can be considered the display elasticity buffer.
• there are always two targets i.e., a transmission rate target and a receiver elasticity target.
• the transmission rate target is typically be higher than once the elasticity target is initially met.
• the target elasticity buffer may be set based on a variety of parameters, such receiving device type and subscriber type. Further, a transmission channel can be
• the target elasticity buffer for the particular receiver may be increased. Comparing regular samples of
• transmission throughput trends can be developed and used to adjust the target elasticity buffering. For example, if the apparent receiver elasticity is decreasing then the transmission rate may be slightly increased. If increasing the transmission rate does not improve elasticity (or at least slow the decline) then there may be no reason for further transmission rate increases.
• process 300 estimates (314) the number of bytes to send in the current transmission epoch using an integral controller as follows.
• Process 300 initializes (316) the number of bytes to send in the current epoch (bytes_to_send_epoch) to a value obtained by the target bitrate times the estimated epoch length and start transmission. In each epoch,
• the average transmission bitrate is (average_bitrate) computed as the total number of transmitted bytes divided by the elapse time after the transmission of the first byte.
• BYTES_EPOCH_MAX can be set to initial bytes_to_send_epoch times a factor greater than 1
• BYTES_EPOCH_MIN can be set to initial bytes_to_send_epoch times a factor less than 1.
• Process 300 includes one or more of the following advantages. Process 300 is useful when there is no network level throttling like TCP. One strength of process 300 is that it is resilient to any small control noise from the server or network to achieve the average target bitrate.
• Process 300 is useful for media servers/proxy facing a wireless network where transient airlink congestion is common.
• implementations can include implementation in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.
• a programmable processor which may be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.
• the systems and techniques described here can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the computer.
• a display device e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor
• a keyboard and a pointing device e.g., a mouse or a trackball
• Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback), and input from the user can be received in any form, including acoustic, speech, or tactile input.
• the systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a client computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components.
• the components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN”), a wide area network (“WAN”), and the Internet.
• LAN local area network
• WAN wide area network
• the Internet the global information network
• the computing system can include clients and servers.
• a client and server are generally remote from each other and typically interact through a communication network.
• the relationship of client and server arises by virtue of computer programs running on the respective computers and having a client- server relationship to each other.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Computer Networks & Wireless Communication (AREA)
• Information Transfer Between Computers (AREA)
• Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
• Data Exchanges In Wide-Area Networks (AREA)

Priority Applications (7)

Applications Claiming Priority (1)

Publications (1)

Family

ID=49483620

Family Applications (1)

Country Status (6)

Cited By (12)

Citations (5)

Family Cites Families (17)

• 2012
  • 2012-04-23 EP EP12875417.3A patent/EP2842046A4/en not_active Withdrawn
  • 2012-04-23 JP JP2015508926A patent/JP6425649B2/ja active Active
  • 2012-04-23 WO PCT/US2012/034690 patent/WO2013162506A1/en active Application Filing
  • 2012-04-23 KR KR1020147031764A patent/KR101931407B1/ko active Active
  • 2012-04-23 IN IN2382KON2014 patent/IN2014KN02382A/en unknown
  • 2012-04-23 CN CN201280074204.9A patent/CN104380275B/zh active Active

Patent Citations (5)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events