WO2012031212A1 - Extending caching network functionality to an existing streaming media server - Google Patents
Extending caching network functionality to an existing streaming media server Download PDFInfo
- Publication number
- WO2012031212A1 WO2012031212A1 PCT/US2011/050343 US2011050343W WO2012031212A1 WO 2012031212 A1 WO2012031212 A1 WO 2012031212A1 US 2011050343 W US2011050343 W US 2011050343W WO 2012031212 A1 WO2012031212 A1 WO 2012031212A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- streaming
- url
- resource
- electronic
- server
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
- H04L65/612—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
Definitions
- This invention relates to content delivery and content delivery networks. More specifically, to content delivery networks and systems, frameworks, devices and methods supporting content delivery and content delivery networks.
- FIG. 1 depicts a content delivery network (CDN);
- Fig. 2 depicts a cache cluster site in the CDN of Fig. 1;
- FIGs. 3-4 depict client interaction with a cache cluster
- FIGs. 5-6 depict a cache cluster with an interface between a streaming server and a caching server
- Fig. 7 is a flow chart depicting operation of the interface between the streaming and caching servers
- Fig. 8 depicts a cache cluster with multiple caching and streaming servers, and with interfaces between the streaming and caching servers;
- Fig. 9 depicts a CDN with the cache clusters of Fig. 8.
- Fig. 10 is a schematic diagram of a computer system.
- CDN means content delivery network
- HTTP Hyper Text Transfer Protocol
- HTML Hyper Text Markup Language
- IP Internet Protocol
- IP address means an address used in the Internet Protocol to identify electronic devices such as servers and the like;
- RTMP Real Time Messaging Protocol
- URL means Uniform Resource Locator
- VIP address means a virtual IP address.
- CDNs Content Delivery Networks
- a primary purpose of a CDN is to distribute resources efficiently to client machines on behalf of one or more content providers, preferably via a public Internet.
- clients end-users
- content providers benefit from using a CDN.
- a content provider is able to take pressure of its own servers. Clients benefit by being able to obtain content with fewer delays.
- CDN 100 An example of a CDN is shown in FIG. 1, and represented as CDN 100.
- An exemplary CDN 100 will typically have multiple points of presence, or cache cluster sites 102-1, 102-2, 102-/M (collectively caches 102), located across a wide geographic area.
- a CDN 100 also includes other components such as, e.g., for control, administration, rendezvous, operation, measurement, etc. (collectively denoted 104 in Fig. 1).
- a cache cluster site 102 includes one or more cache clusters 204-1, 204-2, 204-p (collectively cache clusters 204) operatively connected to a routing mechanism 206.
- the routing mechanism 206 may, e.g., be a switch such as an Ethernet switch.
- One of the cache clusters, cache cluster 204-1, is shown in greater detail in the drawing.
- Each cache cluster includes a routing mechanism 210 and one or more servers 208.
- the routing mechanism 210 may, e.g., be a switch, and it may be part of or the same as routing mechanism 206.
- the servers 208 in a cache cluster 204 may include one or more caching servers 212 for delivering electronic resources using the HTTP protocol and one or more streaming servers 214 for delivery of resources using streaming protocols.
- caching servers 212 for delivering electronic resources using the HTTP protocol
- streaming servers 214 for delivery of resources using streaming protocols.
- streaming media formats used in the marketplace, including, e.g., Flash ® Media format by Adobe ® , QuickTime ® format by Apple ® , and Windows ® Media format by Microsoft ® .
- Each streaming protocol is associated with a different format for streaming media.
- streaming resources electronic resources that are to be delivered using a streaming protocol
- the caching server(s) 212 and streaming server(s) 214 within a given cache cluster 204 each have dedicated databases 216 and 218,
- the databases 216 for the caching servers 212 store either configuration data or electronic resources, or both, in accordance with various embodiments.
- the databases 218 for the streaming servers 214 store either configuration data or electronic streaming resources, or both, in accordance with various embodiments.
- configuration data can represent any other form of data associated with end users' requests, such as, e.g., authentication data, authorization information, geographical restrictions, licensing information, or any other attributes, properties or characteristics relevant to content owners, electronic resources or end users.
- configuration data may include credentials for determining whether a particular end user is authenticated to receive a specific electronic resource, or whether a particular end user is authorized to receive a specific electronic resource, or whether a particular end user is within a geographic location that is authorized to receive a specific electronic resource.
- Content providers typically determine the format in which streaming media will be delivered to end users on the Internet, although sometimes this decision is made by CDN operators on behalf of the content owners. Regardless of the format chosen for a particular streaming resource, a proprietary media player designed to play media in accordance with that format is required on the end user's computer, either stand-alone, or as a browser plug- in, in order for that resource to be delivered from the appropriate server.
- Fig. 3 shows a client 302 operatively connected with a cache cluster 204'.
- the cache cluster 204' includes a switch 210' as the routing mechanism.
- exemplary proprietary players are represented as media client(s) 304, it being understood that each streaming media format requires its own media client.
- the client 302 also includes an HTTP client 306 (e.g., included in a web browser or the like).
- the media client(s) 304 and the streaming media server(s) 214 are designed to communicate using proprietary protocols, and a separate streaming media server (generally running on the same server hardware) is required for each different type of proprietary media client.
- the caching server(s) 212 are operable to communicate with all such Internet browsers using HTTP.
- media client 304 is provided with a streaming media resource from a streaming server 214-1 using an appropriate streaming protocol.
- the steps associated with providing the streaming media resource are typically as follows:
- the media client 304 requests a specific electronic resource from the streaming server 214-1 using the proprietary protocol associated with these devices (e.g., Adobe® Flash®).
- the streaming server 214-1 references configuration data from the streaming database(s) 218, and, assuming the end user is authorized and authenticated, the streaming server 214-1 obtains requested electronic streaming resource from the streaming database(s) 218.
- the requested electronic streaming resource is then delivered (streamed) from the streaming server 214-1 to the media client 304.
- rendezvous The manner in which the client is associated with a particular cache cluster site or a particular server within that site is referred to as rendezvous, and is not described here.
- rendezvous The manner in which the client is associated with a particular cache cluster site or a particular server within that site is referred to as rendezvous, and is not described here.
- rendezvous may be implemented using name servers and the domain name system.
- Fig. 5 shows various components of cache cluster 204' that includes streaming server 214-1 and caching server 212-1.
- An interface 502 is associated with the streaming server 214-1.
- the interface 502 is preferably implemented as a software plugin on the streaming server 214-1, although it may be a separate component (e.g., interface 604 in Fig. 6).
- the streaming server 214-1 is able to make use of the caching database(s) 216 in order to obtain streaming media content. Instead of using separate streaming media database(s), streaming media and their associated metadata are stored in the caching database(s) 216.
- the interface 502 (or 604) translates interactions/requests from the streaming server 214-1 into corresponding HTTP requests which may then be handled by the caching server 212-1.
- FIG. 6 shows operation of an exemplary interaction in which media client 304 is provided with a streaming media resource from a streaming server 214-1 using an appropriate streaming protocol.
- the interface 604 is shown as a separate component from the streaming server 214-1, although, as noted above, it is preferably integrated into the streaming server (e.g., as a plugin).
- the streaming server 214-1 asks for configuration data associated with the requested resource (at la). This request is made of the caching server 212-1 through the interface 604 which converts the request to a corresponding HTTP request (at lb).
- the caching server 208-1 obtains the required configuration data from database 280 in the caching databases 216.
- the caching server 212-1 may use the configuration data to perform such processes as authentication, geo-blocking evaluation, authorization and/or licensing, etc.
- the caching server 212-1 passes some or all of the configuration data to the streaming server 214-1. Some of the configuration data may relate to the streaming protocol, in which case it will be handled by the streaming server 214-1.
- configuration data may relate to CDN and/or content provider policies, and those configuration data may be handled by the caching server 212-1.
- the streaming server 214-1 may also use some the configuration data to perform such processes as authentication, geo-blocking evaluation, authorization and/or licensing, etc.
- the streaming server 214-1 then pulls the actual media resource from the caching server 208-1. Again, the pull request is made through the interface 604 which converts the request to a corresponding HTTP request (at 2b) for the actual media resource.
- the caching server 212-1 obtains the required media resource data from database 282 in the caching databases 216 (at 2c) and provides (serves) that media resource to the streaming server 214-1 via the interface 604.
- Embodiments of the present invention thus provide an approach for use by streaming servers to use functionality of caching servers, including, without limitation, functionality of caching servers in pulling electronic resources from data storage and/or accessing configuration data from data storage.
- server represents a collection of processes implemented in software and/or firmware by a computer. While these processes are each implemented on the same device, in accordance with one embodiment, any number of these processes could alternatively be implemented on any number of devices.
- the streaming servers, the interface software and the caching servers are shown in the drawings on single device, however, it should be appreciated that any of these components may be separately located on more than one device. That said, the interface software is preferably located on at least the same device as the streaming server and allows the streaming server to communicate with the caching server using HTTP protocol.
- the interface 502, 604 has a number of roles.
- a primary role of the interface 502, 604 is to convert requests from the streaming server into HTTP requests that can be sent to a caching server.
- the other roles of the interface include intercepting (or accepting) requests from the streaming server 214-1 and, after conversion to HTTP, making those requests of a caching server.
- URLs are described in RFC 1738, Uniform Resource Locators (URL), by T. Berners-Lee et al., the entire contents of which are fully incorporated herein for all purposes.
- the general form of a URL is:
- RTMP Real Time Messaging Protocol
- RTMPE Encrypted RTMP
- RTMPT means encapsulated RTMP
- RTMPTE means encrypted, encapsulated RTMP
- RTMP protocol e.g., RTPMPT, RTMPE, RTMPTE, etc.
- a typical streaming request with the RTMP protocol uses a streaming URL with, e.g., one of the following forms:
- the list of codecs currently includes: flv:, id3:, mp3:, mp4: and raw:, although those of skill in the art will realize and understand that other codecs may be used, and that the present invention is not limited to only the currently-existing codecs.
- the optional stream name extension (as indicated by the ".ext" in square brackets) reflects the type of the stream (e.g., mp3, mp4, flv, f4v, mov, avi, etc.). In many cases the stream type may be determined from the codec or the application or some other information in the URL if the extension is not provided.
- the streaming server 214-1 issues various instructions / requests using this form of URL. These instructions include instructions to connect, play, stop, or disconnect.
- These instructions include instructions to connect, play, stop, or disconnect.
- a streaming client goes through two phases: connect and play.
- the connect phase only uses part of the streaming URL.
- connect URL does not include the "/path_to_stream/[codec:]streamname[.ext]" part(s) of the streaming URL.
- URLl or URL2
- HTTP is a stateless protocol, meaning that every single HTTP request has enough information for server to process it independently.
- Streaming protocols (such as RTMPx) are statefull, i.e. streaming server must preserve client state across transactions. A streaming client can request and play multiple streams over the same connection to the streaming server.
- a streaming player makes two requests- a "connect” phase and a “play” phase— splitting the streaming URL into two parts.
- the streaming URL may be considered to be of the form: protocol://connect_part/play_part where connect__part is used by the CONNECT phase, and includes protocol, host, application, and instance information, and where the play_part is used by the PLAY phase.
- connectjpart is "protocol://host/application/[instance]"
- the playjpart is "/[path_to_stream]/[codec:]streamname[.ext]” or
- CONNECT and PLA Y instructions are intercepted by the interface 604, 502 which converts them into the appropriate HTTP commands for the caching server 212-1. Specifically, the interface 604, 502 extracts (obtains/determines) the following information from the streaming URL (i.e., from the parameters to the CONNECT and PLAY commands): the host, the path to the stream, and the stream name. Those of skill in the art will realize and understand, upon reading this description, that the interface may obtain the required information directly or indirectly from the parameters to the
- the interface 604, 502 extracts (obtains/determines) the following:
- the interface determines the type, e.g. from the codec or from other information in the URL.
- the type is needed because the caching server may have copies of the same stream encoded in different formats.
- the application name is provided as the value of the HTTP "Host:" header.
- the interface 604, 502 uses this generated HTTP-based URL (or the infomation in or associated with that URL) to make HTTP requests of the caching server 212-1.
- HTTP-based URL or the infomation in or associated with that URL
- the following HTTP- based URL is generated by the interface 604, 502: http://xyz.com/pathl/foo.mp3 [URL 4]
- the interface 604, 502 then makes the following HTTP GET request, with the HOST HEADER set to "appl":
- the application and instance may be used to determine which media resource is returned to the streaming server, and so must be provided to the cache.
- the path may contain appl with some other value for "Host:”.
- the interface 604, 502 may use a well-known program such as, e.g. , cURL to make the HTTP requests of the cache server.
- a well-known program such as, e.g. , cURL to make the HTTP requests of the cache server.
- caching server 212-1 obtains the requested streaming resource and provides it to the streaming server 214-1.
- Fig. 7 is a flowchart according to embodiments herein.
- the rectangular elements are herein denoted as “steps" and represent computer software instructions or groups of instructions that carry out such functions.
- the flow diagrams do not necessarily depict the syntax of any particular programming language. Rather, the flow diagrams illustrate the functional information one of ordinary skill in the art could use to fabricate circuits or to generate computer software (or a hybrid of both circuits and software code) to carry out the features as described herein. It should be noted that many routine program elements, such as initialization of loops and variables and the use of temporary variables are inherent in the flowcharts.
- the interface 502, 604 obtains one or more requests from a streaming server (at S702).
- the request(s) include mformation from an RTMP-based streaming URL (e.g., of the form of URL 1 above).
- the interface 604 extracts or derives appropriate HTTP information from the streaming URL (at S704).
- the interface determines (extracts or derives) the host, path to stream, and stream name from the streaming URL. In some cases it may be necessary to normalize the streaming URL before extraction takes place. Further, even though the type extension (e.g., mp3, mp4, flv, f4v, mov, avi, etc) may be optional in the streaming URL, it is required for the HTTP information.
- the type extension e.g., mp3, mp4, flv, f4v, mov, avi, etc
- the interface With the required information determined from the streaming URL, the interface generates a corresponding HTTP URL (at S708). Using this generated HTTP URL, the interface makes the corresponding HTTP GET request(s) from a cache server (at S710).
- the interface performs a similar function for configuration data and streaming content that is requested by the streaming server.
- a streaming server does not have to modify its protocols in order to operate with the caching servers.
- the interface 502, 604 effectively intercepts the streaming server's interactions and directs them to the caching server(s).
- the streaming server's interactions with the media client(s) still follows the same (potentially proprietary) protocol(s) as they did when a streaming database was in use.
- it is dealing with an HTTP client. This approach allows for new and different streaming protocols and/or streaming servers to be used without modification of interface to the caching server(s).
- a streaming server's interface can make the HTTP calls from any caching server, in the context of a CDN, it is preferable that the caching server be one that is close (by some measure of network cost and/or distance) to the streaming server.
- streaming servers obtain their content from caching databases and using caching servers in the same cache cluster.
- a cache cluster 804 includes a number of caching servers 212-1, 212-2, 212-A (collectively 212) and a number of streaming servers 214-1, 214-2, 214-/ (collectively 214).
- Each caching server has a corresponding interface 502-1, 502-2, 502-/, respectively.
- these interfaces are implemented as plugins on the streaming servers.
- the caching servers 212 and the streaming servers 214 are connected to a switch 210, e.g., an Ethernet switch. There may be different numbers of streaming and caching servers.
- the interface 502-m associated with streaming server 214-m will preferably use one of the caching servers 212 in the same cluster 804_to access the caching database 216.
- a CDN 900 including streaming servers with interfaces includes a number of caches 800, including a number of cache clusters 804-1, 804-2, ... 804-m (collectively cache clusters 804).
- the CDN's caches 800 may also include cache clusters 204 which do not serve HTTP content (cached content) outside of the cluster, and cache clusters 204 which do not include streaming servers or in which the streaming servers do not use an interface to a caching database.
- Each streaming server may also be designated a caching server to use, which may be on the same device as the streaming server.
- the streaming servers 214 in a particular cache cluster 804 will all have the same VTP (e.g., VTP SS ).
- the caching servers 212 in a particular cluster have the same VIP (e.g., VIP CS ).
- External requests to the cluster are made to a VIP, and the switch passes those requests to all servers in the cluster.
- the servers in the cluster decide for and among themselves which server is to handle a request. This process is described, e.g., in U.S. Patent Application No. 12/390,560, filed Feb. 23, 2009, and in U.S. Patent Application No. 12/880,313, filed Sept. 13, 2010, the entire contents of each of which are fully incorporated herein for all purposes.
- a particular cache cluster may be configured so that the caching servers are not used directly to serve content to requesting clients outside the cluster, and are used to handle only streaming requests (made via the interfaces 502).
- the CDN will be configured so that they do not send HTTP traffic to the streaming-only clusters.
- Other cache clusters may serve both streaming and cache content externally.
- a streaming server's interface needs to make a request of a caching server, one of the caching servers needs to be selected.
- the streaming servers' interfaces may make their HTTP requests via the switch, using the VIP (VEP CS ) of the cluster servers in the same cluster. In that way, the cluster servers can use the appropriate load balancing and other selection process to determine which of them is to handle the request.
- VIP VIP
- VTP for the cache servers and the streaming servers may be the same (i.e., in some cases VIP CS is the same as VIP CS ). In those cases all servers connect to the switch 210 will get all requests, and the servers themselves will select who is to handle the requests (based, e.g., on the type of request - e.g., streaming versus HTTP - and on their respective loads). Those of skill in the art will realize and understand, upon reading this description, that different and/or other factors may be used within a cluster to determine which server handles a particular request.
- a typical streaming flow has two parts: an authentication/authorization part, followed by the actual delivery.
- authentication may take place at two levels.
- the streaming servers may still perform whatever authentication / authorization is required by the particular streaming protocol in use. This process may require authentication / authorization information from the caching databases.
- the caching servers may perform
- CDN can implement its own and content provider policies independent of the streaming protocols.
- a content provider may pay different rates to the CDN operator for different kinds or encodings of streamed content. Or certain content may be restricted to certain geographical areas (e.g., for copyright purposes).
- the caching servers can be used to implement some or all of these policies, leaving the streaming server to deal with streaming.
- Programs that implement such methods may be stored and transmitted using a variety of media (e.g., computer readable media) in a number of manners.
- Hard-wired circuitry or custom hardware may be used in place of, or in combination with, some or all of the software instructions that can implement the processes of various
- FIG. 10 is a schematic diagram of a computer system 1000 upon which embodiments of the present disclosure may be implemented and carried out.
- the computer system 1000 includes a bus 1001 (i.e., interconnect), at least one processor 1002, at least one communications port 1003, a main memory 1004, a removable storage media 1005, a read-only memory 1006, and a mass storage 1007.
- Processor(s) 1002 can be any known processor, such as, but not limited to, an Intel® Itanium® or Itanium 2® processor(s), AMD® Opteron® or Athlon MP® processors), or Motorola® lines of processors, and the like.
- Communications port(s) 1003 can be any of an RS-232 port for use with a modem based dial-up connection, a 10/100 Ethernet port, a Gigabit port using copper or fiber, or a USB port, and the like. Communications port(s) 1003 may be chosen depending on a network such as a Local Area Network (LAN), a Wide Area Network (WAN), a CDN, or any network to which the computer system 1000 connects.
- the computer system 1000 may be in communication with peripheral devices (e.g., display screen 1030, input device(s) 1016) via Input/Output (I/O) port 1009.
- peripheral devices e.g., display screen 1030, input device(s) 1016) via Input/Output (I
- Main memory 1004 can be Random Access Memory (RAM), or any other dynamic storage device(s) commonly known in the art.
- Read-only memory 1006 can be any static storage device(s) such as Programmable Readonly Memory (PROM) chips for storing static information such as instructions for processor 1002.
- Mass storage 1007 can be used to store information and instructions. For example, hard disks such as the Adaptec® family of Small Computer Serial Interface (SCSI) drives, an optical disc, an array of disks such as Redundant Array of Independent Disks (RAID), such as the Adaptec® family of RAID drives, or any other mass storage devices may be used.
- SCSI Small Computer Serial Interface
- RAID Redundant Array of Independent Disks
- Bus 1001 communicatively couples processor(s) 1002 with the other memory, storage and communications blocks.
- Bus 1001 can be a PCI / PCI-X, SCSI, a Universal Serial Bus (USB) based system bus (or other) depending on the storage devices used, and the like.
- Removable storage media 1005 can be any kind of external hard-drives, floppy drives, IOMEGA® Zip Drives, Compact Disc - Read Only Memory (CD-ROM), Compact Disc - Re- Writable (CD-RW), Digital Video Disk - Read Only Memory (DVD-ROM), etc.
- Embodiments herein may be provided as a computer program product, which may include a machine-readable medium having stored thereon instructions, which may be used to program a computer (or other electronic devices) to perform a process.
- machine-readable medium refers to any medium, a plurality of the same, or a combination of different media, which participate in providing data (e.g., instructions, data structures) which may be read by a computer, a processor or a like device.
- Such a medium may take many forms, including but not limited to, non- volatile media, volatile media, and transmission media.
- Non- volatile media include, for example, optical or magnetic disks and other persistent memory.
- Volatile media include dynamic random access memory, which typically constitutes the main memory of the computer.
- Transmission media include coaxial cables, copper wire and fiber optics, including the wires that comprise a system bus coupled to the processor. Transmission media may include or convey acoustic waves, light waves and electromagnetic emissions, such as those generated during radio frequency (RF) and infrared (IR) data communications.
- RF radio frequency
- IR infrared
- the machine-readable medium may include, but is not limited to, floppy diskettes, optical discs, CD-ROMs, magneto-optical disks, ROMs, RAMs, erasable programmable read-only memories (EPROMs), electrically erasable programmable read-only memories (EEPROMs), magnetic or optical cards, flash memory, or other type of media/machine-readable medium suitable for storing electronic instructions.
- embodiments herein may also be downloaded as a computer program product, wherein the program may be transferred from a remote computer to a requesting computer by way of data signals embodied in a carrier wave or other propagation medium via a cominunication link (e.g., modem or network connection).
- data may be (i) delivered from RAM to a processor; (ii) carried over a wireless transmission medium; (iii) formatted and/or transmitted according to numerous formats, standards or protocols; and/or (iv) encrypted in any of a variety of ways well known in the art.
- a computer-readable medium can store (in any appropriate format) those program elements which are appropriate to perform the methods.
- main memory 1004 is encoded with interface application 1050-1 that supports the interface functionality as discussed herein.
- Interface application 1050-1 (and/or other resources as described herein) can be embodied as software code such as data and/or logic instructions (e.g., code stored in the memory or on another computer readable medium such as a disk) that supports processing functionality according to different embodiments described herein.
- processor(s) 1002 accesses main memory 1004 via the use of bus 1001 in order to launch, run, execute, interpret or otherwise perform the logic instructions of the interface application 1050-1.
- Execution of interface application 1050-1 produces processing functionality in content delivery process 1050-2.
- the content delivery process 1050-2 represents one or more portions of the interface application 1050-1 performing within or upon the processor(s) 1002 in the computer system 1000.
- interface application 1050-1 itself (i.e., the un-executed or non-performing logic instructions and/or data).
- the interface application 1050- 1 may be stored on a computer readable medium (e.g., a repository) such as a floppy disk, hard disk or in an optical medium.
- the interface application 1050-1 can also be stored in a memory type system such as in firmware, read only memory (ROM), or, as in this example, as executable code within the main memory 1004 (e.g., within Random Access Memory or RAM).
- interface application 1050-1 may also be stored in removable storage media 1005, read-only memory 1006, and/or mass storage device 1007.
- Example functionality supported by computer system 1000 and, more particularly, functionality associated with interface application 1050-1 is discussed above with reference to Figs. 6-7.
- the computer system 1000 can include other processes and/or software and hardware components, such as an operating system that controls allocation and use of hardware resources.
- embodiments of the present invention include various steps or operations. A variety of these steps may be performed by hardware components or may be embodied in machine-executable instructions, which may be used to cause a general-purpose or special-purpose processor programmed with the instructions to perform the operations.
- module refers to a self-contained functional component, which can include hardware, software, firmware or any combination thereof.
- an apparatus may include a computer/computing device operable to perform some (but not necessarily all) of the described process.
- Embodiments of a computer-readable medium storing a program or data structure include a computer-readable medium storing a program that, when executed, can cause a processor to perform some (but not necessarily all) of the described process.
- a process is described herein, those of skill in the art will appreciate that the process may operate without any user intervention. In another embodiment, the process includes some human intervention (e.g., a step is performed by or with the assistance of a human).
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
A content delivery network (CDN) includes multiple cluster sites, including sites with streaming media servers, caching servers and storage devices accessible to the caching servers for storing streaming content. Interface software is configured to initiate retrieval, by a caching server, of electronic streaming resources from the one or more storage devices in response to requests for the electronic streaming resource received by the streaming media server.
Description
EXTENDING CACHING NETWORK FUNCTIONALITY TO AN EXISTING STREAMING MEDIA SERVER
BACKGROUND OF THE INVENTION COPYRIGHT STATEMENT
[0001] This patent document contains material subject to copyright protection. The copyright owner has no objection to the reproduction of this patent document or any related materials in the files of the United States Patent and Trademark Office, but otherwise reserves all copyrights whatsoever.
RELATED APPLICATIONS
[0002] This Patent Cooperation Treaty (PCT) patent application is related to and claims priority from co-owned and co-pending U.S. Provisional patent application No. 61/380,148, filed September 3, 2010, titled "Extending Caching Network Functionality to an Existing Streaming Media Server," (attorney docket no. 0376-US-P1), the entire contents of which is fully incorporated herein by reference for all purposes.
FIELD OF THE INVENTION
[0003] This invention relates to content delivery and content delivery networks. More specifically, to content delivery networks and systems, frameworks, devices and methods supporting content delivery and content delivery networks.
BRIEF DESCRIPTION OF THE DRAWINGS
[0004] Other objects, features, and characteristics of the present invention as well as the methods of operation and functions of the related elements of structure, and the combination of parts and economies of manufacture, will become more apparent upon consideration of the following description and the appended claims with reference to the accompanying drawings, all of which form a part of this specification.
[0005] FIG. 1 depicts a content delivery network (CDN);
[0006] Fig. 2 depicts a cache cluster site in the CDN of Fig. 1;
[0007] Figs. 3-4 depict client interaction with a cache cluster;
[0008] Figs. 5-6 depict a cache cluster with an interface between a streaming server and a caching server;
[0009] Fig. 7 is a flow chart depicting operation of the interface between the streaming and caching servers;
[0010] Fig. 8 depicts a cache cluster with multiple caching and streaming servers, and with interfaces between the streaming and caching servers;
[0011] Fig. 9 depicts a CDN with the cache clusters of Fig. 8; and
[0012] Fig. 10 is a schematic diagram of a computer system.
DETAILED DESCRIPTION OF THE PRESENTLY PREFERRED EXEMPLARY EMBODIMENTS
GLOSSARY
[0013] As used herein, unless used otherwise, the following terms or abbreviations have the following meanings:
[0014] CDN means content delivery network;
[0015] HTTP means Hyper Text Transfer Protocol;
[0016] HTML means Hyper Text Markup Language;
[0017] IP means Internet Protocol;
[0018] IP address means an address used in the Internet Protocol to identify electronic devices such as servers and the like;
[0019] RTMP means Real Time Messaging Protocol;
[0020] URL means Uniform Resource Locator; and
[0021] VIP address means a virtual IP address.
BACKGROUND AND OVERVIEW
[0022] Networks that are engaged to deliver electronic resources, such as video, images, audio files, documents, software and the like, to end users on the
Internet on behalf of owners or providers of those resources ("content providers") are commonly referred to as Content Delivery Networks (CDNs). A primary purpose of a CDN is to distribute resources efficiently to client machines on behalf of one or more content providers, preferably via a public Internet. Both end-users (clients) and content providers benefit from using a CDN. By using a CDN, a content provider is able to take pressure of its own servers. Clients benefit by being able to obtain content with fewer delays.
[0023] An example of a CDN is shown in FIG. 1, and represented as CDN 100. An exemplary CDN 100 will typically have multiple points of presence, or cache cluster sites 102-1, 102-2, 102-/M (collectively caches 102), located across a wide geographic area. A CDN 100 also includes other components such as, e.g., for control, administration, rendezvous, operation, measurement, etc. (collectively denoted 104 in Fig. 1).
[0024] As shown in Fig. 2, a cache cluster site 102 includes one or more cache clusters 204-1, 204-2, 204-p (collectively cache clusters 204) operatively connected to a routing mechanism 206. The routing mechanism 206 may, e.g., be a switch such as an Ethernet switch. One of the cache clusters, cache cluster 204-1, is shown in greater detail in the drawing. Each cache cluster includes a routing mechanism 210 and one or more servers 208. The routing mechanism 210 may, e.g., be a switch, and it may be part of or the same as routing mechanism 206.
[0025] The servers 208 in a cache cluster 204 may include one or more caching servers 212 for delivering electronic resources using the HTTP protocol and one or more streaming servers 214 for delivery of resources using streaming protocols. There are a variety of streaming media formats used in the marketplace, including, e.g., Flash® Media format by Adobe®, QuickTime® format by Apple®, and Windows® Media format by Microsoft®. Each streaming protocol is associated with a different format for streaming media.
[0026] As used herein, electronic resources that are to be delivered using a streaming protocol are referred to as streaming resources or streaming media.
[0027] The caching server(s) 212 and streaming server(s) 214 within a given cache cluster 204 each have dedicated databases 216 and 218,
respectively. The databases 216 for the caching servers 212 store either configuration data or electronic resources, or both, in accordance with various embodiments. Likewise, the databases 218 for the streaming servers 214 store either configuration data or electronic streaming resources, or both, in accordance with various embodiments.
[0028] While electronic resources represent the actual files that an end user requests delivery of, configuration data can represent any other form of data associated with end users' requests, such as, e.g., authentication data, authorization information, geographical restrictions, licensing information, or any other attributes, properties or characteristics relevant to content owners, electronic resources or end users. For example, configuration data may include credentials for determining whether a particular end user is authenticated to receive a specific electronic resource, or whether a particular end user is authorized to receive a specific electronic resource, or whether a particular end user is within a geographic location that is authorized to receive a specific electronic resource.
[0029] Content providers typically determine the format in which streaming media will be delivered to end users on the Internet, although sometimes this decision is made by CDN operators on behalf of the content owners. Regardless of the format chosen for a particular streaming resource, a proprietary media player designed to play media in accordance with that format is required on the end user's computer, either stand-alone, or as a browser plug- in, in order for that resource to be delivered from the appropriate server.
[0030] Fig. 3 shows a client 302 operatively connected with a cache cluster 204'. The cache cluster 204' includes a switch 210' as the routing mechanism. In Fig. 3, exemplary proprietary players are represented as media client(s) 304, it being understood that each streaming media format requires its own media client. The client 302 also includes an HTTP client 306 (e.g., included in a web browser or the like).
[0031] The media client(s) 304 and the streaming media server(s) 214 are designed to communicate using proprietary protocols, and a separate streaming media server (generally running on the same server hardware) is required for each different type of proprietary media client. In contrast, with respect to end users requesting an HTML document (e.g., a traditional webpage) using a traditional Internet browser, the caching server(s) 212 are operable to communicate with all such Internet browsers using HTTP.
[0032] As shown in Fig. 4, in operation, media client 304 is provided with a streaming media resource from a streaming server 214-1 using an appropriate streaming protocol. The steps associated with providing the streaming media resource are typically as follows:
1. The media client 304 requests a specific electronic resource from the streaming server 214-1 using the proprietary protocol associated with these devices (e.g., Adobe® Flash®).
2. The streaming server 214-1 references configuration data from the streaming database(s) 218, and, assuming the end user is authorized and authenticated, the streaming server 214-1 obtains requested electronic streaming resource from the streaming database(s) 218.
3. The requested electronic streaming resource is then delivered (streamed) from the streaming server 214-1 to the media client 304.
[0033] An analogous process occurs for HTTP client 306 being provided with an HTTP resource from the caching server 208-1.
[0034] Those of skill in the art will realize and understand, upon reading this description, that the client 302 connects to the cache cluster 204' via a network such as the Internet (not shown in the drawings). The manner in which the client is associated with a particular cache cluster site or a particular server within that site is referred to as rendezvous, and is not described here. Those of skill in the art will realize and understand, upon reading this
description, that within a CDN rendezvous may be implemented using name servers and the domain name system.
[0035] There are disadvantages to having separate storage for streaming resources and HTTP resource. These include the overhead of having an abundance of storage and the fact that the configuration data for traditional streaming servers is relatively less sophisticated than configuration data for caching servers.
DESCRIPTION
[0036] Fig. 5 shows various components of cache cluster 204' that includes streaming server 214-1 and caching server 212-1. An interface 502 is associated with the streaming server 214-1. The interface 502 is preferably implemented as a software plugin on the streaming server 214-1, although it may be a separate component (e.g., interface 604 in Fig. 6). Using the interface 502 (or 604), the streaming server 214-1 is able to make use of the caching database(s) 216 in order to obtain streaming media content. Instead of using separate streaming media database(s), streaming media and their associated metadata are stored in the caching database(s) 216. The interface 502 (or 604) translates interactions/requests from the streaming server 214-1 into corresponding HTTP requests which may then be handled by the caching server 212-1.
[0037] Interaction between the media client 304 and the streaming server 214-1 continues to use the appropriate streaming protocol (i.e., the streaming protocol for the type / format of media being streamed), although the streaming server 214-1 does not interact directly with the database(s) in the cache cluster and it does not interact with a streaming database.
[0038] Fig. 6 shows operation of an exemplary interaction in which media client 304 is provided with a streaming media resource from a streaming server 214-1 using an appropriate streaming protocol. In Fig. 6 the interface 604 is shown as a separate component from the streaming server 214-1,
although, as noted above, it is preferably integrated into the streaming server (e.g., as a plugin).
[0039] The steps associated with providing the streaming media resource are as follows (in response to media client 304 requesting an electronic resource from the streaming server 214-1):
[0040] 1. The streaming server 214-1 asks for configuration data associated with the requested resource (at la). This request is made of the caching server 212-1 through the interface 604 which converts the request to a corresponding HTTP request (at lb). The caching server 208-1 obtains the required configuration data from database 280 in the caching databases 216. The caching server 212-1 may use the configuration data to perform such processes as authentication, geo-blocking evaluation, authorization and/or licensing, etc. The caching server 212-1 passes some or all of the configuration data to the streaming server 214-1. Some of the configuration data may relate to the streaming protocol, in which case it will be handled by the streaming server 214-1. Some of the configuration data may relate to CDN and/or content provider policies, and those configuration data may be handled by the caching server 212-1. The streaming server 214-1 may also use some the configuration data to perform such processes as authentication, geo-blocking evaluation, authorization and/or licensing, etc.
[0041] 2. Assuming that the request passes required authentication, authorization, etc., the streaming server 214-1 then pulls the actual media resource from the caching server 208-1. Again, the pull request is made through the interface 604 which converts the request to a corresponding HTTP request (at 2b) for the actual media resource. The caching server 212-1 obtains the required media resource data from database 282 in the caching databases 216 (at 2c) and provides (serves) that media resource to the streaming server 214-1 via the interface 604.
[0042] Embodiments of the present invention thus provide an approach for use by streaming servers to use functionality of caching servers, including,
without limitation, functionality of caching servers in pulling electronic resources from data storage and/or accessing configuration data from data storage.
[0043] Given the extension of functionality available to the streaming server 106, separate data storage is not needed for the streaming servers.
[0044] It should be appreciated that the term "server" represents a collection of processes implemented in software and/or firmware by a computer. While these processes are each implemented on the same device, in accordance with one embodiment, any number of these processes could alternatively be implemented on any number of devices.
[0045] The streaming servers, the interface software and the caching servers are shown in the drawings on single device, however, it should be appreciated that any of these components may be separately located on more than one device. That said, the interface software is preferably located on at least the same device as the streaming server and allows the streaming server to communicate with the caching server using HTTP protocol.
THE INTERFACE
[0046] The interface 502, 604 has a number of roles. A primary role of the interface 502, 604 is to convert requests from the streaming server into HTTP requests that can be sent to a caching server. The other roles of the interface include intercepting (or accepting) requests from the streaming server 214-1 and, after conversion to HTTP, making those requests of a caching server.
[0047] URLs are described in RFC 1738, Uniform Resource Locators (URL), by T. Berners-Lee et al., the entire contents of which are fully incorporated herein for all purposes. The general form of a URL is:
«protocol»://«host»/«path»
[0048] For HTTP URLs, the protocol is "http", and so in an HTTP URL the "«protocol»" in the general URL is replaced by "http". For streaming
URLs, the protocol is one of: "rtmp", "rtmpe", "rtmpt", "rtmpte", etc. RTMP means Real Time Messaging Protocol; RTMPE means Encrypted RTMP;
RTMPT means encapsulated RTMP; and RTMPTE means encrypted, encapsulated RTMP. Those of skill in the art will realize and understand, upon reading this description, that different and/or other streaming protocols may be used.
[0049] Although the following discussion is made with reference to the standard RTMP protocol, it should be appreciated, however, that the other RTMP protocols (e.g., RTPMPT, RTMPE, RTMPTE, etc.) are treated in the same way.
[0050] A typical streaming request with the RTMP protocol uses a streaming URL with, e.g., one of the following forms:
URL1:
protocol://host/application/[instance]/[path_to_stream]/[codec:]streamname[.ext] URL2:
protocol://host/appIication/[instance]/[codec:][path_to_stream]/streamname[.ext] where the [codec:], f.extj, [instance], and [path Jo _str earn] parts are optional (as indicated by the square brackets). (As used herein, following well-known and conventional notation, URL components denoted in square brackets ("[" and "]") are considered optional.) The protocol is one of: "rtmp", "rtmpe", "rtmpt", "rtmpte", etc. The list of codecs currently includes: flv:, id3:, mp3:, mp4: and raw:, although those of skill in the art will realize and understand that other codecs may be used, and that the present invention is not limited to only the currently-existing codecs. The optional stream name extension (as indicated by the ".ext" in square brackets) reflects the type of the stream (e.g., mp3, mp4, flv, f4v, mov, avi, etc.). In many cases the stream type may be determined from the codec or the application or some other information in the URL if the extension is not provided. It should be understood that the letters "ext" in the extension, if provided, are the letters for the appropriate extension (e.g., "mp3", "mp4", "flv", "f4v", "mov", "avi", and so on).
[0051] The streaming server 214-1 issues various instructions / requests using this form of URL. These instructions include instructions to connect, play, stop, or disconnect. In order to obtain and render a stream, a streaming client goes through two phases: connect and play. The connect phase only uses part of the streaming URL. In particular, in preferred implementations, connect URL does not include the "/path_to_stream/[codec:]streamname[.ext]" part(s) of the streaming URL. Thus, to connect to a stream denoted by URLl (or URL2), the streaming client does (or issues or invokes):
CONNECT(protocol://host/application/instance/)
[0052] Following the CONNECT instruction/command comes a PLAY instruction, which only includes the
ii/path_to_stream/[codec:]sti"eamname[.ext]" part(s) of the URL. It is important to understand difference between streaming protocol (such as
RTMPx) and HTTP. HTTP is a stateless protocol, meaning that every single HTTP request has enough information for server to process it independently. Streaming protocols (such as RTMPx) are statefull, i.e. streaming server must preserve client state across transactions. A streaming client can request and play multiple streams over the same connection to the streaming server.
[0053] Thus, a streaming player makes two requests- a "connect" phase and a "play" phase— splitting the streaming URL into two parts. The
"connect" conveys protocol, host, application, and instance information, while the "play" conveys the remainder. The streaming URL may be considered to be of the form: protocol://connect_part/play_part where connect__part is used by the CONNECT phase, and includes protocol, host, application, and instance information, and where the play_part is used by the PLAY phase.
[0054] In the exemplary URLs above (URL 1 and URL2), the
connectjpart is "protocol://host/application/[instance]", and the playjpart is
"/[path_to_stream]/[codec:]streamname[.ext]" or
"[codec:][path_to_stream]/streamname[.ext]".
[0055] For example, to connect to an MP3 stream at the following URL: rtmp://xyzxom/appl/instl/pathl/codecl:foo.mp3 [URL 3] the streaming client does performs/invokes):
CONNECT(rtmp://xyz.com/appl/instl/) followed by
PLAY(/pathl/codecl/foo.mp3)
[0056] These CONNECT and PLA Y instructions are intercepted by the interface 604, 502 which converts them into the appropriate HTTP commands for the caching server 212-1. Specifically, the interface 604, 502 extracts (obtains/determines) the following information from the streaming URL (i.e., from the parameters to the CONNECT and PLAY commands): the host, the path to the stream, and the stream name. Those of skill in the art will realize and understand, upon reading this description, that the interface may obtain the required information directly or indirectly from the parameters to the
CONNECT and PLAY commands, and that the term "extracts" is not limited to a string extraction or the like, and covers any manner of obtaining or otherwise deteraiining the information.
[0057] Using the example of URL 3, the interface 604, 502 extracts (obtains/determines) the following:
[0058] If the streaming URL omits the optional stream type, the interface determines the type, e.g. from the codec or from other information in the URL.
In preferred implementations the type is needed because the caching server may have copies of the same stream encoded in different formats.
[0059] The infomation extracted (or derived) from the streaming URL used by the interface 604, 502 to create a corresponding HTTP-based URL of the form: http://host/path_to_stream/streamname.ext [URL 4]
[0060] In a present embodiment, the application name is provided as the value of the HTTP "Host:" header.
[0061] The interface 604, 502 uses this generated HTTP-based URL (or the infomation in or associated with that URL) to make HTTP requests of the caching server 212-1. In the example of URL 2 (above), the following HTTP- based URL is generated by the interface 604, 502: http://xyz.com/pathl/foo.mp3 [URL 4]
[0062] The interface 604, 502 then makes the following HTTP GET request, with the HOST HEADER set to "appl":
GET /instl/pathl/foo.mp3
Host: appl
[0063] The application and instance may be used to determine which media resource is returned to the streaming server, and so must be provided to the cache. Those of skill in the art will realize and understand, upon reading this description, that the path may contain appl with some other value for "Host:".
[0064] The interface 604, 502 may use a well-known program such as, e.g. , cURL to make the HTTP requests of the cache server. In response to receipt of that GET request caching server 212-1 obtains the requested streaming resource and provides it to the streaming server 214-1.
[0065] Fig. 7 is a flowchart according to embodiments herein. The rectangular elements are herein denoted as "steps" and represent computer
software instructions or groups of instructions that carry out such functions. The flow diagrams do not necessarily depict the syntax of any particular programming language. Rather, the flow diagrams illustrate the functional information one of ordinary skill in the art could use to fabricate circuits or to generate computer software (or a hybrid of both circuits and software code) to carry out the features as described herein. It should be noted that many routine program elements, such as initialization of loops and variables and the use of temporary variables are inherent in the flowcharts. It will be appreciated by those of ordinary skill in the art that unless otherwise indicated herein, the particular sequence of steps described is illustrative only and can be varied without departing from the spirit of the invention. Thus, unless otherwise stated the steps described below are unordered meaning that, when possible, the steps can be performed in any convenient or desirable order.
[0066] With reference to the flowchart in Fig. 7, the interface 502, 604 obtains one or more requests from a streaming server (at S702). The request(s) include mformation from an RTMP-based streaming URL (e.g., of the form of URL 1 above). If the request requires data from the caching server (e.g., it is a connect or play request), then the interface 604 extracts or derives appropriate HTTP information from the streaming URL (at S704). In particular, the interface determines (extracts or derives) the host, path to stream, and stream name from the streaming URL. In some cases it may be necessary to normalize the streaming URL before extraction takes place. Further, even though the type extension (e.g., mp3, mp4, flv, f4v, mov, avi, etc) may be optional in the streaming URL, it is required for the HTTP information.
[0067] With the required information determined from the streaming URL, the interface generates a corresponding HTTP URL (at S708). Using this generated HTTP URL, the interface makes the corresponding HTTP GET request(s) from a cache server (at S710).
[0068] It should be understood that the interface performs a similar function for configuration data and streaming content that is requested by the streaming server.
[0069] Those of skill in the art will realize and understand, upon reading this description, that a streaming server does not have to modify its protocols in order to operate with the caching servers. As far as the streaming server is concerned, it is interacting with a streaming database. The interface 502, 604 effectively intercepts the streaming server's interactions and directs them to the caching server(s). It should further be appreciated that the streaming server's interactions with the media client(s) still follows the same (potentially proprietary) protocol(s) as they did when a streaming database was in use. Likewise, as far as the caching server is concerned, it is dealing with an HTTP client. This approach allows for new and different streaming protocols and/or streaming servers to be used without modification of interface to the caching server(s).
[0070] While a streaming server's interface can make the HTTP calls from any caching server, in the context of a CDN, it is preferable that the caching server be one that is close (by some measure of network cost and/or distance) to the streaming server. In a presently preferred embodiment, streaming servers obtain their content from caching databases and using caching servers in the same cache cluster. Thus, e.g., as shown in Fig. 8, a cache cluster 804 includes a number of caching servers 212-1, 212-2, 212-A (collectively 212) and a number of streaming servers 214-1, 214-2, 214-/ (collectively 214). Each caching server has a corresponding interface 502-1, 502-2, 502-/, respectively. In the preferred embodiments, these interfaces are implemented as plugins on the streaming servers. The caching servers 212 and the streaming servers 214 are connected to a switch 210, e.g., an Ethernet switch. There may be different numbers of streaming and caching servers.
[0071] In these preferred embodiments, the interface 502-m associated with streaming server 214-m will preferably use one of the caching servers 212 in the same cluster 804_to access the caching database 216.
[0072] As shown in Fig. 9, a CDN 900 including streaming servers with interfaces, as described above, includes a number of caches 800, including a number of cache clusters 804-1, 804-2, ... 804-m (collectively cache clusters
804). The CDN's caches 800 may also include cache clusters 204 which do not serve HTTP content (cached content) outside of the cluster, and cache clusters 204 which do not include streaming servers or in which the streaming servers do not use an interface to a caching database. Each streaming server may also be designated a caching server to use, which may be on the same device as the streaming server.
[0073] Preferably the streaming servers 214 in a particular cache cluster 804 will all have the same VTP (e.g., VTPSS). Similarly, the caching servers 212 in a particular cluster have the same VIP (e.g., VIPCS). External requests to the cluster (via the switch 210) are made to a VIP, and the switch passes those requests to all servers in the cluster. The servers in the cluster decide for and among themselves which server is to handle a request. This process is described, e.g., in U.S. Patent Application No. 12/390,560, filed Feb. 23, 2009, and in U.S. Patent Application No. 12/880,313, filed Sept. 13, 2010, the entire contents of each of which are fully incorporated herein for all purposes.
[0074] In some cases, a particular cache cluster may be configured so that the caching servers are not used directly to serve content to requesting clients outside the cluster, and are used to handle only streaming requests (made via the interfaces 502). In these cases the CDN will be configured so that they do not send HTTP traffic to the streaming-only clusters. Other cache clusters may serve both streaming and cache content externally.
[0075] When a streaming server's interface needs to make a request of a caching server, one of the caching servers needs to be selected. The streaming servers' interfaces may make their HTTP requests via the switch, using the VIP (VEPCS) of the cluster servers in the same cluster. In that way, the cluster servers can use the appropriate load balancing and other selection process to determine which of them is to handle the request.
[0076] In cache clusters that serve both streaming and cache content, the VTP for the cache servers and the streaming servers may be the same (i.e., in some cases VIPCS is the same as VIPCS). In those cases all servers connect to
the switch 210 will get all requests, and the servers themselves will select who is to handle the requests (based, e.g., on the type of request - e.g., streaming versus HTTP - and on their respective loads). Those of skill in the art will realize and understand, upon reading this description, that different and/or other factors may be used within a cluster to determine which server handles a particular request.
[0077] As described above (with reference to Fig. 6), a typical streaming flow has two parts: an authentication/authorization part, followed by the actual delivery. In the approach described here, authentication may take place at two levels. The streaming servers may still perform whatever authentication / authorization is required by the particular streaming protocol in use. This process may require authentication / authorization information from the caching databases. In addition, the caching servers may perform
authentication, authorization, logging and other data collection required for CDN operation. In this way the CDN can implement its own and content provider policies independent of the streaming protocols.
[0078] For example, a content provider may pay different rates to the CDN operator for different kinds or encodings of streamed content. Or certain content may be restricted to certain geographical areas (e.g., for copyright purposes). The caching servers can be used to implement some or all of these policies, leaving the streaming server to deal with streaming.
COMPUTING
[0079] Programs that implement such methods (as well as other types of data) may be stored and transmitted using a variety of media (e.g., computer readable media) in a number of manners. Hard-wired circuitry or custom hardware may be used in place of, or in combination with, some or all of the software instructions that can implement the processes of various
embodiments. Thus, various combinations of hardware and software may be used instead of software only.
[0080] Fig. 10 is a schematic diagram of a computer system 1000 upon which embodiments of the present disclosure may be implemented and carried out.
[0081 According to the present example, the computer system 1000 includes a bus 1001 (i.e., interconnect), at least one processor 1002, at least one communications port 1003, a main memory 1004, a removable storage media 1005, a read-only memory 1006, and a mass storage 1007.
[0082] Processor(s) 1002 can be any known processor, such as, but not limited to, an Intel® Itanium® or Itanium 2® processor(s), AMD® Opteron® or Athlon MP® processors), or Motorola® lines of processors, and the like. Communications port(s) 1003 can be any of an RS-232 port for use with a modem based dial-up connection, a 10/100 Ethernet port, a Gigabit port using copper or fiber, or a USB port, and the like. Communications port(s) 1003 may be chosen depending on a network such as a Local Area Network (LAN), a Wide Area Network (WAN), a CDN, or any network to which the computer system 1000 connects. The computer system 1000 may be in communication with peripheral devices (e.g., display screen 1030, input device(s) 1016) via Input/Output (I/O) port 1009.
[0083] Main memory 1004 can be Random Access Memory (RAM), or any other dynamic storage device(s) commonly known in the art. Read-only memory 1006 can be any static storage device(s) such as Programmable Readonly Memory (PROM) chips for storing static information such as instructions for processor 1002. Mass storage 1007 can be used to store information and instructions. For example, hard disks such as the Adaptec® family of Small Computer Serial Interface (SCSI) drives, an optical disc, an array of disks such as Redundant Array of Independent Disks (RAID), such as the Adaptec® family of RAID drives, or any other mass storage devices may be used.
[0084] Bus 1001 communicatively couples processor(s) 1002 with the other memory, storage and communications blocks. Bus 1001 can be a PCI / PCI-X, SCSI, a Universal Serial Bus (USB) based system bus (or other)
depending on the storage devices used, and the like. Removable storage media 1005 can be any kind of external hard-drives, floppy drives, IOMEGA® Zip Drives, Compact Disc - Read Only Memory (CD-ROM), Compact Disc - Re- Writable (CD-RW), Digital Video Disk - Read Only Memory (DVD-ROM), etc.
[0085] Embodiments herein may be provided as a computer program product, which may include a machine-readable medium having stored thereon instructions, which may be used to program a computer (or other electronic devices) to perform a process. As used herein, the term "machine-readable medium" refers to any medium, a plurality of the same, or a combination of different media, which participate in providing data (e.g., instructions, data structures) which may be read by a computer, a processor or a like device. Such a medium may take many forms, including but not limited to, non- volatile media, volatile media, and transmission media. Non- volatile media include, for example, optical or magnetic disks and other persistent memory. Volatile media include dynamic random access memory, which typically constitutes the main memory of the computer. Transmission media include coaxial cables, copper wire and fiber optics, including the wires that comprise a system bus coupled to the processor. Transmission media may include or convey acoustic waves, light waves and electromagnetic emissions, such as those generated during radio frequency (RF) and infrared (IR) data communications.
[0086] The machine-readable medium may include, but is not limited to, floppy diskettes, optical discs, CD-ROMs, magneto-optical disks, ROMs, RAMs, erasable programmable read-only memories (EPROMs), electrically erasable programmable read-only memories (EEPROMs), magnetic or optical cards, flash memory, or other type of media/machine-readable medium suitable for storing electronic instructions. Moreover, embodiments herein may also be downloaded as a computer program product, wherein the program may be transferred from a remote computer to a requesting computer by way of data signals embodied in a carrier wave or other propagation medium via a cominunication link (e.g., modem or network connection).
[0087] Various forms of computer readable media may be involved in carrying data (e.g. sequences of instructions) to a processor. For example, data may be (i) delivered from RAM to a processor; (ii) carried over a wireless transmission medium; (iii) formatted and/or transmitted according to numerous formats, standards or protocols; and/or (iv) encrypted in any of a variety of ways well known in the art.
[0088] A computer-readable medium can store (in any appropriate format) those program elements which are appropriate to perform the methods.
[0089] As shown, main memory 1004 is encoded with interface application 1050-1 that supports the interface functionality as discussed herein. Interface application 1050-1 (and/or other resources as described herein) can be embodied as software code such as data and/or logic instructions (e.g., code stored in the memory or on another computer readable medium such as a disk) that supports processing functionality according to different embodiments described herein.
[0090] During operation of one embodiment, processor(s) 1002 accesses main memory 1004 via the use of bus 1001 in order to launch, run, execute, interpret or otherwise perform the logic instructions of the interface application 1050-1. Execution of interface application 1050-1 produces processing functionality in content delivery process 1050-2. In other words, the content delivery process 1050-2 represents one or more portions of the interface application 1050-1 performing within or upon the processor(s) 1002 in the computer system 1000.
[0091 ] It should be noted that, in addition to the content delivery process 1050-2 that carries out operations as discussed herein, other embodiments herein include the interface application 1050-1 itself (i.e., the un-executed or non-performing logic instructions and/or data). The interface application 1050- 1 may be stored on a computer readable medium (e.g., a repository) such as a floppy disk, hard disk or in an optical medium. According to other
embodiments, the interface application 1050-1 can also be stored in a memory
type system such as in firmware, read only memory (ROM), or, as in this example, as executable code within the main memory 1004 (e.g., within Random Access Memory or RAM). For example, interface application 1050-1 may also be stored in removable storage media 1005, read-only memory 1006, and/or mass storage device 1007.
[0092] Example functionality supported by computer system 1000 and, more particularly, functionality associated with interface application 1050-1 is discussed above with reference to Figs. 6-7.
[0093] Those skilled in the art will understand that the computer system 1000 can include other processes and/or software and hardware components, such as an operating system that controls allocation and use of hardware resources.
[0094] As discussed herein, embodiments of the present invention include various steps or operations. A variety of these steps may be performed by hardware components or may be embodied in machine-executable instructions, which may be used to cause a general-purpose or special-purpose processor programmed with the instructions to perform the operations.
Alternatively, the steps may be performed by a combination of hardware, software, and/or firmware. The term "module" refers to a self-contained functional component, which can include hardware, software, firmware or any combination thereof.
[0095] One of ordinary skill in the art will readily appreciate and understand, upon reading this description, that embodiments of an apparatus may include a computer/computing device operable to perform some (but not necessarily all) of the described process.
[0096] Embodiments of a computer-readable medium storing a program or data structure include a computer-readable medium storing a program that, when executed, can cause a processor to perform some (but not necessarily all) of the described process.
[0097] Where a process is described herein, those of skill in the art will appreciate that the process may operate without any user intervention. In another embodiment, the process includes some human intervention (e.g., a step is performed by or with the assistance of a human).
[0098] It should be appreciated that the words "first" and "second" in the claims are used to distinguish or identify, and not to show a serial or numerical limitation. Similarly, the use of letter or numerical labels (such as "(a)", "(b)", and the like) are used to help distinguish and / or identify, and not to show any serial or numerical limitation or ordering.
[0099] Thus are described methods, systems, and devices extending caching network functionality to existing streaming media servers.
[00100] While the invention has been described in connection with what is presently considered to be the most practical and preferred embodiments, it is to be understood that the invention is not to be limited to the disclosed embodiment, but on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.
Claims
1. A system for content delivery comprising: a streaming media server; a caching server;
one or more storage devices accessible to the caching server, wherein the one or more storage devices store content;
interface software configured to initiate retrieval, by the caching server, of at least one electronic streaming resource from the one or more storage devices in response to an end user's request for the at least one electronic streaming resource received by the streaming media server.
2. The system of claim 1 wherein the interface software is integrated into the streaming media server.
3. The system of claim 2 wherein the interface software is a plugin on the streaming media server.
4. The system of claim 1 wherein the interface software is configured to:
(a) obtain an instruction from the streaming media server regarding the at least one electronic resource, the instruction including at least some information regarding the at least one electronic streaming resource; and
(b) convert the instruction into information associated with an Hyper Text Transfer Protocol (HTTP) request regarding the at least one electronic streaming resource; and (c) use the information associated with the HTTP request to initiate retrieval, by the caching server, of the at least one electronic streaming resource.
5. The system of claim 4 wherein the at least some information regarding the at least one electronic resource included with the instruction from the streaming media server includes a first Uniform Resource Locator (URL) of the at least one electronic resource, and wherein the interface software converts the first URL into a second URL.
6. The system of claim 5 wherein the first URL is in a streaming format and wherein the second URL is an HTTP URL.
7. The system of claim 6 wherein the first URL is an Real Time Messaging Protocol (RTMP) URL.
8. The system of claim 5 wherein the first URL has the form: protocol://host/appHcation/[instance]/|jpath_to_stream]/[codec:]streamname
or
protocol://host/application/[mstance]/[co
with an optional extension ext after "streamname", and wherein the second URL has the form: http ://host/path_to_stream/ streamname.ext
9. The system of claim 1 wherein the type of the at least one electronic resource is one of: mp3, mp4, flv, f4v, mov, and avi.
10. The system of claim 4 wherein the instruction is selected from the instructions: connect and play.
11. The system of claim 1 wherein the one or more storage devices also store configuration data related to at least some of the content, and wherein the interface software is further configured to initiate retrieval, by the caching server, of at least some configuration data related to the at least one electronic streaming resource.
12. An interface device, in a system for content delivery comprising: a streaming media server; a caching server; and one or more storage devices accessible to the caching server, wherein the storage device stores streaming content, the interface device comprising:
interface software configured to initiate retrieval, by the caching server, of at least one electronic streaming resource from the one or more storage devices in response to an end user's request for the at least one electronic streaming resource received by the streaming media server.
13. The interface device of claim 12 wherein the interface software is configured to initiate retrieval by the caching server of configuration data.
14. The interface device of claim 12 wherein the device is integrated into the streaming media server.
15. The interface device of claim 14 wherein the device is a plugin on the streaming media server.
16. The interface device of claim 12 wherein the device is configured to:
(a) obtain an instruction from the streaming media server regarding the at least one electronic streaming resource, the instruction including at least some information regarding the at least one electronic streaming resource; and
(b) convert the instruction into information associated with an Hyper Text Transfer Protocol (HTTP) request regarding the at least one electronic resource; and
(c) use the information associated with the HTTP request to initiate retrieval, by the caching server, of the at least one electronic streaming resource.
17. The interface device of claim 16 wherein the at least some information regarding the at least one electronic streaming resource included with the instruction from the streaming media server includes a first Uniform Resource Locator (URL) of the at least one electronic streaming resource, and wherein the interface device converts the first URL into a second URL.
18. The interface device of claim 16 wherein the first URL is in a streaming URL format and wherein the second URL is an HTTP URL.
19. The interface device of claim 16 wherein the first URL is a Real Time Messaging Protocol (RTMP) URL.
20. The interface device of claim 16 wherein the first URL has the form:
protocol://host/applicatiori/[instance]/[pa^
or protocol://host/application/[instance]/[co
where 'protocol' can be 'rtmp', 'rtmpe', 'rtmpt', 'rtmpte', and with an optional extension ".ext" after "streamname", and wherein the second URL has the form: http://host/path_to_streaiTi/streaiTiname.ext
21. The interface device of claim 12 wherein the type of the at least one electronic resource is one of: mp3, mp4, flv, f4v, mov, and avi.
22. The interface device of claim 16 wherein the instruction is selected from the instructions: connect and play.
23. A streaming server, in a system for content delivery comprising: a caching server; and one or more storage devices accessible to the caching server, wherein the storage device stores content deliverable by the streaming server, the streaming server comprising: an interface device comprising software configured to initiate retrieval, by the caching server, of at least one electronic streaming resource from the one or more storage devices in response to an end user's request for the at least one electronic streaming resource received by the streaming media server.
24. A computer cluster comprising:
(A) a switch;
(B) a first plurality of caching servers connected to the switch;
(C) one or more storage devices accessible to the caching servers, wherein the one or more storage devices store streaming content; and (D) a second plurality of streaming servers connected to the switch, each of said streaming servers having a corresponding interface mechanism associated therewith, each said interface mechanism being configured to initiate retrieval, by one of the caching servers, of least one electronic streaming resource from the one or more storage devices in response to a request for the at least one electronic streaming resource received by a corresponding streaming media server.
25. The computer cluster of claim 24 wherein the second plurality of streaming servers share the same first virtual Internet Protocol address (VIP).
26. The computer cluster of claim 25 wherein the first plurality of caching servers share the same second VIP.
27. The computer cluster of claim 26 wherein the first VTP is the same as the second VIP.
28. The computer cluster of claim 26 wherein each said interface mechanism initiates retrieval, by one of the caching servers using at least the second VIP.
29. A content delivery network comprising:
a plurality of computer clusters according to any one of claims 24 to 29.
30. A computer-implemented method implemented by hardware in combination with software, the method operable in a system for content delivery comprising a streaming media server; a caching server; an interface mechanism associated with the caching server; and one or more storage devices accessible to the caching server, wherein the storage device stores streaming content, the method comprising, by the interface mechanism:
(a) obtaining an instruction from the streaming media server regarding at least one electronic resource, the instruction including at least some infomation regarding the at least one electronic streaming resource; and
(b) converting the at least some information into information associated with an Hyper Text Transfer Protocol (HTTP) request regarding the at least one electronic resource; and
(c) using the information associated with the HTTP request to request the at least one electronic resource from the caching server.
31. The method of claim 30 wherein the at least some information regarding the at least one electronic resource included with the instruction from the streaming media server includes a first Uniform Resource Locator (URL) of the at least one electronic streaming resource, the method further
comprising: the interface software converting the first URL into a second URL.
32. The method of claim 31 wherein the first URL is in a streaming format and wherein the second URL is an HTTP URL.
33. The method of claim 31 wherein the first URL is a Real Time Messaging Protocol (RTMP) URL.
34. The method of claim 31 wherein the first URL has the form: rtw^://hosi appHcation/[instance]/[path_to_stream]/[codec:]streanmam or
7'tmj!?://host/applicatiori/[msta^^
with an optional extension ".ext" after "streamname", and wherein the second URL has the form: http://host/path_to_stream/streamname.ext
35. The method of claim 30 wherein a type of the at least one electronic streaming resource is one of: mp3, mp4, flv, f4v, mov, and avi.
36. The method of claim 30 wherein the instruction is selected from the instructions: connect and play.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP11822724.8A EP2612254B1 (en) | 2010-09-03 | 2011-09-02 | Extending caching network functionality to an existing streaming media server |
CA2810239A CA2810239C (en) | 2010-09-03 | 2011-09-02 | Extending caching network functionality to an existing streaming media server |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US38014810P | 2010-09-03 | 2010-09-03 | |
US61/380,148 | 2010-09-03 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2012031212A1 true WO2012031212A1 (en) | 2012-03-08 |
Family
ID=45773288
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2011/050343 WO2012031212A1 (en) | 2010-09-03 | 2011-09-02 | Extending caching network functionality to an existing streaming media server |
Country Status (4)
Country | Link |
---|---|
US (3) | US9596278B2 (en) |
EP (1) | EP2612254B1 (en) |
CA (1) | CA2810239C (en) |
WO (1) | WO2012031212A1 (en) |
Families Citing this family (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8489750B2 (en) * | 2008-02-28 | 2013-07-16 | Level 3 Communications, Llc | Load-balancing cluster |
US11323510B2 (en) | 2008-02-28 | 2022-05-03 | Level 3 Communications, Llc | Load-balancing cluster |
CA2810239C (en) | 2010-09-03 | 2018-11-27 | Level 3 Communications, Llc | Extending caching network functionality to an existing streaming media server |
US8738736B2 (en) * | 2010-11-23 | 2014-05-27 | Edgecast Networks, Inc. | Scalable content streaming system with server-side archiving |
US8977704B2 (en) * | 2011-12-29 | 2015-03-10 | Nokia Corporation | Method and apparatus for flexible caching of delivered media |
US20130173806A1 (en) | 2011-12-31 | 2013-07-04 | Level 3 Communications, Llc | Load-balancing cluster |
US9621667B2 (en) * | 2012-08-27 | 2017-04-11 | Adobe Systems Incorporated | Streaming media with a server identified at runtime |
EP2975854B1 (en) | 2013-03-15 | 2019-09-18 | Panasonic Intellectual Property Management Co., Ltd. | Content distribution method, content distribution system, source device, and sink device |
US10530852B2 (en) * | 2016-05-19 | 2020-01-07 | Level 3 Communications, Llc | Network mapping in content delivery network |
US10560726B2 (en) | 2017-07-26 | 2020-02-11 | CodeShop BV | System and method for delivery and caching of personalized media streaming content |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070288518A1 (en) * | 2006-05-03 | 2007-12-13 | Jeff Crigler | System and method for collecting and distributing content |
US20090157850A1 (en) * | 2007-12-13 | 2009-06-18 | Highwinds Holdings, Inc. | Content delivery network |
US20100138534A1 (en) * | 2008-11-25 | 2010-06-03 | Rishi Mutnuru | Systems and methods for monitor an access gateway |
US20100146139A1 (en) * | 2006-09-29 | 2010-06-10 | Avinity Systems B.V. | Method for streaming parallel user sessions, system and computer software |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7003574B1 (en) * | 2000-11-01 | 2006-02-21 | Microsoft Corporation | Session load balancing and use of VIP as source address for inter-cluster traffic through the use of a session identifier |
JP4221646B2 (en) * | 2002-06-26 | 2009-02-12 | 日本電気株式会社 | Shared cache server |
US20060064478A1 (en) * | 2004-05-03 | 2006-03-23 | Level 3 Communications, Inc. | Geo-locating load balancing |
US20080294694A1 (en) * | 2007-05-24 | 2008-11-27 | Videoclix Technologies Inc. | Method, apparatus, system, medium, and signals for producing interactive video content |
US7707308B1 (en) * | 2007-06-26 | 2010-04-27 | Cello Partnership | OSPF routing to geographically diverse applications using OSPF and route health injection (RHI) |
WO2009126829A2 (en) * | 2008-04-09 | 2009-10-15 | Level 3 Communications, Llc | Rule-based content request handling |
US8370520B2 (en) * | 2008-11-24 | 2013-02-05 | Juniper Networks, Inc. | Adaptive network content delivery system |
EP2422275B1 (en) * | 2009-04-24 | 2018-04-11 | Level 3 Communications, LLC | Media resource storage and management |
US9237387B2 (en) * | 2009-10-06 | 2016-01-12 | Microsoft Technology Licensing, Llc | Low latency cacheable media streaming |
CA2810239C (en) | 2010-09-03 | 2018-11-27 | Level 3 Communications, Llc | Extending caching network functionality to an existing streaming media server |
-
2011
- 2011-09-02 CA CA2810239A patent/CA2810239C/en active Active
- 2011-09-02 WO PCT/US2011/050343 patent/WO2012031212A1/en active Application Filing
- 2011-09-02 US US13/224,507 patent/US9596278B2/en active Active
- 2011-09-02 EP EP11822724.8A patent/EP2612254B1/en active Active
-
2017
- 2017-03-10 US US15/456,443 patent/US9992297B2/en active Active
-
2018
- 2018-06-04 US US15/996,849 patent/US10367908B2/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070288518A1 (en) * | 2006-05-03 | 2007-12-13 | Jeff Crigler | System and method for collecting and distributing content |
US20100146139A1 (en) * | 2006-09-29 | 2010-06-10 | Avinity Systems B.V. | Method for streaming parallel user sessions, system and computer software |
US20090157850A1 (en) * | 2007-12-13 | 2009-06-18 | Highwinds Holdings, Inc. | Content delivery network |
US20100138534A1 (en) * | 2008-11-25 | 2010-06-03 | Rishi Mutnuru | Systems and methods for monitor an access gateway |
Non-Patent Citations (1)
Title |
---|
ROY S ET AL.: "Architecture of a modular streaming media server for content delivery networks", PROCEEDINGS OF THE 2003 INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, vol. 3, 6 July 2003 (2003-07-06), pages 569 - 572, XP010651142, ISSN: 978-0-7803-7965-7 |
Also Published As
Publication number | Publication date |
---|---|
US20170187821A1 (en) | 2017-06-29 |
EP2612254B1 (en) | 2021-05-26 |
US9992297B2 (en) | 2018-06-05 |
EP2612254A1 (en) | 2013-07-10 |
US9596278B2 (en) | 2017-03-14 |
CA2810239C (en) | 2018-11-27 |
US20190007514A1 (en) | 2019-01-03 |
US10367908B2 (en) | 2019-07-30 |
CA2810239A1 (en) | 2012-03-08 |
US20120072525A1 (en) | 2012-03-22 |
EP2612254A4 (en) | 2014-04-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10367908B2 (en) | Extending caching network functionality to an existing streaming media server | |
US11463480B2 (en) | Security policy editor | |
US11038773B2 (en) | Content delivery methods and systems | |
EP2941897B1 (en) | Connected-media end user experience using an overlay network | |
US20030158928A1 (en) | Systems and methods for supporting the delivery of streamed content | |
US10200490B2 (en) | Content-based redirection | |
US20170019506A1 (en) | Spdy-based web acceleration method and spdy proxy therefor | |
JP2018506772A (en) | Network address resolution | |
US20170346924A1 (en) | System and method for providing reliable and efficient data transfer | |
Nelson | Smooth Streaming Deployment Guide | |
JP6121964B2 (en) | Access restriction method, distribution system, and reverse proxy server | |
WO2010061262A2 (en) | Content brokering system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11822724 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2011822724 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2810239 Country of ref document: CA |
|
NENP | Non-entry into the national phase |
Ref country code: DE |