EP3682617B1 - Distributed multi-datacenter video packaging system - Google Patents
Distributed multi-datacenter video packaging system Download PDFInfo
- Publication number
- EP3682617B1 EP3682617B1 EP18789276.5A EP18789276A EP3682617B1 EP 3682617 B1 EP3682617 B1 EP 3682617B1 EP 18789276 A EP18789276 A EP 18789276A EP 3682617 B1 EP3682617 B1 EP 3682617B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- content
- encoded
- segments
- video packaging
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000004806 packaging method and process Methods 0.000 title claims description 411
- 238000012545 processing Methods 0.000 claims description 153
- 238000000034 method Methods 0.000 claims description 79
- 230000005540 biological transmission Effects 0.000 claims description 76
- 230000008569 process Effects 0.000 claims description 61
- 238000007726 management method Methods 0.000 claims description 54
- 239000002957 persistent organic pollutant Substances 0.000 description 49
- 238000004590 computer program Methods 0.000 description 42
- 238000004891 communication Methods 0.000 description 39
- 238000010586 diagram Methods 0.000 description 30
- 230000003993 interaction Effects 0.000 description 25
- 230000006870 function Effects 0.000 description 18
- 238000012512 characterization method Methods 0.000 description 15
- 230000003044 adaptive effect Effects 0.000 description 14
- 230000002085 persistent effect Effects 0.000 description 14
- 238000013500 data storage Methods 0.000 description 8
- 238000012937 correction Methods 0.000 description 7
- 230000015572 biosynthetic process Effects 0.000 description 6
- 230000001186 cumulative effect Effects 0.000 description 6
- 238000012856 packing Methods 0.000 description 6
- 239000013589 supplement Substances 0.000 description 6
- 241000278713 Theora Species 0.000 description 4
- 238000013459 approach Methods 0.000 description 4
- 230000003190 augmentative effect Effects 0.000 description 4
- 230000001413 cellular effect Effects 0.000 description 4
- 230000002950 deficient Effects 0.000 description 4
- 239000000835 fiber Substances 0.000 description 4
- 230000010365 information processing Effects 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 4
- 230000006855 networking Effects 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 230000003466 anti-cipated effect Effects 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 238000011156 evaluation Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000037406 food intake Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000001131 transforming effect Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
- H04N21/2408—Monitoring of the upstream path of the transmission network, e.g. client requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
- H04L65/612—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
- H04L67/1021—Server selection for load balancing based on client or server locations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2181—Source of audio or video content, e.g. local disk arrays comprising remotely distributed storage units, e.g. when movies are replicated over a plurality of video servers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/21815—Source of audio or video content, e.g. local disk arrays comprising local storage units
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2183—Cache memory
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
- H04N21/23106—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion involving caching operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
- H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
- H04N21/2402—Monitoring of the downstream path of the transmission network, e.g. bandwidth available
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
- H04N21/2405—Monitoring of the internal components or processes of the server, e.g. server load
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
- H04N21/2407—Monitoring of transmitted content, e.g. distribution time, number of downloads
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
Definitions
- computing devices and communication networks can be utilized to exchange data and/or information.
- a computing device can request content from another computing device via the communication network.
- a user at a personal computing device can utilize a browser application to request a content page (e.g., a network page, a Web page, etc.) from a server computing device via the network (e.g., the Internet).
- a content page e.g., a network page, a Web page, etc.
- the server computing device can be referred to as a content provider.
- Content providers provide requested content to client computing devices often with consideration of efficient transmission of the requested content to the client computing device and/or consideration of a cost associated with the transmission of the content.
- a content provider may receive content requests from a high volume of client computing devices which can place a strain on the content provider's computing resources. Additionally, the content requested by the client computing devices may have a number of components, which can further place additional strain on the content provider's computing resources.
- CDN service providers attempt to facilitate the delivery of requested content through the utilization of a content delivery network (“CDN”) service provider.
- CDN service providers also provide requested content to client computing devices often with consideration of efficient transmission of the requested content to the client computing device and/or consideration of a cost associated with the transmission of the content. Accordingly, CDN service providers often consider factors such as latency of delivery of requested content in order to meet service level agreements or the quality of delivery service.
- US 2010/250710 A1 describes a system and method for delivering content objects over the Internet to an end user system with a content delivery network (CDN).
- the system and method aim at dynamically serving content objects by loading and/or reconfiguring publishing points upon receipt of an end user request.
- a content object is requested by an end user media player, the request is assigned to an edge server within a particular POP of the CDN.
- a peer-discovery algorithm is used to determine a content source for the requested content object within the CDN. The peer-discovery algorithm first determines whether the publishing point associated with the requested content object is loaded into the edge server.
- the peer-discovery algorithm queries other edge servers within or remote from the particular POP to determine whether the request for content object is mapped by other edge servers to a content source using their respective publishing points. Once the content source for the requested content object is determined, the edge server reconfigures its publishing point toward the content source. Ultimately, the content object is streamed to the end user media player.
- a content provider can implement a video packaging and origination service that is able to deliver video content to requesting users.
- a video packaging and origination service indexes a collection of source video content (either live streaming or file-based video-on-demand) and delivers it to clients via a wide range of communication protocols such as HTTP Live Streaming ("HLS”), Dynamic Adaptive Streaming over HTTP (“DASH”), HTTP Dynamic Streaming (“HDS”), Real Time Messaging Protocol (“RTMP”), Smooth Streaming, and the like.
- HLS HTTP Live Streaming
- DASH Dynamic Adaptive Streaming over HTTP
- HDS HTTP Dynamic Streaming
- RTMP Real Time Messaging Protocol
- Smooth Streaming and the like.
- a video packaging and origination service can also provide advanced video transmission features such as just-in-time packaging of video content, digital rights management (“DRM”) encryption, time-shifting, bitrate selection, catch up TV, and more.
- DRM digital rights management
- content providers can organize requested content, such as a video file, into multiple segments that are then transmitted to requesting devices, segment by segment. For example, in a video stream, each segment typically accounts for 2-10 seconds of video rendered on a receiving device.
- individual content segments can be encoded by an encoder and transmitted to the video and origination service.
- a single processing node on the video packaging and origination service can receive an incoming stream of encoded segments and then transmit the stream to requesting user devices.
- Video segments can be encoded according to a defined bitrate and format, which generally defines the number of bits of data that are encoded over a measured amount of time and the specific software algorithm and resulting content representation format utilized to encode the data for transmission.
- bitrates are typically measured according to how many kilobits or megabits of data are processed over a second of time.
- a data file that corresponds to 1 megabyte of video data encoded in one second would be considered to have an encoding bitrate of 8 mbps (e.g., 8 megabits per second) while a lower definition video file that corresponds to 45 kilobytes of video data processed in one second would be considered to have an encoding bitrate of 360 kbps (e.g., 360 kilobits per second).
- the content provider may be possible for the content provider to facilitate variable bit rate encoding to enable for variances in the encoding bitrates of individual segments of a video file.
- the content provider can generate multiple encoded bitrate versions or combinations of encoded bitrates and formats of individual video file segments. The content provider can then make at least a subset of the multiple bitrate encoded versions available to clients responsive to a request for a particular encoded bitrate version and format.
- a content provider can generate a catalog identifying the video segments and encoded bitrates for each identified video segment. The catalog can be written into a manifest file that is provided to individual client computing devices that have requested the video file.
- the packaging and origination service is available to receive and process requests for encoded content. More specifically, client computing devices, through a respective software application, can request individual video segments according to the available encoded bitrates and formats as published in the manifest file.
- a client computing device can simply request content having a fixed encoding rate or have a fixed encoding rate selected in response to a streaming content request.
- Such a fixed encoding rate approach can be deficient in facilitating variance of the encoding bitrate (both positive and negative) based on factors, such as network bandwidth, client computing device utilization, quality demands, and the like.
- video segments can be further defined by associating the encoding bitrate with the encoding format utilized by the encoder to generate the output stream.
- the encoding format can correspond to a content representation format for storage or transmission of video content (such as in a data file or bitstream).
- Examples of encoding formats include but not limited to the motion pictures expert group (“MPEG) MPEG-2 Part 2, MPEG-4 Part 2, H.264 (MPEG-4 Part 10), H.265 high efficiency video coding (“HEVC”), Theora, RealVideo RV40, VP9, and AOMedia Video 1 (“AV1”), and the like.
- MPEG motion pictures expert group
- MPEG-4 Part 2 MPEG-4 Part 2
- H.264 MPEG-4 Part 10
- HEVC high efficiency video coding
- Theora Theora
- RealVideo RV40, VP9 RealVideo RV40
- VP9 VP9
- AOMedia Video 1 AOMedia Video 1
- video packaging and origination services can maintain a single node or server to receive incoming content streams and transmit received streaming content to requesting clients. More specifically, the single node can operate as an ingress node to receive individual content streams or channels corresponding to encoded segments encoded to a specific encoding profile (e.g., encoding bitrate and format). The individual content streams or channels are provided by an original content provider. The single node can utilize state information that facilitates determination that all encoding versions of the same encoded segment have been received.
- the throughput of incoming data streams is limited by characteristics of the single node functionality. For example, an ingress node may experience latencies associated with processing more complex encoded content.
- a video packaging and origination service could experience additional inefficiencies by limiting the ability of the video packaging and origination service to process additional encoding channels related to other encoding profiles until the current encoded data is processed.
- a single node may experience a failure, which will result in downstream unavailability of the content stream.
- the single node or server traditionally operates as an egress node to process requests for content by transmitting a content stream in the form of a set of encoded segments to a requesting entity, such as a CDN service or user devices.
- the single node can access the encoded content information received from the original content provider and generate content streams to requesting entities.
- the location of the single node (functioning as both an ingress and egress node) can be optimized for the attributes of the original content provider or the attributes of the requesting entity.
- the single node may be instantiated in a geographic area logically proximate to the original content provider, which can lead to inefficiencies in the transmission of content streams for requesting entities.
- the single node may be instantiated in a geographic area logically proximate to one or more requesting entities, which can lead to inefficiencies in the transmission of content streams from the original content provider.
- the computing resources for the single node are often optimized for an identified need of the ingress functionality or the egress functionality, which can lead to inefficiencies in the operation of the single node. For example, a single node may require a larger amount of processing and memory resources to receive and process incoming content streams than would be required to transmit content streams to requesting entities. Thus, scaling egress functionality would require server nodes with much higher computing resource requirements based on the dual function as an ingress node.
- the invention relates to a system, as further defined in claim 1, and a method, as further defined in claim 5, for managing streaming content.
- aspects of the present application corresponding to a multi-data center, multi-node system for receiving, processing and transmitting encoder streams. More specifically, aspects of the present application correspond to utilization of a set of nodes that function as ingress nodes and a set of nodes that function as egress nodes.
- the ingress nodes and egress nodes can correspond to separate computing devices or virtualized computing devices that can be configured individually to the relative function as ingress or egress nodes.
- the ingress and egress nodes can be individually instantiated and located based on the attributes of the original content provider and the video packaging and origination service for the ingress nodes and the attributes of the requesting entity and the video packaging and origination service for the egress nodes.
- a video packaging and origination service can implement one or more services to manage the instantiated ingress nodes, the instantiated egress nodes and the interaction between ingress and egress nodes.
- an ingress node management service can monitor the operation of ingress nodes and facilitate the storage of processed encoding stream information, including redundant content stream ingestion.
- An egress management service can monitor the operation of egress nodes and facilitate access to the stored processed encoding stream information.
- the ingress node management service and the egress management service can utilize an index that identifies the stored location of individual encoded segments from a set of encoded segments corresponding to streaming content.
- the content management service can generate the index based on input from the ingress nodes that can identify the location and attributes on received encoded content segments. Additionally, the content management service can provide the index to all egress nodes information to allow for access to the encoded content segments at the time of responding to requests for streaming content.
- the egress nodes can dynamically generate content packages by collecting or compiling the stored, processed segments as identified in the index.
- the video packaging and origination service can further include a caching mechanism to facilitate the transmission of the streaming content. More specifically, individual geographic locations of sets of egress nodes may be associated with local caching resources to facilitate increased throughput or performance in responding to content requests. The local caching resources may be populated from the generated index. Additionally, management of the cached information can be optimized based on historical demand for content that has not yet been requested or to maintain encoded content in the cache beyond traditional cache management processes.
- FIG. 1 illustrates a general content delivery environment 100 for delivering content from original content providers to user devices.
- the content delivery environment 100 includes a plurality of devices 102 utilized by individual users, generally referred to as client computing devices, to request streaming or download content from a video packaging and origination service 120.
- the video packaging and origination service 120 indexes a collection of source video content (either live streaming or file-based video-on-demand) and delivers it to clients via a wide range of communication protocols such as HTTP Live Streaming ("HLS”), Dynamic Adaptive Streaming over HTTP (“DASH”), HTTP Dynamic Streaming ("HDS”), Smooth Streaming, Real Time Messaging Protocol (“RTMP”), and the like.
- HLS HTTP Live Streaming
- DASH Dynamic Adaptive Streaming over HTTP
- HDS HTTP Dynamic Streaming
- Smooth Streaming Real Time Messaging Protocol
- RTMP Real Time Messaging Protocol
- a video packaging and origination service can also provide advanced video transmission features such as just-in-time packaging of video content, digital rights management ("DRM”) encryption, time-shifting, bitrate selection, catch up TV, and more.
- DRM digital rights management
- the content can be illustratively provided by one or more origin sources, such as original content provider 130.
- Client computing devices 102 may include any number of different computing devices capable of communicating with the networks 140, 150, 160, via a direct connection or via an intermediary.
- individual accessing computing devices may correspond to a laptop or tablet computer, personal computer, wearable computer, server, personal digital assistant (PDA), hybrid PDA/mobile phone, mobile phone, electronic book reader, set-top box, camera, appliance (e.g. a thermostat or refrigerator), controller, digital media player, watch, glasses, a home or car device, Internet of Thing ("IoT”) devices, virtual reality or augmented reality devices, and the like.
- PDA personal digital assistant
- IoT Internet of Thing
- Each client computing device 102 may optionally include one or more data stores (not shown in FIG. 1 ) including various applications or computer-executable instructions, such as web browsers, used to implement the embodiments disclosed herein. Illustrative components of a client computing device 102 will be described with regard to FIG. 2 .
- a CDN service provider 110 may include multiple edge locations from which a user device can retrieve content.
- Individual edge location 112 may be referred to herein as a point of presence ("POP"), where a POP is intended to refer to any collection of related computing devices utilized to implement functionality on behalf of one or many providers.
- POPs are generally associated with a specific geographic location in which the computing devices implementing the POP are located, or with a region serviced by the POP.
- the POP 110 can include one or more metric information processing component 114 for processing metric information provided by client computing devices 102 and a data store 116 for maintain collected metric information. For example, a data center or a collection of computing devices within a data center may form a POP.
- the POPs may implement one or more services, such as CDN services, data storage services, data processing services, etc.
- the CDN service provider 110 may include multiple POPs located in different geographic locations so that user devices can communicate with a nearby a POP to retrieve content, thereby reducing the latency of delivering requested content.
- Networks 140, 150, 160 may be any wired network, wireless network, or combination thereof.
- the networks 140, 150, 160 may be a personal area network, local area network, wide area network, cable network, fiber network, satellite network, cellular telephone network, data network, or combination thereof.
- network 140 is a global area network (GAN), such as the Internet. Protocols and components for communicating via the other aforementioned types of communication networks are well known to those skilled in the art of computer communications and thus, need not be described in more detail herein.
- GAN global area network
- each of the client computing devices 102 and video packaging and origination service 110 are depicted as having a single connection to the network 140, individual components of the client computing devices 102 and video packaging and origination service 110 may be connected to the network 130 at disparate points. Accordingly, communication times and capabilities may vary between the components of FIG. 1 .
- FIG. 1 is illustrated as having three separate networks 140, 150, 160, one skilled in the relevant art will appreciate that the video packaging and origination service 110 may utilize any number or combination of networks.
- the video packaging and origination service 120 includes one or more servers for receiving content from original content providers 130 and processing the content to make available a set of received encoded bitrate segments.
- the video packaging and origination service 120 includes a plurality of ingress components 122 utilized to receive encoded data streams from encoding servers 132 from content providers 130.
- the ingress components 122 can generate deterministic data that will facilitate a determination of when a complete set of encoded content segments have been received and is ready for further processing or transmission.
- the video packaging and origination service 120 also includes one or more servers for receiving content requests for a requesting entity, such as a POP 110 or user device 102, accessing encoded content utilizing an index and transmission encoded content in return.
- the ingress components 122 and egress components 124 may be distributed according to geographic criteria or availability zones to facilitate delivery or access to encoded content.
- the video packaging and origination service 120 can further include management services 126 for generating synchronization information utilized by the encoders, such as sequence numbers corresponding to the set of encoded segments, time stamp information related to a relative time of the encoded segments or from which relative time of encoded segments will be based, and the like.
- the management services 126 can control the generation or instantiation of additional ingress and egress components or the generation of the indices utilized to identify content.
- the video packing and origination service 120 can include a plurality of cache components 129 that maintain encoded content in one or more distinct availability zones, such as different geographic areas or zones.
- the video packaging and origination service 120 can further include a data store 128 for maintaining received encoded data for transmission.
- the video packaging and origination service 120 may have fewer or greater components than are illustrated in FIG. 1 .
- the depiction of the video packaging and origination service 120 in FIG. 1 should be taken as illustrative.
- components of the video packaging and origination service 120 may be executed by one more virtual machines implemented in a hosted computing environment.
- a hosted computing environment may include one or more rapidly provisioned and released computing resources, which computing resources may include computing, networking or storage devices.
- aspects of the present application relate to the selection of individual ingress servers 122, egress servers 124 and local cache components 129 based on attributes of the components, such as geographic information, logical network information, and the like.
- FIG. 1 While such components are illustrated as logically being logically grouped in FIG. 1 , one skilled in the relevant art will appreciate that one or more aspects of the present application can include the video packaging and origination service 120 as being implemented in multiple geographic areas. Additionally, not all geographic areas hosting portions of the video packaging and origination service 120 will necessary have all the same components or combination of components.
- the content delivery environment 100 also includes original content providers 130.
- the original content provider can include a plurality of encoders 132 for generating multiple encoded streams for transmission to the video packaging and origination service 120.
- individual encoders may generate different encode versions of a content segment according to a different encoding profile.
- the original content provider 130 can also include logic or other management components for determining how many encoders 132 should be utilized or how to manage the addition or removal of encoders.
- the original content provider the original content provider 130 can further include synchronization services 136 for generating synchronization information utilized by the encoders, such as sequence numbers corresponding to the set of encoded segments, time stamp information related to a relative time of the encoded segments or from which relative time of encoded segments will be based, and the like.
- the video packaging and origination service 120 can further include a data store 134 for maintaining encoded data for transmission.
- the synchronization services 124 and 136 may work in conjunction or in a complimentary basis.
- FIG. 2 depicts one embodiment of an architecture of an illustrative user computing device 102 that can generate content requests and process metric information in accordance with the present application.
- the general architecture of the user computing device 102 depicted in FIG. 2 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure.
- the user computing device 102 includes a processing unit 204, a network interface 206, an input/output device interface 209, an optional display 202, and an input device 224, all of which may communicate with one another by way of a communication bus.
- the network interface 206 may provide connectivity to one or more networks or computing systems, such as the network 140 of FIG. 1 and the video packaging and origination service 120 or the original content provider 130.
- the processing unit 204 may thus receive information and instructions from other computing systems or services via a network.
- the processing unit 204 may also communicate to and from memory 210 and further provide output information for an optional display 202 via the input/output device interface 209.
- the input/output device interface 209 may also accept input from the optional input device 224, such as a keyboard, mouse, digital pen, etc.
- the user computing device 102 may include more (or fewer) components than those shown in FIG. 2 .
- the memory 210 may include computer program instructions that the processing unit 204 executes in order to implement one or more embodiments.
- the memory 210 generally includes RAM, ROM, or other persistent or non-transitory memory.
- the memory 210 may store an operating system 214 that provides computer program instructions for use by the processing unit 204 in the general administration and operation of the user computing device 102.
- the memory 210 may further include computer program instructions and other information for implementing aspects of the present disclosure.
- the memory 210 includes a network application 216, such as browser application or media player, for accessing content and communicating with the video packaging and origination service 120.
- FIG. 3 depicts one embodiment of an architecture of an illustrative server for encoding content as described herein.
- the general architecture of the encoder 132 depicted in FIG. 3 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure.
- the encoder 132 includes a processing unit 304, a network interface 306, a computer readable medium drive 308, an input/output device interface 309, all of which may communicate with one another by way of a communication bus.
- the components of the encoder 132 may be physical hardware components or implemented in a virtualized environment.
- the network interface 306 may provide connectivity to one or more networks or computing systems, such as the network 150 or network 160 of FIG. 1 .
- the processing unit 304 may thus receive information and instructions from other computing systems or services via a network.
- the processing unit 304 may also communicate to and from memory 310 and further provide output information for an optional display via the input/output device interface 309.
- the encoder 132 may include more (or fewer) components than those shown in FIG. 3 .
- the memory 310 may include computer program instructions that the processing unit 304 executes in order to implement one or more embodiments.
- the memory 310 generally includes RAM, ROM, or other persistent or non-transitory memory.
- the memory 310 may store an operating system 314 that provides computer program instructions for use by the processing unit 304 in the general administration and operation of the video packaging and origination service 120.
- the memory 310 may further include computer program instructions and other information for implementing aspects of the present disclosure.
- the memory 310 includes interface software 312 for receiving and processing content requests from the video packaging and origination services 120.
- the memory 310 includes an encoder component 316 for processing content segments. Additionally, the encoder component 316 can further include a synchronization parameter component 318 for utilizing the synchronization information in the encoding process to increase the likelihood that encoded segments from multiple encoders can be utilized by a video packaging and origination service 120.
- the synchronization information can be utilized in the generation of deterministic data as will be described below.
- FIG. 4 depicts one embodiment of an architecture of an illustrative server for functioning as an ingress component 122 as described herein.
- the video packaging and origination service 120 includes multiple ingress components 122 (or nodes) that facilitate intake of encoded segments that have been encoded according to different encoding profiles.
- the general architecture of the ingress component 122 depicted in FIG. 4 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure.
- the ingress component 122 includes a processing unit 404, a network interface 406, a computer readable medium drive 408, an input/output device interface 409, all of which may communicate with one another by way of a communication bus.
- the components of the ingress component 122 may be physical hardware components or implemented in a virtualized environment.
- the network interface 406 may provide connectivity to one or more networks or computing systems, such as the network 150 or network 160 of FIG. 1 .
- the processing unit 404 may thus receive information and instructions from other computing systems or services via a network.
- the processing unit 404 may also communicate to and from memory 410 and further provide output information for an optional display via the input/output device interface 409.
- the ingress component 122 may include more (or fewer) components than those shown in FIG. 4 .
- the memory 410 may include computer program instructions that the processing unit 404 executes in order to implement one or more embodiments.
- the memory 410 generally includes RAM, ROM, or other persistent or non-transitory memory.
- the memory 410 may store an operating system 414 that provides computer program instructions for use by the processing unit 404 in the general administration and operation of the ingress node.
- the memory 410 may further include computer program instructions and other information for implementing aspects of the present disclosure.
- the memory 410 includes interface software 412 for receiving and processing content from encoders 132.
- the memory 410 includes an encoder processing application 416 for processing incoming encoded content segments.
- the ingress component 122 can further include a synchronization parameter component 418 for utilizing the synchronization information to generate the deterministic information as described above. Still further, the ingress component 122 can also include an index interface 420 for writing deterministic data or providing deterministic data to generate index of stored content segments.
- FIG. 5 depicts one embodiment of an architecture of an illustrative server for functioning as an egress component 124 as described herein.
- the video packaging and origination service 120 includes multiple egress components 124 (or nodes) that facilitate intake of encoded segment content requests from different requesting entities, such as CDN 110 or user devices 102.
- the general architecture of the egress component 124 depicted in FIG. 5 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure.
- the egress component 124 includes a processing unit 504, a network interface 506, a computer readable medium drive 508, an input/output device interface 509, all of which may communicate with one another by way of a communication bus.
- the components of the egress component 124 may be physical hardware components or implemented in a virtualized environment.
- the network interface 506 may provide connectivity to one or more networks or computing systems, such as the network 150 or network 160 of FIG. 1 .
- the processing unit 504 may thus receive information and instructions from other computing systems or services via a network.
- the processing unit 504 may also communicate to and from memory 510 and further provide output information for an optional display via the input/output device interface 509.
- the egress component 124 may include more (or fewer) components than those shown in FIG. 5 .
- the memory 510 may include computer program instructions that the processing unit 504 executes in order to implement one or more embodiments.
- the memory 510 generally includes RAM, ROM, or other persistent or non-transitory memory.
- the memory 510 may store an operating system 514 that provides computer program instructions for use by the processing unit 504 in the general administration and operation of the egress component 124.
- the memory 510 may further include computer program instructions and other information for implementing aspects of the present disclosure.
- the memory 510 includes interface software 512 for receiving and processing content requests from requesting entities.
- the memory 510 includes a content generation component 516 for processing received encoded content segments from an index.
- the egress component 124 can further include an index component 518 for generating the encoded content streams by accessing encoded content segments as identified in the index information as described above.
- FIG. 6 depicts one embodiment of an architecture of an illustrative server for functioning as a cache component 129 as described herein.
- the video packaging and origination service 120 includes cache components 129 (or nodes) that facilitate the management of content streams to requesting users.
- the cache components 129 are part of the video packaging and origination service 120 and can be managed in manner to optimize the processing and transmission of content streams to requesting users.
- the cache components 129 may correspond to local cache components that serve one or more distinct geographic areas.
- a cache component 129 can have a one-to-one association with a specific geographic region or logical zone and can be optimized according to the attributes of the specific geographic region or logical zone.
- a cache component 129 can have a one-to-many association with multiple geographic zones or logical zones and can be optimized to according to the attributes of individual geographic zones or logical or multiple geographic zones or logical zones.
- the general architecture of the cache component 129 depicted in FIG. 6 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure.
- the cache component 129 includes a processing unit 604, a network interface 606, a computer readable medium drive 608, an input/output device interface 609, all of which may communicate with one another by way of a communication bus.
- the components of the cache component 129 may be physical hardware components or implemented in a virtualized environment.
- the network interface 606 may provide connectivity to one or more networks or computing systems, such as the network 160 or network 160 of FIG. 1 .
- the processing unit 604 may thus receive information and instructions from other computing systems or services via a network.
- the processing unit 604 may also communicate to and from memory 610 and further provide output information for an optional display via the input/output device interface 609.
- the cache component 129 may include more (or fewer) components than those shown in FIG. 6 .
- the memory 610 may include computer program instructions that the processing unit 604 executes in order to implement one or more embodiments.
- the memory 610 generally includes RAM, ROM, or other persistent or non-transitory memory.
- the memory 610 may store an operating system 614 that provides computer program instructions for use by the processing unit 604 in the general administration and operation of the cache component 129.
- the memory 610 may further include computer program instructions and other information for implementing aspects of the present disclosure.
- the memory 610 includes interface software 612 for receiving and processing content caching commands from the content management services 126 and requests from requesting egress servers 124.
- the memory 610 includes a content generation component 616 for processing received encoded content segments from an index for storage.
- Content generation component 616 also includes or access the mass storage utilized to maintain cached content.
- the ingress component 122 can further include an index interface component 618 for obtaining and processing indexes to identify encoded content segments that make up the requesting encoded content.
- the original content provider 130 determine a number of encoder nodes 132 to transmit a set of encoded content segments.
- the original content provider 130 can be configured to identify the requested content and the manner of how the encoded content will be transmitted.
- the original content provider 130 can received configuration information that identifies whether a single encoder will be utilized to transmit encoded streams, whether multiple encoders will be utilized to transmit encoded streams, whether multiple encoders will be utilized to transmit redundant encoded streams, and the like.
- two encoders are illustrated in FIG. 6A , one skilled in the relevant art will appreciate that additional or alternative number of encoders 132 may be utilized.
- the original content provider 130 causes one or more encoders to generate encoded streams based on synchronization information.
- the video packaging and origination service 120 may provide synchronization information, such as timestamp information or sequence information that allows multiple encoders to transmit at least some portion of the encoded content.
- the original content provider 130 can utilize self-providing synchronization, information provided by a third-party service or a combination. Still further, if a single encoder is utilized, synchronization information may not be required to transmit encoded content to the video packaging and origination service 120.
- the original content provider 130 (whether through a single or a plurality of encoding servers 132A and 132B) can provide multiple encoder streams that can correspond to individual content streams corresponding to the different requested encoding profiles.
- a first content stream can correspond to a first encoding bitrate and format (e.g., a first encoding profile) and a second content stream can correspond to a second encoding bitrate and format that is different.
- the content provider transmits the one or more content streams.
- the video packaging and origination service 120 receives the plurality of incoming encoded content streams from the encoders. More specifically, at (4), the content management service 126, such as via an ingress microservice, selects an ingress node or component 122 based on attributes of the original content provider 130, the video packaging and origination service 120 or a combination. Such attributes may include geographic information, network location or traffic information, user configurations, general service levels, resource load information, and the like. For example, the video packaging and origination service 120 can identify a computing device that will function as the ingress component 122 and that is located in a region or availability zone that is determined to be proximate to the original content provider 130.
- the video packaging and origination service 120 can identify a computing device that will function as ingress component 122 and that is associated with sufficient processing resources as anticipated to receive and process incoming content segments. In still another example, the video packaging and origination service 120 can identify a computing device that will function as the ingress component 122 based on the correlation of the target computing device to specific types of content, content providers, or requesting entities.
- the content management system instantiates or causes an instantiated ingress component 122 to receive and process the encoded segments from a first received stream.
- the ingress component 122 of the video packaging and origination service 120 processes the received encoded segments to generate deterministic data included in a set of meta-data utilized to access and generate outgoing content streams.
- the deterministic data can include timestamp information related to a time of play of the set of encoded segments, sequence number identifying an order of the encoded content segment in the set of encoded segments, a time of operation of the encoder and the like.
- the deterministic data will be illustratively utilized to identify a same content segment or matching content segments that have been encoded according to different encoding profiles and received at different ingress components. For example, four content segments sharing a common timestamp of play but encoded according to the different encoding profiles are considered to be the same content segment.
- the ingress component 122 can also format or translate the incoming content to generate different encoding bitrate and format combinations or packages. In another example, the ingress component 122 or content management service 126 can conduct quality or error checking that can be included in meta-data.
- the ingress component 122 stores the encoded data stream.
- the ingress component 122 may store all received encoded content regardless of whether it is duplicative or alternative to what will be used by the video packaging and origination service 120.
- the ingress component 122 can illustratively utilize local storage resources to maintain the received encoded content segments regardless of whether the local storage resources maintain all the received encoded content segments.
- the ingress component 122 causes the generation or updating of an index identifying the location of the received encoded content. As will be described below, the index will be utilized by a separate egress component 124 to respond to content requests from requesting entities.
- the index may be made up of one or more files that include relevant identifiers utilized by the video packaging and origination service 120 to identify the storage location of the received and processed encoded components.
- the index files may be serialized in a manner to facilitate transmission of the index to other computing devices or storage in memory.
- the user device directly or through POP 110 transmits a request for encoded content to the video packaging and origination service 120.
- the interaction between the requesting entities and the video packaging and origination service 120 can include multiple interactions to identify available content and receive request for content.
- a user device 102 may generate various user interfaces or software applications that facilitate the selection of content that are directed to the video packaging and origination service 120.
- the content requests from user devices 102 may be transmitted via a POP 110 or alternatively be transmitted directly from user devices 102 to the video packaging and origination service 120.
- the video packaging and origination service 120 receives one or more requests for encoded content streams from requesting entities.
- the content management service 126 selects an egress node or component 124 based on attributes of the requesting entity (user 102 or POP 110), the video packaging and origination service 120 or a combination.
- attributes may include geographic information, network location or traffic information, user configurations, general service levels for delivery of content, technical configuration information, and the like.
- the video packaging and origination service 120 can identify a computing device that will function as the egress component 124 and that is located in a region or availability zone that is determined to be proximate to the requesting entity.
- the video packaging and origination service 120 can identify a computing device that will function as egress component 124 and that is associated with a communication latency that meets a service level agreement threshold or that is specified by a user.
- the video packaging and origination service 120 can select an egress component 124 that is optimized for the transmitting content streams to a particular requesting entity, such as by custom communication protocol or security requirements.
- the video packaging and origination service 120 can utilize the same criteria (or different criteria) as the criteria utilized to identify the ingress component 122 ( FIG. 6A ), but the evaluation of the criteria may yield identification of the different computing devices based on consideration of the differences in attributes between a content source 130 and the requesting entities.
- the content management system instantiates or causes an instantiated egress component 124 to identify and process the index of the encoded segment requests from a first received stream.
- the egress component 124 of the video packaging and origination service 120 processes the received index to identify the storage location of the encoded segments previously processed and stored by the ingress components 122.
- the egress component 124 can access an index that is available in a known storage location or that is otherwise made available to the egress component 124.
- the egress component 124 packages the encoded content to generate the content streams based on the identified storage location of the encoded data stream.
- the egress component 124 can dynamically access individual encoded content segments at different storage locations associated with ingress components 122.
- the packing of the encoded content segments for transmission as encoded content streams can occur at the time of request which facilitates the management of individual encoded content segments (e.g., removing one segment for another).
- the egress component 124 causes the transmission of the content responsive to the content request.
- the transmission of content segments to requesting entities can include a number of interactions and considerate of the specific protocols implemented to stream content.
- the content management service 126 selects and generates local cache components based on attributes of the requesting entity (user 102 or POP 110), the video packaging and origination service 120 or a combination.
- attributes may include geographic information, network information, user configurations, general service levels, storage requirements, and the like.
- the video packaging and origination service 120 can maintain a cache component in identified regions or availability zones to facilitate the delivery of content.
- the local cache components may be instantiated by the video packaging and origination service 120 in a manner that facilitates that management of the cache components. As will be described in greater detail, one or more aspects of individual local cache components can be optimized based on usage and configuration information.
- the video packaging and origination service 120 configures the individual properties of the cache component based on the received usage and configuration information.
- the video packaging and origination service 120 can allocate different amounts of the cache data storage based on a characterization of the content streams, such as a characterization of quality, popularity, importance, and the like.
- the usage and configuration information may include information from the content provider 130, similar subject matter, user information, and the like.
- the video packaging and origination service 120 can identify content that has been characterized as heavily in demand based on historical information indicative request load.
- the video packaging and origination service 120 can configure one or more local cache components to process the indexes to make the encoded content available for streaming.
- the egress component 122 may provide the usage and configuration information to the video packaging and origination service 120 to facilitate the local caching of content streams, such as content streams predicted to be popular or in which minimum service delivery levels are required.
- the video packaging and origination service 120 identifies cache content based on usage and configuration information.
- the video packaging and origination service 120 can identify content that should be included in the cache data storage based on a characterization of the content streams, such as a characterization of quality, popularity, importance, and the like.
- the usage and configuration information may include information from the content provider 130, similar subject matter, user information, and the like.
- the video packaging and origination service 120 can allocate greater portions of cache content for content associated with a content provider that is characterized as popular to facilitate increase delivery of such content.
- the video packaging and origination service 120 collects the encoded information from the index and causes individual caching stores to be updated.
- the video packaging and origination service 120 can modify traditional caching mechanisms that would either not add content to cache components without first receiving a request or that would otherwise associate a time to live the cached content.
- Routine 700 utilized by the video packaging and origination service 120 to receive and process encoder streams will be described.
- Routine 700 may be illustratively implemented by the video packaging and origination service 120, including one or more an ingress components 122.
- routine 700 will begin once the original content provider 130 begins transmitting a plurality of encoded content streams to the video packaging and origination service 120 and incorporating received/accessed synchronization information.
- the synchronization information may be utilized by the original content provider 130 and video packaging and origination service 120 to transmit and receive encoded content from multiple encoders. If a single encoder is utilized by the original content provider 130, the synchronization information may be omitted.
- the original content provider 130 may be configured to transmit different content streams corresponding to a common encoded segment or set of segments encoded according to different encoding profiles. In other embodiments, the original content provider 130 can be configured to transmit redundant content streams to the video packaging and origination service 120.
- the video packaging and origination service 120 obtains content stream data from an original content provider.
- the content stream data may be transmitted by the original content provider 130 responsive to a request from a user device 102, a request from the video packaging and origination service 120, or other request/trigger.
- the video packaging and origination service 120 can optionally transmit synchronization information to the original content provider 130.
- the synchronization information is utilized by multiple encoders 132 to allow encoded segments from multiple encoders to be combined seamlessly or substantially seamlessly.
- the synchronization information can include timestamp information related to a relative timestamp of individual encoded segments in the set of encoded segments.
- the synchronization information can include sequence numbers for the individual segments.
- the synchronization information can include a time of operation or other time elapsed information.
- the synchronization information is incorporated into the encoded segments and then utilized by the video packaging and origination service 120 to assemble the set of ordered segments, remove duplicates and identifying missing encoded segments.
- block 704 may be omitted.
- the content management system instantiates an ingress component 122 or causes an instantiated ingress component 122 to receive and process the encoded segments from a first received stream.
- the content management service 126 selects an ingress node or component 122 based on attributes of the original content provider 130, the video packaging and origination service 120 or a combination.
- attributes may include geographic information, network location or traffic information, user configurations, general service levels, resource load information, and the like.
- the video packaging and origination service 120 can identify a computing device that will function as the ingress component 122 and that is located in a region or availability zone that is determined to be proximate to the original content provider 130.
- the video packaging and origination service 120 can identify a computing device that will function as ingress component 122 and that is associated with sufficient processing resources as anticipated to receive and process incoming content segments.
- the video packaging and origination service 120 can identify a computing device that will function as the ingress component 122 based on the correlation of the target computing device to specific types of content, content providers, or requesting entities.
- the video packaging and origination service 120 can utilize financial information, such as pricing plans or an attributed cost per transmission, specified by the original content provider 130 or the requesting entities to select an ingress component 122.
- the ingress component 122 of the video packaging and origination service 120 processes the received encoded segments to generate deterministic data.
- the deterministic data can include timestamp information related to a time of play of the set of encoded segments, sequence number identifying an order of the encoded content segment in the set of encoded segments, a time of operation of the encoder and the like.
- the deterministic data will be illustratively utilized to identify a same content segment or matching content segments that have been encoded according to different encoding profiles and received at different ingress components. For example, four content segments sharing a common timestamp of play but encoded according to the different encoding profiles can be considered to be the same content segment.
- the video packaging and origination service 120 performs a determination if encoded segments determined to be matching correspond to all the anticipated encoded profiles. For example, to enable variable bitrate encoding, requesting entities may be offered encoded content segments according to five different encoding profiles. Accordingly, the video packaging and origination service 120 could determine via the deterministic information whether there are five matching segments covering the five requested encoding profiles. If additional encoded segments remain unreceived or not fully processed, the routine 700 returns to block 702 to receive the additional encoder streams. If not, the routine 700 proceeds to block 710.
- the ingress component 122 processes the received encoded segments.
- the video packaging and origination service 120 can be adjustments or error correction for any of the selected encoded segments.
- the video packaging and origination service 120 can extrapolate additional segments or portions to facilitate combination.
- the processed encoded segments can include the generation or translation of the encoded content to correspond to different encoding profiles, such as different combinations of encoding bitrate and format.
- the ingress component 122 stores the encoded data stream.
- the ingress component 122 may store all received encoded content regardless of whether it is duplicative or alternative to what will be used by the video packaging and origination service 120.
- the ingress component 122 causes the generation or updating of an index identifying the location of the received encoded content.
- the index will be utilized by a separate egress component 124 or local cache components 129 to respond to content requests from requesting entities.
- the index may be made up of one or more files that include relevant identifiers utilized by the video packaging and origination service 120 to identify the storage location of the received and processed encoded components.
- the index files may be serialized in a manner to facilitate transmission of the index to other computing devices or storage of the index for access by the additional components of the video packaging and origination service 120.
- the video packaging and origination service 120 can continue to update the index on a periodic basis. For example, if one or more encoded segments are determined to have an error, the video packaging and origination service 120 can receive a different version of the encoded segment from the original content provider 130 or otherwise identify a redundant version of the encoded segment and update the index accordingly. Similarly, if a specific ingress component 122 may be considered offline or unable to process requests or the storage location associated with stored encoded segments blocks becomes unavailable or beyond capacity to service additional information, the video packaging and origination service 120 can select additional or redundant versions of the encoded segment that have been processed and update the index accordingly. At block 716, routine 700 terminates or starts a new iteration of routine 700.
- the video packaging and origination service 120 receives content requests from a requesting entity.
- the user device directly or through CDN 110 transmits a request for encoded content to the video packaging and origination service 120.
- the interaction between the requesting entities and the video packaging and origination service 120 can include multiple interactions to identify available content and receive request for content.
- a user device 102 may generate various user interfaces or software applications that facilitate the selection of content that are directed to the video packaging and origination service 120.
- the content requests from user devices 102 may be transmitted via a CDN 110 or alternatively be transmitted directly from user devices 102 to the video packaging and origination service 120.
- the video packaging and origination service 120 receives one or more requests for encoded content streams from requesting entities.
- the content management service 126 selects an egress node or component 124 based on attributes of the requesting entity (user 102 or POP 110), the video packaging and origination service 120 or a combination.
- attributes may include geographic information, network information, user configurations, general service levels, and the like.
- the video packaging and origination service 120 can identify a computing device that will function as the egress component 124 and that is located in a region or availability zone that is determined to be proximate to the requesting entity.
- the video packaging and origination service 120 can identify a computing device that will function as egress component 124 and that is associated with a communication latency that meets a service level agreement threshold or that is specified by a user.
- the video packaging and origination service 120 can utilize financial information, such as pricing plans or an attributed cost per transmission, specified by the requesting entities or original content provider 130 to select an egress component 122.
- the egress component 124 may be selected based on levels of performance and costs attributed to the performance.
- the video packaging and origination service 120 can utilize the same criteria (or different criteria) as the criteria utilized to identify the ingress component 122 ( FIG. 6A ), but the evaluation of the criteria may yield identification of the different computing devices based on consideration of the differences in attributes between a content source 130 and the requesting entities.
- the content management system instantiates or causes an instantiated egress component 124 to identify and process the index of the encoded segment requests from a first received stream.
- the egress component 124 of the video packaging and origination service 120 processes the received index to identify the storage location of the encoded segments previously processed and stored by the ingress components 122.
- the identification and processing of the index is completed substantially contemporaneously with the processing of the content request. Accordingly, the generation of the encoded content segments package that form the content stream is dynamic and can be adjusted by the video packaging and origination service 120.
- the dynamic packaging of encoded content segments mitigates the need to store all the packages for each egress component locally until requested and for the management of the content segments identified in the index.
- the egress component 124 compiles or packages the encoded content to be provided based on the identified storage location of the encoded data stream. As described above, the generation of the packages are illustratively completed substantially in real time and responsive to the request for the content, which facilitates the management of the encoded content.
- the egress component 124 causes the transmission of the content responsive to the content request.
- the transmission of content segments to requesting entities can include a number of interactions and considerate of the specific protocols implemented to stream content. Routine 800 terminates at block 812 or initiates a new iteration of routine 800.
- the content management service 126 selects and generates local cache components 129 based on attributes of the requesting entity (user 102 or POP 110), the video packaging and origination service 120 or a combination.
- attributes may include geographic information, logical network information, user configurations, general service levels, and the like.
- the video packaging and origination service 120 may utilize latency measurements for content streams to determine the number of local cache components 129 that may be required.
- the video packaging and origination service 120 can maintain a cache component 129 in identified regions or availability zones to facilitate the delivery of content.
- the local cache components 129 can correspond to a one-to-one relationship with a geographic zone or logical network zone.
- the local cache components 129 can correspond to a one-to-many relationship with multiple geographic zones or logical network zones.
- the local cache components may be instantiated by the video packaging and origination service 120 in a manner that facilitates that management of the cache components. As will be described in greater detail, one or more aspects of individual local cache components can be optimized based on configuration and usage information.
- the video packaging and origination service 120 obtains usage and configuration information regarding content delivery.
- the usage and configuration information may include historical information regarding previous requesting entity requests associated with the original content provider 130, similar subject matter or subject matter characterizations, user specified-information, such as request metrics, preferences, ratings, descriptions, and the like.
- the video packaging and origination service 120 configures the individual properties of the cache component 129 based on at least a portion of the usage and configuration information.
- the video packaging and origination service 120 can allocate different amounts of the cache data storage based on a characterization of the content streams, such as a characterization of quality, popularity, importance, and the like.
- the video packaging and origination service 120 can identify content that has been characterized as heavily in demand based on historical information indicative request load.
- the video packaging and origination service 120 can configure a threshold amount of memory of one or more local cache components 129 to maintain content associated with the characterization of quality, popularity, importance, etc.
- the video packaging and origination service 120 can adjust timing information associated with cached content, such as a time to live, for content matching the characterization of quality, popularity, important, etc.
- the usage and configuration information may correspond to individual geographic zones such that multiple local cache components 129 may be associated with different usage and configuration information.
- the video packaging and origination service 120 may group different combinations of usage and configuration information to include all geographic zones or sub-combinations of geographic zones.
- the video packaging and origination service 120 identifies cache content based on usage and configuration information.
- the video packaging and origination service 120 can identify content that should be included in the cache data storage based on a characterization of the content streams, such as a characterization of quality, popularity, importance, and the like.
- the usage and configuration information may include information from the content provider 130, similar subject matter, user information, and the like.
- the video packaging and origination service 120 can allocate greater portions of cache content for content associated with identified original content providers 130 that have been characterized as generating popular content or that have otherwise contractually specified to have content caching.
- the video packaging and origination service 120 can utilize relationships between content streams, such as serial content (e.g., television programming) or movie serials to determine the content streams that will be cached.
- the video packaging and origination service 120 can receive inputs from the original content provider 130, the ingress components 122, or egress components 124 that include mechanisms for identification of content to be cached.
- the video packaging and origination service 120 collects the encoded information from the index and causes individual caching stores to be updated.
- the video packaging and origination service 120 can modify traditional caching mechanisms that would either not add content to cache components without first receiving a request or that would otherwise associate a time to live the cached content.
- Routine 900 terminates at block 912 or starts a new iteration of routine 900.
- a content provider can implement a video packaging and origination service that is able to deliver video content to requesting users.
- a video packaging and origination service indexes a collection of source video content (either live streaming or file-based video-on-demand) and delivers it to clients via a wide range of communication protocols such as HTTP Live Streaming ("HLS”), Dynamic Adaptive Streaming over HTTP (“DASH”), HTTP Dynamic Streaming (“HDS”), Real Time Messaging Protocol (“RTMP”), Smooth Streaming, and the like.
- HLS HTTP Live Streaming
- DASH Dynamic Adaptive Streaming over HTTP
- HDS HTTP Dynamic Streaming
- RTMP Real Time Messaging Protocol
- Smooth Streaming and the like.
- a video packaging and origination service can also provide advanced video transmission features such as just-in-time packaging of video content, digital rights management (“DRM”) encryption, time-shifting, bitrate selection, catch up TV, and more.
- DRM digital rights management
- content providers can organize requested content, such as a video file, into multiple segments that are then transmitted to requesting devices segment by segment. For example, in a video stream, each segment typically accounts for 2-10 seconds of video rendered on a receiving device.
- individual content segments can be encoded by an encoder and transmitted to the video and origination service.
- a processing node on the video packaging and origination service can receive an incoming stream of encoded segments and then transmit the stream to requesting user devices.
- each distinct encoded video segment (e.g., combination of bitrate encoding and format) is provided to the video packaging and origination service from a single encoder or encoding node.
- Video segments can be encoded according to a defined bitrate and format, which generally defines the number of bits of data that are encoded over a measured amount of time and the specific software algorithm and resulting content representation format utilized to encode the data for transmission.
- bitrates are typically measured according to how many kilobits or megabits of data are processed over a second of time.
- a data file that corresponds to 1 megabyte of video data encoded in one second would be considered to have an encoding bitrate of 8 mbps (e.g., 8 megabits per second) while a lower definition video file that corresponds to 45 kilobytes of video data processed in one second would be considered to have an encoding bitrate of 360 kbps (e.g., 360 kilobits per second).
- a client computing device can simply request content having a fixed encoding rate or have a fixed encoding rate selected in response to a streaming content request.
- Such a fixed encoding rate approach can be deficient in facilitating variance of the encoding bitrate (both positive and negative) based on factors, such as network bandwidth, client computing device utilization, quality demands, and the like.
- video segments can be further defined by associating the encoding bitrate with the encoding format utilized by the encoder to generate the output stream.
- the encoding format can correspond to a content representation format for storage or transmission of video content (such as in a data file or bitstream).
- Examples of encoding formats include but not limited to the motion pictures expert group (“MPEG) MPEG-2 Part 2, MPEG-4 Part 2, H.264 (MPEG-4 Part 10), H.265 high efficiency video coding (“HEVC”), Theora, RealVideo RV40, VP9, and AOMedia Video 1 (“AV1”), and the like.
- MPEG motion pictures expert group
- MPEG-4 Part 2 MPEG-4 Part 2
- H.264 MPEG-4 Part 10
- HEVC high efficiency video coding
- Theora RealVideo RV40
- VP9 RealVideo RV40
- AV1 AOMedia Video 1
- aspects of the present application corresponding to a multiencoder node system for transmitting multiple encoder streams. More specifically, aspects of the present application correspond to utilization of synchronization information to allow a video packaging and origination service to receive multiple input streams corresponding to a set of content segments. Each individual stream can be provided by different encoders based on the synchronization information, such as sequence reference numbers or timestamp information.
- the number of encoders utilized by the content source may be based on the complexity of the encoding profile (e.g., encoded bitrate and format), available encoder computing resources, available network bandwidth, financial cost information, processing cost information and the like.
- the video packaging and origination service can generate the set of encoded content by processing the multiple encoder streams and selecting encoded segments from different encoders.
- the video packaging and origination service can select from duplicate encoding streams based on time received, quality measurements, priority designations, attributable cost, or other selection criteria. Additionally, in the event of a failure of one of the encoders, the video packaging and origination service can request additional encoders to complete the transmission or begin collecting additional encoded segments from other encoders.
- FIG. 10 illustrates a general content delivery environment 1000 for delivering content from original content providers to user devices.
- the content delivery environment 100 includes a plurality of devices 1002 utilized by individual users, generally referred to as client computing devices, to request streaming or download content from a video packaging and origination service 1020.
- the video packaging and origination service 1020 indexes a collection of source video content (either live streaming or file-based video-on-demand) and delivers it to clients via a wide range of communication protocols such as HTTP Live Streaming ("HLS”), Dynamic Adaptive Streaming over HTTP (“DASH”), HTTP Dynamic Streaming (“HDS”), Real Time Messaging Protocol (“RTMP”), Smooth Streaming, and the like.
- HTTP Live Streaming (“HLS)
- DASH Dynamic Adaptive Streaming over HTTP
- HDS HTTP Dynamic Streaming
- RTMP Real Time Messaging Protocol
- Smooth Streaming and the like.
- a video packaging and origination service can also provide advanced video transmission features such as just-in-time packaging of video content, digital rights management ("DRM”) encryption, time-shifting, bitrate selection, catch up TV, and more.
- DRM digital rights management
- the content can be illustratively provided by one or more origin sources, such as original content provider 1030.
- Client computing devices 1002 may include any number of different computing devices capable of communicating with the networks 1040, 1050, 1060, via a direct connection or via an intermediary.
- individual accessing computing devices may correspond to a laptop or tablet computer, personal computer, wearable computer, server, personal digital assistant (PDA), hybrid PDA/mobile phone, mobile phone, electronic book reader, set-top box, camera, appliance (e.g., a thermostat or refrigerator), controller, watch, eyewear, a home or car device, Internet of Things ("IoT”) devices, virtual reality or augmented reality devices, digital media player, and the like.
- Each client computing device 1002 may optionally include one or more data stores (not shown in FIG. 1 ) including various applications or computer-executable instructions, such as web browsers, used to implement the embodiments disclosed herein. Illustrative components of a client computing device 1002 will be described with regard to FIG. 11 .
- a CDN service provider 1010 may include multiple edge locations from which a user device can retrieve content.
- Individual edge location 1012 may be referred to herein as a point of presence ("POP"), where a POP is intended to refer to any collection of related computing devices utilized to implement functionality on behalf of one or many providers.
- POPs are generally associated with a specific geographic location in which the computing devices implementing the POP are located, or with a region serviced by the POP.
- the POP 1010 can include one or more metric information processing component 1014 for processing metric information provided by client computing devices 1002 and a data store 1016 for maintain collected metric information.
- a data center or a collection of computing devices within a data center may form a POP.
- the POPs may implement one or more services, such as CDN services, data storage services, data processing services, etc.
- the CDN service provider 1010 may include multiple POPs located in different geographic locations so that user devices can communicate with a nearby a POP to retrieve content, thereby reducing the latency of delivering requested content.
- Networks 1040, 1050, 1060 may be any wired network, wireless network, or combination thereof.
- the networks 1040, 1050, 1060 may be a personal area network, local area network, wide area network, cable network, fiber network, satellite network, cellular telephone network, data network, or combination thereof.
- network 1040 is a global area network (GAN), such as the Internet. Protocols and components for communicating via the other aforementioned types of communication networks are well known to those skilled in the art of computer communications and thus, need not be described in more detail herein.
- GAN global area network
- each of the client computing devices 1002 and video packaging and origination service 1010 are depicted as having a single connection to the network 1040, individual components of the client computing devices 1002 and video packaging and origination service 1010 may be connected to the network 1030 at disparate points. Accordingly, communication times and capabilities may vary between the components of FIG. 10 .
- FIG. 10 is illustrated as having three separate networks 1040, 1050, 1060, one skilled in the relevant art will appreciate that the video packaging and origination service 1010 may utilize any number or combination of networks.
- the video packaging and origination service 1020 includes one or more servers for receiving content from original content providers 1030 and processing the content to make available a set of received encoded bitrate segments.
- the video packaging and origination service 1020 includes an ingress component 1022 utilized to receive encoded data streams from multiple encoding servers 1032 from original content providers 1030.
- the video packaging and origination service 1020 can further include synchronization services 1024 for generating synchronization information utilized by the encoders, such as sequence numbers corresponding to the set of encoded segments, time stamp information related to a relative time of the encoded segments or from which relative time of encoded segments will be based, and the like.
- the video packaging and origination service 1020 can further include a data store 1026 for maintaining received encoded data for transmission.
- the video packaging and origination service 1020 may have fewer or greater components than are illustrated in FIG. 1 .
- the depiction of the video packaging and origination service 1020 in FIG. 1 should be taken as illustrative.
- components of the video packaging and origination service 1020 may be executed by one more virtual machines implemented in a hosted computing environment.
- a hosted computing environment may include one or more rapidly provisioned and released computing resources, which computing resources may include computing, networking or storage devices.
- the video packaging and origination service 1020 can include one or more egress components that can utilize the content received and processed from the ingress component 1022 and further process the content for transmission to user devices 1002.
- Such egress components may be implemented in conjunction with the ingress component 1022, such as in a transcoding node.
- the egress components may be implemented and managed independently of the ingress components 1022, such as in separate stand-alone computing devices.
- the content delivery environment 100 also includes original content providers 1030.
- the original content provider can include a plurality of encoders 1032 for generating multiple encoded streams for transmission to the video packaging and origination service 1020.
- the original content provider 1030 can also include logic or other management components for determining how many encoders 1032 should be utilized or how to manage the addition or removal of encoders.
- the original content provider the original content provider 1030 can further include synchronization services 1036 for generating synchronization information utilized by the encoders, such as sequence numbers corresponding to the set of encoded segments, time stamp information related to a relative time of the encoded segments or from which relative time of encoded segments will be based, and the like.
- the video packaging and origination service 1020 can further include a data store 1034 for maintaining encoded data for transmission.
- the synchronization services 1024 and 1036 may work in conjunction or in a complimentary basis.
- FIG. 11 depicts one embodiment of an architecture of an illustrative user computing device 1002 that can generate content requests and process metric information in accordance with the present application.
- the general architecture of the user computing device 1002 depicted in FIG. 11 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure.
- the user computing device 104 includes a processing unit 1104, a network interface 1106, an input/output device interface 1109, an optional display 1102, and an input device 1124, all of which may communicate with one another by way of a communication bus.
- the network interface 1106 may provide connectivity to one or more networks or computing systems, such as the network 1040 of FIG. 1 and the video packaging and origination service 1020 or the original content provider 1030.
- the processing unit 1104 may thus receive information and instructions from other computing systems or services via a network.
- the processing unit 1104 may also communicate to and from memory 1110 and further provide output information for an optional display 1102 via the input/output device interface 1109.
- the input/output device interface 1109 may also accept input from the optional input device 1124, such as a keyboard, mouse, digital pen, etc.
- the user computing device 1002 may include more (or fewer) components than those shown in FIG. 11 .
- the memory 1110 may include computer program instructions that the processing unit 1104 executes in order to implement one or more embodiments.
- the memory 1110 generally includes RAM, ROM, or other persistent or non-transitory memory.
- the memory 1110 may store an operating system 214 that provides computer program instructions for use by the processing unit 1104 in the general administration and operation of the user computing device 1002.
- the memory 1110 may further include computer program instructions and other information for implementing aspects of the present disclosure.
- the memory 1110 includes a network application 1116, such as browser application or media player, for accessing content and communicating with the video packaging and origination service 1020.
- FIG. 12 depicts one embodiment of an architecture of an illustrative server for encoding content as described herein.
- the general architecture of the encoder 1032 depicted in FIG. 12 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure.
- the encoder 1032 includes a processing unit 1204, a network interface 1206, a computer readable medium drive 1208, an input/output device interface 1209, all of which may communicate with one another by way of a communication bus.
- the components of the encoder 1032 may be physical hardware components or implemented in a virtualized environment.
- the network interface 1206 may provide connectivity to one or more networks or computing systems, such as the network 1050 or network 1060 of FIG. 10 .
- the processing unit 1204 may thus receive information and instructions from other computing systems or services via a network.
- the processing unit 1204 may also communicate to and from memory 1210 and further provide output information for an optional display via the input/output device interface 1209.
- the encoder 1032 may include more (or fewer) components than those shown in FIG. 12 .
- the memory 1210 may include computer program instructions that the processing unit 1204 executes in order to implement one or more embodiments.
- the memory 1210 generally includes RAM, ROM, or other persistent or non-transitory memory.
- the memory 1210 may store an operating system 1214 that provides computer program instructions for use by the processing unit 1204 in the general administration and operation of the video packaging and origination service 1020.
- the memory 1210 may further include computer program instructions and other information for implementing aspects of the present disclosure.
- the memory 1210 includes interface software 1212 for receiving and processing content requests from the encoder 1032.
- the resulting information can include a dynamically configured bundle to encoding bitrates.
- the memory 1210 includes an encoder component 1216 for processing content segments.
- the encoder component 1216 can further include a synchronization parameter component 1218 for utilizing the synchronization information in the encoding process to increase the likelihood that encoded segments from multiple encoders can be utilized by a video packaging and origination service 1020.
- FIG. 13 depicts one embodiment of an architecture of an illustrative server for functioning as an ingress component 1022 as described herein.
- the general architecture of the ingress component 1022 depicted in FIG. 13 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure.
- the ingress component 1022 includes a processing unit 1304, a network interface 1306, a computer readable medium drive 1308, an input/output device interface 409, all of which may communicate with one another by way of a communication bus.
- the components of the ingress component 1022 may be physical hardware components or implemented in a virtualized environment.
- the network interface 1306 may provide connectivity to one or more networks or computing systems, such as the network 1050 or network 1060 of FIG. 10 .
- the processing unit 1304 may thus receive information and instructions from other computing systems or services via a network.
- the processing unit 1304 may also communicate to and from memory 1310 and further provide output information for an optional display via the input/output device interface 409.
- the ingress component 1022 may include more (or fewer) components than those shown in FIG. 13 .
- the memory 1310 may include computer program instructions that the processing unit 1304 executes in order to implement one or more embodiments.
- the memory 1310 generally includes RAM, ROM, or other persistent or non-transitory memory.
- the memory 1310 may store an operating system 1314 that provides computer program instructions for use by the processing unit 1304 in the general administration and operation of the ingress node.
- the memory 1310 may further include computer program instructions and other information for implementing aspects of the present disclosure.
- the memory 1310 includes interface software 1312 for receiving and processing content requests from the ingress component 1022.
- the resulting information can include a dynamically configured bundle to encoding bitrates.
- the memory 1310 includes an encoder processing application 1316 for processing incoming encoded content segments.
- the ingress component 1022 can further include a synchronization parameter component 1318 for utilizing the synchronization information in the encoding process to increase the likelihood that encoded segments from multiple encoders can be utilized by the ingress component 1022.
- the video packaging and origination service 1020 can transmit synchronization information to the original content provider 1030.
- the synchronization information is utilized by multiple encoders 1032 to allow encoded segments from multiple encoders to be combined seamlessly or substantially seamlessly.
- the synchronization information can include timestamp information related to a relative timestamp of individual encoded segments in the set of encoded segments.
- the synchronization information can include sequence numbers for the individual segments.
- the synchronization information can include a time of operation or other time elapsed information.
- the synchronization information is incorporated into the encoded segments and then utilized by the video packaging and origination service 1020 to assemble the set of ordered segments, remove duplicates and identifying missing encoded segments.
- FIG. 14A illustrates the transmission of the synchronization information from the video packaging and origination service 1020, in some embodiments, synchronization information may not be transmitted by the video packaging and origination service 1020 and this interaction would be omitted altogether.
- the receiving original content provider 1030 determines the number of encoders that will be utilized to generate the requested encoded content streams.
- the determination the number of encoders will generally corresponding to a plurality of encoders that generate encoded content streams for identified requested content and incorporating synchronization information.
- the determination of the number of encoders can be based on the complexity of the encoded bitrate and formation combination, available encoder resources, an attributable cost associated with the generated encoded content segments, preferences or service levels associated with the video packaging and origination service 1020, network conditions (e.g., available bandwidth, network throughput, error rates), demand from users devices (e.g., total number of requests or frequencies of requests), and the like.
- the content stream data may be transmitted by the original content provider 1030 responsive to a request from a user device 1002, a request from the video packaging and origination service 1020, or other request/trigger.
- the encoded content can correspond to a set of encoded profiles corresponding to the encoding bitrate and format combinations that may be made available to users.
- the video packaging and origination service 1020 may provide a requesting user device 1002 with a set of encoding bitrate and format combinations in order to support adaptive bitrate streaming.
- the request from the original content provider may transmit the set of identified encoding bitrates and formats or individual encoding bitrate and format combinations to supplement previously receive encoded segments.
- the transmission of the request or the identification of requested encoded segments can be facilitated in a number of ways.
- the original content provider causes the selected number of encoders to generate encoded streams based on synchronization information.
- the video packaging and origination service 1020 may provide the synchronization information.
- the original content provider 1030 can utilize self-providing synchronization, information provided by a third-party service or a combination.
- the original content provider begins transmitting a plurality of encoded content streams to the video packaging and origination service 1020 and incorporating received/accessed synchronization information.
- the encoders 1032B and 1032A are configured to transmit non-overlapping segments in which the encoding task for the set of segments it distributed among encoders. In other embodiments, the encoders are configured to at least partially transmit overlapping or redundant encoded segments.
- the video packaging and origination service 1020 receives the plurality of incoming encoded content streams from the encoders. At (5), the video packaging and origination service 1020 selects encoded segments from the received streams. Illustratively, if the encoded content streams are non-overlapping, the video packaging and origination service 1020 does not have to check for redundancies or other selection criteria (e.g., time received or reputation of encoders). If the encoded content streams may have overlapping segments, the video packaging and origination service 1020 checks for redundancies or other utilizes selection criteria to determine which of the redundant encoded content segments will be utilized.
- redundancies or other selection criteria e.g., time received or reputation of encoders
- the video packaging and origination service 1020 processes the received encoded segments.
- the video packaging and origination service 1020 can be adjustments or error correction for any of the selected encoded segments.
- the video packaging and origination service 1020 can extrapolate additional segments or portions to facilitate combination.
- the ingress component 1022 of the video packaging and origination service 1020 generates deterministic data included in a set of meta-data utilized to access and generate outgoing content streams.
- the deterministic data can include timestamp information related to a time of play of the set of encoded segments, sequence number identifying an order of the encoded content segment in the set of encoded segments, a time of operation of the encoder and the like.
- the ingress component 1022 or content management service 1026 can conduct quality or error checking that can be included in meta-data.
- the video packaging and origination service 1020 stores the cumulative set of encoded segments for delivery to user devices 1002 along with any meta-data generated as part of the processing.
- FIG. 14B a fail over scenario will be described.
- the interactions illustrated in FIG. 14B are based interaction after the initial transmission of multiple encoded segment transmission has begun.
- the original content provider 1030 experiences an encoder failure, generally illustrated as a failure to encoded component 1032A.
- the original content provider continues transmitting a plurality of encoded content streams to the video packaging and origination service 1020 and incorporating received/accessed synchronization information.
- the original content provider (via request or a priori) will be required to update the configuration of the remaining encoders 1032 or to otherwise cause the initiation of additional encoders.
- the encoders may be configured will at least partially overlapping encoded segments. In this embodiment, the original content provider may not choose to make any changes to the configurations.
- the video packaging and origination service 1020 receives the adjusted encoder node streams and processing the determine failover.
- the ingress component 1022 may have specific rules regarding failover, such as switching to a default encoder node or set of nodes.
- the video packaging and origination service 1020 can request additional or alternative encoder nodes. Additionally, the video packaging and origination service 1020 can scan for already received encoded nodes received from the encoder prior to failure and ensure that no additional errors were introduced prior to the determined failure.
- Routine 1500 utilized by the video packaging and origination service 1020 to receive and process multiple encoder streams will be described.
- Routine 1500 may be illustratively implemented by an ingress component 1022.
- the video packaging and origination service 1020 can optionally transmit synchronization information to the original content provider 1030.
- the synchronization information is utilized by multiple encoders 1032 to allow encoded segments from multiple encoders to be combined seamlessly or substantially seamlessly.
- the synchronization information can include timestamp information related to a relative timestamp of individual encoded segments in the set of encoded segments.
- the synchronization information can include sequence numbers for the individual segments.
- the synchronization information can include a time of operation or other time elapsed information.
- the synchronization information is incorporated into the encoded segments and then utilized by the video packaging and origination service 1020 to assemble the set of ordered segments, remove duplicates and identifying missing encoded segments.
- block 1502 may be omitted.
- the original content provider 1030 begins transmitting a plurality of encoded content streams to the video packaging and origination service 1020 and incorporating received/accessed synchronization information at block 1504.
- the encoders 1032B and 1032A may be configured to transmit non-overlapping segments in which the encoding task for the set of segments it distributed among encoders. In other embodiments, the encoders may be configured will at least partially overlapping encoded segments.
- the video packaging and origination service 1020 receives the plurality of incoming encoded content streams from the encoders.
- decision block 606 a determination is made as to whether additional encoder segments streams are received. If so, the routine 1500 returns to block 1504 to receive the additional encoder streams. If not, the routine 1500 proceeds to block 1508.
- the video packaging and origination service 1020 processes the received encoded segments.
- the video packaging and origination service 1020 can be adjustments or error correction for any of the selected encoded segments.
- the video packaging and origination service 1020 can extrapolate additional segments or portions to facilitate combination.
- the ingress component 1022 of the video packaging and origination service 1020 generates deterministic data included in a set of meta-data utilized to access and generate outgoing content streams.
- the deterministic data can include timestamp information related to a time of play of the set of encoded segments, sequence number identifying an order of the encoded content segment in the set of encoded segments, a time of operation of the encoder and the like.
- the ingress component 1022 or content management service 1026 can conduct quality or error checking that can be included in meta-data.
- the video packaging and origination service 1020 stores the cumulative set of encoded segments for delivery to user devices 1002. As described above, the video packaging and origination service 1020 can also associate or store meta-data associated with the segments. Routine 1500 terminates at block 1512 or starts a new iteration of routine 1500.
- Routine 1600 may be illustratively implemented by multiple encoder components 1032.
- the encoder component 1032 determines that an encoded content should be provided.
- the encoded content can correspond to a set of encoded profiles corresponding to the encoding bitrate and format combinations that may be made available to users.
- the video packaging and origination service 1020 may provide a set of encoding bitrate and format combinations in order to support adaptive bitrate streaming.
- the content that will be delivered to the video packaging and origination service 1020 may correspond to the set of identified encoding bitrates and formats or individual encoding bitrate and format combinations to supplement previously receive encoded segments.
- One skilled in the relevant art will appreciate that the transmission of the request or the identification of requested encoded segments (including format) can be facilitated in a number of ways.
- the encoder can receive synchronization information or generate synchronization information.
- the synchronization information is utilized by multiple encoders 1032 to allow encoded segments from multiple encoders to be combined seamlessly or substantially seamlessly.
- the synchronization information can include timestamp information related to a relative timestamp of individual encoded segments in the set of encoded segments.
- the synchronization information can include sequence numbers for the individual segments.
- the synchronization information can include a time of operation or other time elapsed information.
- the synchronization information is incorporated into the encoded segments and then utilized by the video packaging and origination service 1020 to assemble the set of ordered segments, remove duplicates and identifying missing encoded segments.
- the receiving original content provider 1030 determines the number of encoders that will be utilized to generate the requested encoded content streams.
- the determination the number of encoders will generally corresponding to a plurality of encoders that generate encoded content streams for identified requested content and incorporating synchronization information.
- the determination of the number of encoders can be based on the complexity of the encoded bitrate and formation combination, available encoder resources, an attributable cost associated with the generated encoded content segments, preferences or service levels associated with the video packaging and origination service 1020, network conditions (e.g., available bandwidth, network throughput, error rates), demand from users devices (e.g., total number of requests or frequencies of requests), and the like.
- the original content provider causes the selected number of encoders to generate encoded streams based on synchronization information.
- the video packaging and origination service 1020 may provide the synchronization information.
- the original content provider 1030 can utilize self-providing synchronization, information provided by a third-party service or a combination.
- the original content provider begins transmitting a plurality of encoded content streams to the video packaging and origination service 1020 and incorporating received/accessed synchronization information.
- the encoders 1032B and 1032A may be configured to transmit non-overlapping segments in which the encoding task for the set of segments it distributed among encoders. In other embodiments, the encoders may be configured will at least partially overlapping encoded segments.
- Routine 700 terminates at block 712 or starts a new iteration of routine 700.
- a content provider can implement a video packaging and origination service that is able to deliver video content to requesting users.
- a video packaging and origination service indexes a collection of source video content (either live streaming or file-based video-on-demand) and delivers it to clients via a wide range of communication protocols such as HTTP Live Streaming ("HLS”), Dynamic Adaptive Streaming over HTTP (“DASH”), HTTP Dynamic Streaming (“HDS”), Real Time Messaging Protocol (“RTMP”), Smooth Streaming, and the like.
- HLS HTTP Live Streaming
- DASH Dynamic Adaptive Streaming over HTTP
- HDS HTTP Dynamic Streaming
- RTMP Real Time Messaging Protocol
- Smooth Streaming and the like.
- a video packaging and origination service can also provide advanced video transmission features such as just-in-time packaging of video content, digital rights management (“DRM”) encryption, time-shifting, bitrate selection, catch up TV, and more.
- DRM digital rights management
- content providers can organize requested content, such as a video file, into multiple segments that are then transmitted to requesting devices segment by segment. For example, in a video stream, each segment typically accounts for 2-10 seconds of video rendered on a receiving device.
- individual content segments can be encoded by an encoder and transmitted to the video and origination service.
- a single processing node on the video packaging and origination service can receive an incoming stream of encoded segments and then transmit the stream to requesting user devices.
- Video segments can be encoded according to a defined bitrate and format, which generally defines the number of bits of data that are encoded over a measured amount of time and the specific software algorithm and resulting content representation format utilized to encode the data for transmission.
- bitrates are typically measured according to how many kilobits or megabits of data are processed over a second of time.
- a data file that corresponds to 1 megabyte of video data encoded in one second would be considered to have an encoding bitrate of 8 mbps (e.g., 8 megabits per second) while a lower definition video file that corresponds to 45 kilobytes of video data processed in one second would be considered to have an encoding bitrate of 360 kbps (e.g., 360 kilobits per second).
- the content provider may be possible for the content provider to facilitate variable bit rate encoding to enable for variances in the encoding bitrates of individual segments of a video file.
- the content provider can generate multiple encoded bitrate versions or combinations of encoded bitrates and formats of individual video file segments. The content provider can then make at least a subset of the multiple bitrate encoded versions available to clients responsive to a request for a particular encoded bitrate version and format.
- a content provider can generate a catalog identifying the video segments and encoded bitrates for each identified video segment. The catalog can be written into a manifest file that is provided to individual client computing devices that have requested the video file.
- the packaging and origination service is available to receive and process requests for encoded content. More specifically, client computing devices, through a respective software application, can request individual video segments according to the available encoded bitrates and formats as published in the manifest file.
- a client computing device can simply request content having a fixed encoding rate or have a fixed encoding rate selected in response to a streaming content request.
- Such a fixed encoding rate approach can be deficient in facilitating variance of the encoding bitrate (both positive and negative) based on factors, such as network bandwidth, client computing device utilization, quality demands, and the like.
- video segments can be further defined by associating the encoding bitrate with the encoding format utilized by the encoder to generate the output stream.
- the encoding format can correspond to a content representation format for storage or transmission of video content (such as in a data file or bitstream).
- Examples of encoding formats include but not limited to the motion pictures expert group (“MPEG) MPEG-2 Part 2, MPEG-4 Part 2, H.264 (MPEG-4 Part 10), H.265 high efficiency video coding (“HEVC”), Theora, RealVideo RV40, VP9, and AOMedia Video 1 (“AV1”), and the like.
- MPEG motion pictures expert group
- MPEG-4 Part 2 MPEG-4 Part 2
- H.264 MPEG-4 Part 10
- HEVC high efficiency video coding
- Theora Theora
- RealVideo RV40, VP9 RealVideo RV40
- VP9 VP9
- AOMedia Video 1 AOMedia Video 1
- video packaging and origination services can maintain a single ingress node to receive individual content streams or channels corresponding to encoded segments encoded to a specific encoding profile (e.g., encoding bitrate and format).
- a single ingress node can utilize state information that facilitates determination that all encoding versions of the same encoded segment have been received.
- the throughput of incoming data streams is limited by characteristics of the single ingress node. For example, an ingress node may experience latencies associated with processing more complex encoded content. In such situation, a video packaging and origination service could experience additional inefficiencies by limiting the ability of the video packaging and origination service to process additional encoding channels related to other encoding profiles until the current encoded data is processed.
- aspects of the present application corresponding to a multi-ingress node system for receiving and processing encoder streams. More specifically, aspects of the present application correspond to utilization of synchronization information to allow a video packaging and origination service to utilize a plurality of ingress nodes that an independently process encoded content segments.
- Individual content streams can correspond to encoding of a common or same content segment according to a different encoding profile, such as a different combination of encoding bitrate and format.
- a content provider may be requested to provide different encoded versions of each content segment based on the content profiles (e.g., encoding bitrate and format combination) identified in a content manifest.
- individual ingress nodes within the video packaging and origination service process the received encoded segments and generate deterministic data identifying the received encoded segment.
- the deterministic data can include encoder timestamps, segment sequence numbers, and timing information regarding operation of the encoder.
- the deterministic data allows the identification of a common encoded segment amongst all the received encoded segments and be stored as meta-data.
- the video packaging and origination service can utilize the deterministic data/meta-data to identify all common encoded segments and determine whether all the requested encoded versions (e.g., by encoding profile) have been processed. If so, the particular encoded segment is ready for storage or transmission to user devices.
- aspects of the present application facilitate parallel process of different incoming content streams without requiring the need for sharing of state data by the plurality of ingress nodes.
- Each incoming content stream corresponding to a different encoding profile can be processed by a different or the same ingress nodes without a need to determine where a different version of the same content stream has been previously processed.
- additional content streams can be processed in concurrently to facilitate faster availability of streaming content to users.
- FIG. 17 illustrates a general content delivery environment 1700 for delivering content from original content providers to user devices.
- the content delivery environment 1700 includes a plurality of devices 1702 utilized by individual users, generally referred to as client computing devices, to request streaming or download content from a video packaging and origination service 1720.
- the video packaging and origination service 1720 indexes a collection of source video content (either live streaming or file-based video-on-demand) and delivers it to clients via a wide range of communication protocols such as HTTP Live Streaming ("HLS”), Dynamic Adaptive Streaming over HTTP (“DASH”), HTTP Dynamic Streaming (“HDS”), Real Time Messaging Protocol (“RTMP”), Smooth Streaming, and the like.
- HTTP Live Streaming (“HLS)
- DASH Dynamic Adaptive Streaming over HTTP
- HDS HTTP Dynamic Streaming
- RTMP Real Time Messaging Protocol
- Smooth Streaming and the like.
- a video packaging and origination service can also provide advanced video transmission features such as just-in-time packaging of video content, digital rights management ("DRM") encryption, time-shifting, bitrate selection, catch up TV, and more.
- DRM digital rights management
- the content can be illustratively provided by one or more origin sources, such as original content provider 1730.
- Client computing devices 1702 may include any number of different computing devices capable of communicating with the networks 1740, 1750, 1760, via a direct connection or via an intermediary.
- individual accessing computing devices may correspond to a laptop or tablet computer, personal computer, wearable computer, server, personal digital assistant (PDA), hybrid PDA/mobile phone, mobile phone, electronic book reader, set-top box, camera, appliance (thermostat or refrigerator), controller, digital media player, watch, eyewear, a home or car device, Internet of Things ("IoT”) devices, virtual reality or augmented reality devices, and the like.
- PDA personal digital assistant
- Each client computing device 1702 may optionally include one or more data stores (not shown in FIG. 17 ) including various applications or computer-executable instructions, such as web browsers, used to implement the embodiments disclosed herein. Illustrative components of a client computing device 1702 will be described with regard to FIG. 18 .
- a CDN service provider may include multiple edge locations from which a user device can retrieve content.
- Individual edge location 1712 may be referred to herein as a point of presence ("POP"), where a POP is intended to refer to any collection of related computing devices utilized to implement functionality on behalf of one or many providers.
- POPs are generally associated with a specific geographic location in which the computing devices implementing the POP are located, or with a region serviced by the POP.
- the POP 1710 can include one or more metric information processing component 114 for processing metric information provided by client computing devices 1702 and a data store 1716 for maintain collected metric information.
- a data center or a collection of computing devices within a data center may form a POP.
- the POPs may implement one or more services, such as CDN services, data storage services, data processing services, etc.
- the CDN service provider 1710 may include multiple POPs located in different geographic locations so that user devices can communicate with a nearby a POP to retrieve content, thereby reducing the latency of delivering requested content.
- Networks 1740, 1750, 1760 may be any wired network, wireless network, or combination thereof.
- the networks 1740, 1750, 1760 may be a personal area network, local area network, wide area network, cable network, fiber network, satellite network, cellular telephone network, data network, or combination thereof.
- network 1740 is a global area network (GAN), such as the Internet. Protocols and components for communicating via the other aforementioned types of communication networks are well known to those skilled in the art of computer communications and thus, need not be described in more detail herein.
- GAN global area network
- each of the client computing devices 1702 and video packaging and origination service 1710 are depicted as having a single connection to the network 1740, individual components of the client computing devices 1702 and video packaging and origination service 1710 may be connected to the network 1730 at disparate points. Accordingly, communication times and capabilities may vary between the components of FIG. 17 .
- FIG. 17 is illustrated as having three separate networks 1740, 1750, 1760, one skilled in the relevant art will appreciate that the video packaging and origination service 1710 may utilize any number or combination of networks.
- the video packaging and origination service 1720 includes one or more servers for receiving content from original content providers 1730 and processing the content to make available a set of received encoded bitrate segments.
- the video packaging and origination service 1720 includes a plurality of ingress components 1722 utilized to receive encoded data streams from encoders encoding servers 1732 from the original content providers 1730.
- the ingress components can generate deterministic data that will facilitate a determination of when a complete set of encoded version of a content segment has been received and is ready for further processing or transmission.
- the video packaging and origination service 1720 can further include synchronization services 1724 for generating synchronization information utilized by the encoders, such as sequence numbers corresponding to the set of encoded segments, time stamp information related to a relative time of the encoded segments or from which relative time of encoded segments will be based, and the like. As described above, the synchronization information can be utilized in the generation of deterministic data for purposes of determining when a content request has been fully completed.
- the video packaging and origination service 1720 can further include a data store 1726 for maintaining received encoded data for transmission.
- the video packaging and origination service 1720 may have fewer or greater components than are illustrated in FIG. 17 .
- the depiction of the video packaging and origination service 1720 in FIG. 17 should be taken as illustrative.
- components of the video packaging and origination service 1720 may be executed by one more virtual machines implemented in a hosted computing environment.
- a hosted computing environment may include one or more rapidly provisioned and released computing resources, which computing resources may include computing, networking or storage devices.
- the video packaging and origination service 1720 can include one or more egress components that can utilize the content received and processed from the ingress component 1722 and further process the content for transmission to user devices 1702.
- Such egress components may be implemented in conjunction with the ingress component 1722, such as in a transcoding node.
- the egress components may be implemented and managed independently of the ingress components 1722, such as in separate stand-alone computing devices.
- the content delivery environment 1700 also includes original content providers 1730.
- the original content provider can include a plurality of encoders 1732 for generating multiple encoded streams for transmission to the video packaging and origination service 1720.
- individual encoders may generate different encode versions of a content segment according to a different encoding profile.
- the original content provider 1730 can also include logic or other management components for determining how many encoders 1732 should be utilized or how to manage the addition or removal of encoders.
- the original content provider the original content provider 1730 can further include synchronization services 136 for generating synchronization information utilized by the encoders, such as sequence numbers corresponding to the set of encoded segments, time stamp information related to a relative time of the encoded segments or from which relative time of encoded segments will be based, and the like.
- the video packaging and origination service 1720 can further include a data store 1734 for maintaining encoded data for transmission.
- the synchronization services 1724 and 136 may work in conjunction or in a complimentary basis.
- FIG. 18 depicts one embodiment of an architecture of an illustrative user computing device 1702 that can generate content requests and process metric information in accordance with the present application.
- the general architecture of the user computing device 1702 depicted in FIG. 18 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure.
- the user computing device 104 includes a processing unit 1804, a network interface 1806, an input/output device interface 1809, an optional display 202, and an input device 224, all of which may communicate with one another by way of a communication bus.
- the network interface 1806 may provide connectivity to one or more networks or computing systems, such as the network 1740 of FIG. 17 and the video packaging and origination service 1720 or the original content providers 1730.
- the processing unit 1804 may thus receive information and instructions from other computing systems or services via a network.
- the processing unit 1804 may also communicate to and from memory 1810 and further provide output information for an optional display 202 via the input/output device interface 1809.
- the input/output device interface 1809 may also accept input from the optional input device 224, such as a keyboard, mouse, digital pen, etc.
- the user computing device 1702 may include more (or fewer) components than those shown in FIG. 18 .
- the memory 1810 may include computer program instructions that the processing unit 1804 executes in order to implement one or more embodiments.
- the memory 1810 generally includes RAM, ROM, or other persistent or non-transitory memory.
- the memory 1810 may store an operating system 1812 that provides computer program instructions for use by the processing unit 1804 in the general administration and operation of the user computing device 1702.
- the memory 1810 may further include computer program instructions and other information for implementing aspects of the present disclosure.
- the memory 1810 includes a network application 1816, such as browser application or media player, for accessing content and communicating with the video packaging and origination service 1720.
- FIG. 19 depicts one embodiment of an architecture of an illustrative server for encoding content as described herein.
- the general architecture of the encoder 1732 depicted in FIG. 19 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure.
- the encoder 1732 includes a processing unit 1904, a network interface 1906, a computer readable medium drive 1908, an input/output device interface 1909, all of which may communicate with one another by way of a communication bus.
- the components of the encoder 1732 may be physical hardware components or implemented in a virtualized environment.
- the network interface 1906 may provide connectivity to one or more networks or computing systems, such as the network 1750 or network 1760 of FIG. 17 .
- the processing unit 1904 may thus receive information and instructions from other computing systems or services via a network.
- the processing unit 1904 may also communicate to and from memory 1910 and further provide output information for an optional display via the input/output device interface 1909.
- the encoder 1732 may include more (or fewer) components than those shown in FIG. 19 .
- the memory 1910 may include computer program instructions that the processing unit 1904 executes in order to implement one or more embodiments.
- the memory 1910 generally includes RAM, ROM, or other persistent or non-transitory memory.
- the memory 1910 may store an operating system 1914 that provides computer program instructions for use by the processing unit 1904 in the general administration and operation of the video packaging and origination service 1720.
- the memory 1910 may further include computer program instructions and other information for implementing aspects of the present disclosure.
- the memory 1910 includes interface software 1912 for receiving and processing content requests from the video packaging and origination services 1702.
- the memory 1910 includes an encoder component 1916 for processing content segments. Additionally, the encoder component 1916 can further include a synchronization parameter component 1918 for utilizing the synchronization information in the encoding process to increase the likelihood that encoded segments from multiple encoders can be utilized by a video packaging and origination service 1720.
- the synchronization information can be utilized in the generation of deterministic data as will be described below.
- FIG. 20 depicts one embodiment of an architecture of an illustrative server for functioning as an ingress component 1722 as described herein.
- the video packaging and origination service 1720 includes multiple ingress components 1722 (or nodes) that facilitate intake of encoded segments that have been encoded according to different encoding profiles.
- the general architecture of the ingress component 1722 depicted in FIG. 20 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure.
- the ingress component 1722 includes a processing unit 2004, a network interface 2006, a computer readable medium drive 2008, an input/output device interface 2009, all of which may communicate with one another by way of a communication bus.
- the components of the ingress component 1722 may be physical hardware components or implemented in a virtualized environment.
- the network interface 2006 may provide connectivity to one or more networks or computing systems, such as the network 1750 or network 1760 of FIG. 17 .
- the processing unit 2004 may thus receive information and instructions from other computing systems or services via a network.
- the processing unit 2004 may also communicate to and from memory 2010 and further provide output information for an optional display via the input/output device interface 2009.
- the ingress component 1722 may include more (or fewer) components than those shown in FIG. 20 .
- the memory 2010 may include computer program instructions that the processing unit 2004 executes in order to implement one or more embodiments.
- the memory 2010 generally includes RAM, ROM, or other persistent or non-transitory memory.
- the memory 2010 may store an operating system 2014 that provides computer program instructions for use by the processing unit 2004 in the general administration and operation of the ingress node.
- the memory 2010 may further include computer program instructions and other information for implementing aspects of the present disclosure.
- the memory 2010 includes interface software 2012 for receiving and processing content from encoders 1732.
- the memory 2010 includes an encoder processing application 416 for processing incoming encoded content segments.
- the ingress component 1722 can further include a synchronization parameter component 2018 for utilizing the synchronization information to generate the deterministic information as described above.
- the video packaging and origination service 1720 can transmit synchronization information to the original content provider 1730.
- the synchronization information is utilized by multiple encoders 1732 to allow encoded segments from multiple encoders to be combined seamlessly or substantially seamlessly.
- the synchronization information can include timestamp information related to a relative timestamp of individual encoded segments in the set of encoded segments.
- the synchronization information can include sequence numbers for the individual segments.
- the synchronization information can include a time of operation or other time elapsed information.
- the synchronization information is incorporated into the encoded segments and then utilized by the video packaging and origination service 1720 to assemble the set of ordered segments, remove duplicates and identifying missing encoded segments.
- FIG. 21A illustrates the transmission of the synchronization information from the video packaging and origination service 1720, in some embodiments, synchronization information may not be transmitted by the video packaging and origination service 1720 and this interaction would be omitted altogether.
- the content stream data may be transmitted by the original content provider 1730 responsive to a request from a user device 1702, a request from the video packaging and origination service 1720, or other request/trigger.
- the encoded content can correspond to a set of encoded profiles corresponding to the encoding bitrate and format combinations that may be made available to users.
- the video packaging and origination service 1720 may provide a requesting user device 1702 with a set of encoding bitrate and format combinations in order to support adaptive bitrate streaming.
- the request from the original content provider may transmit the set of identified encoding bitrates and formats or individual encoding bitrate and format combinations to supplement previously receive encoded segments.
- the transmission of the request or the identification of requested encoded segments can be facilitated in a number of ways.
- the receiving original content provider 1730 determines the number of encoders that will be utilized to generate the requested encoded content streams.
- the determination the number of encoders will generally corresponding to a plurality of encoders that generate encoded content streams for identified requested content and incorporating synchronization information.
- the determination of the number of encoders can be based on the complexity of the encoded bitrate and formation combination, available encoder resources, an attributable cost associated with the generated encoded content segments, preferences or service levels associated with the video packaging and origination service 1720, network conditions (e.g., available bandwidth, network throughput, error rates), demand from users devices (e.g., total number of requests or frequencies of requests), and the like.
- the original content provider 1730 causes one or more encoders to generate encoded streams based on synchronization information.
- the video packaging and origination service 1720 may provide the synchronization information.
- the original content provider 1730 can utilize self-providing synchronization, information provided by a third-party service or a combination.
- the original content provider can provide multiple encoder streams that can correspond to individual content streams corresponding to the different requested encoding profiles.
- a first content stream can correspond to a first encoding bitrate and format (e.g., a first encoding profile) and a second content stream can correspond to a second encoding bitrate and format that is different.
- the encoding streams may be provided by different encoders as illustrated in FIG. 21A as encoder components 17321032A and 1732B.
- the video packaging and origination service 1720 receives the plurality of incoming encoded content streams from the encoders. More specifically, at (4), a first ingress component is determined.
- a first ingress component such as ingress component 1722A, of the video packaging and origination service 1720 receives and processes the encoded segments from a first received stream.
- Such an ingress component 1722 may be selected by various factors, such as geographic proximity to the original content provider, available processing resources, types or characterizations of the streaming content, original content provider specifications, video packaging and origination service specifications, and the like.
- the ingress component 1722A of the video packaging and origination service 1720 processes the received encoded segments to generate deterministic data.
- the deterministic data can include timestamp information related to a time of play of the set of encoded segments, sequence number identifying an order of the encoded content segment in the set of encoded segments, a time of operation of the encoder and the like.
- the deterministic data will be illustratively utilized to identify a same content segment or matching content segments that have been encoded according to different encoding profiles and received at different ingress components. For example, four content segments sharing a common timestamp of play but encoded according to the different encoding profiles can be considered to be the same content segment.
- the ingress component 1722A generates the deterministic data as a set of meta-data utilized to access and generate outgoing content streams.
- the ingress component 1722A can conduct quality or error checking that can be included in meta-data.
- the video packaging and origination service 1720 performs a determination if encoded segments determined to be matching correspond to all the requested encoded profiles. For example, to enable variable bitrate encoding, the content request may request encoded content segments according to five different encoding profiles. Accordingly, the video packaging and origination service 1720 could determine via the deterministic information whether there are five matching segments covering the five requested encoding profiles. For purposes of illustration, FIG. 21A illustrates when the segment determination indicates that all the encoded segments have not been received and the encoded segment is not ready for transmission to the client.
- the original content provider 1730 selects or causes one or more encoders to generate encoded streams based on synchronization information or continue to generate additional encoded content streams.
- the video packaging and origination service 1720 may provide the synchronization information.
- the original content provider 1730 can utilize self-providing synchronization, information provided by a third-party service or a combination.
- the original content provider can provide multiple encoder streams that can correspond to individual content streams corresponding to the different requested encoding profiles.
- a first content stream can correspond to a first encoding bitrate and format (e.g., a first encoding profile) and a second content stream can correspond to a second encoding bitrate and format that is different.
- the encoding streams may be provided by different encoders, such as encoders 1732A and 1732B.
- the video packaging and origination service 1720 receives the plurality of incoming encoded content streams from the encoders. More specifically, at (2), a second ingress component, such as ingress component 1722B, of the video packaging and origination service 1720 receives and processes the encoded segments from a second or subsequent received stream. In one embodiment, the subsequent processing of the second content stream may occur in parallel to the processing of the first content stream. For example, the processing of the first content stream by ingress component 1722A ( FIG. 21A ) may experience a latency.
- the ingress component 122B of the video packaging and origination service 1720 processes the received encoded segments to generate deterministic data.
- the deterministic data can include timestamp information related to a time of play of the set of encoded segments, sequence number identifying an order of the encoded content segment in the set of encoded segments, a time of operation of the encoder and the like.
- the deterministic data will be illustratively utilized to identify a same content segment or matching content segments that have been encoded according to different encoding profiles and received at different ingress components. For example, four content segments sharing a common timestamp of play but encoded according to the different encoding profiles can be considered to be the same content segment.
- the video packaging and origination service 1720 performs a determination if encoded segments determined to be matching correspond to all the requested encoded profiles. For example, to enable variable bitrate encoding, the content request may request encoded content segments according to five different encoding profiles. Accordingly, the video packaging and origination service 1720 could determine via the deterministic information whether there are five matching segments covering the five requested encoding profiles. For purposes of illustration, FIG. 21B illustrates when the segment determination indicates that all the encoded segments have been received and the encoded segment is not ready for transmission to the client. Accordingly, at (6), the video packaging and origination service 1720 creates a segment output of all the processed encoded segments, which can include writing to storage or indicating to an egress node that transmission can begin.
- Routine 22001500 utilized by the video packaging and origination service 1720 to receive and process multiple encoder streams will be described.
- Routine 22001500 may be illustratively implemented by an ingress component 1722.
- the video packaging and origination service 1720 can optionally transmit synchronization information to the original content provider 1730.
- the synchronization information is utilized by multiple encoders 1732 to allow encoded segments from multiple encoders to be combined seamlessly or substantially seamlessly.
- the synchronization information can include timestamp information related to a relative timestamp of individual encoded segments in the set of encoded segments.
- the synchronization information can include sequence numbers for the individual segments.
- the synchronization information can include a time of operation or other time elapsed information.
- the synchronization information is incorporated into the encoded segments and then utilized by the video packaging and origination service 1720 to assemble the set of ordered segments, remove duplicates and identifying missing encoded segments.
- block 2204 may be omitted.
- the original content provider 1730 begins transmitting a plurality of encoded content streams to the video packaging and origination service 1720 and incorporating received/accessed synchronization information.
- the encoders 1732B and 1732A may be configured to transmit different content streams corresponding to a common encoded segment or set of segments encoded according to different encoding profiles.
- the video packaging and origination service 1720 receives the plurality of incoming encoded content streams from the encoders.
- the designation of a specific ingress component 1722 may be based on algorithms incorporating geographic or network information, random selection, weighted selection, load balancing, client specified information, encoding format, and the like.
- the video packaging and origination service 1720 may maintain ingress components 1722 that have been optimized to receive different encoding profiles.
- the video packaging and origination service 1720 can utilize load balancing to determine which ingress component 1722 is better suited to receive an incoming stream at the time it is received.
- Other variations are also possible.
- the video packaging and origination service 1720 processes the received encoded segments.
- the video packaging and origination service 1720 can be adjustments or error correction for any of the selected encoded segments.
- the video packaging and origination service 1720 can extrapolate additional segments or portions to facilitate combination.
- the ingress component 1722 of the video packaging and origination service 1720 generates deterministic data included in a set of meta-data utilized to access and generate outgoing content streams.
- the deterministic data can include timestamp information related to a time of play of the set of encoded segments, sequence number identifying an order of the encoded content segment in the set of encoded segments, a time of operation of the encoder and the like.
- the ingress component 1722 or content management service 1726 can conduct quality or error checking that can be included in meta-data.
- the video packaging and origination service 1720 performs a determination if encoded segments determined to be matching correspond to all the requested encoded profiles. For example, to enable variable bitrate encoding, the content request may request encoded content segments according to five different encoding profiles. Accordingly, the video packaging and origination service 1720 could determine via the deterministic information whether there are five matching segments covering the five requested encoding profiles. If additional encoded segments remain unreceived or not fully processed, the routine 2200 returns to block 2204 to receive the additional encoder streams. If not, the routine 2200 proceeds to block 2210.
- the video packaging and origination service 1720 stores the cumulative set of encoded segments for delivery to user devices 1702. As described above, the video packaging and origination service 1720 can also associate or store meta-data associated with the segments. Alternatively, the video packaging and origination service 1720 can also interact with egress nodes or generate a notification that the collected content is ready for transmission. Routine 2200 terminates at block 2212 or starts a new iteration of routine 2200.
- a content provider can implement a video packaging and origination service that is able to deliver video content to requesting users.
- a video packaging and origination service indexes a collection of source video content (either live streaming or file-based video-on-demand) and delivers it to clients via a wide range of communication protocols such as HTTP Live Streaming ("HLS”), Dynamic Adaptive Streaming over HTTP (“DASH”), HTTP Dynamic Streaming (“HDS”), Real Time Messaging Protocol (“RTMP”), Smooth Streaming, and the like.
- HLS HTTP Live Streaming
- DASH Dynamic Adaptive Streaming over HTTP
- HDS HTTP Dynamic Streaming
- RTMP Real Time Messaging Protocol
- Smooth Streaming and the like.
- a video packaging and origination service can also provide advanced video transmission features such as just-in-time packaging of video content, digital rights management (“DRM”) encryption, time-shifting, bitrate selection, catch up TV, and more.
- DRM digital rights management
- content providers can organize requested content, such as a video file, into multiple segments that are then transmitted to requesting devices segment by segment. For example, in a video stream, each segment typically accounts for 2-10 seconds of video rendered on a receiving device.
- individual content segments can be encoded by an encoder and transmitted to the video and origination service.
- a processing node on the video packaging and origination service can receive an incoming stream of encoded segments and then transmit the stream to requesting user devices.
- each distinct encoded video segment (e.g., combination of bitrate encoding and format) is provided to the video packaging and origination service from a single encoder or encoding node.
- Video segments can be encoded according to a defined bitrate and format, which generally defines the number of bits of data that are encoded over a measured amount of time and the specific software algorithm and resulting content representation format utilized to encode the data for transmission.
- bitrates are typically measured according to how many kilobits or megabits of data are processed over a second of time.
- a data file that corresponds to 1 megabyte of video data encoded in one second would be considered to have an encoding bitrate of 8 mbps (e.g., 8 megabits per second) while a lower definition video file that corresponds to 45 kilobytes of video data processed in one second would be considered to have an encoding bitrate of 360 kbps (e.g., 360 kilobits per second).
- a client computing device can simply request content having a fixed encoding rate or have a fixed encoding rate selected in response to a streaming content request.
- Such a fixed encoding rate approach can be deficient in facilitating variance of the encoding bitrate (both positive and negative) based on factors, such as network bandwidth, client computing device utilization, quality demands, and the like.
- video segments can be further defined by associating the encoding bitrate with the encoding format utilized by the encoder to generate the output stream.
- the encoding format can correspond to a content representation format for storage or transmission of video content (such as in a data file or bitstream).
- Examples of encoding formats include but not limited to the motion pictures expert group (“MPEG) MPEG-2 Part 2, MPEG-4 Part 2, H.264 (MPEG-4 Part 10), H.265 high efficiency video coding (“HEVC”), Theora, RealVideo RV40, VP9, and AOMedia Video 1 (“AVI”), and the like.
- MPEG motion pictures expert group
- MPEG-4 Part 2 MPEG-4 Part 2
- H.264 MPEG-4 Part 10
- HEVC high efficiency video coding
- AVI AOMedia Video 1
- a single encoded may be constrained for more complex encoding profiles. This can limit the ability for content providers to provide different encoding bitrate/format combinations or require utilization of increased computing device resources to provide for individual encoding nodes.
- the video packaging and origination service does not receive content and manifests as an outage to downstream user devices.
- aspects of the present application corresponding to a redundant node system for transmitting redundant encoder streams. More specifically, aspects of the present application correspond to utilization of synchronization information to allow a video packaging and origination service to receive multiple, redundant input streams corresponding to a set of content segments. Each individual stream can be provided by different encoders based on the synchronization information, such as sequence reference numbers or timestamp information.
- the number of encoders utilized by the content source may be based on the complexity of the encoding profile (e.g., encoded bitrate and format), available encoder computing resources, available network bandwidth, financial cost information, processing cost information and the like.
- the receiving video packaging and origination service can resolve discrepancies or conflicts to form the set of encoded segments.
- the video packaging and origination service can select from the redundant encoding streams based on time received, quality measurements, priority designations, attributable cost, priority meta-data included in the transmitted content segments, user preferences, historical information, or other selection criteria. Additionally, in the event of a failure of one of the encoders, the video packaging and origination service can request additional encoders to complete the transmission or begin collecting additional encoded segments from other encoders.
- FIG. 23 illustrates a general content delivery environment 2300 for delivering content from original content providers to user devices.
- the content delivery environment 2300 includes a plurality of devices 2302 utilized by individual users, generally referred to as client computing devices, to request streaming or download content from a video packaging and origination service 2320.
- the video packaging and origination service 2320 indexes a collection of source video content (either live streaming or file-based video-on-demand) and delivers it to clients via a wide range of communication protocols such as HTTP Live Streaming ("HLS”), Dynamic Adaptive Streaming over HTTP (“DASH”), HTTP Dynamic Streaming (“HDS”), Real Time Messaging Protocol (“RTMP”), Smooth Streaming, and the like.
- HTTP Live Streaming (“HLS)
- DASH Dynamic Adaptive Streaming over HTTP
- HDS HTTP Dynamic Streaming
- RTMP Real Time Messaging Protocol
- Smooth Streaming and the like.
- a video packaging and origination service can also provide advanced video transmission features such as just-in-time packaging of video content, digital rights management ("DRM") encryption, time-shifting, bitrate selection, catch up TV, and more.
- DRM digital rights management
- the content can be illustratively provided by one or more origin sources, such as original content provider 1730.
- Client computing devices 2302 may include any number of different computing devices capable of communicating with the networks 1740, 2350, 2360, via a direct connection or via an intermediary.
- individual accessing computing devices may correspond to a laptop or tablet computer, personal computer, wearable computer, server, personal digital assistant (PDA), hybrid PDA/mobile phone, mobile phone, electronic book reader, set-top box, camera, appliance (e.g., a thermostat or refrigerator), controller, digital media player, watch, eyewear, a home or car device, Internet of Things (“IoT”) devices, virtual reality or augmented reality devices, and the like.
- Each client computing device 2302 may optionally include one or more data stores (not shown in FIG. 23 ) including various applications or computer-executable instructions, such as web browsers, used to implement the embodiments disclosed herein. Illustrative components of a client computing device 2302 will be described with regard to FIG. 24 .
- a CDN service provider 2310 may include multiple edge locations from which a user device can retrieve content.
- Individual edge location 2312 may be referred to herein as a point of presence ("POP"), where a POP is intended to refer to any collection of related computing devices utilized to implement functionality on behalf of one or many providers.
- POPs are generally associated with a specific geographic location in which the computing devices implementing the POP are located, or with a region serviced by the POP.
- the POP 2310 can include one or more metric information processing component 2314 for processing metric information provided by client computing devices 2302 and a data store 2316 for maintain collected metric information. For example, a data center or a collection of computing devices within a data center may form a POP.
- the POPs may implement one or more services, such as CDN services, data storage services, data processing services, etc.
- the CDN service provider 2310 may include multiple POPs located in different geographic locations so that user devices can communicate with a nearby a POP to retrieve content, thereby reducing the latency of delivering requested content.
- Networks 2340, 2350, 2360 may be any wired network, wireless network, or combination thereof.
- the networks 2340, 2350, 2360 may be a personal area network, local area network, wide area network, cable network, fiber network, satellite network, cellular telephone network, data network, or combination thereof.
- network 2340 is a global area network (GAN), such as the Internet. Protocols and components for communicating via the other aforementioned types of communication networks are well known to those skilled in the art of computer communications and thus, need not be described in more detail herein.
- each of the client computing devices 2302 and video packaging and origination service 2310 are depicted as having a single connection to the network 2340, individual components of the client computing devices 2302 and video packaging and origination service 2310 may be connected to the network 2330 at disparate points. Accordingly, communication times and capabilities may vary between the components of FIG. 23 .
- FIG. 23 is illustrated as having three separate networks 2340, 2350, 2360, one skilled in the relevant art will appreciate that the video packaging and origination service 2310 may utilize any number or combination of networks.
- the video packaging and origination service 2320 includes one or more servers for receiving content from original content providers 2330 and processing the content to make available a set of received encoded bitrate segments.
- the video packaging and origination service 2320 includes an ingress component 2322 or multiple ingress components 2322 utilized to receive redundant encoded data streams from multiple encoding servers 132 from original content providers 2330.
- the video packaging and origination service 2320 can further include synchronization services 1724 for generating synchronization information utilized by the encoders, such as sequence numbers corresponding to the set of encoded segments, time stamp information related to a relative time of the encoded segments or from which relative time of encoded segments will be based, and the like.
- the video packaging and origination service 2320 can further include a data store 2326 for maintaining received encoded data for transmission.
- the video packaging and origination service 2320 may have fewer or greater components than are illustrated in FIG23 .
- the depiction of the video packaging and origination service 2320 in FIG. 23 should be taken as illustrative.
- components of the video packaging and origination service 2320 may be executed by one more virtual machines implemented in a hosted computing environment.
- a hosted computing environment may include one or more rapidly provisioned and released computing resources, which computing resources may include computing, networking or storage devices.
- the video packaging and origination service 2320 can include one or more egress components that can utilize the content received and processed from the ingress component 2322 and further process the content for transmission to user devices 2302.
- Such egress components may be implemented in conjunction with the ingress component 2322, such as in a transcoding node.
- the egress components may be implemented and managed independently of the ingress components 2322, such as in separate stand-alone computing devices.
- the content delivery environment 2300 also includes original content providers 2330.
- the original content provider can include a plurality of encoders 132 for generating multiple encoded streams for transmission to the video packaging and origination service 2320.
- the original content provider 2330 can also include logic or other management components for determining how many encoders 132 should be utilized or how to manage the addition or removal of encoders.
- the original content provider 2330 can further include synchronization services 2336 for generating synchronization information utilized by the encoders, such as sequence numbers corresponding to the set of encoded segments, time stamp information related to a relative time of the encoded segments or from which relative time of encoded segments will be based, and the like.
- the video packaging and origination service 2320 can further include a data store 2334 for maintaining encoded data for transmission.
- the synchronization services 124 and 2336 may work in conjunction or in a complimentary basis.
- FIG. 24 depicts one embodiment of an architecture of an illustrative user computing device 2302 that can generate content requests and process metric information in accordance with the present application.
- the general architecture of the user computing device 2302 depicted in FIG.24 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure.
- the user computing device 2302 includes a processing unit 2404, a network interface 2406, an input/output device interface 2409, an optional display 2402, and an input device 2424, all of which may communicate with one another by way of a communication bus.
- the network interface 2406 may provide connectivity to one or more networks or computing systems, such as the network 2340 of FIG23 and the video packaging and origination service 2320 or the original content provider 2330.
- the processing unit 2404 may thus receive information and instructions from other computing systems or services via a network.
- the processing unit 2404 may also communicate to and from memory 2410 and further provide output information for an optional display 2402 via the input/output device interface 2409.
- the input/output device interface 2409 may also accept input from the optional input device 2424, such as a keyboard, mouse, digital pen, etc.
- the user computing device 2302 may include more (or fewer) components than those shown in FIG. 2 .
- the memory 2410 may include computer program instructions that the processing unit 2404 executes in order to implement one or more embodiments.
- the memory 2410 generally includes RAM, ROM, or other persistent or non-transitory memory.
- the memory 2410 may store an operating system 2414 that provides computer program instructions for use by the processing unit 2404 in the general administration and operation of the user computing device 2302.
- the memory 2410 may further include computer program instructions and other information for implementing aspects of the present disclosure.
- the memory 2410 includes a network application 2416, such as browser application or media player, for accessing content and communicating with the video packaging and origination service 2320.
- FIG. 25 depicts one embodiment of an architecture of an illustrative server for encoding content as described herein.
- the general architecture of the encoder 132 depicted in FIG. 25 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure.
- the encoder 132 includes a processing unit 2504, a network interface 2506, a computer readable medium drive 2508, an input/output device interface 2509, all of which may communicate with one another by way of a communication bus.
- the components of the encoder 132 may be physical hardware components or implemented in a virtualized environment.
- the network interface 2506 may provide connectivity to one or more networks or computing systems, such as the network 2350 or network 2360 of FIG. 23 .
- the processing unit 2504 may thus receive information and instructions from other computing systems or services via a network.
- the processing unit 2504 may also communicate to and from memory 2510 and further provide output information for an optional display via the input/output device interface 2509.
- the encoder 132 may include more (or fewer) components than those shown in FIG. 25 .
- the memory 2510 may include computer program instructions that the processing unit 2504 executes in order to implement one or more embodiments.
- the memory 2510 generally includes RAM, ROM, or other persistent or non-transitory memory.
- the memory 2510 may store an operating system 2514 that provides computer program instructions for use by the processing unit 2504 in the general administration and operation of the video packaging and origination service 2320.
- the memory 2510 may further include computer program instructions and other information for implementing aspects of the present disclosure.
- the memory 2510 includes interface software 2512 for receiving and processing content requests from the video packaging and origination service 2320.
- the memory 2510 includes an encoder component 2516 for processing content segments.
- the encoder component 2516 can further include a synchronization parameter component 2518 for utilizing the synchronization information in the encoding process to increase the likelihood that encoded segments from multiple encoders can be utilized by a video packaging and origination service 2320.
- FIG. 26 depicts one embodiment of an architecture of an illustrative server for functioning as an ingress component 2322 as described herein.
- the general architecture of the ingress component 2322 depicted in FIG. 26 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure.
- the ingress component 2322 includes a processing unit 2604, a network interface 2606, a computer readable medium drive 2608, an input/output device interface 2609, all of which may communicate with one another by way of a communication bus.
- the components of the ingress component 2322 may be physical hardware components or implemented in a virtualized environment.
- the network interface 2606 may provide connectivity to one or more networks or computing systems, such as the network 2350 or network 2360 of FIG. 23 .
- the processing unit 2604 may thus receive information and instructions from other computing systems or services via a network.
- the processing unit 2604 may also communicate to and from memory 2610 and further provide output information for an optional display via the input/output device interface 2609.
- the ingress component 2322 may include more (or fewer) components than those shown in FIG. 26 .
- the memory 2610 may include computer program instructions that the processing unit 2604 executes in order to implement one or more embodiments.
- the memory 2610 generally includes RAM, ROM, or other persistent or non-transitory memory.
- the memory 2610 may store an operating system 2614 that provides computer program instructions for use by the processing unit 2604 in the general administration and operation of the ingress node.
- the memory 2610 may further include computer program instructions and other information for implementing aspects of the present disclosure.
- the memory 2610 includes interface software 2612 for receiving and processing content requests from the ingress component 2322.
- the resulting information can include a dynamically configured bundle to encoding bitrates.
- the memory 2610 includes an encoder processing application 2616 for processing incoming encoded content segments.
- the ingress component 2322 can further include a synchronization parameter component 2618 for utilizing the synchronization information in the encoding process to increase the likelihood that encoded segments from multiple encoders can be utilized by the ingress component 2322.
- the video packaging and origination service 2320 can transmit synchronization information to the original content provider 2330.
- the synchronization information is utilized by multiple encoders 132 to allow encoded segments from multiple encoders to be combined seamlessly or substantially seamlessly.
- the synchronization information can include timestamp information related to a relative timestamp of individual encoded segments in the set of encoded segments.
- the synchronization information can include sequence numbers for the individual segments.
- the synchronization information can include a time of operation or other time elapsed information.
- the synchronization information is incorporated into the encoded segments and then utilized by the video packaging and origination service 2320 to assemble the set of ordered segments, remove duplicates and identifying missing encoded segments.
- FIG. 27A illustrates the transmission of the synchronization information from the video packaging and origination service 2320, in some embodiments, synchronization information may not be transmitted by the video packaging and origination service 2320 and this interaction would be omitted altogether.
- the receiving original content provider 2330 determines the number of encoders that will be utilized to generate the requested redundant encoded content streams.
- the determination the number of encoders will generally corresponding to a plurality of encoders that generate encoded content streams for identified requested content and incorporating synchronization information.
- the determination of the number of encoders can be based on the complexity of the encoded bitrate and formation combination, available encoder resources, an attributable cost associated with the generated encoded content segments, user preferences or service levels associated with the video packaging and origination service 2320, network conditions (e.g., available bandwidth, network throughput, error rates), demand from users devices (e.g., total number of requests or frequencies of requests), and the like.
- a system experiencing a number of failures may implement a higher level of redundancy that a system that has not experienced as much failure.
- user preferences stored in a profile or included in a request can also be a factor in determining redundancy.
- the content stream data may be transmitted by the original content provider 2330 responsive to a request from a user device 2302, a request from the video packaging and origination service 2320, or other request/trigger.
- the encoded content can correspond to a set of encoded profiles corresponding to the encoding bitrate and format combinations that may be made available to users.
- the video packaging and origination service 2320 may provide a requesting user device 2302 with a set of encoding bitrate and format combinations in order to support adaptive bitrate streaming.
- the request from the original content provider may transmit the set of identified encoding bitrates and formats or individual encoding bitrate and format combinations to supplement previously receive encoded segments.
- the transmission of the request or the identification of requested encoded segments can be facilitated in a number of ways.
- the original content provider causes the selected number of encoders to generate redundant encoded streams.
- the video packaging and origination service 2320 may provide synchronization information to facilitate compatibility or to establish that the encoded content segments are substantially similar.
- the synchronization information can be utilized so that encoded content can be within a timing range, such as +/- 1 second.
- redundant segments may be generally considered to be segments that can be interchangeably utilized as transmitted or with additional processing or otherwise substantially similar.
- the original content provider 2330 can utilize self-providing synchronization, information provided by a third-party service or a combination.
- the original content provider begins transmitting a plurality of encoded content streams to the video packaging and origination service 2320 and incorporating received/accessed synchronization information.
- the redundant streams can be generated from multiple encoders, such as encoding node 132A and encoding node 132B, associated with a single source.
- the video packaging and origination service 2320 receives the plurality of incoming encoded content streams from the encoders. At (5), the video packaging and origination service 2320 collects encoded segments from the received streams. At (6), the video packaging and origination service 2320 processes the received encoded segments which are determined to be substantially similar or otherwise sufficiently compatible. For example, the video packaging and origination service 2320 can be adjustments or error correction for any of the selected encoded segments. In other embodiment, if the synchronization information does not ensure perfectly compatible encoded segments, the video packaging and origination service 2320 can extrapolate additional segments or portions to facilitate combination. Still further, the video packaging and origination service 2320 can implement conflict resolution from multiple overlapping content segments.
- the video packaging and origination service 2320 can utilize a first source wins implementation or last source wins.
- the video packaging and origination service 2320 can utilize historical information such as error rate, quality characterizations, or performance assessments.
- the video packaging and origination service 2320 can implement user preferences or user inputs or content provider preferences or content provider inputs to select from redundant input streams.
- the ingress component 2322 of the video packaging and origination service 2320 generates deterministic data included in a set of meta-data utilized to access and generate outgoing content streams.
- the deterministic data can include timestamp information related to a time of play of the set of encoded segments, sequence number identifying an order of the encoded content segment in the set of encoded segments, a time of operation of the encoder and the like.
- the ingress component 2322 or content management service 2326 can conduct quality or error checking that can be included in meta-data.
- the video packaging and origination service 2320 stores the cumulative set of encoded segments for delivery to user devices 2302.
- the redundant input streams to do not have to be received substantially in real time or in the same order.
- the video packaging and origination service 2320 can identify overlapping content segments at any point once all the segments are received and the select from one of the redundant encoded segments.
- the video packaging and origination service 2320 can continue to receive from the other redundant nodes or adjust the selection algorithm to minimize the impact of the failure.
- the video packaging and origination service 2320 can transmit synchronization information to the original content provider 2330A and original content provider 2330B (directly or indirectly).
- the synchronization information is utilized by multiple encoders 132 to allow encoded segments from multiple encoders to be combined seamlessly or substantially seamlessly.
- the synchronization information can include timestamp information related to a relative timestamp of individual encoded segments in the set of encoded segments.
- the synchronization information can include sequence numbers for the individual segments.
- the synchronization information can include a time of operation or other time elapsed information.
- the synchronization information is incorporated into the encoded segments and then utilized by the video packaging and origination service 2320 to assemble the set of ordered segments, remove duplicates and identifying missing encoded segments.
- FIG. 27B illustrates the transmission of the synchronization information from the video packaging and origination service 2320, in some embodiments, synchronization information may not be transmitted by the video packaging and origination service 2320 and this interaction would be omitted altogether.
- individual receiving original content providers 2330 determine the number of encoders that will be utilized to generate the requested redundant encoded content streams.
- the determination the number of encoders will generally corresponding to a plurality of encoders that generate encoded content streams for identified requested content and incorporating synchronization information.
- the determination of the number of encoders can be based on the complexity of the encoded bitrate and formation combination, available encoder resources, an attributable cost associated with the generated encoded content segments, user preferences or service levels associated with the video packaging and origination service 2320, network conditions (e.g., available bandwidth, network throughput, error rates), demand from users devices (e.g., total number of requests or frequencies of requests), and the like.
- a system experiencing a number of failures may implement a higher level of redundancy that a system that has not experienced as much failure.
- user preferences stored in a profile or included in a request can also be a factor in determining redundancy.
- the content stream data may be transmitted by the original content provider 2330 responsive to a request from a user device 2302, a request from the video packaging and origination service 2320, or other request/trigger.
- the encoded content can correspond to a set of encoded profiles corresponding to the encoding bitrate and format combinations that may be made available to users.
- the video packaging and origination service 2320 may provide a requesting user device 2302 with a set of encoding bitrate and format combinations in order to support adaptive bitrate streaming.
- the request from the original content provider may transmit the set of identified encoding bitrates and formats or individual encoding bitrate and format combinations to supplement previously receive encoded segments.
- the transmission of the request or the identification of requested encoded segments can be facilitated in a number of ways.
- the original content provider causes the selected number of encoders to generate redundant encoded streams.
- the video packaging and origination service 2320 may provide synchronization information to facilitate compatibility.
- the original content provider 2330 can utilize self-providing synchronization, information provided by a third-party service or a combination.
- the original content provider begins transmitting a plurality of encoded content streams to the video packaging and origination service 2320 and incorporating received/accessed synchronization information.
- the redundant streams can be generated from multiple encoder 132 associated with different sources.
- the video packaging and origination service 2320 receives the plurality of incoming encoded content streams from the encoders. At (5), the video packaging and origination service 2320 collects encoded segments from the received streams. At (6), the video packaging and origination service 2320 processes the received encoded segments. For example, the video packaging and origination service 2320 can be adjustments or error correction for any of the selected encoded segments. In other embodiment, if the synchronization information does not ensure perfectly compatible encoded segments, the video packaging and origination service 2320 can extrapolate additional segments or portions to facilitate combination. Still further, the video packaging and origination service 2320 can implement conflict resolution from multiple overlapping content segments. For example, the video packaging and origination service 2320 can utilize a first source wins implementation or last source wins.
- the ingress component 2322 of the video packaging and origination service 2320 generates deterministic data included in a set of meta-data utilized to access and generate outgoing content streams.
- the deterministic data can include timestamp information related to a time of play of the set of encoded segments, sequence number identifying an order of the encoded content segment in the set of encoded segments, a time of operation of the encoder and the like.
- the ingress component 2322 or content management service 2326 can conduct quality or error checking that can be included in meta-data.
- the video packaging and origination service 2320 can utilize historical information such as error rate, quality characterizations, or performance assessments.
- the video packaging and origination service 2320 can implement user preferences or user inputs or content provider preferences or content provider inputs to select from redundant input streams.
- the video packaging and origination service 2320 stores the cumulative set of encoded segments for delivery to user devices 2302.
- the redundant input streams to do not have to be received substantially in real time or in the same order.
- the video packaging and origination service 2320 can identify overlapping content segments at any point once all the segments are received and the select from one of the redundant encoded segments.
- the video packaging and origination service 2320 can continue to receive from the other redundant nodes or adjust the selection algorithm to minimize the impact of the failure.
- Routine 2800 utilized by the video packaging and origination service 2320 to receive and process multiple encoder streams will be described. Routine 2800 may be illustratively implemented by an ingress component 2322.
- the video packaging and origination service 2320 can optionally transmit synchronization information to the original content provider 2330.
- the synchronization information is utilized by multiple encoders 132 to allow encoded segments from multiple encoders to be combined seamlessly or substantially seamlessly.
- the synchronization information can include timestamp information related to a relative timestamp of individual encoded segments in the set of encoded segments.
- the synchronization information can include sequence numbers for the individual segments.
- the synchronization information can include a time of operation or other time elapsed information.
- the synchronization information is incorporated into the encoded segments and then utilized by the video packaging and origination service 2320 to assemble the set of ordered segments, remove duplicates and identifying missing encoded segments.
- block 2804 may be omitted.
- the original content provider 2330 begins transmitting a plurality of redundant, encoded content streams to the video packaging and origination service 2320 and incorporating received/accessed synchronization information.
- the transmission of the redundant streams does not have to be simultaneously received or received in the same order.
- the video packaging and origination service 2320 receives the plurality of incoming encoded content streams from the encoders.
- a determination is made as to whether additional encoder segments streams are received. If so, the routine 2800 returns to block 2806 to receive the additional encoder streams. If not, the routine 2800 proceeds to block 2808.
- the video packaging and origination service 2320 processes the received encoded segments.
- the video packaging and origination service 2320 collects encoded segments from the received streams.
- the video packaging and origination service 2320 can be adjustments or error correction for any of the selected encoded segments.
- the video packaging and origination service 2320 can extrapolate additional segments or portions to facilitate combination.
- the video packaging and origination service 2320 can implement conflict resolution from multiple overlapping content segments.
- the video packaging and origination service 2320 can utilize a first source wins implementation or last source wins.
- the video packaging and origination service 2320 can utilize historical information such as error rate, quality characterizations, or performance assessments.
- the video packaging and origination service 2320 can implement user preferences or user inputs or content provider preferences or content provider inputs to select from redundant input streams. Still further, in some embodiments, the ingress component 2322 of the video packaging and origination service 2320 generates deterministic data included in a set of meta-data utilized to access and generate outgoing content streams. Illustratively, the deterministic data can include timestamp information related to a time of play of the set of encoded segments, sequence number identifying an order of the encoded content segment in the set of encoded segments, a time of operation of the encoder and the like. In another example, the ingress component 2322 or content management service 2326 can conduct quality or error checking that can be included in meta-data. At block 2810, the video packaging and origination service 2320 stores the cumulative set of encoded segments for delivery to user devices 2302. Routine 2800 terminates at block 2812 or starts a new iteration of routine 2800.
- Routine 2900 may be illustratively implemented by multiple encoder components 132.
- the encoder component 132 (directly or indirectly) identifies a request for encoded content.
- the encoded content request can correspond to a set of encoded profiles corresponding to the encoding bitrate and format combinations that may be made available to users.
- the video packaging and origination service 2320 may provide a set of encoding bitrate and format combinations in order to support adaptive bitrate streaming.
- the request from the video packaging and origination service 2320 may correspond to the set of identified encoding bitrates and formats or individual encoding bitrate and format combinations to supplement previously receive encoded segments.
- the transmission of the request or the identification of requested encoded segments (including format) can be facilitated in a number of ways.
- the encoder can receive synchronization information or generate synchronization information.
- the synchronization information is utilized by multiple encoders 132 to allow encoded segments from multiple encoders to be combined seamlessly or substantially seamlessly.
- the synchronization information can include timestamp information related to a relative timestamp of individual encoded segments in the set of encoded segments.
- the synchronization information can include sequence numbers for the individual segments.
- the synchronization information can include a time of operation or other time elapsed information.
- the synchronization information is incorporated into the encoded segments and then utilized by the video packaging and origination service 2320 to assemble the set of ordered segments, remove duplicates and identifying missing encoded segments.
- the receiving original content provider 2330 determines the number of encoders that will be utilized to generate the requested encoded content streams.
- the determination the number of encoders will generally corresponding to a plurality of encoders that generate encoded content streams for identified requested content and incorporating synchronization information.
- the determination of the number of encoders can be based on the complexity of the encoded bitrate and formation combination, available encoder resources, an attributable cost associated with the generated encoded content segments, preferences or service levels associated with the video packaging and origination service 2320, network conditions (e.g., available bandwidth, network throughput, error rates), demand from users devices (e.g., total number of requests or frequencies of requests), and the like.
- the video packaging and origination service 2320 can utilize a compatibility assessment information based on historical information or otherwise calculated to select.
- the original content provider causes the selected number of encoders to generate encoded streams based on synchronization information.
- the video packaging and origination service 2320 may provide the synchronization information.
- the original content provider 2330 can utilize self-providing synchronization, information provided by a third-party service or a combination.
- the original content provider begins transmitting a plurality of encoded content streams to the video packaging and origination service 2320 and incorporating received/accessed synchronization information.
- the encoders 132B and 132A may be configured to transmit non-overlapping segments in which the encoding task for the set of segments it distributed among encoders. In other embodiments, the encoders may be configured will at least partially overlapping encoded segments. Routine 2900 terminates at block 291 or starts a new iteration of routine 2900.
- the computer system may, in some cases, include multiple distinct computers or computing devices (e.g., physical servers, workstations, storage arrays, cloud computing resources, etc.) that communicate and interoperate over a network to perform the described functions.
- Each such computing device typically includes a processor (or multiple processors) that executes program instructions or modules stored in a memory or other non-transitory computer-readable storage medium or device (e.g., solid state storage devices, disk drives, etc.).
- the various functions disclosed herein may be embodied in such program instructions, or may be implemented in application-specific circuitry (e.g., ASICs or FPGAs) of the computer system.
- the computer system may, but need not, be co-located.
- the results of the disclosed methods and tasks may be persistently stored by transforming physical storage devices, such as solid state memory chips or magnetic disks, into a different state.
- the computer system may be a cloud-based computing system whose processing resources are shared by multiple distinct business entities or other users.
- the various illustrative logical blocks, modules, routines, and algorithm steps described in connection with the embodiments disclosed herein can be implemented as electronic hardware (e.g., ASICs or FPGA devices), computer software that runs on computer hardware, or combinations of both.
- the various illustrative logical blocks and modules described in connection with the embodiments disclosed herein can be implemented or performed by a machine, such as a processor device, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein.
- DSP digital signal processor
- ASIC application specific integrated circuit
- FPGA field programmable gate array
- a processor device can be a microprocessor, but in the alternative, the processor device can be a controller, microcontroller, or state machine, combinations of the same, or the like.
- a processor device can include electrical circuitry configured to process computer-executable instructions.
- a processor device includes an FPGA or other programmable device that performs logic operations without processing computer-executable instructions.
- a processor device can also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.
- a processor device may also include primarily analog components.
- a computing environment can include any type of computer system, including, but not limited to, a computer system based on a microprocessor, a mainframe computer, a digital signal processor, a portable computing device, a device controller, or a computational engine within an appliance, to name a few.
- a software module can reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of a non-transitory computer-readable storage medium.
- An exemplary storage medium can be coupled to the processor device such that the processor device can read information from, and write information to, the storage medium.
- the storage medium can be integral to the processor device.
- the processor device and the storage medium can reside in an ASIC.
- the ASIC can reside in a user terminal.
- the processor device and the storage medium can reside as discrete components in a user terminal.
- Disjunctive language such as the phrase "at least one of X, Y, or Z," unless specifically stated otherwise, is otherwise understood with the context as used in general to present that an item, term, etc., may be either X, Y, or Z, or any combination thereof (e.g., X, Y, or Z). Thus, such disjunctive language is not generally intended to, and should not, imply that certain embodiments require at least one of X, at least one of Y, and at least one of Z to each be present.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- General Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Information Transfer Between Computers (AREA)
Description
- Generally described, computing devices and communication networks can be utilized to exchange data and/or information. In a common application, a computing device can request content from another computing device via the communication network. For example, a user at a personal computing device can utilize a browser application to request a content page (e.g., a network page, a Web page, etc.) from a server computing device via the network (e.g., the Internet). In such embodiments, the user computing device can be referred to as a client computing device and the server computing device can be referred to as a content provider.
- Content providers provide requested content to client computing devices often with consideration of efficient transmission of the requested content to the client computing device and/or consideration of a cost associated with the transmission of the content. For larger scale implementations, a content provider may receive content requests from a high volume of client computing devices which can place a strain on the content provider's computing resources. Additionally, the content requested by the client computing devices may have a number of components, which can further place additional strain on the content provider's computing resources.
- Some content providers attempt to facilitate the delivery of requested content through the utilization of a content delivery network ("CDN") service provider. As with content providers, CDN service providers also provide requested content to client computing devices often with consideration of efficient transmission of the requested content to the client computing device and/or consideration of a cost associated with the transmission of the content. Accordingly, CDN service providers often consider factors such as latency of delivery of requested content in order to meet service level agreements or the quality of delivery service.
-
US 2010/250710 A1 describes a system and method for delivering content objects over the Internet to an end user system with a content delivery network (CDN). The system and method aim at dynamically serving content objects by loading and/or reconfiguring publishing points upon receipt of an end user request. When a content object is requested by an end user media player, the request is assigned to an edge server within a particular POP of the CDN. A peer-discovery algorithm is used to determine a content source for the requested content object within the CDN. The peer-discovery algorithm first determines whether the publishing point associated with the requested content object is loaded into the edge server. Alternatively, the peer-discovery algorithm queries other edge servers within or remote from the particular POP to determine whether the request for content object is mapped by other edge servers to a content source using their respective publishing points. Once the content source for the requested content object is determined, the edge server reconfigures its publishing point toward the content source. Ultimately, the content object is streamed to the end user media player. - Throughout the drawings, reference numbers may be re-used to indicate correspondence between referenced elements. The drawings are provided to illustrate example embodiments described herein and are not intended to limit the scope of the disclosure.
-
FIG. 1 is a block diagram of a content delivery environment that includes one or more user devices, a video packaging and origination service and an original content provider according to one embodiment; -
FIG 2 is a block diagram of illustrative components of a user computing device configured to remotely process content in accordance with an illustrative embodiment; -
FIG. 3 is a block diagram of illustrative components of an encoder component configured to generate encoded content according to synchronization information in accordance with an illustrative embodiment; -
FIG. 4 is a block diagram of illustrative components of an ingress node configured to manage encoder content streams in accordance with an illustrative embodiment; -
FIG. 5 is a block diagram of illustrative components of an egress node configured to manage content requests from requesting entities in accordance with an illustrative embodiment; -
FIG. 6 is a block diagram of illustrative components of a local cache component configured to manage streaming content for processing content requests in accordance with an illustrative embodiment -
FIGS. 6A-6C are block diagrams of the content delivery environment ofFIG. 1 illustrating the interaction related to video packing and origination service for obtaining encoded content for delivery to user devices; and -
FIG. 7 is a flow diagram illustrative of an ingress component routine implemented by a video packaging and origination service; -
FIG. 8 is a flow diagram illustrative of an egress component routine implemented by a video packaging and origination service; and -
FIG. 9 is a flow diagram illustrative of a content caching routine implemented by a video packaging and origination service. -
FIG. 10 is a block diagram of a content delivery environment that includes one or more user devices, a video packaging and origination service and an original content provider according to one embodiment; -
FIG 11 is a block diagram of illustrative components of a user computing device configured to remotely process content in accordance with an illustrative embodiment; -
FIG. 12 is a block diagram of illustrative components of an encoder component configured to generate encoded content according to synchronization information in accordance with an illustrative embodiment; -
FIG.13 is a block diagram of illustrative components of an ingress node configured to manage multiple encoder content streams in accordance with an illustrative embodiment -
FIGS. 14 are block diagrams of the content delivery environment ofFIG. 1 illustrating the interaction related to video packing and origination service for obtaining encoded content for delivery to user devices; -
FIG. 15 is a flow diagram illustrative of a content processing routine implemented by a video packaging and origination service; and -
FIG. 16 is a flow diagram illustrative of a content processing routine implemented by a content provider to generate multiple content streams. -
FIG. 17 is a block diagram of a content delivery environment that includes one or more user devices, a video packaging and origination service and an original content provider according to one embodiment; -
FIG. 18 is a block diagram of illustrative components of a user computing device configured to remotely process content in accordance with an illustrative embodiment; -
FIG. 19 is a block diagram of illustrative components of an encoder component configured to generate encoded content according to synchronization information in accordance with an illustrative embodiment; -
FIG. 20 is a block diagram of illustrative components of an ingress node configured to manage multiple encoder content streams in accordance with an illustrative embodiment -
FIGS. 21 are block diagrams of the content delivery environment ofFIG. 1 illustrating the interaction related to video packing and origination service for obtaining encoded content for delivery to user devices; and -
FIG. 22 is a flow diagram illustrative of a content processing routine implemented by a video packaging and origination service. -
FIG. 23 is a block diagram of a content delivery environment that includes one or more user devices, a video packaging and origination service and an original content provider according to one embodiment; -
FIG. 24 is a block diagram of illustrative components of a user computing device configured to remotely process content in accordance with an illustrative embodiment; -
FIG. 25 is a block diagram of illustrative components of an encoder component configured to generate encoded content according to synchronization information in accordance with an illustrative embodiment; -
FIG. 26 is a block diagram of illustrative components of an ingress node configured to manage multiple encoder content streams in accordance with an illustrative embodiment -
FIGS. 27 are block diagrams of the content delivery environment ofFIG. 1 illustrating the interaction related to video packing and origination service for obtaining encoded content for delivery to user devices; -
FIG. 28 is a flow diagram illustrative of a content processing routine implemented by a video packaging and origination service; and -
FIG. 29 is a flow diagram illustrative of a content processing routine implemented by a content provider to generate multiple content streams. - Generally described, content providers can provide content to requesting users. With regard to video content, a content provider can implement a video packaging and origination service that is able to deliver video content to requesting users. Illustratively, a video packaging and origination service indexes a collection of source video content (either live streaming or file-based video-on-demand) and delivers it to clients via a wide range of communication protocols such as HTTP Live Streaming ("HLS"), Dynamic Adaptive Streaming over HTTP ("DASH"), HTTP Dynamic Streaming ("HDS"), Real Time Messaging Protocol ("RTMP"), Smooth Streaming, and the like. Based on consumer demand, a video packaging and origination service can also provide advanced video transmission features such as just-in-time packaging of video content, digital rights management ("DRM") encryption, time-shifting, bitrate selection, catch up TV, and more.
- To deliver content, content providers can organize requested content, such as a video file, into multiple segments that are then transmitted to requesting devices, segment by segment. For example, in a video stream, each segment typically accounts for 2-10 seconds of video rendered on a receiving device. To provide content to the video packaging and origination service, individual content segments can be encoded by an encoder and transmitted to the video and origination service. Traditionally, a single processing node on the video packaging and origination service can receive an incoming stream of encoded segments and then transmit the stream to requesting user devices.
- Video segments can be encoded according to a defined bitrate and format, which generally defines the number of bits of data that are encoded over a measured amount of time and the specific software algorithm and resulting content representation format utilized to encode the data for transmission. For video files, bitrates are typically measured according to how many kilobits or megabits of data are processed over a second of time. By way of example, a data file that corresponds to 1 megabyte of video data encoded in one second would be considered to have an encoding bitrate of 8 mbps (e.g., 8 megabits per second) while a lower definition video file that corresponds to 45 kilobytes of video data processed in one second would be considered to have an encoding bitrate of 360 kbps (e.g., 360 kilobits per second).
- In some embodiments, it may be possible for the content provider to facilitate variable bit rate encoding to enable for variances in the encoding bitrates of individual segments of a video file. In such embodiments, the content provider can generate multiple encoded bitrate versions or combinations of encoded bitrates and formats of individual video file segments. The content provider can then make at least a subset of the multiple bitrate encoded versions available to clients responsive to a request for a particular encoded bitrate version and format. Generally, a content provider can generate a catalog identifying the video segments and encoded bitrates for each identified video segment. The catalog can be written into a manifest file that is provided to individual client computing devices that have requested the video file. Thereafter, once all the versions of an encoded segment are received by the packaging and origination service, the packaging and origination service is available to receive and process requests for encoded content. More specifically, client computing devices, through a respective software application, can request individual video segments according to the available encoded bitrates and formats as published in the manifest file.
- To receive content, a client computing device can simply request content having a fixed encoding rate or have a fixed encoding rate selected in response to a streaming content request. Such a fixed encoding rate approach can be deficient in facilitating variance of the encoding bitrate (both positive and negative) based on factors, such as network bandwidth, client computing device utilization, quality demands, and the like. In addition to the association of the encoding bitrate, video segments can be further defined by associating the encoding bitrate with the encoding format utilized by the encoder to generate the output stream. The encoding format can correspond to a content representation format for storage or transmission of video content (such as in a data file or bitstream). Examples of encoding formats include but not limited to the motion pictures expert group ("MPEG) MPEG-2
Part 2, MPEG-4Part 2, H.264 (MPEG-4 Part 10), H.265 high efficiency video coding ("HEVC"), Theora, RealVideo RV40, VP9, and AOMedia Video 1 ("AV1"), and the like. - Traditionally, video packaging and origination services can maintain a single node or server to receive incoming content streams and transmit received streaming content to requesting clients. More specifically, the single node can operate as an ingress node to receive individual content streams or channels corresponding to encoded segments encoded to a specific encoding profile (e.g., encoding bitrate and format). The individual content streams or channels are provided by an original content provider. The single node can utilize state information that facilitates determination that all encoding versions of the same encoded segment have been received. However, the throughput of incoming data streams is limited by characteristics of the single node functionality. For example, an ingress node may experience latencies associated with processing more complex encoded content. In such situation, a video packaging and origination service could experience additional inefficiencies by limiting the ability of the video packaging and origination service to process additional encoding channels related to other encoding profiles until the current encoded data is processed. Similarly, a single node may experience a failure, which will result in downstream unavailability of the content stream.
- Additionally, the single node or server traditionally operates as an egress node to process requests for content by transmitting a content stream in the form of a set of encoded segments to a requesting entity, such as a CDN service or user devices. The single node can access the encoded content information received from the original content provider and generate content streams to requesting entities. In such traditional embodiments, the location of the single node (functioning as both an ingress and egress node) can be optimized for the attributes of the original content provider or the attributes of the requesting entity. For example, the single node may be instantiated in a geographic area logically proximate to the original content provider, which can lead to inefficiencies in the transmission of content streams for requesting entities. In another example, the single node may be instantiated in a geographic area logically proximate to one or more requesting entities, which can lead to inefficiencies in the transmission of content streams from the original content provider. In still another example, the computing resources for the single node are often optimized for an identified need of the ingress functionality or the egress functionality, which can lead to inefficiencies in the operation of the single node. For example, a single node may require a larger amount of processing and memory resources to receive and process incoming content streams than would be required to transmit content streams to requesting entities. Thus, scaling egress functionality would require server nodes with much higher computing resource requirements based on the dual function as an ingress node.
- The invention relates to a system, as further defined in
claim 1, and a method, as further defined inclaim 5, for managing streaming content. To address at least a portion of the inefficiencies described above with regard to single nodes functioning as ingress nodes and egress nodes, aspects of the present application corresponding to a multi-data center, multi-node system for receiving, processing and transmitting encoder streams. More specifically, aspects of the present application correspond to utilization of a set of nodes that function as ingress nodes and a set of nodes that function as egress nodes. The ingress nodes and egress nodes can correspond to separate computing devices or virtualized computing devices that can be configured individually to the relative function as ingress or egress nodes. The ingress and egress nodes can be individually instantiated and located based on the attributes of the original content provider and the video packaging and origination service for the ingress nodes and the attributes of the requesting entity and the video packaging and origination service for the egress nodes. - In accordance with other aspects of the present application, to facilitate interaction between different ingress and egress nodes, a video packaging and origination service can implement one or more services to manage the instantiated ingress nodes, the instantiated egress nodes and the interaction between ingress and egress nodes. Illustratively, an ingress node management service can monitor the operation of ingress nodes and facilitate the storage of processed encoding stream information, including redundant content stream ingestion. An egress management service can monitor the operation of egress nodes and facilitate access to the stored processed encoding stream information. In one embodiment, the ingress node management service and the egress management service, collectively a content management service, can utilize an index that identifies the stored location of individual encoded segments from a set of encoded segments corresponding to streaming content. The content management service can generate the index based on input from the ingress nodes that can identify the location and attributes on received encoded content segments. Additionally, the content management service can provide the index to all egress nodes information to allow for access to the encoded content segments at the time of responding to requests for streaming content. In this regarding, the egress nodes can dynamically generate content packages by collecting or compiling the stored, processed segments as identified in the index.
- In still further aspects of the present application, the video packaging and origination service can further include a caching mechanism to facilitate the transmission of the streaming content. More specifically, individual geographic locations of sets of egress nodes may be associated with local caching resources to facilitate increased throughput or performance in responding to content requests. The local caching resources may be populated from the generated index. Additionally, management of the cached information can be optimized based on historical demand for content that has not yet been requested or to maintain encoded content in the cache beyond traditional cache management processes.
-
FIG. 1 illustrates a generalcontent delivery environment 100 for delivering content from original content providers to user devices. Thecontent delivery environment 100 includes a plurality ofdevices 102 utilized by individual users, generally referred to as client computing devices, to request streaming or download content from a video packaging andorigination service 120. Illustratively, the video packaging andorigination service 120 indexes a collection of source video content (either live streaming or file-based video-on-demand) and delivers it to clients via a wide range of communication protocols such as HTTP Live Streaming ("HLS"), Dynamic Adaptive Streaming over HTTP ("DASH"), HTTP Dynamic Streaming ("HDS"), Smooth Streaming, Real Time Messaging Protocol ("RTMP"), and the like. Based on consumer demand, a video packaging and origination service can also provide advanced video transmission features such as just-in-time packaging of video content, digital rights management ("DRM") encryption, time-shifting, bitrate selection, catch up TV, and more. The content can be illustratively provided by one or more origin sources, such asoriginal content provider 130. -
Client computing devices 102 may include any number of different computing devices capable of communicating with thenetworks client computing device 102 may optionally include one or more data stores (not shown inFIG. 1 ) including various applications or computer-executable instructions, such as web browsers, used to implement the embodiments disclosed herein. Illustrative components of aclient computing device 102 will be described with regard toFIG. 2 . - In some embodiments, a
CDN service provider 110 may include multiple edge locations from which a user device can retrieve content.Individual edge location 112 may be referred to herein as a point of presence ("POP"), where a POP is intended to refer to any collection of related computing devices utilized to implement functionality on behalf of one or many providers. POPs are generally associated with a specific geographic location in which the computing devices implementing the POP are located, or with a region serviced by the POP. As illustrated inFIG 1 , thePOP 110 can include one or more metricinformation processing component 114 for processing metric information provided byclient computing devices 102 and adata store 116 for maintain collected metric information. For example, a data center or a collection of computing devices within a data center may form a POP. In some instances, the POPs may implement one or more services, such as CDN services, data storage services, data processing services, etc. TheCDN service provider 110 may include multiple POPs located in different geographic locations so that user devices can communicate with a nearby a POP to retrieve content, thereby reducing the latency of delivering requested content. -
Networks networks FIG. 1 ,network 140 is a global area network (GAN), such as the Internet. Protocols and components for communicating via the other aforementioned types of communication networks are well known to those skilled in the art of computer communications and thus, need not be described in more detail herein. While each of theclient computing devices 102 and video packaging andorigination service 110 are depicted as having a single connection to thenetwork 140, individual components of theclient computing devices 102 and video packaging andorigination service 110 may be connected to thenetwork 130 at disparate points. Accordingly, communication times and capabilities may vary between the components ofFIG. 1 . Likewise, althoughFIG. 1 is illustrated as having threeseparate networks origination service 110 may utilize any number or combination of networks. - In accordance with embodiments, the video packaging and
origination service 120 includes one or more servers for receiving content fromoriginal content providers 130 and processing the content to make available a set of received encoded bitrate segments. As described in further detail below, the video packaging andorigination service 120 includes a plurality ofingress components 122 utilized to receive encoded data streams from encodingservers 132 fromcontent providers 130. Illustratively, theingress components 122 can generate deterministic data that will facilitate a determination of when a complete set of encoded content segments have been received and is ready for further processing or transmission. The video packaging andorigination service 120 also includes one or more servers for receiving content requests for a requesting entity, such as aPOP 110 oruser device 102, accessing encoded content utilizing an index and transmission encoded content in return. Theingress components 122 andegress components 124 may be distributed according to geographic criteria or availability zones to facilitate delivery or access to encoded content. - The video packaging and
origination service 120 can further includemanagement services 126 for generating synchronization information utilized by the encoders, such as sequence numbers corresponding to the set of encoded segments, time stamp information related to a relative time of the encoded segments or from which relative time of encoded segments will be based, and the like. Themanagement services 126 can control the generation or instantiation of additional ingress and egress components or the generation of the indices utilized to identify content. Still further, the video packing andorigination service 120 can include a plurality ofcache components 129 that maintain encoded content in one or more distinct availability zones, such as different geographic areas or zones. The video packaging andorigination service 120 can further include adata store 128 for maintaining received encoded data for transmission. - It will be appreciated by those skilled in the art that the video packaging and
origination service 120 may have fewer or greater components than are illustrated inFIG. 1 . Thus, the depiction of the video packaging andorigination service 120 inFIG. 1 should be taken as illustrative. For example, in some embodiments, components of the video packaging andorigination service 120 may be executed by one more virtual machines implemented in a hosted computing environment. A hosted computing environment may include one or more rapidly provisioned and released computing resources, which computing resources may include computing, networking or storage devices. Still further, aspects of the present application relate to the selection ofindividual ingress servers 122,egress servers 124 andlocal cache components 129 based on attributes of the components, such as geographic information, logical network information, and the like. Accordingly, while such components are illustrated as logically being logically grouped inFIG. 1 , one skilled in the relevant art will appreciate that one or more aspects of the present application can include the video packaging andorigination service 120 as being implemented in multiple geographic areas. Additionally, not all geographic areas hosting portions of the video packaging andorigination service 120 will necessary have all the same components or combination of components. - With continued reference to
FIG. 1 , thecontent delivery environment 100 also includesoriginal content providers 130. Illustratively, the original content provider can include a plurality ofencoders 132 for generating multiple encoded streams for transmission to the video packaging andorigination service 120. In one embodiment, individual encoders may generate different encode versions of a content segment according to a different encoding profile. Theoriginal content provider 130 can also include logic or other management components for determining howmany encoders 132 should be utilized or how to manage the addition or removal of encoders. In some embodiments, the original content provider theoriginal content provider 130 can further includesynchronization services 136 for generating synchronization information utilized by the encoders, such as sequence numbers corresponding to the set of encoded segments, time stamp information related to a relative time of the encoded segments or from which relative time of encoded segments will be based, and the like. The video packaging andorigination service 120 can further include adata store 134 for maintaining encoded data for transmission. Thesynchronization services -
FIG. 2 depicts one embodiment of an architecture of an illustrativeuser computing device 102 that can generate content requests and process metric information in accordance with the present application. The general architecture of theuser computing device 102 depicted inFIG. 2 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure. As illustrated, theuser computing device 102 includes aprocessing unit 204, anetwork interface 206, an input/output device interface 209, anoptional display 202, and aninput device 224, all of which may communicate with one another by way of a communication bus. - The
network interface 206 may provide connectivity to one or more networks or computing systems, such as thenetwork 140 ofFIG. 1 and the video packaging andorigination service 120 or theoriginal content provider 130. Theprocessing unit 204 may thus receive information and instructions from other computing systems or services via a network. Theprocessing unit 204 may also communicate to and frommemory 210 and further provide output information for anoptional display 202 via the input/output device interface 209. The input/output device interface 209 may also accept input from theoptional input device 224, such as a keyboard, mouse, digital pen, etc. In some embodiments, theuser computing device 102 may include more (or fewer) components than those shown inFIG. 2 . - The
memory 210 may include computer program instructions that theprocessing unit 204 executes in order to implement one or more embodiments. Thememory 210 generally includes RAM, ROM, or other persistent or non-transitory memory. Thememory 210 may store anoperating system 214 that provides computer program instructions for use by theprocessing unit 204 in the general administration and operation of theuser computing device 102. Thememory 210 may further include computer program instructions and other information for implementing aspects of the present disclosure. For example, in one embodiment, thememory 210 includes anetwork application 216, such as browser application or media player, for accessing content and communicating with the video packaging andorigination service 120. -
FIG. 3 depicts one embodiment of an architecture of an illustrative server for encoding content as described herein. The general architecture of theencoder 132 depicted inFIG. 3 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure. As illustrated, theencoder 132 includes aprocessing unit 304, anetwork interface 306, a computerreadable medium drive 308, an input/output device interface 309, all of which may communicate with one another by way of a communication bus. The components of theencoder 132 may be physical hardware components or implemented in a virtualized environment. - The
network interface 306 may provide connectivity to one or more networks or computing systems, such as thenetwork 150 ornetwork 160 ofFIG. 1 . Theprocessing unit 304 may thus receive information and instructions from other computing systems or services via a network. Theprocessing unit 304 may also communicate to and frommemory 310 and further provide output information for an optional display via the input/output device interface 309. In some embodiments, theencoder 132 may include more (or fewer) components than those shown inFIG. 3 . - The
memory 310 may include computer program instructions that theprocessing unit 304 executes in order to implement one or more embodiments. Thememory 310 generally includes RAM, ROM, or other persistent or non-transitory memory. Thememory 310 may store anoperating system 314 that provides computer program instructions for use by theprocessing unit 304 in the general administration and operation of the video packaging andorigination service 120. Thememory 310 may further include computer program instructions and other information for implementing aspects of the present disclosure. For example, in one embodiment, thememory 310 includes interface software 312 for receiving and processing content requests from the video packaging andorigination services 120. - Additionally, the
memory 310 includes anencoder component 316 for processing content segments. Additionally, theencoder component 316 can further include asynchronization parameter component 318 for utilizing the synchronization information in the encoding process to increase the likelihood that encoded segments from multiple encoders can be utilized by a video packaging andorigination service 120. The synchronization information can be utilized in the generation of deterministic data as will be described below. -
FIG. 4 depicts one embodiment of an architecture of an illustrative server for functioning as aningress component 122 as described herein. As described above, the video packaging andorigination service 120 includes multiple ingress components 122 (or nodes) that facilitate intake of encoded segments that have been encoded according to different encoding profiles. The general architecture of theingress component 122 depicted inFIG. 4 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure. As illustrated, theingress component 122 includes aprocessing unit 404, anetwork interface 406, a computerreadable medium drive 408, an input/output device interface 409, all of which may communicate with one another by way of a communication bus. The components of theingress component 122 may be physical hardware components or implemented in a virtualized environment. - The
network interface 406 may provide connectivity to one or more networks or computing systems, such as thenetwork 150 ornetwork 160 ofFIG. 1 . Theprocessing unit 404 may thus receive information and instructions from other computing systems or services via a network. Theprocessing unit 404 may also communicate to and frommemory 410 and further provide output information for an optional display via the input/output device interface 409. In some embodiments, theingress component 122 may include more (or fewer) components than those shown inFIG. 4 . - The
memory 410 may include computer program instructions that theprocessing unit 404 executes in order to implement one or more embodiments. Thememory 410 generally includes RAM, ROM, or other persistent or non-transitory memory. Thememory 410 may store anoperating system 414 that provides computer program instructions for use by theprocessing unit 404 in the general administration and operation of the ingress node. Thememory 410 may further include computer program instructions and other information for implementing aspects of the present disclosure. For example, in one embodiment, thememory 410 includes interface software 412 for receiving and processing content fromencoders 132. Additionally, thememory 410 includes anencoder processing application 416 for processing incoming encoded content segments. Theingress component 122 can further include asynchronization parameter component 418 for utilizing the synchronization information to generate the deterministic information as described above. Still further, theingress component 122 can also include anindex interface 420 for writing deterministic data or providing deterministic data to generate index of stored content segments. -
FIG. 5 depicts one embodiment of an architecture of an illustrative server for functioning as anegress component 124 as described herein. As described above, the video packaging andorigination service 120 includes multiple egress components 124 (or nodes) that facilitate intake of encoded segment content requests from different requesting entities, such asCDN 110 oruser devices 102. The general architecture of theegress component 124 depicted inFIG. 5 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure. As illustrated, theegress component 124 includes aprocessing unit 504, anetwork interface 506, a computerreadable medium drive 508, an input/output device interface 509, all of which may communicate with one another by way of a communication bus. The components of theegress component 124 may be physical hardware components or implemented in a virtualized environment. - The
network interface 506 may provide connectivity to one or more networks or computing systems, such as thenetwork 150 ornetwork 160 ofFIG. 1 . Theprocessing unit 504 may thus receive information and instructions from other computing systems or services via a network. Theprocessing unit 504 may also communicate to and frommemory 510 and further provide output information for an optional display via the input/output device interface 509. In some embodiments, theegress component 124 may include more (or fewer) components than those shown inFIG. 5 . - The
memory 510 may include computer program instructions that theprocessing unit 504 executes in order to implement one or more embodiments. Thememory 510 generally includes RAM, ROM, or other persistent or non-transitory memory. Thememory 510 may store an operating system 514 that provides computer program instructions for use by theprocessing unit 504 in the general administration and operation of theegress component 124. Thememory 510 may further include computer program instructions and other information for implementing aspects of the present disclosure. For example, in one embodiment, thememory 510 includes interface software 512 for receiving and processing content requests from requesting entities. Additionally, thememory 510 includes acontent generation component 516 for processing received encoded content segments from an index. Additionally, theegress component 124 can further include anindex component 518 for generating the encoded content streams by accessing encoded content segments as identified in the index information as described above. -
FIG. 6 depicts one embodiment of an architecture of an illustrative server for functioning as acache component 129 as described herein. As described above, the video packaging andorigination service 120 includes cache components 129 (or nodes) that facilitate the management of content streams to requesting users. Illustratively, thecache components 129 are part of the video packaging andorigination service 120 and can be managed in manner to optimize the processing and transmission of content streams to requesting users. Thecache components 129 may correspond to local cache components that serve one or more distinct geographic areas. For example, acache component 129 can have a one-to-one association with a specific geographic region or logical zone and can be optimized according to the attributes of the specific geographic region or logical zone. In another example, acache component 129 can have a one-to-many association with multiple geographic zones or logical zones and can be optimized to according to the attributes of individual geographic zones or logical or multiple geographic zones or logical zones. - The general architecture of the
cache component 129 depicted inFIG. 6 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure. As illustrated, thecache component 129 includes aprocessing unit 604, anetwork interface 606, a computerreadable medium drive 608, an input/output device interface 609, all of which may communicate with one another by way of a communication bus. The components of thecache component 129 may be physical hardware components or implemented in a virtualized environment. - The
network interface 606 may provide connectivity to one or more networks or computing systems, such as thenetwork 160 ornetwork 160 ofFIG. 1 . Theprocessing unit 604 may thus receive information and instructions from other computing systems or services via a network. Theprocessing unit 604 may also communicate to and frommemory 610 and further provide output information for an optional display via the input/output device interface 609. In some embodiments, thecache component 129 may include more (or fewer) components than those shown inFIG. 6 . - The
memory 610 may include computer program instructions that theprocessing unit 604 executes in order to implement one or more embodiments. Thememory 610 generally includes RAM, ROM, or other persistent or non-transitory memory. Thememory 610 may store anoperating system 614 that provides computer program instructions for use by theprocessing unit 604 in the general administration and operation of thecache component 129. Thememory 610 may further include computer program instructions and other information for implementing aspects of the present disclosure. For example, in one embodiment, thememory 610 includes interface software 612 for receiving and processing content caching commands from thecontent management services 126 and requests from requestingegress servers 124. Additionally, thememory 610 includes a content generation component 616 for processing received encoded content segments from an index for storage. Content generation component 616 also includes or access the mass storage utilized to maintain cached content. Additionally, theingress component 122 can further include anindex interface component 618 for obtaining and processing indexes to identify encoded content segments that make up the requesting encoded content. - Turning now to
FIGS. 6A -6C , an illustrative interaction for the processing of content requests will be described. With reference first toFIG. 6A, at (1 ), theoriginal content provider 130 determine a number ofencoder nodes 132 to transmit a set of encoded content segments. Illustratively, theoriginal content provider 130 can be configured to identify the requested content and the manner of how the encoded content will be transmitted. For example, theoriginal content provider 130 can received configuration information that identifies whether a single encoder will be utilized to transmit encoded streams, whether multiple encoders will be utilized to transmit encoded streams, whether multiple encoders will be utilized to transmit redundant encoded streams, and the like. Although two encoders are illustrated inFIG. 6A , one skilled in the relevant art will appreciate that additional or alternative number ofencoders 132 may be utilized. - At (2), the
original content provider 130 causes one or more encoders to generate encoded streams based on synchronization information. As described above, the video packaging andorigination service 120 may provide synchronization information, such as timestamp information or sequence information that allows multiple encoders to transmit at least some portion of the encoded content. In another embodiment, theoriginal content provider 130 can utilize self-providing synchronization, information provided by a third-party service or a combination. Still further, if a single encoder is utilized, synchronization information may not be required to transmit encoded content to the video packaging andorigination service 120. Illustratively, the original content provider 130 (whether through a single or a plurality ofencoding servers 132A and 132B) can provide multiple encoder streams that can correspond to individual content streams corresponding to the different requested encoding profiles. For example, a first content stream can correspond to a first encoding bitrate and format (e.g., a first encoding profile) and a second content stream can correspond to a second encoding bitrate and format that is different. At (3), the content provider transmits the one or more content streams. - The video packaging and
origination service 120 receives the plurality of incoming encoded content streams from the encoders. More specifically, at (4), thecontent management service 126, such as via an ingress microservice, selects an ingress node orcomponent 122 based on attributes of theoriginal content provider 130, the video packaging andorigination service 120 or a combination. Such attributes may include geographic information, network location or traffic information, user configurations, general service levels, resource load information, and the like. For example, the video packaging andorigination service 120 can identify a computing device that will function as theingress component 122 and that is located in a region or availability zone that is determined to be proximate to theoriginal content provider 130. In another example, the video packaging andorigination service 120 can identify a computing device that will function asingress component 122 and that is associated with sufficient processing resources as anticipated to receive and process incoming content segments. In still another example, the video packaging andorigination service 120 can identify a computing device that will function as theingress component 122 based on the correlation of the target computing device to specific types of content, content providers, or requesting entities. - At (5), the content management system instantiates or causes an instantiated
ingress component 122 to receive and process the encoded segments from a first received stream. Illustratively, theingress component 122 of the video packaging andorigination service 120 processes the received encoded segments to generate deterministic data included in a set of meta-data utilized to access and generate outgoing content streams. Illustratively, the deterministic data can include timestamp information related to a time of play of the set of encoded segments, sequence number identifying an order of the encoded content segment in the set of encoded segments, a time of operation of the encoder and the like. The deterministic data will be illustratively utilized to identify a same content segment or matching content segments that have been encoded according to different encoding profiles and received at different ingress components. For example, four content segments sharing a common timestamp of play but encoded according to the different encoding profiles are considered to be the same content segment. Theingress component 122 can also format or translate the incoming content to generate different encoding bitrate and format combinations or packages. In another example, theingress component 122 orcontent management service 126 can conduct quality or error checking that can be included in meta-data. - At (6), the
ingress component 122 stores the encoded data stream. Illustratively, theingress component 122 may store all received encoded content regardless of whether it is duplicative or alternative to what will be used by the video packaging andorigination service 120. As will be described in greater detail below, theingress component 122 can illustratively utilize local storage resources to maintain the received encoded content segments regardless of whether the local storage resources maintain all the received encoded content segments. At (7), theingress component 122 causes the generation or updating of an index identifying the location of the received encoded content. As will be described below, the index will be utilized by aseparate egress component 124 to respond to content requests from requesting entities. Illustratively, the index may be made up of one or more files that include relevant identifiers utilized by the video packaging andorigination service 120 to identify the storage location of the received and processed encoded components. In some embodiments, the index files may be serialized in a manner to facilitate transmission of the index to other computing devices or storage in memory. - With reference now to
FIG.6B , interactions between components of thecontent delivery environment 100 illustrating the processing of streaming content requests from requesting entities will be described. At (1), the user device directly or throughPOP 110 transmits a request for encoded content to the video packaging andorigination service 120. The interaction between the requesting entities and the video packaging andorigination service 120 can include multiple interactions to identify available content and receive request for content. For example, auser device 102 may generate various user interfaces or software applications that facilitate the selection of content that are directed to the video packaging andorigination service 120. As illustrated inFIG. 6B , the content requests fromuser devices 102 may be transmitted via aPOP 110 or alternatively be transmitted directly fromuser devices 102 to the video packaging andorigination service 120. - Illustratively, the video packaging and
origination service 120 receives one or more requests for encoded content streams from requesting entities. To begin processing the content requests, at (2), thecontent management service 126 selects an egress node orcomponent 124 based on attributes of the requesting entity (user 102 or POP 110), the video packaging andorigination service 120 or a combination. Such attributes may include geographic information, network location or traffic information, user configurations, general service levels for delivery of content, technical configuration information, and the like. For example, the video packaging andorigination service 120 can identify a computing device that will function as theegress component 124 and that is located in a region or availability zone that is determined to be proximate to the requesting entity. In another example, the video packaging andorigination service 120 can identify a computing device that will function asegress component 124 and that is associated with a communication latency that meets a service level agreement threshold or that is specified by a user. In still a further example, the video packaging andorigination service 120 can select anegress component 124 that is optimized for the transmitting content streams to a particular requesting entity, such as by custom communication protocol or security requirements. Illustratively, the video packaging andorigination service 120 can utilize the same criteria (or different criteria) as the criteria utilized to identify the ingress component 122 (FIG. 6A ), but the evaluation of the criteria may yield identification of the different computing devices based on consideration of the differences in attributes between acontent source 130 and the requesting entities. - At (3), the content management system instantiates or causes an instantiated
egress component 124 to identify and process the index of the encoded segment requests from a first received stream. Illustratively, theegress component 124 of the video packaging andorigination service 120 processes the received index to identify the storage location of the encoded segments previously processed and stored by theingress components 122. Theegress component 124 can access an index that is available in a known storage location or that is otherwise made available to theegress component 124. - At (4), the
egress component 124 packages the encoded content to generate the content streams based on the identified storage location of the encoded data stream. In this regard, theegress component 124 can dynamically access individual encoded content segments at different storage locations associated withingress components 122. The packing of the encoded content segments for transmission as encoded content streams (e.g., encoded bitrate and format) can occur at the time of request which facilitates the management of individual encoded content segments (e.g., removing one segment for another). At (5), theegress component 124 causes the transmission of the content responsive to the content request. One skilled in the relevant art will appreciate that the transmission of content segments to requesting entities can include a number of interactions and considerate of the specific protocols implemented to stream content. - With reference now to
FIG.6C , the generation of distributed caching resources by the video packaging andorigination service 120 will be described. At (1), thecontent management service 126 selects and generates local cache components based on attributes of the requesting entity (user 102 or POP 110), the video packaging andorigination service 120 or a combination. Such attributes may include geographic information, network information, user configurations, general service levels, storage requirements, and the like. Illustratively, the video packaging andorigination service 120 can maintain a cache component in identified regions or availability zones to facilitate the delivery of content. Additionally, the local cache components may be instantiated by the video packaging andorigination service 120 in a manner that facilitates that management of the cache components. As will be described in greater detail, one or more aspects of individual local cache components can be optimized based on usage and configuration information. - At (2), the video packaging and
origination service 120 configures the individual properties of the cache component based on the received usage and configuration information. In one embodiment, the video packaging andorigination service 120 can allocate different amounts of the cache data storage based on a characterization of the content streams, such as a characterization of quality, popularity, importance, and the like. The usage and configuration information may include information from thecontent provider 130, similar subject matter, user information, and the like. For example, the video packaging andorigination service 120 can identify content that has been characterized as heavily in demand based on historical information indicative request load. In such an example, the video packaging andorigination service 120 can configure one or more local cache components to process the indexes to make the encoded content available for streaming. In another example, theegress component 122 may provide the usage and configuration information to the video packaging andorigination service 120 to facilitate the local caching of content streams, such as content streams predicted to be popular or in which minimum service delivery levels are required. - At (3), the video packaging and
origination service 120 identifies cache content based on usage and configuration information. For example, the video packaging andorigination service 120 can identify content that should be included in the cache data storage based on a characterization of the content streams, such as a characterization of quality, popularity, importance, and the like. As described above, the usage and configuration information may include information from thecontent provider 130, similar subject matter, user information, and the like. For example, the video packaging andorigination service 120 can allocate greater portions of cache content for content associated with a content provider that is characterized as popular to facilitate increase delivery of such content. At (4), the video packaging andorigination service 120 collects the encoded information from the index and causes individual caching stores to be updated. In some embodiments, the video packaging andorigination service 120 can modify traditional caching mechanisms that would either not add content to cache components without first receiving a request or that would otherwise associate a time to live the cached content. - Turning now to
FIG. 7 , a routine 700 utilized by the video packaging andorigination service 120 to receive and process encoder streams will be described.Routine 700 may be illustratively implemented by the video packaging andorigination service 120, including one or more aningress components 122. Illustratively, routine 700 will begin once theoriginal content provider 130 begins transmitting a plurality of encoded content streams to the video packaging andorigination service 120 and incorporating received/accessed synchronization information. As described above, the synchronization information may be utilized by theoriginal content provider 130 and video packaging andorigination service 120 to transmit and receive encoded content from multiple encoders. If a single encoder is utilized by theoriginal content provider 130, the synchronization information may be omitted. In some embodiments, theoriginal content provider 130 may be configured to transmit different content streams corresponding to a common encoded segment or set of segments encoded according to different encoding profiles. In other embodiments, theoriginal content provider 130 can be configured to transmit redundant content streams to the video packaging andorigination service 120. - At
block 702, the video packaging andorigination service 120 obtains content stream data from an original content provider. As described above, the content stream data may be transmitted by theoriginal content provider 130 responsive to a request from auser device 102, a request from the video packaging andorigination service 120, or other request/trigger. Atblock 704, the video packaging andorigination service 120 can optionally transmit synchronization information to theoriginal content provider 130. Illustratively, the synchronization information is utilized bymultiple encoders 132 to allow encoded segments from multiple encoders to be combined seamlessly or substantially seamlessly. For example, the synchronization information can include timestamp information related to a relative timestamp of individual encoded segments in the set of encoded segments. In another example, the synchronization information can include sequence numbers for the individual segments. In another example, the synchronization information can include a time of operation or other time elapsed information. The synchronization information is incorporated into the encoded segments and then utilized by the video packaging andorigination service 120 to assemble the set of ordered segments, remove duplicates and identifying missing encoded segments. In embodiments in which the video packaging andorigination service 120 does not transmit synchronization information, such as if theoriginal content provider 130 or other service provides the synchronization information, block 704 may be omitted. - At
block 706, the content management system instantiates aningress component 122 or causes an instantiatedingress component 122 to receive and process the encoded segments from a first received stream. In selecting theingress component 122, thecontent management service 126, such as via an ingress microservice, selects an ingress node orcomponent 122 based on attributes of theoriginal content provider 130, the video packaging andorigination service 120 or a combination. Such attributes may include geographic information, network location or traffic information, user configurations, general service levels, resource load information, and the like. For example, the video packaging andorigination service 120 can identify a computing device that will function as theingress component 122 and that is located in a region or availability zone that is determined to be proximate to theoriginal content provider 130. In another example, the video packaging andorigination service 120 can identify a computing device that will function asingress component 122 and that is associated with sufficient processing resources as anticipated to receive and process incoming content segments. In still another example, the video packaging andorigination service 120 can identify a computing device that will function as theingress component 122 based on the correlation of the target computing device to specific types of content, content providers, or requesting entities. In a further example, the video packaging andorigination service 120 can utilize financial information, such as pricing plans or an attributed cost per transmission, specified by theoriginal content provider 130 or the requesting entities to select aningress component 122. - Illustratively, the
ingress component 122 of the video packaging andorigination service 120 processes the received encoded segments to generate deterministic data. Illustratively, the deterministic data can include timestamp information related to a time of play of the set of encoded segments, sequence number identifying an order of the encoded content segment in the set of encoded segments, a time of operation of the encoder and the like. The deterministic data will be illustratively utilized to identify a same content segment or matching content segments that have been encoded according to different encoding profiles and received at different ingress components. For example, four content segments sharing a common timestamp of play but encoded according to the different encoding profiles can be considered to be the same content segment. - At
decision block 708, a determination is made as to whether additional encoder segments streams still need to be received. As described above, the video packaging andorigination service 120 performs a determination if encoded segments determined to be matching correspond to all the anticipated encoded profiles. For example, to enable variable bitrate encoding, requesting entities may be offered encoded content segments according to five different encoding profiles. Accordingly, the video packaging andorigination service 120 could determine via the deterministic information whether there are five matching segments covering the five requested encoding profiles. If additional encoded segments remain unreceived or not fully processed, the routine 700 returns to block 702 to receive the additional encoder streams. If not, the routine 700 proceeds to block 710. - At
block 710, theingress component 122 processes the received encoded segments. For example, the video packaging andorigination service 120 can be adjustments or error correction for any of the selected encoded segments. In other embodiment, if the synchronization information does not ensure perfectly compatible encoded segments, the video packaging andorigination service 120 can extrapolate additional segments or portions to facilitate combination. In another embodiment, the processed encoded segments can include the generation or translation of the encoded content to correspond to different encoding profiles, such as different combinations of encoding bitrate and format. - At
block 712, theingress component 122 stores the encoded data stream. Illustratively, theingress component 122 may store all received encoded content regardless of whether it is duplicative or alternative to what will be used by the video packaging andorigination service 120. Atblock 714, theingress component 122 causes the generation or updating of an index identifying the location of the received encoded content. As will be described below, the index will be utilized by aseparate egress component 124 orlocal cache components 129 to respond to content requests from requesting entities. Illustratively, the index may be made up of one or more files that include relevant identifiers utilized by the video packaging andorigination service 120 to identify the storage location of the received and processed encoded components. In some embodiments, the index files may be serialized in a manner to facilitate transmission of the index to other computing devices or storage of the index for access by the additional components of the video packaging andorigination service 120. - In some embodiments, the video packaging and
origination service 120 can continue to update the index on a periodic basis. For example, if one or more encoded segments are determined to have an error, the video packaging andorigination service 120 can receive a different version of the encoded segment from theoriginal content provider 130 or otherwise identify a redundant version of the encoded segment and update the index accordingly. Similarly, if aspecific ingress component 122 may be considered offline or unable to process requests or the storage location associated with stored encoded segments blocks becomes unavailable or beyond capacity to service additional information, the video packaging andorigination service 120 can select additional or redundant versions of the encoded segment that have been processed and update the index accordingly. At block 716, routine 700 terminates or starts a new iteration ofroutine 700. - Turning now to
FIG. 8 , a routine 800 utilized by the video packaging andorigination service 120 to select anegress component 124 and process requests for content will be described. Atblock 802, the video packaging andorigination service 120 receives content requests from a requesting entity. Illustratively, the user device directly or throughCDN 110 transmits a request for encoded content to the video packaging andorigination service 120. The interaction between the requesting entities and the video packaging andorigination service 120 can include multiple interactions to identify available content and receive request for content. For example, auser device 102 may generate various user interfaces or software applications that facilitate the selection of content that are directed to the video packaging andorigination service 120. As illustrated inFIG. 6B , the content requests fromuser devices 102 may be transmitted via aCDN 110 or alternatively be transmitted directly fromuser devices 102 to the video packaging andorigination service 120. - Illustratively, the video packaging and
origination service 120 receives one or more requests for encoded content streams from requesting entities. To begin processing the content requests, atblock 804 thecontent management service 126 selects an egress node orcomponent 124 based on attributes of the requesting entity (user 102 or POP 110), the video packaging andorigination service 120 or a combination. Such attributes may include geographic information, network information, user configurations, general service levels, and the like. For example, the video packaging andorigination service 120 can identify a computing device that will function as theegress component 124 and that is located in a region or availability zone that is determined to be proximate to the requesting entity. In another example, the video packaging andorigination service 120 can identify a computing device that will function asegress component 124 and that is associated with a communication latency that meets a service level agreement threshold or that is specified by a user. In a further example, the video packaging andorigination service 120 can utilize financial information, such as pricing plans or an attributed cost per transmission, specified by the requesting entities ororiginal content provider 130 to select anegress component 122. In such an example, theegress component 124 may be selected based on levels of performance and costs attributed to the performance. Illustratively, the video packaging andorigination service 120 can utilize the same criteria (or different criteria) as the criteria utilized to identify the ingress component 122 (FIG. 6A ), but the evaluation of the criteria may yield identification of the different computing devices based on consideration of the differences in attributes between acontent source 130 and the requesting entities. - At
block 806, the content management system instantiates or causes an instantiatedegress component 124 to identify and process the index of the encoded segment requests from a first received stream. Illustratively, theegress component 124 of the video packaging andorigination service 120 processes the received index to identify the storage location of the encoded segments previously processed and stored by theingress components 122. As described above, in some embodiments, the identification and processing of the index is completed substantially contemporaneously with the processing of the content request. Accordingly, the generation of the encoded content segments package that form the content stream is dynamic and can be adjusted by the video packaging andorigination service 120. As described above, the dynamic packaging of encoded content segments mitigates the need to store all the packages for each egress component locally until requested and for the management of the content segments identified in the index. - At
block 808, theegress component 124 compiles or packages the encoded content to be provided based on the identified storage location of the encoded data stream. As described above, the generation of the packages are illustratively completed substantially in real time and responsive to the request for the content, which facilitates the management of the encoded content. Atblock 810, theegress component 124 causes the transmission of the content responsive to the content request. One skilled in the relevant art will appreciate that the transmission of content segments to requesting entities can include a number of interactions and considerate of the specific protocols implemented to stream content.Routine 800 terminates atblock 812 or initiates a new iteration ofroutine 800. - Turning now to
FIG. 9 , a routine 900 utilized by one or morelocal cache components 129 in the video packaging andorigination service 120 will be described. Atblock 902, the content management service 126 (or other service) selects and generateslocal cache components 129 based on attributes of the requesting entity (user 102 or POP 110), the video packaging andorigination service 120 or a combination. Such attributes may include geographic information, logical network information, user configurations, general service levels, and the like. For example, the video packaging andorigination service 120 may utilize latency measurements for content streams to determine the number oflocal cache components 129 that may be required. - Illustratively, the video packaging and
origination service 120 can maintain acache component 129 in identified regions or availability zones to facilitate the delivery of content. In one embodiment, thelocal cache components 129 can correspond to a one-to-one relationship with a geographic zone or logical network zone. In another embodiment, thelocal cache components 129 can correspond to a one-to-many relationship with multiple geographic zones or logical network zones. Additionally, the local cache components may be instantiated by the video packaging andorigination service 120 in a manner that facilitates that management of the cache components. As will be described in greater detail, one or more aspects of individual local cache components can be optimized based on configuration and usage information. - At
block 904, the video packaging andorigination service 120 obtains usage and configuration information regarding content delivery. The usage and configuration information may include historical information regarding previous requesting entity requests associated with theoriginal content provider 130, similar subject matter or subject matter characterizations, user specified-information, such as request metrics, preferences, ratings, descriptions, and the like. Atblock 906 the video packaging andorigination service 120 configures the individual properties of thecache component 129 based on at least a portion of the usage and configuration information. In one embodiment, the video packaging andorigination service 120 can allocate different amounts of the cache data storage based on a characterization of the content streams, such as a characterization of quality, popularity, importance, and the like. For example, the video packaging andorigination service 120 can identify content that has been characterized as heavily in demand based on historical information indicative request load. In such an example, the video packaging andorigination service 120 can configure a threshold amount of memory of one or morelocal cache components 129 to maintain content associated with the characterization of quality, popularity, importance, etc. In another example, the video packaging andorigination service 120 can adjust timing information associated with cached content, such as a time to live, for content matching the characterization of quality, popularity, important, etc. Illustratively, the usage and configuration information may correspond to individual geographic zones such that multiplelocal cache components 129 may be associated with different usage and configuration information. In other embodiments, the video packaging andorigination service 120 may group different combinations of usage and configuration information to include all geographic zones or sub-combinations of geographic zones. - At
block 908, the video packaging andorigination service 120 identifies cache content based on usage and configuration information. For example, the video packaging andorigination service 120 can identify content that should be included in the cache data storage based on a characterization of the content streams, such as a characterization of quality, popularity, importance, and the like. As described above, the usage and configuration information may include information from thecontent provider 130, similar subject matter, user information, and the like. For example, the video packaging andorigination service 120 can allocate greater portions of cache content for content associated with identifiedoriginal content providers 130 that have been characterized as generating popular content or that have otherwise contractually specified to have content caching. In another example, the video packaging andorigination service 120 can utilize relationships between content streams, such as serial content (e.g., television programming) or movie serials to determine the content streams that will be cached. In still a further example, the video packaging andorigination service 120 can receive inputs from theoriginal content provider 130, theingress components 122, oregress components 124 that include mechanisms for identification of content to be cached. - At
block 910, the video packaging andorigination service 120 collects the encoded information from the index and causes individual caching stores to be updated. In some embodiments, the video packaging andorigination service 120 can modify traditional caching mechanisms that would either not add content to cache components without first receiving a request or that would otherwise associate a time to live the cached content.Routine 900 terminates atblock 912 or starts a new iteration ofroutine 900. - Generally described, content providers can provide content to requesting users. With regard to video content, a content provider can implement a video packaging and origination service that is able to deliver video content to requesting users. Illustratively, a video packaging and origination service indexes a collection of source video content (either live streaming or file-based video-on-demand) and delivers it to clients via a wide range of communication protocols such as HTTP Live Streaming ("HLS"), Dynamic Adaptive Streaming over HTTP ("DASH"), HTTP Dynamic Streaming ("HDS"), Real Time Messaging Protocol ("RTMP"), Smooth Streaming, and the like. Based on consumer demand, a video packaging and origination service can also provide advanced video transmission features such as just-in-time packaging of video content, digital rights management ("DRM") encryption, time-shifting, bitrate selection, catch up TV, and more.
- To deliver content, content providers can organize requested content, such as a video file, into multiple segments that are then transmitted to requesting devices segment by segment. For example, in a video stream, each segment typically accounts for 2-10 seconds of video rendered on a receiving device. To provide content to the video packaging and origination service, individual content segments can be encoded by an encoder and transmitted to the video and origination service. Traditionally, a processing node on the video packaging and origination service can receive an incoming stream of encoded segments and then transmit the stream to requesting user devices. Additionally, each distinct encoded video segment (e.g., combination of bitrate encoding and format) is provided to the video packaging and origination service from a single encoder or encoding node.
- Video segments can be encoded according to a defined bitrate and format, which generally defines the number of bits of data that are encoded over a measured amount of time and the specific software algorithm and resulting content representation format utilized to encode the data for transmission. For video files, bitrates are typically measured according to how many kilobits or megabits of data are processed over a second of time. By way of example, a data file that corresponds to 1 megabyte of video data encoded in one second would be considered to have an encoding bitrate of 8 mbps (e.g., 8 megabits per second) while a lower definition video file that corresponds to 45 kilobytes of video data processed in one second would be considered to have an encoding bitrate of 360 kbps (e.g., 360 kilobits per second).
- To receive content, a client computing device can simply request content having a fixed encoding rate or have a fixed encoding rate selected in response to a streaming content request. Such a fixed encoding rate approach can be deficient in facilitating variance of the encoding bitrate (both positive and negative) based on factors, such as network bandwidth, client computing device utilization, quality demands, and the like. In addition to the association of the encoding bitrate, video segments can be further defined by associating the encoding bitrate with the encoding format utilized by the encoder to generate the output stream. The encoding format can correspond to a content representation format for storage or transmission of video content (such as in a data file or bitstream). Examples of encoding formats include but not limited to the motion pictures expert group ("MPEG) MPEG-2
Part 2, MPEG-4Part 2, H.264 (MPEG-4 Part 10), H.265 high efficiency video coding ("HEVC"), Theora, RealVideo RV40, VP9, and AOMedia Video 1 ("AV1"), and the like. Depending on the complexity of the encoding profiles specifying the bitrate and format, a single encoded may be constrained for more complex encoding profiles. This can limit the ability for content providers to provide different encoding bitrate/format combinations or require utilization of increased computing device resources to provide for individual encoding nodes. - To address at least a portion of the inefficiencies described above with regard to single encoder transmission nodes, aspects of the present application corresponding to a multiencoder node system for transmitting multiple encoder streams. More specifically, aspects of the present application correspond to utilization of synchronization information to allow a video packaging and origination service to receive multiple input streams corresponding to a set of content segments. Each individual stream can be provided by different encoders based on the synchronization information, such as sequence reference numbers or timestamp information. The number of encoders utilized by the content source, such as a content provider, may be based on the complexity of the encoding profile (e.g., encoded bitrate and format), available encoder computing resources, available network bandwidth, financial cost information, processing cost information and the like.
- Using the synchronization information, the video packaging and origination service can generate the set of encoded content by processing the multiple encoder streams and selecting encoded segments from different encoders. The video packaging and origination service can select from duplicate encoding streams based on time received, quality measurements, priority designations, attributable cost, or other selection criteria. Additionally, in the event of a failure of one of the encoders, the video packaging and origination service can request additional encoders to complete the transmission or begin collecting additional encoded segments from other encoders.
-
FIG. 10 illustrates a generalcontent delivery environment 1000 for delivering content from original content providers to user devices. Thecontent delivery environment 100 includes a plurality ofdevices 1002 utilized by individual users, generally referred to as client computing devices, to request streaming or download content from a video packaging andorigination service 1020. Illustratively, the video packaging andorigination service 1020 indexes a collection of source video content (either live streaming or file-based video-on-demand) and delivers it to clients via a wide range of communication protocols such as HTTP Live Streaming ("HLS"), Dynamic Adaptive Streaming over HTTP ("DASH"), HTTP Dynamic Streaming ("HDS"), Real Time Messaging Protocol ("RTMP"), Smooth Streaming, and the like. Based on consumer demand, a video packaging and origination service can also provide advanced video transmission features such as just-in-time packaging of video content, digital rights management ("DRM") encryption, time-shifting, bitrate selection, catch up TV, and more. The content can be illustratively provided by one or more origin sources, such asoriginal content provider 1030. -
Client computing devices 1002 may include any number of different computing devices capable of communicating with thenetworks client computing device 1002 may optionally include one or more data stores (not shown inFIG. 1 ) including various applications or computer-executable instructions, such as web browsers, used to implement the embodiments disclosed herein. Illustrative components of aclient computing device 1002 will be described with regard toFIG. 11 . - In some embodiments, a
CDN service provider 1010 may include multiple edge locations from which a user device can retrieve content.Individual edge location 1012 may be referred to herein as a point of presence ("POP"), where a POP is intended to refer to any collection of related computing devices utilized to implement functionality on behalf of one or many providers. POPs are generally associated with a specific geographic location in which the computing devices implementing the POP are located, or with a region serviced by the POP. As illustrated inFIG 1 , the POP 1010can include one or more metricinformation processing component 1014 for processing metric information provided byclient computing devices 1002 and adata store 1016 for maintain collected metric information. For example, a data center or a collection of computing devices within a data center may form a POP. In some instances, the POPs may implement one or more services, such as CDN services, data storage services, data processing services, etc. TheCDN service provider 1010 may include multiple POPs located in different geographic locations so that user devices can communicate with a nearby a POP to retrieve content, thereby reducing the latency of delivering requested content. -
Networks networks FIG. 1 ,network 1040 is a global area network (GAN), such as the Internet. Protocols and components for communicating via the other aforementioned types of communication networks are well known to those skilled in the art of computer communications and thus, need not be described in more detail herein. While each of theclient computing devices 1002 and video packaging andorigination service 1010 are depicted as having a single connection to thenetwork 1040, individual components of theclient computing devices 1002 and video packaging andorigination service 1010 may be connected to thenetwork 1030 at disparate points. Accordingly, communication times and capabilities may vary between the components ofFIG. 10 . Likewise, althoughFIG. 10 is illustrated as having threeseparate networks origination service 1010 may utilize any number or combination of networks. - In accordance with embodiments, the video packaging and
origination service 1020 includes one or more servers for receiving content fromoriginal content providers 1030 and processing the content to make available a set of received encoded bitrate segments. As described in further detail below, the video packaging andorigination service 1020 includes aningress component 1022 utilized to receive encoded data streams frommultiple encoding servers 1032 fromoriginal content providers 1030. The video packaging andorigination service 1020 can further includesynchronization services 1024 for generating synchronization information utilized by the encoders, such as sequence numbers corresponding to the set of encoded segments, time stamp information related to a relative time of the encoded segments or from which relative time of encoded segments will be based, and the like. The video packaging andorigination service 1020 can further include adata store 1026 for maintaining received encoded data for transmission. - It will be appreciated by those skilled in the art that the video packaging and
origination service 1020 may have fewer or greater components than are illustrated inFIG. 1 . Thus, the depiction of the video packaging andorigination service 1020 inFIG. 1 should be taken as illustrative. For example, in some embodiments, components of the video packaging andorigination service 1020 may be executed by one more virtual machines implemented in a hosted computing environment. A hosted computing environment may include one or more rapidly provisioned and released computing resources, which computing resources may include computing, networking or storage devices. In another example, the video packaging andorigination service 1020 can include one or more egress components that can utilize the content received and processed from theingress component 1022 and further process the content for transmission touser devices 1002. Such egress components may be implemented in conjunction with theingress component 1022, such as in a transcoding node. In other embodiments, the egress components may be implemented and managed independently of theingress components 1022, such as in separate stand-alone computing devices. - With continued reference to
FIG. 10 , thecontent delivery environment 100 also includesoriginal content providers 1030. Illustratively, the original content provider can include a plurality ofencoders 1032 for generating multiple encoded streams for transmission to the video packaging andorigination service 1020. Theoriginal content provider 1030 can also include logic or other management components for determining howmany encoders 1032 should be utilized or how to manage the addition or removal of encoders. In some embodiments, the original content provider theoriginal content provider 1030 can further includesynchronization services 1036 for generating synchronization information utilized by the encoders, such as sequence numbers corresponding to the set of encoded segments, time stamp information related to a relative time of the encoded segments or from which relative time of encoded segments will be based, and the like. The video packaging andorigination service 1020 can further include adata store 1034 for maintaining encoded data for transmission. Thesynchronization services -
FIG. 11 depicts one embodiment of an architecture of an illustrativeuser computing device 1002 that can generate content requests and process metric information in accordance with the present application. The general architecture of theuser computing device 1002 depicted inFIG. 11 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure. As illustrated, the user computing device 104 includes aprocessing unit 1104, a network interface 1106, an input/output device interface 1109, anoptional display 1102, and aninput device 1124, all of which may communicate with one another by way of a communication bus. - The network interface 1106 may provide connectivity to one or more networks or computing systems, such as the
network 1040 ofFIG. 1 and the video packaging andorigination service 1020 or theoriginal content provider 1030. Theprocessing unit 1104 may thus receive information and instructions from other computing systems or services via a network. Theprocessing unit 1104 may also communicate to and frommemory 1110 and further provide output information for anoptional display 1102 via the input/output device interface 1109. The input/output device interface 1109 may also accept input from theoptional input device 1124, such as a keyboard, mouse, digital pen, etc. In some embodiments, theuser computing device 1002 may include more (or fewer) components than those shown inFIG. 11 . - The
memory 1110 may include computer program instructions that theprocessing unit 1104 executes in order to implement one or more embodiments. Thememory 1110 generally includes RAM, ROM, or other persistent or non-transitory memory. Thememory 1110 may store anoperating system 214 that provides computer program instructions for use by theprocessing unit 1104 in the general administration and operation of theuser computing device 1002. Thememory 1110 may further include computer program instructions and other information for implementing aspects of the present disclosure. For example, in one embodiment, thememory 1110 includes anetwork application 1116, such as browser application or media player, for accessing content and communicating with the video packaging andorigination service 1020. -
FIG. 12 depicts one embodiment of an architecture of an illustrative server for encoding content as described herein. The general architecture of theencoder 1032 depicted inFIG. 12 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure. As illustrated, theencoder 1032 includes aprocessing unit 1204, a network interface 1206, a computerreadable medium drive 1208, an input/output device interface 1209, all of which may communicate with one another by way of a communication bus. The components of theencoder 1032 may be physical hardware components or implemented in a virtualized environment. - The network interface 1206 may provide connectivity to one or more networks or computing systems, such as the
network 1050 ornetwork 1060 ofFIG. 10 . Theprocessing unit 1204 may thus receive information and instructions from other computing systems or services via a network. Theprocessing unit 1204 may also communicate to and frommemory 1210 and further provide output information for an optional display via the input/output device interface 1209. In some embodiments, theencoder 1032 may include more (or fewer) components than those shown inFIG. 12 . - The
memory 1210 may include computer program instructions that theprocessing unit 1204 executes in order to implement one or more embodiments. Thememory 1210 generally includes RAM, ROM, or other persistent or non-transitory memory. Thememory 1210 may store anoperating system 1214 that provides computer program instructions for use by theprocessing unit 1204 in the general administration and operation of the video packaging andorigination service 1020. Thememory 1210 may further include computer program instructions and other information for implementing aspects of the present disclosure. For example, in one embodiment, thememory 1210 includes interface software 1212 for receiving and processing content requests from theencoder 1032. As will be described in detail below, the resulting information can include a dynamically configured bundle to encoding bitrates. Additionally, thememory 1210 includes anencoder component 1216 for processing content segments. Additionally, theencoder component 1216 can further include asynchronization parameter component 1218 for utilizing the synchronization information in the encoding process to increase the likelihood that encoded segments from multiple encoders can be utilized by a video packaging andorigination service 1020. -
FIG. 13 depicts one embodiment of an architecture of an illustrative server for functioning as aningress component 1022 as described herein. The general architecture of theingress component 1022 depicted inFIG. 13 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure. As illustrated, theingress component 1022 includes aprocessing unit 1304, anetwork interface 1306, a computerreadable medium drive 1308, an input/output device interface 409, all of which may communicate with one another by way of a communication bus. The components of theingress component 1022 may be physical hardware components or implemented in a virtualized environment. - The
network interface 1306 may provide connectivity to one or more networks or computing systems, such as thenetwork 1050 ornetwork 1060 ofFIG. 10 . Theprocessing unit 1304 may thus receive information and instructions from other computing systems or services via a network. Theprocessing unit 1304 may also communicate to and frommemory 1310 and further provide output information for an optional display via the input/output device interface 409. In some embodiments, theingress component 1022 may include more (or fewer) components than those shown inFIG. 13 . - The
memory 1310 may include computer program instructions that theprocessing unit 1304 executes in order to implement one or more embodiments. Thememory 1310 generally includes RAM, ROM, or other persistent or non-transitory memory. Thememory 1310 may store anoperating system 1314 that provides computer program instructions for use by theprocessing unit 1304 in the general administration and operation of the ingress node. Thememory 1310 may further include computer program instructions and other information for implementing aspects of the present disclosure. For example, in one embodiment, thememory 1310 includes interface software 1312 for receiving and processing content requests from theingress component 1022. As will be described in detail below, the resulting information can include a dynamically configured bundle to encoding bitrates. Additionally, thememory 1310 includes an encoder processing application 1316 for processing incoming encoded content segments. Additionally, theingress component 1022 can further include asynchronization parameter component 1318 for utilizing the synchronization information in the encoding process to increase the likelihood that encoded segments from multiple encoders can be utilized by theingress component 1022. - At (1), the video packaging and
origination service 1020 can transmit synchronization information to theoriginal content provider 1030. Illustratively, the synchronization information is utilized bymultiple encoders 1032 to allow encoded segments from multiple encoders to be combined seamlessly or substantially seamlessly. For example, the synchronization information can include timestamp information related to a relative timestamp of individual encoded segments in the set of encoded segments. In another example, the synchronization information can include sequence numbers for the individual segments. In another example, the synchronization information can include a time of operation or other time elapsed information. The synchronization information is incorporated into the encoded segments and then utilized by the video packaging andorigination service 1020 to assemble the set of ordered segments, remove duplicates and identifying missing encoded segments. AlthoughFIG. 14A illustrates the transmission of the synchronization information from the video packaging andorigination service 1020, in some embodiments, synchronization information may not be transmitted by the video packaging andorigination service 1020 and this interaction would be omitted altogether. - At (2), the receiving
original content provider 1030 determines the number of encoders that will be utilized to generate the requested encoded content streams. Illustratively, the determination the number of encoders will generally corresponding to a plurality of encoders that generate encoded content streams for identified requested content and incorporating synchronization information. In one embodiment, the determination of the number of encoders can be based on the complexity of the encoded bitrate and formation combination, available encoder resources, an attributable cost associated with the generated encoded content segments, preferences or service levels associated with the video packaging andorigination service 1020, network conditions (e.g., available bandwidth, network throughput, error rates), demand from users devices (e.g., total number of requests or frequencies of requests), and the like. - Illustratively, the content stream data may be transmitted by the
original content provider 1030 responsive to a request from auser device 1002, a request from the video packaging andorigination service 1020, or other request/trigger. Illustratively, the encoded content can correspond to a set of encoded profiles corresponding to the encoding bitrate and format combinations that may be made available to users. For example, the video packaging andorigination service 1020 may provide a requestinguser device 1002 with a set of encoding bitrate and format combinations in order to support adaptive bitrate streaming. Accordingly, the request from the original content provider may transmit the set of identified encoding bitrates and formats or individual encoding bitrate and format combinations to supplement previously receive encoded segments. One skilled in the relevant art will appreciate that the transmission of the request or the identification of requested encoded segments (including format) can be facilitated in a number of ways. - At (3), the original content provider causes the selected number of encoders to generate encoded streams based on synchronization information. As described above, the video packaging and
origination service 1020 may provide the synchronization information. In another embodiment, theoriginal content provider 1030 can utilize self-providing synchronization, information provided by a third-party service or a combination. At (4), the original content provider begins transmitting a plurality of encoded content streams to the video packaging andorigination service 1020 and incorporating received/accessed synchronization information. In some embodiments, theencoders 1032B and 1032A are configured to transmit non-overlapping segments in which the encoding task for the set of segments it distributed among encoders. In other embodiments, the encoders are configured to at least partially transmit overlapping or redundant encoded segments. - The video packaging and
origination service 1020 receives the plurality of incoming encoded content streams from the encoders. At (5), the video packaging andorigination service 1020 selects encoded segments from the received streams. Illustratively, if the encoded content streams are non-overlapping, the video packaging andorigination service 1020 does not have to check for redundancies or other selection criteria (e.g., time received or reputation of encoders). If the encoded content streams may have overlapping segments, the video packaging andorigination service 1020 checks for redundancies or other utilizes selection criteria to determine which of the redundant encoded content segments will be utilized. - At (6), the video packaging and
origination service 1020 processes the received encoded segments. For example, the video packaging andorigination service 1020 can be adjustments or error correction for any of the selected encoded segments. In other embodiment, if the synchronization information does not ensure perfectly compatible encoded segments, the video packaging andorigination service 1020 can extrapolate additional segments or portions to facilitate combination. Still further, in some embodiments, theingress component 1022 of the video packaging andorigination service 1020 generates deterministic data included in a set of meta-data utilized to access and generate outgoing content streams. Illustratively, the deterministic data can include timestamp information related to a time of play of the set of encoded segments, sequence number identifying an order of the encoded content segment in the set of encoded segments, a time of operation of the encoder and the like. In another example, theingress component 1022 orcontent management service 1026 can conduct quality or error checking that can be included in meta-data. At (7) the video packaging andorigination service 1020 stores the cumulative set of encoded segments for delivery touser devices 1002 along with any meta-data generated as part of the processing. - Turning now to
FIG. 14B , a fail over scenario will be described. The interactions illustrated inFIG. 14B are based interaction after the initial transmission of multiple encoded segment transmission has begun. At (1), theoriginal content provider 1030 experiences an encoder failure, generally illustrated as a failure to encodedcomponent 1032A. At (2), the original content provider continues transmitting a plurality of encoded content streams to the video packaging andorigination service 1020 and incorporating received/accessed synchronization information. In some embodiments, if theencoders 1032B and 1032A were previously configured to transmit non-overlapping segments in which the encoding task for the set of segments it distributed among encoders, the original content provider (via request or a priori) will be required to update the configuration of the remainingencoders 1032 or to otherwise cause the initiation of additional encoders. In other embodiments, the encoders may be configured will at least partially overlapping encoded segments. In this embodiment, the original content provider may not choose to make any changes to the configurations. - At (3), the video packaging and
origination service 1020 receives the adjusted encoder node streams and processing the determine failover. Illustratively, theingress component 1022 may have specific rules regarding failover, such as switching to a default encoder node or set of nodes. In other embodiments, the video packaging andorigination service 1020 can request additional or alternative encoder nodes. Additionally, the video packaging andorigination service 1020 can scan for already received encoded nodes received from the encoder prior to failure and ensure that no additional errors were introduced prior to the determined failure. - Turning now to
FIG. 6 , a routine 1500 utilized by the video packaging andorigination service 1020 to receive and process multiple encoder streams will be described.Routine 1500 may be illustratively implemented by aningress component 1022. - At
block 1502, the video packaging andorigination service 1020 can optionally transmit synchronization information to theoriginal content provider 1030. Illustratively, the synchronization information is utilized bymultiple encoders 1032 to allow encoded segments from multiple encoders to be combined seamlessly or substantially seamlessly. For example, the synchronization information can include timestamp information related to a relative timestamp of individual encoded segments in the set of encoded segments. In another example, the synchronization information can include sequence numbers for the individual segments. In another example, the synchronization information can include a time of operation or other time elapsed information. The synchronization information is incorporated into the encoded segments and then utilized by the video packaging andorigination service 1020 to assemble the set of ordered segments, remove duplicates and identifying missing encoded segments. In embodiments in which the video packaging andorigination service 1020 does not transmit synchronization information, such as if theoriginal content provider 1030 or other service provides the synchronization information, block 1502 may be omitted. - Responsive to a request or trigger, as described above, the
original content provider 1030 begins transmitting a plurality of encoded content streams to the video packaging andorigination service 1020 and incorporating received/accessed synchronization information atblock 1504. In some embodiments, theencoders 1032B and 1032A may be configured to transmit non-overlapping segments in which the encoding task for the set of segments it distributed among encoders. In other embodiments, the encoders may be configured will at least partially overlapping encoded segments. Atblock 1504, the video packaging andorigination service 1020 receives the plurality of incoming encoded content streams from the encoders. Atdecision block 606, a determination is made as to whether additional encoder segments streams are received. If so, the routine 1500 returns to block 1504 to receive the additional encoder streams. If not, the routine 1500 proceeds to block 1508. - At
block 1508, the video packaging andorigination service 1020 processes the received encoded segments. For example, the video packaging andorigination service 1020 can be adjustments or error correction for any of the selected encoded segments. In other embodiment, if the synchronization information does not ensure perfectly compatible encoded segments, the video packaging andorigination service 1020 can extrapolate additional segments or portions to facilitate combination. Still further, in some embodiments, theingress component 1022 of the video packaging andorigination service 1020 generates deterministic data included in a set of meta-data utilized to access and generate outgoing content streams. Illustratively, the deterministic data can include timestamp information related to a time of play of the set of encoded segments, sequence number identifying an order of the encoded content segment in the set of encoded segments, a time of operation of the encoder and the like. In another example, theingress component 1022 orcontent management service 1026 can conduct quality or error checking that can be included in meta-data. Atblock 1510, the video packaging andorigination service 1020 stores the cumulative set of encoded segments for delivery touser devices 1002. As described above, the video packaging andorigination service 1020 can also associate or store meta-data associated with the segments.Routine 1500 terminates atblock 1512 or starts a new iteration of routine 1500. - Turning now to
FIG. 16 , a routine 1600 utilized by to generate multiple encoder streams will be described.Routine 1600 may be illustratively implemented bymultiple encoder components 1032. Atblock 1602, the encoder component 1032 (directly or indirectly) determines that an encoded content should be provided. Illustratively, the encoded content can correspond to a set of encoded profiles corresponding to the encoding bitrate and format combinations that may be made available to users. For example, the video packaging andorigination service 1020 may provide a set of encoding bitrate and format combinations in order to support adaptive bitrate streaming. Accordingly, the content that will be delivered to the video packaging andorigination service 1020 may correspond to the set of identified encoding bitrates and formats or individual encoding bitrate and format combinations to supplement previously receive encoded segments. One skilled in the relevant art will appreciate that the transmission of the request or the identification of requested encoded segments (including format) can be facilitated in a number of ways. - At (2), the encoder can receive synchronization information or generate synchronization information. As described above, the synchronization information is utilized by
multiple encoders 1032 to allow encoded segments from multiple encoders to be combined seamlessly or substantially seamlessly. For example, the synchronization information can include timestamp information related to a relative timestamp of individual encoded segments in the set of encoded segments. In another example, the synchronization information can include sequence numbers for the individual segments. In another example, the synchronization information can include a time of operation or other time elapsed information. The synchronization information is incorporated into the encoded segments and then utilized by the video packaging andorigination service 1020 to assemble the set of ordered segments, remove duplicates and identifying missing encoded segments. - At
block 1606, the receivingoriginal content provider 1030 determines the number of encoders that will be utilized to generate the requested encoded content streams. Illustratively, the determination the number of encoders will generally corresponding to a plurality of encoders that generate encoded content streams for identified requested content and incorporating synchronization information. In one embodiment, the determination of the number of encoders can be based on the complexity of the encoded bitrate and formation combination, available encoder resources, an attributable cost associated with the generated encoded content segments, preferences or service levels associated with the video packaging andorigination service 1020, network conditions (e.g., available bandwidth, network throughput, error rates), demand from users devices (e.g., total number of requests or frequencies of requests), and the like. - At
block 1608, the original content provider causes the selected number of encoders to generate encoded streams based on synchronization information. As described above, the video packaging andorigination service 1020 may provide the synchronization information. In another embodiment, theoriginal content provider 1030 can utilize self-providing synchronization, information provided by a third-party service or a combination. Atblock 1610, the original content provider begins transmitting a plurality of encoded content streams to the video packaging andorigination service 1020 and incorporating received/accessed synchronization information. In some embodiments, theencoders 1032B and 1032A may be configured to transmit non-overlapping segments in which the encoding task for the set of segments it distributed among encoders. In other embodiments, the encoders may be configured will at least partially overlapping encoded segments.Routine 700 terminates atblock 712 or starts a new iteration ofroutine 700. - Generally described, content providers can provide content to requesting users. With regard to video content, a content provider can implement a video packaging and origination service that is able to deliver video content to requesting users. Illustratively, a video packaging and origination service indexes a collection of source video content (either live streaming or file-based video-on-demand) and delivers it to clients via a wide range of communication protocols such as HTTP Live Streaming ("HLS"), Dynamic Adaptive Streaming over HTTP ("DASH"), HTTP Dynamic Streaming ("HDS"), Real Time Messaging Protocol ("RTMP"), Smooth Streaming, and the like. Based on consumer demand, a video packaging and origination service can also provide advanced video transmission features such as just-in-time packaging of video content, digital rights management ("DRM") encryption, time-shifting, bitrate selection, catch up TV, and more.
- To deliver content, content providers can organize requested content, such as a video file, into multiple segments that are then transmitted to requesting devices segment by segment. For example, in a video stream, each segment typically accounts for 2-10 seconds of video rendered on a receiving device. To provide content to the video packaging and origination service, individual content segments can be encoded by an encoder and transmitted to the video and origination service. Traditionally, a single processing node on the video packaging and origination service can receive an incoming stream of encoded segments and then transmit the stream to requesting user devices.
- Video segments can be encoded according to a defined bitrate and format, which generally defines the number of bits of data that are encoded over a measured amount of time and the specific software algorithm and resulting content representation format utilized to encode the data for transmission. For video files, bitrates are typically measured according to how many kilobits or megabits of data are processed over a second of time. By way of example, a data file that corresponds to 1 megabyte of video data encoded in one second would be considered to have an encoding bitrate of 8 mbps (e.g., 8 megabits per second) while a lower definition video file that corresponds to 45 kilobytes of video data processed in one second would be considered to have an encoding bitrate of 360 kbps (e.g., 360 kilobits per second).
- In some embodiments, it may be possible for the content provider to facilitate variable bit rate encoding to enable for variances in the encoding bitrates of individual segments of a video file. In such embodiments, the content provider can generate multiple encoded bitrate versions or combinations of encoded bitrates and formats of individual video file segments. The content provider can then make at least a subset of the multiple bitrate encoded versions available to clients responsive to a request for a particular encoded bitrate version and format. Generally, a content provider can generate a catalog identifying the video segments and encoded bitrates for each identified video segment. The catalog can be written into a manifest file that is provided to individual client computing devices that have requested the video file. Thereafter, once all the versions of an encoded segment are received by the packaging and origination service, the packaging and origination service is available to receive and process requests for encoded content. More specifically, client computing devices, through a respective software application, can request individual video segments according to the available encoded bitrates and formats as published in the manifest file.
- To receive content, a client computing device can simply request content having a fixed encoding rate or have a fixed encoding rate selected in response to a streaming content request. Such a fixed encoding rate approach can be deficient in facilitating variance of the encoding bitrate (both positive and negative) based on factors, such as network bandwidth, client computing device utilization, quality demands, and the like. In addition to the association of the encoding bitrate, video segments can be further defined by associating the encoding bitrate with the encoding format utilized by the encoder to generate the output stream. The encoding format can correspond to a content representation format for storage or transmission of video content (such as in a data file or bitstream). Examples of encoding formats include but not limited to the motion pictures expert group ("MPEG) MPEG-2
Part 2, MPEG-4Part 2, H.264 (MPEG-4 Part 10), H.265 high efficiency video coding ("HEVC"), Theora, RealVideo RV40, VP9, and AOMedia Video 1 ("AV1"), and the like. - Traditionally, video packaging and origination services can maintain a single ingress node to receive individual content streams or channels corresponding to encoded segments encoded to a specific encoding profile (e.g., encoding bitrate and format). A single ingress node can utilize state information that facilitates determination that all encoding versions of the same encoded segment have been received. However, the throughput of incoming data streams is limited by characteristics of the single ingress node. For example, an ingress node may experience latencies associated with processing more complex encoded content. In such situation, a video packaging and origination service could experience additional inefficiencies by limiting the ability of the video packaging and origination service to process additional encoding channels related to other encoding profiles until the current encoded data is processed.
- To address at least a portion of the inefficiencies described above with regard to single ingress nodes, aspects of the present application corresponding to a multi-ingress node system for receiving and processing encoder streams. More specifically, aspects of the present application correspond to utilization of synchronization information to allow a video packaging and origination service to utilize a plurality of ingress nodes that an independently process encoded content segments. Individual content streams can correspond to encoding of a common or same content segment according to a different encoding profile, such as a different combination of encoding bitrate and format. For example, in embodiments supporting variable bit rate encoding, a content provider may be requested to provide different encoded versions of each content segment based on the content profiles (e.g., encoding bitrate and format combination) identified in a content manifest.
- Using the synchronization information, individual ingress nodes within the video packaging and origination service process the received encoded segments and generate deterministic data identifying the received encoded segment. Illustratively, the deterministic data can include encoder timestamps, segment sequence numbers, and timing information regarding operation of the encoder. The deterministic data allows the identification of a common encoded segment amongst all the received encoded segments and be stored as meta-data. As individual ingress nodes process incoming data, the video packaging and origination service can utilize the deterministic data/meta-data to identify all common encoded segments and determine whether all the requested encoded versions (e.g., by encoding profile) have been processed. If so, the particular encoded segment is ready for storage or transmission to user devices.
- By allowing the utilization of a plurality of ingress nodes, aspects of the present application facilitate parallel process of different incoming content streams without requiring the need for sharing of state data by the plurality of ingress nodes. Each incoming content stream corresponding to a different encoding profile can be processed by a different or the same ingress nodes without a need to determine where a different version of the same content stream has been previously processed. Additionally, in situations in which a particular ingress node experiences some latency, additional content streams can be processed in concurrently to facilitate faster availability of streaming content to users.
-
FIG. 17 illustrates a generalcontent delivery environment 1700 for delivering content from original content providers to user devices. Thecontent delivery environment 1700 includes a plurality ofdevices 1702 utilized by individual users, generally referred to as client computing devices, to request streaming or download content from a video packaging andorigination service 1720. Illustratively, the video packaging andorigination service 1720 indexes a collection of source video content (either live streaming or file-based video-on-demand) and delivers it to clients via a wide range of communication protocols such as HTTP Live Streaming ("HLS"), Dynamic Adaptive Streaming over HTTP ("DASH"), HTTP Dynamic Streaming ("HDS"), Real Time Messaging Protocol ("RTMP"), Smooth Streaming, and the like. Based on consumer demand, a video packaging and origination service can also provide advanced video transmission features such as just-in-time packaging of video content, digital rights management ("DRM") encryption, time-shifting, bitrate selection, catch up TV, and more. The content can be illustratively provided by one or more origin sources, such asoriginal content provider 1730. -
Client computing devices 1702 may include any number of different computing devices capable of communicating with thenetworks client computing device 1702 may optionally include one or more data stores (not shown inFIG. 17 ) including various applications or computer-executable instructions, such as web browsers, used to implement the embodiments disclosed herein. Illustrative components of aclient computing device 1702 will be described with regard toFIG. 18 . - In some embodiments, a CDN service provider may include multiple edge locations from which a user device can retrieve content.
Individual edge location 1712 may be referred to herein as a point of presence ("POP"), where a POP is intended to refer to any collection of related computing devices utilized to implement functionality on behalf of one or many providers. POPs are generally associated with a specific geographic location in which the computing devices implementing the POP are located, or with a region serviced by the POP. As illustrated inFIG 1 , thePOP 1710 can include one or more metricinformation processing component 114 for processing metric information provided byclient computing devices 1702 and adata store 1716 for maintain collected metric information. For example, a data center or a collection of computing devices within a data center may form a POP. In some instances, the POPs may implement one or more services, such as CDN services, data storage services, data processing services, etc. TheCDN service provider 1710 may include multiple POPs located in different geographic locations so that user devices can communicate with a nearby a POP to retrieve content, thereby reducing the latency of delivering requested content. -
Networks networks FIG. 17 ,network 1740 is a global area network (GAN), such as the Internet. Protocols and components for communicating via the other aforementioned types of communication networks are well known to those skilled in the art of computer communications and thus, need not be described in more detail herein. While each of theclient computing devices 1702 and video packaging andorigination service 1710 are depicted as having a single connection to thenetwork 1740, individual components of theclient computing devices 1702 and video packaging andorigination service 1710 may be connected to thenetwork 1730 at disparate points. Accordingly, communication times and capabilities may vary between the components ofFIG. 17 . Likewise, althoughFIG. 17 is illustrated as having threeseparate networks origination service 1710 may utilize any number or combination of networks. - In accordance with embodiments, the video packaging and
origination service 1720 includes one or more servers for receiving content fromoriginal content providers 1730 and processing the content to make available a set of received encoded bitrate segments. As described in further detail below, the video packaging andorigination service 1720 includes a plurality ofingress components 1722 utilized to receive encoded data streams fromencoders encoding servers 1732 from theoriginal content providers 1730. As will be explain in greater detail below, the ingress components can generate deterministic data that will facilitate a determination of when a complete set of encoded version of a content segment has been received and is ready for further processing or transmission. - The video packaging and
origination service 1720 can further includesynchronization services 1724 for generating synchronization information utilized by the encoders, such as sequence numbers corresponding to the set of encoded segments, time stamp information related to a relative time of the encoded segments or from which relative time of encoded segments will be based, and the like. As described above, the synchronization information can be utilized in the generation of deterministic data for purposes of determining when a content request has been fully completed. The video packaging andorigination service 1720 can further include adata store 1726 for maintaining received encoded data for transmission. - It will be appreciated by those skilled in the art that the video packaging and
origination service 1720 may have fewer or greater components than are illustrated inFIG. 17 . Thus, the depiction of the video packaging andorigination service 1720 inFIG. 17 should be taken as illustrative. For example, in some embodiments, components of the video packaging andorigination service 1720 may be executed by one more virtual machines implemented in a hosted computing environment. A hosted computing environment may include one or more rapidly provisioned and released computing resources, which computing resources may include computing, networking or storage devices. In another example, the video packaging andorigination service 1720 can include one or more egress components that can utilize the content received and processed from theingress component 1722 and further process the content for transmission touser devices 1702. Such egress components may be implemented in conjunction with theingress component 1722, such as in a transcoding node. In other embodiments, the egress components may be implemented and managed independently of theingress components 1722, such as in separate stand-alone computing devices. - With continued reference to
FIG. 17 , thecontent delivery environment 1700 also includesoriginal content providers 1730. Illustratively, the original content provider can include a plurality ofencoders 1732 for generating multiple encoded streams for transmission to the video packaging andorigination service 1720. In one embodiment, individual encoders may generate different encode versions of a content segment according to a different encoding profile. Theoriginal content provider 1730 can also include logic or other management components for determining howmany encoders 1732 should be utilized or how to manage the addition or removal of encoders. In some embodiments, the original content provider theoriginal content provider 1730 can further includesynchronization services 136 for generating synchronization information utilized by the encoders, such as sequence numbers corresponding to the set of encoded segments, time stamp information related to a relative time of the encoded segments or from which relative time of encoded segments will be based, and the like. The video packaging andorigination service 1720 can further include adata store 1734 for maintaining encoded data for transmission. Thesynchronization services -
FIG. 18 depicts one embodiment of an architecture of an illustrativeuser computing device 1702 that can generate content requests and process metric information in accordance with the present application. The general architecture of theuser computing device 1702 depicted inFIG. 18 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure. As illustrated, the user computing device 104 includes aprocessing unit 1804, a network interface 1806, an input/output device interface 1809, anoptional display 202, and aninput device 224, all of which may communicate with one another by way of a communication bus. - The network interface 1806 may provide connectivity to one or more networks or computing systems, such as the
network 1740 ofFIG. 17 and the video packaging andorigination service 1720 or theoriginal content providers 1730. Theprocessing unit 1804 may thus receive information and instructions from other computing systems or services via a network. Theprocessing unit 1804 may also communicate to and frommemory 1810 and further provide output information for anoptional display 202 via the input/output device interface 1809. The input/output device interface 1809 may also accept input from theoptional input device 224, such as a keyboard, mouse, digital pen, etc. In some embodiments, theuser computing device 1702 may include more (or fewer) components than those shown inFIG. 18 . - The
memory 1810 may include computer program instructions that theprocessing unit 1804 executes in order to implement one or more embodiments. Thememory 1810 generally includes RAM, ROM, or other persistent or non-transitory memory. Thememory 1810 may store anoperating system 1812 that provides computer program instructions for use by theprocessing unit 1804 in the general administration and operation of theuser computing device 1702. Thememory 1810 may further include computer program instructions and other information for implementing aspects of the present disclosure. For example, in one embodiment, thememory 1810 includes anetwork application 1816, such as browser application or media player, for accessing content and communicating with the video packaging andorigination service 1720. -
FIG. 19 depicts one embodiment of an architecture of an illustrative server for encoding content as described herein. The general architecture of theencoder 1732 depicted inFIG. 19 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure. As illustrated, theencoder 1732 includes aprocessing unit 1904, anetwork interface 1906, a computerreadable medium drive 1908, an input/output device interface 1909, all of which may communicate with one another by way of a communication bus. The components of theencoder 1732 may be physical hardware components or implemented in a virtualized environment. - The
network interface 1906 may provide connectivity to one or more networks or computing systems, such as thenetwork 1750 ornetwork 1760 ofFIG. 17 . Theprocessing unit 1904 may thus receive information and instructions from other computing systems or services via a network. Theprocessing unit 1904 may also communicate to and frommemory 1910 and further provide output information for an optional display via the input/output device interface 1909. In some embodiments, theencoder 1732 may include more (or fewer) components than those shown inFIG. 19 . - The
memory 1910 may include computer program instructions that theprocessing unit 1904 executes in order to implement one or more embodiments. Thememory 1910 generally includes RAM, ROM, or other persistent or non-transitory memory. Thememory 1910 may store anoperating system 1914 that provides computer program instructions for use by theprocessing unit 1904 in the general administration and operation of the video packaging andorigination service 1720. Thememory 1910 may further include computer program instructions and other information for implementing aspects of the present disclosure. For example, in one embodiment, thememory 1910 includes interface software 1912 for receiving and processing content requests from the video packaging andorigination services 1702. - Additionally, the
memory 1910 includes anencoder component 1916 for processing content segments. Additionally, theencoder component 1916 can further include asynchronization parameter component 1918 for utilizing the synchronization information in the encoding process to increase the likelihood that encoded segments from multiple encoders can be utilized by a video packaging andorigination service 1720. The synchronization information can be utilized in the generation of deterministic data as will be described below. -
FIG. 20 depicts one embodiment of an architecture of an illustrative server for functioning as aningress component 1722 as described herein. As described above, the video packaging andorigination service 1720 includes multiple ingress components 1722 (or nodes) that facilitate intake of encoded segments that have been encoded according to different encoding profiles. The general architecture of theingress component 1722 depicted inFIG. 20 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure. As illustrated, theingress component 1722 includes aprocessing unit 2004, anetwork interface 2006, a computerreadable medium drive 2008, an input/output device interface 2009, all of which may communicate with one another by way of a communication bus. The components of theingress component 1722 may be physical hardware components or implemented in a virtualized environment. - The
network interface 2006 may provide connectivity to one or more networks or computing systems, such as thenetwork 1750 ornetwork 1760 ofFIG. 17 . Theprocessing unit 2004 may thus receive information and instructions from other computing systems or services via a network. Theprocessing unit 2004 may also communicate to and frommemory 2010 and further provide output information for an optional display via the input/output device interface 2009. In some embodiments, theingress component 1722 may include more (or fewer) components than those shown inFIG. 20 . - The
memory 2010 may include computer program instructions that theprocessing unit 2004 executes in order to implement one or more embodiments. Thememory 2010 generally includes RAM, ROM, or other persistent or non-transitory memory. Thememory 2010 may store anoperating system 2014 that provides computer program instructions for use by theprocessing unit 2004 in the general administration and operation of the ingress node. Thememory 2010 may further include computer program instructions and other information for implementing aspects of the present disclosure. For example, in one embodiment, thememory 2010 includes interface software 2012 for receiving and processing content fromencoders 1732. Additionally, thememory 2010 includes anencoder processing application 416 for processing incoming encoded content segments. Additionally, theingress component 1722 can further include asynchronization parameter component 2018 for utilizing the synchronization information to generate the deterministic information as described above. - Turning now to FIGS. 5A and 5B, an illustrative interaction for the processing of content requests will be described. [0039] At (1), the video packaging and
origination service 1720 can transmit synchronization information to theoriginal content provider 1730. Illustratively, the synchronization information is utilized bymultiple encoders 1732 to allow encoded segments from multiple encoders to be combined seamlessly or substantially seamlessly. For example, the synchronization information can include timestamp information related to a relative timestamp of individual encoded segments in the set of encoded segments. In another example, the synchronization information can include sequence numbers for the individual segments. In another example, the synchronization information can include a time of operation or other time elapsed information. The synchronization information is incorporated into the encoded segments and then utilized by the video packaging andorigination service 1720 to assemble the set of ordered segments, remove duplicates and identifying missing encoded segments. AlthoughFIG. 21A illustrates the transmission of the synchronization information from the video packaging andorigination service 1720, in some embodiments, synchronization information may not be transmitted by the video packaging andorigination service 1720 and this interaction would be omitted altogether. - Illustratively, the content stream data may be transmitted by the
original content provider 1730 responsive to a request from auser device 1702, a request from the video packaging andorigination service 1720, or other request/trigger. Illustratively, the encoded content can correspond to a set of encoded profiles corresponding to the encoding bitrate and format combinations that may be made available to users. For example, the video packaging andorigination service 1720 may provide a requestinguser device 1702 with a set of encoding bitrate and format combinations in order to support adaptive bitrate streaming. Accordingly, the request from the original content provider may transmit the set of identified encoding bitrates and formats or individual encoding bitrate and format combinations to supplement previously receive encoded segments. One skilled in the relevant art will appreciate that the transmission of the request or the identification of requested encoded segments (including format) can be facilitated in a number of ways. - At (2), the receiving
original content provider 1730 determines the number of encoders that will be utilized to generate the requested encoded content streams. Illustratively, the determination the number of encoders will generally corresponding to a plurality of encoders that generate encoded content streams for identified requested content and incorporating synchronization information. In one embodiment, the determination of the number of encoders can be based on the complexity of the encoded bitrate and formation combination, available encoder resources, an attributable cost associated with the generated encoded content segments, preferences or service levels associated with the video packaging andorigination service 1720, network conditions (e.g., available bandwidth, network throughput, error rates), demand from users devices (e.g., total number of requests or frequencies of requests), and the like. At (3), theoriginal content provider 1730 causes one or more encoders to generate encoded streams based on synchronization information. As described above, the video packaging andorigination service 1720 may provide the synchronization information. In another embodiment, theoriginal content provider 1730 can utilize self-providing synchronization, information provided by a third-party service or a combination. Illustratively, the original content provider can provide multiple encoder streams that can correspond to individual content streams corresponding to the different requested encoding profiles. For example, a first content stream can correspond to a first encoding bitrate and format (e.g., a first encoding profile) and a second content stream can correspond to a second encoding bitrate and format that is different. The encoding streams may be provided by different encoders as illustrated inFIG. 21A asencoder components 17321032A and 1732B. - The video packaging and
origination service 1720 receives the plurality of incoming encoded content streams from the encoders. More specifically, at (4), a first ingress component is determined. By way of example, , a first ingress component, such asingress component 1722A, of the video packaging andorigination service 1720 receives and processes the encoded segments from a first received stream. Such aningress component 1722 may be selected by various factors, such as geographic proximity to the original content provider, available processing resources, types or characterizations of the streaming content, original content provider specifications, video packaging and origination service specifications, and the like. - At (5), the
ingress component 1722A of the video packaging andorigination service 1720 processes the received encoded segments to generate deterministic data. Illustratively, the deterministic data can include timestamp information related to a time of play of the set of encoded segments, sequence number identifying an order of the encoded content segment in the set of encoded segments, a time of operation of the encoder and the like. The deterministic data will be illustratively utilized to identify a same content segment or matching content segments that have been encoded according to different encoding profiles and received at different ingress components. For example, four content segments sharing a common timestamp of play but encoded according to the different encoding profiles can be considered to be the same content segment. Still further, in some embodiments, theingress component 1722A generates the deterministic data as a set of meta-data utilized to access and generate outgoing content streams. In another example, theingress component 1722A can conduct quality or error checking that can be included in meta-data. - At (6) the video packaging and
origination service 1720 performs a determination if encoded segments determined to be matching correspond to all the requested encoded profiles. For example, to enable variable bitrate encoding, the content request may request encoded content segments according to five different encoding profiles. Accordingly, the video packaging andorigination service 1720 could determine via the deterministic information whether there are five matching segments covering the five requested encoding profiles. For purposes of illustration,FIG. 21A illustrates when the segment determination indicates that all the encoded segments have not been received and the encoded segment is not ready for transmission to the client. - Turning now to
FIG. 21B , a subsequent interaction and processing on encoded segments will be described. The interactions illustrated inFIG. 21B are based interaction after the initial transmission of multiple encoded segment stream transmission has begun. At (1), theoriginal content provider 1730 selects or causes one or more encoders to generate encoded streams based on synchronization information or continue to generate additional encoded content streams. As described above, the video packaging andorigination service 1720 may provide the synchronization information. In another embodiment, theoriginal content provider 1730 can utilize self-providing synchronization, information provided by a third-party service or a combination. Illustratively, the original content provider can provide multiple encoder streams that can correspond to individual content streams corresponding to the different requested encoding profiles. For example, a first content stream can correspond to a first encoding bitrate and format (e.g., a first encoding profile) and a second content stream can correspond to a second encoding bitrate and format that is different. The encoding streams may be provided by different encoders, such asencoders - The video packaging and
origination service 1720 receives the plurality of incoming encoded content streams from the encoders. More specifically, at (2), a second ingress component, such asingress component 1722B, of the video packaging andorigination service 1720 receives and processes the encoded segments from a second or subsequent received stream. In one embodiment, the subsequent processing of the second content stream may occur in parallel to the processing of the first content stream. For example, the processing of the first content stream byingress component 1722A (FIG. 21A ) may experience a latency. - At (3), the ingress component 122B of the video packaging and
origination service 1720 processes the received encoded segments to generate deterministic data. Illustratively, the deterministic data can include timestamp information related to a time of play of the set of encoded segments, sequence number identifying an order of the encoded content segment in the set of encoded segments, a time of operation of the encoder and the like. The deterministic data will be illustratively utilized to identify a same content segment or matching content segments that have been encoded according to different encoding profiles and received at different ingress components. For example, four content segments sharing a common timestamp of play but encoded according to the different encoding profiles can be considered to be the same content segment. - At (5), the video packaging and
origination service 1720 performs a determination if encoded segments determined to be matching correspond to all the requested encoded profiles. For example, to enable variable bitrate encoding, the content request may request encoded content segments according to five different encoding profiles. Accordingly, the video packaging andorigination service 1720 could determine via the deterministic information whether there are five matching segments covering the five requested encoding profiles. For purposes of illustration,FIG. 21B illustrates when the segment determination indicates that all the encoded segments have been received and the encoded segment is not ready for transmission to the client. Accordingly, at (6), the video packaging andorigination service 1720 creates a segment output of all the processed encoded segments, which can include writing to storage or indicating to an egress node that transmission can begin. - Turning now to
FIG. 22 , a routine 22001500 utilized by the video packaging andorigination service 1720 to receive and process multiple encoder streams will be described. Routine 22001500 may be illustratively implemented by aningress component 1722. - At
block 2202, the video packaging andorigination service 1720 can optionally transmit synchronization information to theoriginal content provider 1730. Illustratively, the synchronization information is utilized bymultiple encoders 1732 to allow encoded segments from multiple encoders to be combined seamlessly or substantially seamlessly. For example, the synchronization information can include timestamp information related to a relative timestamp of individual encoded segments in the set of encoded segments. In another example, the synchronization information can include sequence numbers for the individual segments. In another example, the synchronization information can include a time of operation or other time elapsed information. The synchronization information is incorporated into the encoded segments and then utilized by the video packaging andorigination service 1720 to assemble the set of ordered segments, remove duplicates and identifying missing encoded segments. In embodiments in which the video packaging andorigination service 1720 does not transmit synchronization information, such as if theoriginal content provider 1730 or other service provides the synchronization information, block 2204 may be omitted. - Responsive to a request or trigger, as described above, the
original content provider 1730 begins transmitting a plurality of encoded content streams to the video packaging andorigination service 1720 and incorporating received/accessed synchronization information. In some embodiments, theencoders block 2204, the video packaging andorigination service 1720 receives the plurality of incoming encoded content streams from the encoders. Illustratively, the designation of aspecific ingress component 1722 may be based on algorithms incorporating geographic or network information, random selection, weighted selection, load balancing, client specified information, encoding format, and the like. For example, the video packaging andorigination service 1720 may maintainingress components 1722 that have been optimized to receive different encoding profiles. In another example, the video packaging andorigination service 1720 can utilize load balancing to determine whichingress component 1722 is better suited to receive an incoming stream at the time it is received. Other variations are also possible. - At
block 2206, the video packaging andorigination service 1720 processes the received encoded segments. For example, the video packaging andorigination service 1720 can be adjustments or error correction for any of the selected encoded segments. In other embodiment, if the synchronization information does not ensure perfectly compatible encoded segments, the video packaging andorigination service 1720 can extrapolate additional segments or portions to facilitate combination. Still further, in some embodiments, theingress component 1722 of the video packaging andorigination service 1720 generates deterministic data included in a set of meta-data utilized to access and generate outgoing content streams. Illustratively, the deterministic data can include timestamp information related to a time of play of the set of encoded segments, sequence number identifying an order of the encoded content segment in the set of encoded segments, a time of operation of the encoder and the like. In another example, theingress component 1722 orcontent management service 1726 can conduct quality or error checking that can be included in meta-data. - At
decision block 2208, a determination is made as to whether additional encoder segments streams still need to be received. As described above, the video packaging andorigination service 1720 performs a determination if encoded segments determined to be matching correspond to all the requested encoded profiles. For example, to enable variable bitrate encoding, the content request may request encoded content segments according to five different encoding profiles. Accordingly, the video packaging andorigination service 1720 could determine via the deterministic information whether there are five matching segments covering the five requested encoding profiles. If additional encoded segments remain unreceived or not fully processed, the routine 2200 returns to block 2204 to receive the additional encoder streams. If not, the routine 2200 proceeds to block 2210. - At
block 2210, the video packaging andorigination service 1720 stores the cumulative set of encoded segments for delivery touser devices 1702. As described above, the video packaging andorigination service 1720 can also associate or store meta-data associated with the segments. Alternatively, the video packaging andorigination service 1720 can also interact with egress nodes or generate a notification that the collected content is ready for transmission.Routine 2200 terminates atblock 2212 or starts a new iteration of routine 2200. - Generally described, content providers can provide content to requesting users. With regard to video content, a content provider can implement a video packaging and origination service that is able to deliver video content to requesting users. Illustratively, a video packaging and origination service indexes a collection of source video content (either live streaming or file-based video-on-demand) and delivers it to clients via a wide range of communication protocols such as HTTP Live Streaming ("HLS"), Dynamic Adaptive Streaming over HTTP ("DASH"), HTTP Dynamic Streaming ("HDS"), Real Time Messaging Protocol ("RTMP"), Smooth Streaming, and the like. Based on consumer demand, a video packaging and origination service can also provide advanced video transmission features such as just-in-time packaging of video content, digital rights management ("DRM") encryption, time-shifting, bitrate selection, catch up TV, and more.
- To deliver content, content providers can organize requested content, such as a video file, into multiple segments that are then transmitted to requesting devices segment by segment. For example, in a video stream, each segment typically accounts for 2-10 seconds of video rendered on a receiving device. To provide content to the video packaging and origination service, individual content segments can be encoded by an encoder and transmitted to the video and origination service. Traditionally, a processing node on the video packaging and origination service can receive an incoming stream of encoded segments and then transmit the stream to requesting user devices. Additionally, each distinct encoded video segment (e.g., combination of bitrate encoding and format) is provided to the video packaging and origination service from a single encoder or encoding node.
- Video segments can be encoded according to a defined bitrate and format, which generally defines the number of bits of data that are encoded over a measured amount of time and the specific software algorithm and resulting content representation format utilized to encode the data for transmission. For video files, bitrates are typically measured according to how many kilobits or megabits of data are processed over a second of time. By way of example, a data file that corresponds to 1 megabyte of video data encoded in one second would be considered to have an encoding bitrate of 8 mbps (e.g., 8 megabits per second) while a lower definition video file that corresponds to 45 kilobytes of video data processed in one second would be considered to have an encoding bitrate of 360 kbps (e.g., 360 kilobits per second).
- To receive content, a client computing device can simply request content having a fixed encoding rate or have a fixed encoding rate selected in response to a streaming content request. Such a fixed encoding rate approach can be deficient in facilitating variance of the encoding bitrate (both positive and negative) based on factors, such as network bandwidth, client computing device utilization, quality demands, and the like. In addition to the association of the encoding bitrate, video segments can be further defined by associating the encoding bitrate with the encoding format utilized by the encoder to generate the output stream. The encoding format can correspond to a content representation format for storage or transmission of video content (such as in a data file or bitstream). Examples of encoding formats include but not limited to the motion pictures expert group ("MPEG) MPEG-2
Part 2, MPEG-4Part 2, H.264 (MPEG-4 Part 10), H.265 high efficiency video coding ("HEVC"), Theora, RealVideo RV40, VP9, and AOMedia Video 1 ("AVI"), and the like. Depending on the complexity of the encoding profiles specifying the bitrate and format, a single encoded may be constrained for more complex encoding profiles. This can limit the ability for content providers to provide different encoding bitrate/format combinations or require utilization of increased computing device resources to provide for individual encoding nodes. Additionally, in the event of a failure in the encoding node at the content source, the video packaging and origination service does not receive content and manifests as an outage to downstream user devices. - To address at least a portion of the inefficiencies described above with regard to single encoder transmission nodes, aspects of the present application corresponding to a redundant node system for transmitting redundant encoder streams. More specifically, aspects of the present application correspond to utilization of synchronization information to allow a video packaging and origination service to receive multiple, redundant input streams corresponding to a set of content segments. Each individual stream can be provided by different encoders based on the synchronization information, such as sequence reference numbers or timestamp information. The number of encoders utilized by the content source, such as a content provider, may be based on the complexity of the encoding profile (e.g., encoded bitrate and format), available encoder computing resources, available network bandwidth, financial cost information, processing cost information and the like.
- The receiving video packaging and origination service can resolve discrepancies or conflicts to form the set of encoded segments. The video packaging and origination service can select from the redundant encoding streams based on time received, quality measurements, priority designations, attributable cost, priority meta-data included in the transmitted content segments, user preferences, historical information, or other selection criteria. Additionally, in the event of a failure of one of the encoders, the video packaging and origination service can request additional encoders to complete the transmission or begin collecting additional encoded segments from other encoders.
-
FIG. 23 illustrates a generalcontent delivery environment 2300 for delivering content from original content providers to user devices. Thecontent delivery environment 2300 includes a plurality ofdevices 2302 utilized by individual users, generally referred to as client computing devices, to request streaming or download content from a video packaging andorigination service 2320. Illustratively, the video packaging andorigination service 2320 indexes a collection of source video content (either live streaming or file-based video-on-demand) and delivers it to clients via a wide range of communication protocols such as HTTP Live Streaming ("HLS"), Dynamic Adaptive Streaming over HTTP ("DASH"), HTTP Dynamic Streaming ("HDS"), Real Time Messaging Protocol ("RTMP"), Smooth Streaming, and the like. Based on consumer demand, a video packaging and origination service can also provide advanced video transmission features such as just-in-time packaging of video content, digital rights management ("DRM") encryption, time-shifting, bitrate selection, catch up TV, and more. The content can be illustratively provided by one or more origin sources, such asoriginal content provider 1730. -
Client computing devices 2302 may include any number of different computing devices capable of communicating with thenetworks client computing device 2302 may optionally include one or more data stores (not shown inFIG. 23 ) including various applications or computer-executable instructions, such as web browsers, used to implement the embodiments disclosed herein. Illustrative components of aclient computing device 2302 will be described with regard toFIG. 24 . - In some embodiments, a
CDN service provider 2310 may include multiple edge locations from which a user device can retrieve content.Individual edge location 2312 may be referred to herein as a point of presence ("POP"), where a POP is intended to refer to any collection of related computing devices utilized to implement functionality on behalf of one or many providers. POPs are generally associated with a specific geographic location in which the computing devices implementing the POP are located, or with a region serviced by the POP. As illustrated inFIG 1 , thePOP 2310 can include one or more metricinformation processing component 2314 for processing metric information provided byclient computing devices 2302 and adata store 2316 for maintain collected metric information. For example, a data center or a collection of computing devices within a data center may form a POP. In some instances, the POPs may implement one or more services, such as CDN services, data storage services, data processing services, etc. TheCDN service provider 2310 may include multiple POPs located in different geographic locations so that user devices can communicate with a nearby a POP to retrieve content, thereby reducing the latency of delivering requested content. -
Networks networks FIG. 23 ,network 2340 is a global area network (GAN), such as the Internet. Protocols and components for communicating via the other aforementioned types of communication networks are well known to those skilled in the art of computer communications and thus, need not be described in more detail herein. While each of theclient computing devices 2302 and video packaging andorigination service 2310 are depicted as having a single connection to thenetwork 2340, individual components of theclient computing devices 2302 and video packaging andorigination service 2310 may be connected to thenetwork 2330 at disparate points. Accordingly, communication times and capabilities may vary between the components ofFIG. 23 . Likewise, althoughFIG. 23 is illustrated as having threeseparate networks origination service 2310 may utilize any number or combination of networks. - In accordance with embodiments, the video packaging and
origination service 2320 includes one or more servers for receiving content fromoriginal content providers 2330 and processing the content to make available a set of received encoded bitrate segments. As described in further detail below, the video packaging andorigination service 2320 includes aningress component 2322 ormultiple ingress components 2322 utilized to receive redundant encoded data streams frommultiple encoding servers 132 fromoriginal content providers 2330. The video packaging andorigination service 2320 can further includesynchronization services 1724 for generating synchronization information utilized by the encoders, such as sequence numbers corresponding to the set of encoded segments, time stamp information related to a relative time of the encoded segments or from which relative time of encoded segments will be based, and the like. The video packaging andorigination service 2320 can further include adata store 2326 for maintaining received encoded data for transmission. - It will be appreciated by those skilled in the art that the video packaging and
origination service 2320 may have fewer or greater components than are illustrated inFIG23 . Thus, the depiction of the video packaging andorigination service 2320 inFIG. 23 should be taken as illustrative. For example, in some embodiments, components of the video packaging andorigination service 2320 may be executed by one more virtual machines implemented in a hosted computing environment. A hosted computing environment may include one or more rapidly provisioned and released computing resources, which computing resources may include computing, networking or storage devices. In another example, the video packaging andorigination service 2320 can include one or more egress components that can utilize the content received and processed from theingress component 2322 and further process the content for transmission touser devices 2302. Such egress components may be implemented in conjunction with theingress component 2322, such as in a transcoding node. In other embodiments, the egress components may be implemented and managed independently of theingress components 2322, such as in separate stand-alone computing devices. - With continued reference to
FIG. 23 , thecontent delivery environment 2300 also includesoriginal content providers 2330. Illustratively, the original content provider can include a plurality ofencoders 132 for generating multiple encoded streams for transmission to the video packaging andorigination service 2320. Theoriginal content provider 2330 can also include logic or other management components for determining howmany encoders 132 should be utilized or how to manage the addition or removal of encoders. In some embodiments, theoriginal content provider 2330 can further includesynchronization services 2336 for generating synchronization information utilized by the encoders, such as sequence numbers corresponding to the set of encoded segments, time stamp information related to a relative time of the encoded segments or from which relative time of encoded segments will be based, and the like. The video packaging andorigination service 2320 can further include adata store 2334 for maintaining encoded data for transmission. Thesynchronization services -
FIG. 24 depicts one embodiment of an architecture of an illustrativeuser computing device 2302 that can generate content requests and process metric information in accordance with the present application. The general architecture of theuser computing device 2302 depicted inFIG.24 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure. As illustrated, theuser computing device 2302 includes aprocessing unit 2404, anetwork interface 2406, an input/output device interface 2409, anoptional display 2402, and aninput device 2424, all of which may communicate with one another by way of a communication bus. - The
network interface 2406 may provide connectivity to one or more networks or computing systems, such as thenetwork 2340 ofFIG23 and the video packaging andorigination service 2320 or theoriginal content provider 2330. Theprocessing unit 2404 may thus receive information and instructions from other computing systems or services via a network. Theprocessing unit 2404 may also communicate to and frommemory 2410 and further provide output information for anoptional display 2402 via the input/output device interface 2409. The input/output device interface 2409 may also accept input from theoptional input device 2424, such as a keyboard, mouse, digital pen, etc. In some embodiments, theuser computing device 2302 may include more (or fewer) components than those shown inFIG. 2 . - The
memory 2410 may include computer program instructions that theprocessing unit 2404 executes in order to implement one or more embodiments. Thememory 2410 generally includes RAM, ROM, or other persistent or non-transitory memory. Thememory 2410 may store anoperating system 2414 that provides computer program instructions for use by theprocessing unit 2404 in the general administration and operation of theuser computing device 2302. Thememory 2410 may further include computer program instructions and other information for implementing aspects of the present disclosure. For example, in one embodiment, thememory 2410 includes anetwork application 2416, such as browser application or media player, for accessing content and communicating with the video packaging andorigination service 2320. -
FIG. 25 depicts one embodiment of an architecture of an illustrative server for encoding content as described herein. The general architecture of theencoder 132 depicted inFIG. 25 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure. As illustrated, theencoder 132 includes aprocessing unit 2504, anetwork interface 2506, a computerreadable medium drive 2508, an input/output device interface 2509, all of which may communicate with one another by way of a communication bus. The components of theencoder 132 may be physical hardware components or implemented in a virtualized environment. - The
network interface 2506 may provide connectivity to one or more networks or computing systems, such as thenetwork 2350 ornetwork 2360 ofFIG. 23 . Theprocessing unit 2504 may thus receive information and instructions from other computing systems or services via a network. Theprocessing unit 2504 may also communicate to and frommemory 2510 and further provide output information for an optional display via the input/output device interface 2509. In some embodiments, theencoder 132 may include more (or fewer) components than those shown inFIG. 25 . - The
memory 2510 may include computer program instructions that theprocessing unit 2504 executes in order to implement one or more embodiments. Thememory 2510 generally includes RAM, ROM, or other persistent or non-transitory memory. Thememory 2510 may store anoperating system 2514 that provides computer program instructions for use by theprocessing unit 2504 in the general administration and operation of the video packaging andorigination service 2320. Thememory 2510 may further include computer program instructions and other information for implementing aspects of the present disclosure. For example, in one embodiment, thememory 2510 includes interface software 2512 for receiving and processing content requests from the video packaging andorigination service 2320. Additionally, thememory 2510 includes anencoder component 2516 for processing content segments. Additionally, theencoder component 2516 can further include asynchronization parameter component 2518 for utilizing the synchronization information in the encoding process to increase the likelihood that encoded segments from multiple encoders can be utilized by a video packaging andorigination service 2320. -
FIG. 26 depicts one embodiment of an architecture of an illustrative server for functioning as aningress component 2322 as described herein. The general architecture of theingress component 2322 depicted inFIG. 26 includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure. As illustrated, theingress component 2322 includes aprocessing unit 2604, anetwork interface 2606, a computerreadable medium drive 2608, an input/output device interface 2609, all of which may communicate with one another by way of a communication bus. The components of theingress component 2322 may be physical hardware components or implemented in a virtualized environment. - The
network interface 2606 may provide connectivity to one or more networks or computing systems, such as thenetwork 2350 ornetwork 2360 ofFIG. 23 . Theprocessing unit 2604 may thus receive information and instructions from other computing systems or services via a network. Theprocessing unit 2604 may also communicate to and frommemory 2610 and further provide output information for an optional display via the input/output device interface 2609. In some embodiments, theingress component 2322 may include more (or fewer) components than those shown inFIG. 26 . - The
memory 2610 may include computer program instructions that theprocessing unit 2604 executes in order to implement one or more embodiments. Thememory 2610 generally includes RAM, ROM, or other persistent or non-transitory memory. Thememory 2610 may store anoperating system 2614 that provides computer program instructions for use by theprocessing unit 2604 in the general administration and operation of the ingress node. Thememory 2610 may further include computer program instructions and other information for implementing aspects of the present disclosure. For example, in one embodiment, thememory 2610 includes interface software 2612 for receiving and processing content requests from theingress component 2322. As will be described in detail below, the resulting information can include a dynamically configured bundle to encoding bitrates. Additionally, thememory 2610 includes an encoder processing application 2616 for processing incoming encoded content segments. Additionally, theingress component 2322 can further include asynchronization parameter component 2618 for utilizing the synchronization information in the encoding process to increase the likelihood that encoded segments from multiple encoders can be utilized by theingress component 2322. - Turning now to FIGS. 5A and 5B, an illustrative interaction for the processing of content requests will be described. [0035] At (1), the video packaging and
origination service 2320 can transmit synchronization information to theoriginal content provider 2330. Illustratively, the synchronization information is utilized bymultiple encoders 132 to allow encoded segments from multiple encoders to be combined seamlessly or substantially seamlessly. For example, the synchronization information can include timestamp information related to a relative timestamp of individual encoded segments in the set of encoded segments. In another example, the synchronization information can include sequence numbers for the individual segments. In another example, the synchronization information can include a time of operation or other time elapsed information. The synchronization information is incorporated into the encoded segments and then utilized by the video packaging andorigination service 2320 to assemble the set of ordered segments, remove duplicates and identifying missing encoded segments. AlthoughFIG. 27A illustrates the transmission of the synchronization information from the video packaging andorigination service 2320, in some embodiments, synchronization information may not be transmitted by the video packaging andorigination service 2320 and this interaction would be omitted altogether. - At (2), the receiving
original content provider 2330 determines the number of encoders that will be utilized to generate the requested redundant encoded content streams. Illustratively, the determination the number of encoders will generally corresponding to a plurality of encoders that generate encoded content streams for identified requested content and incorporating synchronization information. In one embodiment, the determination of the number of encoders can be based on the complexity of the encoded bitrate and formation combination, available encoder resources, an attributable cost associated with the generated encoded content segments, user preferences or service levels associated with the video packaging andorigination service 2320, network conditions (e.g., available bandwidth, network throughput, error rates), demand from users devices (e.g., total number of requests or frequencies of requests), and the like. For example, a system experiencing a number of failures may implement a higher level of redundancy that a system that has not experienced as much failure. In another example, user preferences stored in a profile or included in a request can also be a factor in determining redundancy. - Illustratively, the content stream data may be transmitted by the
original content provider 2330 responsive to a request from auser device 2302, a request from the video packaging andorigination service 2320, or other request/trigger. Illustratively, the encoded content can correspond to a set of encoded profiles corresponding to the encoding bitrate and format combinations that may be made available to users. For example, the video packaging andorigination service 2320 may provide a requestinguser device 2302 with a set of encoding bitrate and format combinations in order to support adaptive bitrate streaming. Accordingly, the request from the original content provider may transmit the set of identified encoding bitrates and formats or individual encoding bitrate and format combinations to supplement previously receive encoded segments. One skilled in the relevant art will appreciate that the transmission of the request or the identification of requested encoded segments (including format) can be facilitated in a number of ways. - At (3), the original content provider causes the selected number of encoders to generate redundant encoded streams. As described above, the video packaging and
origination service 2320 may provide synchronization information to facilitate compatibility or to establish that the encoded content segments are substantially similar. For example, the synchronization information can be utilized so that encoded content can be within a timing range, such as +/- 1 second. In that regard, redundant segments may be generally considered to be segments that can be interchangeably utilized as transmitted or with additional processing or otherwise substantially similar. In another embodiment, theoriginal content provider 2330 can utilize self-providing synchronization, information provided by a third-party service or a combination. At (4), the original content provider begins transmitting a plurality of encoded content streams to the video packaging andorigination service 2320 and incorporating received/accessed synchronization information. As illustrated inFIG. 27a , the redundant streams can be generated from multiple encoders, such asencoding node 132A and encoding node 132B, associated with a single source. - The video packaging and
origination service 2320 receives the plurality of incoming encoded content streams from the encoders. At (5), the video packaging andorigination service 2320 collects encoded segments from the received streams. At (6), the video packaging andorigination service 2320 processes the received encoded segments which are determined to be substantially similar or otherwise sufficiently compatible. For example, the video packaging andorigination service 2320 can be adjustments or error correction for any of the selected encoded segments. In other embodiment, if the synchronization information does not ensure perfectly compatible encoded segments, the video packaging andorigination service 2320 can extrapolate additional segments or portions to facilitate combination. Still further, the video packaging andorigination service 2320 can implement conflict resolution from multiple overlapping content segments. For example, the video packaging andorigination service 2320 can utilize a first source wins implementation or last source wins. In another example, the video packaging andorigination service 2320 can utilize historical information such as error rate, quality characterizations, or performance assessments. In yet another example, the video packaging andorigination service 2320 can implement user preferences or user inputs or content provider preferences or content provider inputs to select from redundant input streams. Still further, in some embodiments, theingress component 2322 of the video packaging andorigination service 2320 generates deterministic data included in a set of meta-data utilized to access and generate outgoing content streams. Illustratively, the deterministic data can include timestamp information related to a time of play of the set of encoded segments, sequence number identifying an order of the encoded content segment in the set of encoded segments, a time of operation of the encoder and the like. In another example, theingress component 2322 orcontent management service 2326 can conduct quality or error checking that can be included in meta-data. - At (7) the video packaging and
origination service 2320 stores the cumulative set of encoded segments for delivery touser devices 2302. Although not illustrated inFIG. 27A , the redundant input streams to do not have to be received substantially in real time or in the same order. For example, utilizing synchronization information, the video packaging andorigination service 2320 can identify overlapping content segments at any point once all the segments are received and the select from one of the redundant encoded segments. Moreover, in the event of a failure of one of the source nodes, the video packaging andorigination service 2320 can continue to receive from the other redundant nodes or adjust the selection algorithm to minimize the impact of the failure. - Turning now to
FIG. 27B , an embodiment including content streams from distinct sources will be described. [0035] At (1), the video packaging andorigination service 2320 can transmit synchronization information to the original content provider 2330A and original content provider 2330B (directly or indirectly). Illustratively, the synchronization information is utilized bymultiple encoders 132 to allow encoded segments from multiple encoders to be combined seamlessly or substantially seamlessly. For example, the synchronization information can include timestamp information related to a relative timestamp of individual encoded segments in the set of encoded segments. In another example, the synchronization information can include sequence numbers for the individual segments. In another example, the synchronization information can include a time of operation or other time elapsed information. The synchronization information is incorporated into the encoded segments and then utilized by the video packaging andorigination service 2320 to assemble the set of ordered segments, remove duplicates and identifying missing encoded segments. AlthoughFIG. 27B illustrates the transmission of the synchronization information from the video packaging andorigination service 2320, in some embodiments, synchronization information may not be transmitted by the video packaging andorigination service 2320 and this interaction would be omitted altogether. - At (2), individual receiving
original content providers 2330 determine the number of encoders that will be utilized to generate the requested redundant encoded content streams. Illustratively, the determination the number of encoders will generally corresponding to a plurality of encoders that generate encoded content streams for identified requested content and incorporating synchronization information. In one embodiment, the determination of the number of encoders can be based on the complexity of the encoded bitrate and formation combination, available encoder resources, an attributable cost associated with the generated encoded content segments, user preferences or service levels associated with the video packaging andorigination service 2320, network conditions (e.g., available bandwidth, network throughput, error rates), demand from users devices (e.g., total number of requests or frequencies of requests), and the like. For example, a system experiencing a number of failures may implement a higher level of redundancy that a system that has not experienced as much failure. In another example, user preferences stored in a profile or included in a request can also be a factor in determining redundancy. - Illustratively, the content stream data may be transmitted by the
original content provider 2330 responsive to a request from auser device 2302, a request from the video packaging andorigination service 2320, or other request/trigger. Illustratively, the encoded content can correspond to a set of encoded profiles corresponding to the encoding bitrate and format combinations that may be made available to users. For example, the video packaging andorigination service 2320 may provide a requestinguser device 2302 with a set of encoding bitrate and format combinations in order to support adaptive bitrate streaming. Accordingly, the request from the original content provider may transmit the set of identified encoding bitrates and formats or individual encoding bitrate and format combinations to supplement previously receive encoded segments. One skilled in the relevant art will appreciate that the transmission of the request or the identification of requested encoded segments (including format) can be facilitated in a number of ways. - At (3), the original content provider causes the selected number of encoders to generate redundant encoded streams. As described above, the video packaging and
origination service 2320 may provide synchronization information to facilitate compatibility. In another embodiment, theoriginal content provider 2330 can utilize self-providing synchronization, information provided by a third-party service or a combination. At (5), the original content provider begins transmitting a plurality of encoded content streams to the video packaging andorigination service 2320 and incorporating received/accessed synchronization information. As illustrated inFIG. 27B , the redundant streams can be generated frommultiple encoder 132 associated with different sources. - The video packaging and
origination service 2320 receives the plurality of incoming encoded content streams from the encoders. At (5), the video packaging andorigination service 2320 collects encoded segments from the received streams. At (6), the video packaging andorigination service 2320 processes the received encoded segments. For example, the video packaging andorigination service 2320 can be adjustments or error correction for any of the selected encoded segments. In other embodiment, if the synchronization information does not ensure perfectly compatible encoded segments, the video packaging andorigination service 2320 can extrapolate additional segments or portions to facilitate combination. Still further, the video packaging andorigination service 2320 can implement conflict resolution from multiple overlapping content segments. For example, the video packaging andorigination service 2320 can utilize a first source wins implementation or last source wins. Still further, in some embodiments, theingress component 2322 of the video packaging andorigination service 2320 generates deterministic data included in a set of meta-data utilized to access and generate outgoing content streams. Illustratively, the deterministic data can include timestamp information related to a time of play of the set of encoded segments, sequence number identifying an order of the encoded content segment in the set of encoded segments, a time of operation of the encoder and the like. In another example, theingress component 2322 orcontent management service 2326 can conduct quality or error checking that can be included in meta-data. In another example, the video packaging andorigination service 2320 can utilize historical information such as error rate, quality characterizations, or performance assessments. In yet another example, the video packaging andorigination service 2320 can implement user preferences or user inputs or content provider preferences or content provider inputs to select from redundant input streams. - At (7) the video packaging and
origination service 2320 stores the cumulative set of encoded segments for delivery touser devices 2302. Although not illustrated inFIG. 27A , the redundant input streams to do not have to be received substantially in real time or in the same order. For example, utilizing synchronization information, the video packaging andorigination service 2320 can identify overlapping content segments at any point once all the segments are received and the select from one of the redundant encoded segments. Moreover, in the event of a failure of one of the source nodes, the video packaging andorigination service 2320 can continue to receive from the other redundant nodes or adjust the selection algorithm to minimize the impact of the failure. - Turning now to
FIG. 6 , a routine 2800 utilized by the video packaging andorigination service 2320 to receive and process multiple encoder streams will be described.Routine 2800 may be illustratively implemented by aningress component 2322. - At
block 2802, the video packaging andorigination service 2320 can optionally transmit synchronization information to theoriginal content provider 2330. Illustratively, the synchronization information is utilized bymultiple encoders 132 to allow encoded segments from multiple encoders to be combined seamlessly or substantially seamlessly. For example, the synchronization information can include timestamp information related to a relative timestamp of individual encoded segments in the set of encoded segments. In another example, the synchronization information can include sequence numbers for the individual segments. In another example, the synchronization information can include a time of operation or other time elapsed information. The synchronization information is incorporated into the encoded segments and then utilized by the video packaging andorigination service 2320 to assemble the set of ordered segments, remove duplicates and identifying missing encoded segments. In embodiments in which the video packaging andorigination service 2320 does not transmit synchronization information, such as if theoriginal content provider 2330 or other service provides the synchronization information, block 2804 may be omitted. - Responsive to the request, as described above, the
original content provider 2330 begins transmitting a plurality of redundant, encoded content streams to the video packaging andorigination service 2320 and incorporating received/accessed synchronization information. The transmission of the redundant streams does not have to be simultaneously received or received in the same order. Atblock 2804, the video packaging andorigination service 2320 receives the plurality of incoming encoded content streams from the encoders. Atdecision block 2806, a determination is made as to whether additional encoder segments streams are received. If so, the routine 2800 returns to block 2806 to receive the additional encoder streams. If not, the routine 2800 proceeds to block 2808. - At
block 2808, the video packaging andorigination service 2320 processes the received encoded segments. the video packaging andorigination service 2320 collects encoded segments from the received streams. For example, the video packaging andorigination service 2320 can be adjustments or error correction for any of the selected encoded segments. In other embodiment, if the synchronization information does not ensure perfectly compatible encoded segments, the video packaging andorigination service 2320 can extrapolate additional segments or portions to facilitate combination. Still further, the video packaging andorigination service 2320 can implement conflict resolution from multiple overlapping content segments. For example, the video packaging andorigination service 2320 can utilize a first source wins implementation or last source wins. In another example, the video packaging andorigination service 2320 can utilize historical information such as error rate, quality characterizations, or performance assessments. In yet another example, the video packaging andorigination service 2320 can implement user preferences or user inputs or content provider preferences or content provider inputs to select from redundant input streams. Still further, in some embodiments, theingress component 2322 of the video packaging andorigination service 2320 generates deterministic data included in a set of meta-data utilized to access and generate outgoing content streams. Illustratively, the deterministic data can include timestamp information related to a time of play of the set of encoded segments, sequence number identifying an order of the encoded content segment in the set of encoded segments, a time of operation of the encoder and the like. In another example, theingress component 2322 orcontent management service 2326 can conduct quality or error checking that can be included in meta-data. Atblock 2810, the video packaging andorigination service 2320 stores the cumulative set of encoded segments for delivery touser devices 2302.Routine 2800 terminates atblock 2812 or starts a new iteration of routine 2800. - Turning now to
FIG. 29 , a routine 2900 utilized by to generate multiple encoder streams will be described.Routine 2900 may be illustratively implemented bymultiple encoder components 132. Atblock 2902, the encoder component 132 (directly or indirectly) identifies a request for encoded content. Illustratively, the encoded content request can correspond to a set of encoded profiles corresponding to the encoding bitrate and format combinations that may be made available to users. For example, the video packaging andorigination service 2320 may provide a set of encoding bitrate and format combinations in order to support adaptive bitrate streaming. Accordingly, the request from the video packaging andorigination service 2320 may correspond to the set of identified encoding bitrates and formats or individual encoding bitrate and format combinations to supplement previously receive encoded segments. One skilled in the relevant art will appreciate that the transmission of the request or the identification of requested encoded segments (including format) can be facilitated in a number of ways. - At
block 2904, the encoder can receive synchronization information or generate synchronization information. As described above, the synchronization information is utilized bymultiple encoders 132 to allow encoded segments from multiple encoders to be combined seamlessly or substantially seamlessly. For example, the synchronization information can include timestamp information related to a relative timestamp of individual encoded segments in the set of encoded segments. In another example, the synchronization information can include sequence numbers for the individual segments. In another example, the synchronization information can include a time of operation or other time elapsed information. The synchronization information is incorporated into the encoded segments and then utilized by the video packaging andorigination service 2320 to assemble the set of ordered segments, remove duplicates and identifying missing encoded segments. - At
block 2906, the receivingoriginal content provider 2330 determines the number of encoders that will be utilized to generate the requested encoded content streams. Illustratively, the determination the number of encoders will generally corresponding to a plurality of encoders that generate encoded content streams for identified requested content and incorporating synchronization information. In one embodiment, the determination of the number of encoders can be based on the complexity of the encoded bitrate and formation combination, available encoder resources, an attributable cost associated with the generated encoded content segments, preferences or service levels associated with the video packaging andorigination service 2320, network conditions (e.g., available bandwidth, network throughput, error rates), demand from users devices (e.g., total number of requests or frequencies of requests), and the like. Still further, the video packaging andorigination service 2320 can utilize a compatibility assessment information based on historical information or otherwise calculated to select. - At
block 2908, the original content provider causes the selected number of encoders to generate encoded streams based on synchronization information. As described above, the video packaging andorigination service 2320 may provide the synchronization information. In another embodiment, theoriginal content provider 2330 can utilize self-providing synchronization, information provided by a third-party service or a combination. Atblock 2910, the original content provider begins transmitting a plurality of encoded content streams to the video packaging andorigination service 2320 and incorporating received/accessed synchronization information. In some embodiments, theencoders 132B and 132A may be configured to transmit non-overlapping segments in which the encoding task for the set of segments it distributed among encoders. In other embodiments, the encoders may be configured will at least partially overlapping encoded segments.Routine 2900 terminates at block 291 or starts a new iteration of routine 2900. - All of the methods and tasks described herein may be performed and fully automated by a computer system. The computer system may, in some cases, include multiple distinct computers or computing devices (e.g., physical servers, workstations, storage arrays, cloud computing resources, etc.) that communicate and interoperate over a network to perform the described functions. Each such computing device typically includes a processor (or multiple processors) that executes program instructions or modules stored in a memory or other non-transitory computer-readable storage medium or device (e.g., solid state storage devices, disk drives, etc.). The various functions disclosed herein may be embodied in such program instructions, or may be implemented in application-specific circuitry (e.g., ASICs or FPGAs) of the computer system. Where the computer system includes multiple computing devices, these devices may, but need not, be co-located. The results of the disclosed methods and tasks may be persistently stored by transforming physical storage devices, such as solid state memory chips or magnetic disks, into a different state. In some embodiments, the computer system may be a cloud-based computing system whose processing resources are shared by multiple distinct business entities or other users.
- Depending on the embodiment, certain acts, events, or functions of any of the processes or algorithms described herein can be performed in a different sequence, can be added, merged, or left out altogether (e.g., not all described operations or events are necessary for the practice of the algorithm). Moreover, in certain embodiments, operations or events can be performed concurrently, e.g., through multi-threaded processing, interrupt processing, or multiple processors or processor cores or on other parallel architectures, rather than sequentially.
- The various illustrative logical blocks, modules, routines, and algorithm steps described in connection with the embodiments disclosed herein can be implemented as electronic hardware (e.g., ASICs or FPGA devices), computer software that runs on computer hardware, or combinations of both. Moreover, the various illustrative logical blocks and modules described in connection with the embodiments disclosed herein can be implemented or performed by a machine, such as a processor device, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A processor device can be a microprocessor, but in the alternative, the processor device can be a controller, microcontroller, or state machine, combinations of the same, or the like. A processor device can include electrical circuitry configured to process computer-executable instructions. In another embodiment, a processor device includes an FPGA or other programmable device that performs logic operations without processing computer-executable instructions. A processor device can also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration. Although described herein primarily with respect to digital technology, a processor device may also include primarily analog components. For example, some or all of the rendering techniques described herein may be implemented in analog circuitry or mixed analog and digital circuitry. A computing environment can include any type of computer system, including, but not limited to, a computer system based on a microprocessor, a mainframe computer, a digital signal processor, a portable computing device, a device controller, or a computational engine within an appliance, to name a few.
- The elements of a method, process, routine, or algorithm described in connection with the embodiments disclosed herein can be embodied directly in hardware, in a software module executed by a processor device, or in a combination of the two. A software module can reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of a non-transitory computer-readable storage medium. An exemplary storage medium can be coupled to the processor device such that the processor device can read information from, and write information to, the storage medium. In the alternative, the storage medium can be integral to the processor device. The processor device and the storage medium can reside in an ASIC. The ASIC can reside in a user terminal. In the alternative, the processor device and the storage medium can reside as discrete components in a user terminal.
- Conditional language used herein, such as, among others, "can," "could," "might," "may," "e.g.," and the like, unless specifically stated otherwise, or otherwise understood within the context as used, is generally intended to convey that certain embodiments include, while other embodiments do not include, certain features, elements or steps. Thus, such conditional language is not generally intended to imply that features, elements or steps are in any way required for one or more embodiments or that one or more embodiments necessarily include logic for deciding, with or without other input or prompting, whether these features, elements or steps are included or are to be performed in any particular embodiment. The terms "comprising," "including," "having," and the like are synonymous and are used inclusively, in an open-ended fashion, and do not exclude additional elements, features, acts, operations, and so forth. Also, the term "or" is used in its inclusive sense (and not in its exclusive sense) so that when used, for example, to connect a list of elements, the term "or" means one, some, or all of the elements in the list.
- Disjunctive language such as the phrase "at least one of X, Y, or Z," unless specifically stated otherwise, is otherwise understood with the context as used in general to present that an item, term, etc., may be either X, Y, or Z, or any combination thereof (e.g., X, Y, or Z). Thus, such disjunctive language is not generally intended to, and should not, imply that certain embodiments require at least one of X, at least one of Y, and at least one of Z to each be present.
- The scope of the invention is defined by the appended claims.
Claims (15)
- A system to manage streaming content comprising:one or more computing devices associated with a set of available ingress nodes (122), wherein at least a portion of the set of available ingress nodes (122) corresponds to a plurality of geographic zones and wherein the set of available ingress nodes (122) is configured to process encoded segments from received encoded content streams to generate deterministic data, to identify same content segments using the deterministic data, to store the encoded segments, and to update an index identifying locations of the encoded segments, the locations being associated with at least a portion of the set of available ingress nodes (122);one or more computing devices associated with a set of available egress nodes (124), wherein at least a portion of the set of available egress nodes (124) corresponds to a plurality of geographic zones, and wherein the set of available egress nodes (124) is configured to identify the locations of the encoded segments, to access the encoded segments at the identified locations that are associated with the at least a portion of the set of available ingress nodes (122), to package encoded content to be provided based on the accessed encoded segments, and to transmit the packaged content responsive to content requests; andone or more computing devices associated with a content management system (126), wherein the content management system (126) is configured to:receive a content stream from a content provider (130), wherein the content stream corresponds to a set of encoded segments encoded according to one or more encoding profiles;select an ingress node from the set of available ingress nodes (122) based on attributes of the content provider (130) and the content management system (126);receive a request for streaming content from a requesting entity; andselect an egress node from the set of available egress nodes (124) based on attributes of the requesting entity and the content management system (126);wherein the content management system (126) is configured to receive meta-data from the selected ingress node and to utilize the meta-data to make at least a portion of the set of encoded segments corresponding to the requested streaming content accessible to the selected egress node.
- The system of Claim 1, wherein the content management system (126) is further configured to cause instantiation of at least one of an ingress node or an egress node.
- The system of Claim 1, wherein the requesting entity is one of a user device or content delivery service provider.
- The system of Claim 1, wherein the content management system (126) is configured to generate an index based on individual meta-data associated with processed encoded content segments.
- A computer-implemented method to manage transmission of content at a video packaging service (120) comprising:receiving one or more content streams from a content provider (130), wherein individual content streams correspond to a set of encoded segments encoded according to one or more encoding profiles;identifying one or more ingress nodes (122) from a set of available ingress nodes (122) of a plurality of available ingress nodes (122) based on attributes of the content provider (130) and a video packaging service (120);receiving a request for streaming content from a requesting entity; andidentifying an egress node from a set of available egress nodes (124) of a plurality of available egress nodes (124) based on attributes of the requesting entity and the video packaging service (120);wherein the one or more identified ingress nodes (122) generate information corresponding to a processing of encoded content segments;wherein the plurality of ingress nodes (122) processes encoded segments from received encoded content streams, stores the encoded segments, and updates an index identifying locations of the encoded segments; andwherein the plurality of egress nodes (124) identifies the locations of the encoded segments, accesses the encoded segments at the identified locations that are associated with at least a portion of the set of available ingress nodes, packages encoded content to be provided based on the identified locations of the encoded segments, and transmits the packaged content responsive to content requests.
- The computer-implemented method of Claim 5, wherein identifying one or more ingress nodes (122) from the set of available ingress nodes (122) based on the attributes of the content provider (130) and the video packaging service (120) includes identifying one or more ingress nodes (122) based on geographic attributes of at least one of the content provider (130) or the video packaging service (120).
- The computer-implemented method of Claim 5, wherein identifying one or more egress nodes (124) from the set of available egress nodes (124) based on the attributes of the requesting entity and the video packaging service (120) includes identifying one or more egress nodes (124) based on geographic attributes of at least one of the requesting entity or the video packaging service (120).
- The computer-implemented method of Claim 5, wherein identifying one or more ingress nodes (122) from the set of available ingress nodes (122) based on the attributes of the content provider (130) and the video packaging service (120) includes identifying one or more ingress nodes (122) based on content type.
- The computer-implemented method of Claim 5, wherein identifying one or more egress nodes (124) from the set of available egress nodes (124) based on the attributes of the requesting entity and the video packaging service (120) includes identifying one or more egress nodes (124) based on content type.
- The computer-implemented method of Claim 5, wherein identifying one or more ingress nodes (122) from the set of available ingress nodes (122) based on the attributes of the content provider (130) and the video packaging service (120) includes identifying a load associated with processing encoded content and selecting an ingress server based on the identified load.
- The computer-implemented method of Claim 5, wherein identifying one or more egress nodes (124) from the set of available egress nodes (124) based on the attributes of the requesting entity and the video packaging service (120) includes identifying a load associated with processing encoded content requests and selecting an egress server based on the identified load.
- The computer-implemented method of Claim 5, wherein identifying one or more ingress nodes (122) from the set of available ingress nodes (122) based on the attributes of the content provider (130) and the video packaging service (120) includes associating an ingress node with one or more encoder components of the content provider (130).
- The computer-implemented method of Claim 5 further comprising generating an index based on individual meta-data associated with processed encoded content segments.
- The computer-implemented method of Claim 13 further comprising providing the generated index to the identified egress node to identify a storage location for encoded content.
- The computer-implemented method of Claim 13, wherein the attributes of the content provider (130) and the video packaging service (120) and the attributes of the requesting entity and the video packaging service (120) are different.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP21204808.6A EP3965404B1 (en) | 2017-09-13 | 2018-09-12 | Distributed video packaging system |
Applications Claiming Priority (8)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201762558265P | 2017-09-13 | 2017-09-13 | |
US15/841,079 US10931988B2 (en) | 2017-09-13 | 2017-12-13 | Distributed multi-datacenter video packaging system |
US15/841,180 US10469883B2 (en) | 2017-09-13 | 2017-12-13 | Distributed multi-datacenter video packaging system |
US15/841,197 US10757453B2 (en) | 2017-09-13 | 2017-12-13 | Distributed multi-datacenter video packaging system |
US15/841,176 US10542302B2 (en) | 2017-09-13 | 2017-12-13 | Distributed multi-datacenter video packaging system |
US15/841,091 US10887631B2 (en) | 2017-09-13 | 2017-12-13 | Distributed multi-datacenter video packaging system |
US15/841,119 US10298968B2 (en) | 2017-09-13 | 2017-12-13 | Distributed multi-datacenter video packaging system |
PCT/US2018/050748 WO2019055564A1 (en) | 2017-09-13 | 2018-09-12 | Distributed multi-datacenter video packaging system |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP21204808.6A Division-Into EP3965404B1 (en) | 2017-09-13 | 2018-09-12 | Distributed video packaging system |
EP21204808.6A Division EP3965404B1 (en) | 2017-09-13 | 2018-09-12 | Distributed video packaging system |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3682617A1 EP3682617A1 (en) | 2020-07-22 |
EP3682617B1 true EP3682617B1 (en) | 2022-01-05 |
Family
ID=65631768
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP18789276.5A Active EP3682617B1 (en) | 2017-09-13 | 2018-09-12 | Distributed multi-datacenter video packaging system |
EP21204808.6A Active EP3965404B1 (en) | 2017-09-13 | 2018-09-12 | Distributed video packaging system |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP21204808.6A Active EP3965404B1 (en) | 2017-09-13 | 2018-09-12 | Distributed video packaging system |
Country Status (4)
Country | Link |
---|---|
US (8) | US10931988B2 (en) |
EP (2) | EP3682617B1 (en) |
CN (1) | CN111684777B (en) |
WO (1) | WO2019055564A1 (en) |
Families Citing this family (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10931988B2 (en) | 2017-09-13 | 2021-02-23 | Amazon Technologies, Inc. | Distributed multi-datacenter video packaging system |
US11012488B2 (en) * | 2017-12-13 | 2021-05-18 | Verizon Patent And Licensing Inc. | Content streaming redundancy architecture |
KR102050780B1 (en) * | 2018-01-10 | 2019-12-02 | 한국과학기술원 | Method and Server Apparatus for Delivering Content Based on Content-aware Using Neural Network |
JP6500132B1 (en) * | 2018-01-15 | 2019-04-10 | ヤフー株式会社 | Information processing apparatus, information processing method, and information processing program |
EP3870124A4 (en) | 2018-10-28 | 2022-08-03 | Belkin Vision Ltd. | Protection for direct selective laser trabeculoplasty |
US11234034B2 (en) * | 2018-11-02 | 2022-01-25 | Netflix, Inc. | Techniques for encoding a media title via multiple encoders |
US11671653B2 (en) * | 2019-03-14 | 2023-06-06 | Comcast Cable Communications, Llc | Methods and systems for content delivery |
CA3132240A1 (en) * | 2019-04-04 | 2020-10-08 | Erik J. Elstermann | Delivery of encrypted multiplexes via hyper text transfer protocol |
US11240156B2 (en) * | 2019-09-06 | 2022-02-01 | Netflix, Inc. | Techniques for steering network traffic to regions of a cloud computing system |
US20210195259A1 (en) * | 2019-12-23 | 2021-06-24 | Comcast Cable Communications, Llc | Method and apparatus for managing redundant segmented streams |
CN111726647B (en) * | 2020-06-17 | 2023-05-26 | 京东方科技集团股份有限公司 | Data distribution device and data processing system |
US20220272136A1 (en) * | 2021-02-19 | 2022-08-25 | International Business Machines Corporatlion | Context based content positioning in content delivery networks |
CN112601097B (en) * | 2021-03-02 | 2021-04-30 | 中国传媒大学 | Double-coding cloud broadcasting method and system |
US20230089154A1 (en) * | 2021-09-22 | 2023-03-23 | Netflix, Inc. | Virtual and index assembly for cloud-based video processing |
CN114338843B (en) * | 2021-12-30 | 2024-04-02 | 咻享智能(深圳)有限公司 | Intelligent coding system of wireless communication protocol |
Family Cites Families (58)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7470381B2 (en) * | 2003-07-25 | 2008-12-30 | Rohmax Additives Gmbh | Functional fluid and the use thereof |
US20050235047A1 (en) | 2004-04-16 | 2005-10-20 | Qiang Li | Method and apparatus for a large scale distributed multimedia streaming system and its media content distribution |
EP2105019A2 (en) | 2006-09-29 | 2009-09-30 | Avinity Systems B.V. | Method for streaming parallel user sessions, system and computer software |
US8958486B2 (en) * | 2007-07-31 | 2015-02-17 | Cisco Technology, Inc. | Simultaneous processing of media and redundancy streams for mitigating impairments |
EP2124451A3 (en) | 2008-05-23 | 2014-03-26 | Sony Corporation | Content server, information processing apparatus, network device, content distribution method, information processing method, and content distribution system |
EP2329395A2 (en) * | 2008-09-19 | 2011-06-08 | Limelight Networks, Inc. | Content delivery network stream server vignette distribution |
US8516082B2 (en) | 2009-03-25 | 2013-08-20 | Limelight Networks, Inc. | Publishing-point management for content delivery network |
US8185477B2 (en) | 2008-12-31 | 2012-05-22 | Ericsson Television Inc. | Systems and methods for providing a license for media content over a network |
US8817596B2 (en) | 2009-01-09 | 2014-08-26 | Futurewei Technologies, Inc. | Protecting ingress and egress of a label switched path |
US20100226428A1 (en) * | 2009-03-09 | 2010-09-09 | Telephoto Technologies Inc. | Encoder and decoder configuration for addressing latency of communications over a packet based network |
US8909806B2 (en) | 2009-03-16 | 2014-12-09 | Microsoft Corporation | Delivering cacheable streaming media presentations |
US20110027417A1 (en) * | 2009-07-31 | 2011-02-03 | Patrick Joseph Corrigan | Process for Dusting Animal Food |
US8392748B2 (en) | 2009-10-06 | 2013-03-05 | Microsoft Corporation | Reliable media streaming |
US9532092B1 (en) | 2009-12-30 | 2016-12-27 | Akamai Technologies, Inc. | Multiple bitrate format-agnostic streaming architecture |
US8315305B2 (en) | 2010-03-26 | 2012-11-20 | Brain Corporation | Systems and methods for invariant pulse latency coding |
US9271052B2 (en) | 2010-05-10 | 2016-02-23 | Comcast Cable Communications, Llc | Grid encoded media asset data |
US8719880B2 (en) * | 2010-06-08 | 2014-05-06 | Panasonic Corporation | Content management server and content management method |
WO2012116078A1 (en) | 2011-02-23 | 2012-08-30 | Level 3 Communications, Llc | Analytics management |
EP2525587B1 (en) * | 2011-05-17 | 2017-07-05 | Alcatel Lucent | Method for streaming video content, node in a network for monitoring video content streaming |
US9197900B2 (en) | 2011-09-14 | 2015-11-24 | Mobitv, Inc. | Localized redundancy for fragment processing |
US8719440B2 (en) | 2011-09-14 | 2014-05-06 | Mobitv, Inc. | Intelligent device media stream caching |
US9942580B2 (en) * | 2011-11-18 | 2018-04-10 | At&T Intellecutal Property I, L.P. | System and method for automatically selecting encoding/decoding for streaming media |
CN103348691B (en) | 2011-11-29 | 2016-10-05 | 华为技术有限公司 | The method, apparatus and system of distribution live content |
WO2013085920A2 (en) | 2011-12-06 | 2013-06-13 | DISH Digital L.L.C. | Remote storage digital video recorder and related operating methods |
US9124671B2 (en) | 2011-12-07 | 2015-09-01 | Imagine Communicaions Corp. | Media service and method for delivery of stored media |
US20130177294A1 (en) | 2012-01-07 | 2013-07-11 | Aleksandr Kennberg | Interactive media content supporting multiple camera views |
US8996712B2 (en) | 2012-01-17 | 2015-03-31 | Wideorbit Inc. | Systems, methods and articles to provide content in networked environment |
US9462302B2 (en) | 2012-02-23 | 2016-10-04 | Mobitv, Inc. | Efficient delineation and distribution of media segments |
US9246741B2 (en) | 2012-04-11 | 2016-01-26 | Google Inc. | Scalable, live transcoding with support for adaptive streaming and failover |
US9042441B2 (en) * | 2012-04-25 | 2015-05-26 | At&T Intellectual Property I, Lp | Apparatus and method for media streaming |
KR101967169B1 (en) * | 2012-05-16 | 2019-04-09 | 삼성전자주식회사 | Synchronization method and apparatus in device to device network |
US9118425B2 (en) | 2012-05-31 | 2015-08-25 | Magnum Semiconductor, Inc. | Transport stream multiplexers and methods for providing packets on a transport stream |
US8887215B2 (en) | 2012-06-11 | 2014-11-11 | Rgb Networks, Inc. | Targeted high-value content in HTTP streaming video on demand |
US20140140417A1 (en) | 2012-11-16 | 2014-05-22 | Gary K. Shaffer | System and method for providing alignment of multiple transcoders for adaptive bitrate streaming in a network environment |
US9276978B2 (en) | 2012-12-31 | 2016-03-01 | Microsoft Technology Licensing, Llc | Program based caching in live media distribution |
US10547882B2 (en) | 2012-12-31 | 2020-01-28 | Dish Technologies Llc | Systems and methods for generating concatenated transport streams from adaptive media streams |
GB2522373A (en) | 2013-01-09 | 2015-07-22 | Qatar Foundation | Storage system and method of storing and managing data |
WO2015003250A1 (en) | 2013-07-11 | 2015-01-15 | Dejero Labs Inc. | Systems and methods for transmission of data streams |
US9529888B2 (en) * | 2013-09-23 | 2016-12-27 | Spotify Ab | System and method for efficiently providing media and associated metadata |
JP6420850B2 (en) | 2014-05-06 | 2018-11-07 | ティヴォ ソリューションズ インコーポレイテッド | Cloud-based media content management |
US10033824B2 (en) | 2014-06-30 | 2018-07-24 | Samsung Electronics Co., Ltd. | Cache manifest for efficient peer assisted streaming |
US10484447B2 (en) | 2014-12-24 | 2019-11-19 | Ribbon Communications Operating Company, Inc. | Methods and apparatus for communicating delay information and minimizing delays |
US20160191961A1 (en) * | 2014-12-31 | 2016-06-30 | Imagine Communications Corp. | Fragmented video transcoding systems and methods |
US10129050B2 (en) | 2015-03-12 | 2018-11-13 | Maged E. Beshai | Contiguous network for cloud communications |
US9838725B2 (en) * | 2015-04-27 | 2017-12-05 | Century Link Intellectual Property LLC | Intelligent video streaming system |
US10356146B2 (en) * | 2015-07-08 | 2019-07-16 | International Business Machines Corporation | Processing of streamed multimedia data |
US20170055007A1 (en) | 2015-08-19 | 2017-02-23 | Ericsson Ab | System and method for managing segment delivery and bandwidth responsive to encoding complexity metrics |
US10104137B2 (en) | 2015-12-09 | 2018-10-16 | Telefonaktiebolaget Lm Ericsson (Publ) | Recording of ABR content |
US9426543B1 (en) | 2015-12-18 | 2016-08-23 | Vuclip (Singapore) Pte. Ltd. | Server-based video stitching |
US10506262B2 (en) * | 2015-12-29 | 2019-12-10 | Telefonaktiebolaget Lm Ericsson (Publ) | Method and system for optimized media delivery |
US20170272792A1 (en) * | 2016-03-16 | 2017-09-21 | Telefonaktiebolaget Lm Ericsson (Publ) | Distributed content popularity determination in a streaming environment with interconnected set-top boxes |
US10334006B2 (en) | 2016-03-29 | 2019-06-25 | Comcast Cable Communications, Llc | Aligning content packager instances |
US10009659B2 (en) | 2016-03-31 | 2018-06-26 | Disney Enterprises, Inc. | System and method for hybrid push-based streaming |
US10687115B2 (en) * | 2016-06-01 | 2020-06-16 | Time Warner Cable Enterprises Llc | Cloud-based digital content recorder apparatus and methods |
US10063613B2 (en) | 2016-11-15 | 2018-08-28 | Genvid Technologies, Inc. | Systems and methods for utilizing client-side synchronization of video and overlay |
US10148990B2 (en) | 2016-12-22 | 2018-12-04 | Cisco Technology, Inc. | Video streaming resource optimization |
US10931988B2 (en) | 2017-09-13 | 2021-02-23 | Amazon Technologies, Inc. | Distributed multi-datacenter video packaging system |
EP3682641A4 (en) | 2017-09-15 | 2021-01-20 | Imagine Communications Corp. | Systems and methods for playout of fragmented video content |
-
2017
- 2017-12-13 US US15/841,079 patent/US10931988B2/en active Active
- 2017-12-13 US US15/841,119 patent/US10298968B2/en active Active
- 2017-12-13 US US15/841,197 patent/US10757453B2/en active Active
- 2017-12-13 US US15/841,180 patent/US10469883B2/en active Active
- 2017-12-13 US US15/841,091 patent/US10887631B2/en active Active
- 2017-12-13 US US15/841,176 patent/US10542302B2/en active Active
-
2018
- 2018-09-12 WO PCT/US2018/050748 patent/WO2019055564A1/en unknown
- 2018-09-12 EP EP18789276.5A patent/EP3682617B1/en active Active
- 2018-09-12 CN CN201880059257.0A patent/CN111684777B/en active Active
- 2018-09-12 EP EP21204808.6A patent/EP3965404B1/en active Active
-
2021
- 2021-01-04 US US17/140,670 patent/US11310546B2/en active Active
-
2022
- 2022-04-18 US US17/659,625 patent/US20220295128A1/en not_active Abandoned
Also Published As
Publication number | Publication date |
---|---|
US20190082198A1 (en) | 2019-03-14 |
CN111684777B (en) | 2023-05-19 |
US20190082201A1 (en) | 2019-03-14 |
US20190082199A1 (en) | 2019-03-14 |
CN111684777A (en) | 2020-09-18 |
US20190082238A1 (en) | 2019-03-14 |
US20210127151A1 (en) | 2021-04-29 |
US20190082217A1 (en) | 2019-03-14 |
US20220295128A1 (en) | 2022-09-15 |
US10469883B2 (en) | 2019-11-05 |
US10931988B2 (en) | 2021-02-23 |
US10757453B2 (en) | 2020-08-25 |
CN116389431A (en) | 2023-07-04 |
US20190082197A1 (en) | 2019-03-14 |
EP3682617A1 (en) | 2020-07-22 |
US10542302B2 (en) | 2020-01-21 |
US10887631B2 (en) | 2021-01-05 |
WO2019055564A1 (en) | 2019-03-21 |
US11310546B2 (en) | 2022-04-19 |
EP3965404A1 (en) | 2022-03-09 |
EP3965404B1 (en) | 2023-03-22 |
US10298968B2 (en) | 2019-05-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3682617B1 (en) | Distributed multi-datacenter video packaging system | |
US11038942B2 (en) | Optimizing adaptive bit rate streaming at edge locations | |
US11064230B2 (en) | Optimizing adaptive bit rate streaming for content delivery | |
US11470326B2 (en) | Encoder output coordination | |
US20150052236A1 (en) | Load based target alteration in streaming environments | |
US20140325023A1 (en) | Size prediction in streaming enviroments | |
US20220060530A1 (en) | Managing encoder updates | |
US11057654B1 (en) | Redundant encoder bandwidth load balancing for live video streaming | |
US11647239B1 (en) | Multi-encoder bandwidth load balancing for live video streaming | |
CN116389431B (en) | System for managing streaming content and method for managing content transmission | |
US10893303B1 (en) | Streaming chunked media segments | |
US10904309B1 (en) | Managing storage and transmission data size in video packaging systems | |
US11638050B1 (en) | Managing video encoders utilizing IoT-based communications | |
US11432025B1 (en) | Multi-encoder bandwidth load balancing based on video format for live video streaming | |
KR102589694B1 (en) | Storage device, operating method of storage device, and streaming system including storage device | |
US11368505B2 (en) | Dynamic variant list modification to achieve bitrate reduction | |
US11025969B1 (en) | Video packaging system using source encoding | |
US20230336620A1 (en) | Predetermining network route for content steering | |
US10708607B1 (en) | Managing encoding based on performance | |
US10887632B1 (en) | Dynamic distribution of encoded content to media endpoints |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20200228 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04L 29/08 20060101AFI20210707BHEP Ipc: H04L 29/06 20060101ALI20210707BHEP Ipc: H04N 21/231 20110101ALI20210707BHEP Ipc: H04N 21/239 20110101ALI20210707BHEP Ipc: H04N 21/2343 20110101ALI20210707BHEP Ipc: H04N 21/234 20110101ALI20210707BHEP Ipc: H04N 21/24 20110101ALI20210707BHEP Ipc: H04N 21/4402 20110101ALI20210707BHEP Ipc: H04N 21/643 20110101ALI20210707BHEP Ipc: H04N 21/433 20110101ALI20210707BHEP Ipc: H04N 21/8547 20110101ALI20210707BHEP |
|
INTG | Intention to grant announced |
Effective date: 20210803 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1461604 Country of ref document: AT Kind code of ref document: T Effective date: 20220115 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602018029199 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20220105 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1461604 Country of ref document: AT Kind code of ref document: T Effective date: 20220105 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220105 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220105 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220105 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220505 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220405 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220105 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220105 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220105 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220405 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220105 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220105 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220406 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220105 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220105 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220505 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602018029199 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220105 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220105 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220105 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220105 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220105 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220105 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220105 |
|
26N | No opposition filed |
Effective date: 20221006 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220105 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220105 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20220930 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230518 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220912 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220930 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220105 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220912 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220930 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220930 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20230927 Year of fee payment: 6 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230925 Year of fee payment: 6 Ref country code: DE Payment date: 20230927 Year of fee payment: 6 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220105 |