US20130263195A1 - Multistream video communication with staggered access points - Google Patents
Multistream video communication with staggered access points Download PDFInfo
- Publication number
- US20130263195A1 US20130263195A1 US13/902,006 US201313902006A US2013263195A1 US 20130263195 A1 US20130263195 A1 US 20130263195A1 US 201313902006 A US201313902006 A US 201313902006A US 2013263195 A1 US2013263195 A1 US 2013263195A1
- Authority
- US
- United States
- Prior art keywords
- video information
- streams
- video
- stream
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000004891 communication Methods 0.000 title description 45
- 238000000034 method Methods 0.000 claims abstract description 83
- 238000012545 processing Methods 0.000 claims abstract description 35
- 230000008569 process Effects 0.000 claims description 12
- 238000012508 change request Methods 0.000 claims description 9
- 230000002123 temporal effect Effects 0.000 description 15
- 238000010586 diagram Methods 0.000 description 14
- 230000005540 biological transmission Effects 0.000 description 12
- 230000003111 delayed effect Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 241000023320 Luma <angiosperm> Species 0.000 description 3
- 230000001934 delay Effects 0.000 description 3
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000006073 displacement reaction Methods 0.000 description 2
- 230000000977 initiatory effect Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010348 incorporation Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25866—Management of end-user data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
- H04N5/50—Tuning indicators; Automatic tuning control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
- H04N21/26266—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists for determining content or additional data repetition rate, e.g. of a file in a DVB carousel according to its importance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
- H04N21/26275—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists for distributing content or additional data in a staggered manner, e.g. repeating movies on different channels in a time-staggered manner in a near video on demand system
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/426—Internal components of the client ; Characteristics thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
- H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/16—Analogue secrecy systems; Analogue subscription systems
- H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
- H04N7/17309—Transmission or handling of upstream communications
- H04N7/17318—Direct or substantially direct transmission and handling of requests
Definitions
- a user may specify a viewing channel corresponding to video information that the user is interested in viewing. Further for example, a user may select a video information title from a menu, a user may enter a channel up/down request, or a user may sequence through a list of favorite video channels.
- Latency time between when the user requests video information and when the system presents the requested video information to the user.
- causes may comprise, without limitation, request processing delays, information communication delays and information processing delays.
- users prefer that the latency time between a video information request and presentation of the requested video information to the user be minimized.
- Various aspects of the present invention provide a system and method that provide reduced latency in a video signal processing system.
- Various aspects of the present invention may comprise transmitting a first video information stream representative of a unit of video information.
- the transmitted first video information stream may, for example, correspond to a video channel.
- a video transmitter may, for example, perform such transmitting.
- a second video information stream representative of the unit of video information may be transmitted simultaneously with the first video information stream.
- the transmitted second video information stream may also, for example, correspond to the video channel.
- a video transmitter may, for example, perform such transmitting
- the second video information stream may, for example, comprise a time delayed version of the first video information stream.
- a time delay module may be utilized to form such a time delayed version.
- the second video information stream may also, for example, be generated from the unit of information independently of the first video information stream.
- An encoder module may, for example, perform such generation.
- the first video information stream may comprise a first encoded version of the unit of information
- the second video information stream may comprise a second encoded version of the unit of information.
- the first and second encoded versions may, for example, be formed using identical or different encoding techniques.
- the first and second encoded versions may, for example, be encoded at identical or different quality levels.
- the transmitted first and second video information streams may each comprise respective sets of access points.
- the transmitted first and second video information streams may be generally temporally aligned, and the respective access points of the temporally aligned transmitted information streams may be generally temporally displaced.
- Various aspects of the present invention may comprise receiving a request for a unit of video information.
- a request may, for example, originate from a user that desired to view the unit of video information.
- a request may also, for example, originate from a device automatically.
- Such a request may, for example and without limitation, comprise a channel change request.
- a plurality of video information streams that are representative of the requested unit of information may be received. Such reception may, for example, occur simultaneously.
- a video receiver module may, for example, perform such receiving.
- the plurality of video information streams may, for example and without limitation, correspond to the same video channel.
- a video information stream of the received plurality of video information streams may be identified that, when processed, is expected to result in the lowest latency in presenting the requested unit of video information.
- a processor module may perform such a stream identification.
- the lowest latency video information stream may, for example, be identified according to predicted or observed time of arrival of respective access points in the received plurality of video information streams.
- the identified video information stream may then be processed to present the unit of video information.
- a processor module may perform such processing.
- the processing may, for example, generate a video display driver signal, which may be provided to a display device.
- the display device may then, for example, present the requested unit of video information in human-perceivable form.
- FIG. 1 is a diagram showing an exemplary video communication system that provides reduced latency, in accordance with various aspects of the present invention.
- FIG. 2 is a flow diagram illustrating an exemplary method for providing reduced latency in a video transmission system, in accordance with various aspects of the present invention.
- FIG. 3 is a diagram showing an exemplary video transmission system that provides reduced latency, in accordance with various aspects of the present invention.
- FIG. 4 is a diagram showing an exemplary video transmission system that provides reduced latency, in accordance with various aspects of the present invention.
- FIG. 5 is a diagram showing an exemplary video transmission system that provides reduced latency, in accordance with various aspects of the present invention.
- FIG. 6 is a flow diagram illustrating an exemplary method for providing reduced latency in a video reception system, in accordance with various aspects of the present invention.
- FIG. 7 is a diagram showing an exemplary video reception system that provides reduced latency, in accordance with various aspects of the present invention.
- FIG. 1 is a diagram showing an exemplary video communication system 100 that provides reduced latency, in accordance with various aspects of the present invention.
- the exemplary video communication system 100 may comprise an information source 110 , a transmitter 120 and a receiver 130 .
- information source 110 Various aspects of the information source 110 , transmitter 120 and receiver 130 will be discussed in more detail later.
- the exemplary video information source 110 may, for example, provide a first video information stream representative of a unit of video information.
- the first video information stream may, for example and without limitation, comprise a serial stream of video-related data.
- a serial stream may comprise video data that has been encoded according to a block encoding standard (e.g., MPEG-2, MPEG-4, MPEG-4 AVC, etc.).
- a serial stream may comprise video data that has not been encoded according to a block encoding standard (e.g., digitized chroma and luma information). Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular type of video information or a particular type of video information stream.
- the unit of video information may comprise any of a large variety of types of units of video information.
- the unit of video information may comprise information of a television program, a movie, a music video, kinetic video art, a video commercial, a teleconference, etc.
- a unit of video information may, for example, be requested by a user or may be communicated automatically.
- a unit of video information may, for example, be unicast, multicast or broadcast. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular unit of video information.
- the exemplary video information source 110 may also, for example, provide a second video information stream representative of the unit of video information (i.e., the same unit of video information that the first video information stream is representative of).
- the second video information stream may share various characteristics with the first video information stream.
- the second video information stream may correspond to a time-shifted version of the first video information stream.
- the first and second video information streams may be formed by encoding the unit of video information according to different respective encoding methods.
- the first and second video information streams may be encoded to provide temporally staggered (or alternating) access points when the first and second video information streams are temporally synchronized overall.
- the first and second video information streams may be encoded to provide different respective numbers of access points.
- Such different respective encodings may comprise encoding the unit of video information to generally identical respective quality levels or generally different respective quality levels.
- an access point may be generally considered to be a point at which decoding (or further processing) of a video stream may conveniently begin.
- decoding (or otherwise processing) an access point might require a minimal amount of video information communicated prior to the access point.
- various block-encoding schemes may utilize inter-coded and intra-coded frames for communicating video information, where intra-coded frames may generally be decoded (or otherwise processed) with no (or minimal) knowledge of information from previously communicated video frames, and inter-coded frames are generally decoded (or otherwise processed) utilizing information from previously communicated video frames.
- Such an intra-coded frame may provide a non-limiting example of an access point.
- the first and second video information streams are each representative of the unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of particular encoding and/or time-shifting methods, or by characteristics of particular access points.
- the exemplary video information source 110 may comprise any of a large variety of video information source characteristics.
- the video information source 110 may comprise a transmitter of a live video broadcast or a database of video information.
- the exemplary video information source 110 may be located in any of a large variety of geographical locations.
- the video information source 110 may be co-located with the transmitter 120 .
- the video information source 110 may be communicatively coupled with the transmitter 120 through a communication network. In such a scenario, the video information source 110 may comprise characteristics of a head-end communication node or an intermediary communication node.
- Such a communication network may, for example, be based on any of a large variety of communication media (e.g., wired, wireless RF, tethered optical, non-tethered optical, etc.).
- Such a communication network may, for example, comprise a television network, computer network, radio network, telephone network, etc. Communication over the communication network may utilize any of a large variety of communication protocols (e.g., television protocols, telephone protocols, data communication protocols, audio protocols, etc.).
- the video information source 110 may comprise any of a large variety of video information source characteristics. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular video information source.
- the exemplary transmitter 120 may receive the first video information stream from the video information source 110 , and may also receive the second video information stream from the video information source 110 .
- the exemplary transmitter 120 may transmit the first video information stream.
- the transmitter 120 may, for example, transmit the first video information stream in a manner in which the first video information stream will correspond to a video channel (e.g., a television channel, video program or other video communication channel).
- a video channel e.g., a television channel, video program or other video communication channel.
- the exemplary transmitter 120 may also transmit the second video information stream simultaneously with the first video information stream.
- the transmitter 120 may transmit the second video information stream in a manner in which the second video information stream will correspond to the same video channel to which the first video information stream corresponds.
- the transmitter 120 may transmit the first and second video information streams in a manner in which both the first and second video information streams correspond to television channel M.
- the transmitter 120 may, for example, transmit the first and second video information streams in this manner, even though the first and second video information streams may each comprise information of the same unit of video information.
- the exemplary transmitter 120 may transmit the first and second video information streams such that the first and second video information streams are substantially temporally aligned.
- the transmitted first and second video information streams may be temporally aligned to within one-to-two seconds (or one-to-two minutes).
- the transmitted first and second video information streams may be temporally aligned to less than the average time between access points in the first video information stream.
- the first and second video information streams may each comprise respective access points.
- the exemplary transmitter 120 may transmit the first and second video information streams such that access points of the transmitted first video information stream are generally temporally displaced from access points of the transmitted second video information stream.
- access points of the transmitted first video information stream may be generally temporally staggered (or alternated) with access points of the transmitted second video information stream.
- access points within a video information stream may have variable temporal spacing, access points of the transmitted first and second video streams may be generally temporally displaced, while a portion of the access points may also be temporally aligned.
- such temporal displacement or staggering of access points need not be perfectly symmetrical.
- the access points of the transmitted streams may be temporally staggered (or alternated) asymmetrically. That is, an access point of the transmitted first video information stream may be transmitted, followed by one, two, or P access points of the transmitted second video information stream, and then followed by the next access point of the first video information stream.
- the transmitter 120 may transmit the first and second video information streams simultaneously and corresponding to the same video channel. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular temporal relationship between the transmitted video information streams or by a particular temporal relationship between access points of the transmitted video information streams.
- the exemplary transmitter 120 may, for example, transmit the first and second video information streams over any of a variety of communication network types, utilizing any of a variety of communication media, utilizing any of a variety of modulation techniques and utilizing any of a variety of communication protocols.
- the transmitter 120 may transmit the first and second video information streams over a television network, radio network, telephone network, computer network, etc.
- the transmitter 120 may, for example, transmit the first and second video information streams over wired, wireless or optical communication media.
- the transmitter 120 may, for example, transmit the first and second video information streams utilizing a television protocol, telephone protocol, data communication protocol, audio protocol, etc.
- the transmitter 120 may transmit the first and second video information streams over a cable or satellite television network.
- the exemplary transmitter 120 may, for example, transmit the first and second video information streams as components of a multi-stream communication channel (e.g., as components of a single QAM channel).
- Such an exemplary transmission may, for example, provide for the first and second video information streams to be more easily received using a single tuner/receiver pair.
- the first and second video information streams may comprise respective access points.
- the transmitter 120 may also transmit information of access point timing for at least one of the first and second video information streams.
- a receiver may utilize such information to determine which of the first and second video information streams will communicate the next access point.
- the transmitter 120 may transmit the first and second video information streams simultaneously and corresponding to the same video channel. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular communication network, media, modulation technique or communication protocol.
- the exemplary receiver 130 may receive video information and process at least a portion of such received video information for presentation to a user.
- the exemplary receiver 130 may receive a plurality of video information streams as discussed previously.
- the exemplary receiver 130 may receive a request from a user (e.g., directly or through a programmed device) to present a unit of video information.
- the request may, for example and without limitation, comprise a video channel change request.
- the request may comprise a television channel change request.
- the receiver 130 may receive such a request in any of a large variety of ways. For example, the receiver 130 may receive such a request through a variety of user interfaces or device communication interfaces.
- the receiver 130 may receive a plurality of video information streams, each of which represents the requested unit of video information. For example and without limitation, the receiver 130 may receive the first and second video information streams discussed previously regarding the exemplary transmitter 120 . The exemplary receiver 130 may, for example, receive the plurality of video information streams over a single multi-stream communication channel or over a plurality of communication channels.
- the receiver 130 may also receive information of access point timing for at least one of the plurality of video information streams.
- information of access point timing may, for example and without limitation, comprise information indicating expected time of arrival for various access points in one or more of the plurality of video information streams.
- information of access point timing may, for example and without limitation, comprise information indicating which of the plurality of streams is expected to provide the next access point (i.e., the access point enabling the earliest commencement of video processing).
- the receiver 130 may identify which of the plurality of video information streams, when processed, is expected to result in the lowest latency (or delay) in presenting the unit of video information. For example, in an exemplary scenario where the receiver 130 may begin processing a video information stream at the next access point, the receiver 130 may identify which of the plurality of video information streams will communicate the next access point.
- the receiver 130 may identify which of the plurality of video information streams is expected to result in the lowest latency in any of a variety of ways. For example, the receiver 130 may identify access points in each of the plurality of video information streams to determine which of the plurality of video information streams communicates the next access point. Also for example, the receiver 130 may identify access points in one of the plurality of video information streams and (e.g., based on a known temporal relationship between access points in the respective plurality of video information streams) determine which of the plurality of video information streams will communicate the next access point. Alternatively, for example, the receiver 130 may receive information of access point timing and analyze such information to determine which of the plurality of video information streams will communicate the next access point.
- the receiver 130 may identify which of the received plurality of video information streams, when processed, is expected to result in the lowest latency in presenting the unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular way of identifying the lowest latency video information stream.
- the receiver 130 may process the identified video information stream to present the unit of video information (e.g., to a user).
- the receiver 130 may, for example and without limitation, decode the identified video information stream.
- the receiver 130 may, for example, convert the identified video information stream to a display driver signal, which the receiver 130 may utilize to drive a display device that is coupled to the receiver 130 .
- the receiver 130 may also, for example, perform conditional access processing related to the identified video information stream.
- the receiver 130 may process the identified video information stream to present the unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of particular processing activities performed with video information to present such information to a user.
- the receiver 130 may also process a second video information stream.
- the receiver 130 may begin processing the second video information stream concurrently with processing the first video information stream.
- the receiver 130 may cease processing the first video information stream after the receiver 130 has begun processing the second video information stream.
- the receiver 130 may begin processing the second video information stream after commencing processing of the first video information stream without processing the two streams concurrently.
- the receiver 130 might process first one stream and then another stream if the second stream is expected to result in higher quality video display.
- FIG. 2 is a flow diagram illustrating an exemplary method 200 for providing reduced latency in a video transmission system, in accordance with various aspects of the present invention.
- the exemplary method 200 may, for example and without limitation, be performed by various components of the exemplary system 100 (e.g., the information source 110 and/or the transmitter 120 ) illustrated in FIG. 1 and discussed previously.
- the exemplary method 200 may begin at step 210 in response to any of a large variety of causes and conditions.
- the method 200 may begin when a television transmission system implementing the method 200 receives a request for a unit of video information.
- the method 200 may begin when a transmission system implementing the method 200 is powered up or initialized. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of any particular initiating events or conditions.
- the exemplary method 200 may, at step 220 , comprise obtaining a first video information stream representative of a unit of video information.
- Step 220 may, for example and without limitation, comprise obtaining the first video information stream from an information source (e.g., an information source as discussed previously with regard to the information source 110 illustrated in FIG. 1 ).
- an information source e.g., an information source as discussed previously with regard to the information source 110 illustrated in FIG. 1 .
- the first video information stream may, for example and without limitation, comprise a serial stream of video-related data.
- a serial stream may comprise video data that has been encoded according to a block encoding standard (e.g., MPEG-2, MPEG-4, MPEG-4 AVC, etc.).
- a serial stream may comprise video data that has not been encoded according to a block encoding standard (e.g., digitized chroma and luma information). Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular type of video information or a particular type of video information stream.
- the unit of video information may comprise any of a large variety of types of units of video information.
- the unit of video information may comprise information of a television program, a movie, a music video, kinetic video art, a video commercial, a teleconference, etc.
- a unit of video information may, for example, be requested by a user or may be communicated automatically.
- a unit of video information may, for example, be unicast, multicast or broadcast. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular unit of video information.
- Step 220 may comprise obtaining the first video information stream in any of a variety of manners.
- step 220 may comprise receiving the first video information stream from a database.
- a database may, for example, be a local database or a networked database.
- Step 220 may, for example, comprise obtaining the unit of video information from a video information source and generating the first video information stream from the obtained unit of video information.
- Step 220 may, for example, comprise obtaining the unit of video information from a local source or through a networked source.
- Such generating may, for example and without limitation, comprise encoding the unit of video information into the first video information stream.
- Such generating may comprise encoding the unit of video information according to any of a large variety of encoding techniques and quality levels.
- step 220 may comprise obtaining a first video information stream representative of the unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of the first video information stream, the unit of video information, a source of the first video information stream, a source of the unit of video information, or a way of obtaining the first video information stream.
- the exemplary method 200 may, at step 230 , comprise obtaining a second video information stream representative of the unit of video information (i.e., the same unit of video information that the first video information stream obtained at step 220 is representative of).
- Step 230 may, for example and without limitation, comprise obtaining the second video information stream from an information source (e.g., an information source as discussed previously with regard to the information source 110 illustrated in FIG. 1 ).
- the second video information stream may share various characteristics with the first video information stream discussed previously.
- Step 230 may comprise obtaining the second video information stream in any of a variety of manners.
- step 230 may comprise receiving the second video information from a database.
- a database may, for example, be a local database or a networked database.
- Step 230 may comprise generating a time-delayed version of the first video information stream, obtained at step 220 .
- a time-delayed version may, for example, be temporally delayed relative to the first video information stream by less than the average time between access points in the first video information stream.
- Such a time-delayed version may, for example, be delayed relative to the first video information stream by a particular temporal quantity (e.g., one or two seconds, or one or two minutes).
- Step 230 may, for example, comprise obtaining the unit of video information and generating the second video information stream from the unit of video information.
- Step 230 may, for example, comprise obtaining the unit of video information from a local source or through a communication network.
- Such generating may, for example and without limitation, comprise encoding the unit of video information into the second video information stream.
- Such generating may comprise encoding the unit of video information according to any of a large variety of encoding techniques and quality levels.
- steps 220 and 230 may comprise encoding the unit of information at respective quality levels.
- quality levels may, for example, be substantially identical or may be substantially different.
- step 230 may comprise obtaining a second video information stream representative of the unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of the second video information stream, the unit of video information, a source of the second video information stream, a source of the unit of video information, or a way of obtaining the second video information stream.
- the exemplary method 200 may, at step 240 , comprise transmitting the first video information stream.
- step 240 may comprise transmitting the first video information stream in a manner in which the first video information stream will correspond to a video channel (e.g., a television channel, video program or other video communication channel).
- a video channel e.g., a television channel, video program or other video communication channel.
- the exemplary method 200 may, at step 250 , comprise transmitting the second video information stream.
- step 250 may comprise transmitting the second video information stream in a manner in which the second video information stream will correspond to the video channel (i.e., the same channel to which the first video information stream corresponds).
- steps 240 and 250 may comprise transmitting the first and second video information streams in a manner in which both the first and second video information streams correspond to television channel M.
- the exemplary steps 240 and 250 may, for example, comprise transmitting the first and second video information streams in this manner, even though the first and second video information streams may each comprise information of the same unit of video information.
- Exemplary steps 240 and 250 may comprise transmitting the first and second video information streams such that the first and second video information streams are substantially temporally aligned.
- the transmitted first and second video information streams may be temporally aligned to within one-to-two seconds (or one-to-two minutes).
- the transmitted first and second video information streams may be temporally aligned to less than the average time between access points in the first video information stream.
- the first and second video information streams may each comprise respective access points.
- Exemplary steps 240 and 250 may, for example, comprise transmitting the first and second video information streams such that access points of the transmitted first video information stream are generally temporally displaced from access points of the transmitted second video information stream.
- access points of the transmitted first video information stream may be generally temporally staggered (or alternated) with access points of the transmitted second video information stream. Note, however, that since access points within a video information stream may have variable temporal spacing, access points of the transmitted first and second video streams may be generally temporally displaced, while a portion of the access points may also be temporally aligned.
- the access points of the transmitted streams may be temporally staggered (or alternated) asymmetrically. That is, an access point of the transmitted first video information stream may be transmitted, followed by one, two or P access points of the transmitted second video information stream, and then followed by the next access point of the first video information stream.
- steps 240 and 250 may comprise transmitting the first and second video information streams simultaneously and corresponding to the same video channel. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular temporal relationship between the transmitted video information streams or by a particular temporal relationship between access points of the transmitted video information streams.
- the exemplary steps 240 and 250 may, for example, comprise transmitting the first and second video information streams over any of a variety of communication network types, utilizing any of a variety of communication media, utilizing any of a variety of modulation techniques, and utilizing any of a variety of communication protocols.
- steps 240 and 250 may comprise transmitting the first and second video information streams over a television network, radio network, telephone network, computer network, etc.
- the steps 240 and 250 may, for example, comprise transmitting the first and second video information streams over wired, wireless or optical communication media.
- the steps 240 and 250 may, for example, comprise transmitting the first and second video information streams utilizing a television protocol, telephone protocol, data communication protocol, audio protocol, etc.
- steps 240 and 250 may comprise transmitting the first and second video information streams over a cable or satellite television network.
- the exemplary steps 240 and 250 may, for example, comprise transmitting the first and second video information streams as components of a multi-stream communication channel (e.g., as components of a single QAM channel).
- Such an exemplary transmission may, for example, provide for the first and second video information streams to be more easily received using a single tuner/receiver pair.
- the first and second video information streams may comprise respective access points.
- steps 240 and 250 may also comprise transmitting information of access point timing for at least one of the first and second video information streams.
- a receiver may utilize such information to determine which of the first and second video information streams will communicate the next access point.
- exemplary steps 240 and 250 may comprise transmitting the first and second video information streams simultaneously and corresponding to the same video channel. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular communication network, media, modulation technique or communication protocol.
- FIG. 3 is a diagram showing an exemplary video transmission system 300 that provides reduced latency, in accordance with various aspects of the present invention.
- the exemplary system 300 may comprise an information source 310 and a transmitter 320 .
- the information source 310 and transmitter 320 may, for example and without limitation, share various characteristics with the information source 110 and transmitter 120 illustrated in FIG. 1 and discussed previously.
- the exemplary information source 310 and transmitter 320 may perform various aspects of the method 200 illustrated in FIG. 2 and discussed previously.
- the exemplary information source 310 may, for example, comprise an information source sub-module 312 and a buffer module 315 .
- the information source sub-module 312 may provide a first video information stream.
- the first video information stream may share various characteristics with the first video information streams discussed previously.
- the information source sub-module 312 may, for example, provide a first video information stream representative of a unit of video information.
- the first video information stream may, for example and without limitation, comprise a serial stream of video-related data.
- a serial stream may comprise video data that has been encoded according to a block encoding standard (e.g., MPEG-2, MPEG-4, MPEG-4 AVC, etc.).
- a serial stream may comprise video data that has not been encoded according to a block encoding standard (e.g., digitized chroma and luma information). Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular type of video information or a particular type of video information stream.
- the unit of video information may comprise any of a large variety of types of units of video information.
- the unit of video information may comprise information of a television program, a movie, a music video, kinetic video art, a video commercial, a teleconference, etc.
- a unit of video information may be requested by a user or may be communicated automatically.
- a unit of video information may be unicast, multicast or broadcast. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular unit of video information.
- the information source sub-module 312 may, for example, provide the first video information stream to the transmitter 320 .
- the information source sub-module 312 may also, for example, provide the first video information stream to the buffer module 315 .
- the buffer module 315 may, for example, receive the first video information stream and output a second video information stream comprising a time-shifted version of the first video information stream.
- the buffer module 315 may generate a time-delayed version of the first video information stream (e.g., as discussed previously regarding step 230 of the exemplary method 200 illustrated in FIG. 2 and discussed previously).
- the transmitter 320 may receive the first video information stream and the second video information stream from the information source 310 (e.g., from the information source sub-module 312 and the buffer module 315 , respectively). The exemplary transmitter 320 may then, for example, transmit the first and second video information streams.
- the transmitter may share various characteristics with the exemplary transmitter 120 illustrated in FIG. 1 and discussed previously.
- the exemplary transmitter 320 may perform various aspects of the exemplary method 200 (e.g., steps 240 and 250 ) illustrated in FIG. 2 and discussed previously.
- FIG. 4 is a diagram showing an exemplary video transmission system 400 that provides reduced latency, in accordance with various aspects of the present invention.
- the exemplary system 400 may comprise an information source 410 and a transmitter 420 .
- the information source 410 and transmitter 420 may, for example and without limitation, share various characteristics with the information source 110 and transmitter 120 illustrated in FIG. 1 and discussed previously, and with the information source 310 and transmitter 320 illustrated in FIG. 3 and discussed previously.
- the exemplary information source 410 and transmitter 420 may perform various aspects of the method 200 illustrated in FIG. 2 and discussed previously.
- the exemplary information source 410 may, for example, comprise an information source sub-module 412 , an encoder module 413 and a buffer module 415 .
- the information source sub-module 412 may provide a unit of video information. As discussed previously, such a unit of video information may comprise any of a large variety of types of units of video information and/or characteristics thereof.
- the encoder module 413 may, for example, receive the unit of video information from the information source sub-module 412 and output a first video information stream representative of the unit of video information.
- the first video information stream may, for example and without limitation, share various characteristics with the first video information streams discussed previously.
- the first video information stream may comprise a serial stream of video-related data.
- the first video information stream may, for example, comprise a stream of encoded video data corresponding to the unit of video information received from the information source sub-module 412 .
- the encoder module 413 may provide the first video information stream to the transmitter 420 .
- the encoder module 413 may also, for example, provide the first video information stream to the buffer module 415 .
- the buffer module 415 (or a general time delay module) may, for example, receive the first video information stream from the encoder module 413 and output a second video information stream comprising a time-shifted version of the first video information stream.
- the buffer module 415 may generate a time-delayed version of the first video information stream (e.g., as discussed previously regarding step 230 of the exemplary method 200 illustrated in FIG. 2 and discussed previously).
- the buffer module 415 may share various characteristics with the buffer module 315 of the exemplary system 300 illustrated in FIG. 3 and discussed previously.
- the transmitter 420 may receive the first video information stream and the second video information stream from the information source 410 (e.g., from the encoder module 413 and the buffer module 415 , respectively). The exemplary transmitter 420 may then, for example, transmit the first and second information streams. For example and without limitation, the transmitter 420 may share various characteristics with the exemplary transmitter 120 illustrated in FIG. 1 and discussed previously and the exemplary transmitter 320 illustrated in FIG. 3 and discussed previously. Also for example and without limitation, the exemplary transmitter 420 may perform various aspects of the exemplary method 200 (e.g., steps 240 and 250 ) illustrated in FIG. 2 and discussed previously.
- FIG. 5 is a diagram showing an exemplary video transmission system 500 that provides reduced latency, in accordance with various aspects of the present invention.
- the exemplary system 500 may comprise an information source 510 and a transmitter 520 .
- the information source 510 and transmitter 520 may, for example and without limitation, share various characteristics with the information source 110 and transmitter 120 illustrated in FIG. 1 and discussed previously, with the information source 310 and transmitter 320 illustrated in FIG. 3 and discussed previously, and with the information source 410 and transmitter 420 illustrated in FIG. 4 and discussed previously.
- the exemplary information source 510 and transmitter 520 may perform various aspects of the method 200 illustrated in FIG. 2 and discussed previously.
- the exemplary information source 510 may, for example, comprise an information source sub-module 512 , a first encoder module 513 and a second encoder module 514 .
- the information source sub-module 512 may provide a unit of video information. As discussed previously, such a unit of video information may comprise any of a large variety of units of video information and/or characteristics thereof.
- the first encoder module 513 may, for example, receive the unit of video information from the information source sub-module 512 and output a first video information stream representative of the unit of video information.
- the first encoder module 513 may, for example, encode the unit of video information according to any of a large variety of encoding techniques and quality levels.
- the first information stream may, for example and without limitation, share various characteristics with the first video information streams discussed previously (e.g., as discussed regarding step 220 of exemplary method 200 ).
- the first video information stream may comprise a serial stream of video-related data.
- the first video information stream may, for example, comprise a stream of encoded video data corresponding to the unit of video information received from the information source sub-module 512 .
- the first encoder module 513 may provide the first video information stream to the transmitter 520 .
- the second encoder module 514 may, for example, receive the unit of video information from the information source sub-module 512 and output a second video information stream representative of the unit of video information.
- the second encoder module 514 may, for example, encode the unit of video information according to any of a large variety of encoding techniques and quality levels.
- the second encoder module 514 may encode the unit of information in a manner similar to the manner in which the first encoder module 513 encodes the unit of information.
- the second information stream may, for example and without limitation, share various characteristics with the first and/or second video information streams discussed previously (e.g., as discussed regarding step 230 of exemplary method 200 ).
- the second video information stream may comprise a serial stream of video-related data.
- the second video information stream may, for example, comprise a stream of encoded video data corresponding to the unit of video information received from the information source sub-module 512 .
- the second encoder module 514 may provide the second video information stream to the transmitter 520 .
- the first encoder module 513 and the second encoder module 514 may encode the first and second video information streams such that the access points of the first and second video information streams are temporally staggered (or alternating) when the first and second video information streams are temporally synchronized overall.
- the first encoder module 513 and the second encoder module 514 may encode the first and second video information streams such that the first and second video information streams comprise different respective numbers of access points.
- the first encoder module 513 and second encoder module 514 may encode the unit of information at respective quality levels.
- quality levels may, for example, be substantially identical or may be substantially different.
- the transmitter 520 may receive the first video information stream and the second video information stream from the information source 510 (e.g., from the first encoder module 513 and the second encoder module 514 respectively). The exemplary transmitter 520 may then, for example, transmit the first and second information streams. For example and without limitation, the transmitter 520 may share various characteristics with the exemplary transmitter 120 illustrated in FIG. 1 and discussed previously, the exemplary transmitter 320 illustrated in FIG. 3 and discussed previously, and the exemplary transmitter 420 illustrated in FIG. 4 and discussed previously. Also for example and without limitation, the exemplary transmitter 520 may perform various aspects of the exemplary method 200 (e.g., steps 240 and 250 ) illustrated in FIG. 2 and discussed previously.
- FIG. 6 is a flow diagram illustrating an exemplary method 600 for providing reduced latency in a video reception system, in accordance with various aspects of the present invention.
- the exemplary method 600 may, for example and without limitation, be performed by the receiver 130 of the exemplary system 100 illustrated in FIG. 1 and discussed previously.
- the exemplary method 600 may also, for example and without limitation, receive and/or process video information streams as produced by the exemplary method 200 illustrated in FIG. 2 and discussed previously, and the exemplary systems 300 - 500 illustrated in FIGS. 3-5 and discussed previously.
- the exemplary method 600 may begin at step 610 in response to any of a large variety of causes and conditions.
- the method 600 may begin when a video reception system implementing the method 600 receives a request for a unit of video information.
- the method 600 may begin when a video reception system implementing the method 200 is powered up or initialized. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of any particular initiating events or conditions.
- the exemplary method 600 may, at step 620 , comprise receiving a request for a unit of video information.
- a request may, for example, be originated by a user directly or indirectly (e.g., through a programmed device).
- the request may, for example and without limitation, comprise a video channel change request.
- the request may comprise a television channel change request.
- the request may comprise a request for a particular unit of video information, or a request for a particular unit of video information to be presented in a particular manner (e.g., at a particular rate and/or temporal direction).
- Exemplary step 620 may comprise receiving such a request in any of a large variety of ways.
- step 620 may comprise receiving the request through a variety of user interfaces or device communication interfaces.
- Step 620 may also, for example, comprise receiving the request from a local source or a remote source (e.g., through a communication network).
- exemplary step 620 may comprise receiving a request for a unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular request, source of a particular request, or manner of receiving a particular request.
- the exemplary method 600 may, at step 630 , comprise receiving a plurality of video information streams, each of which represents the requested unit of video information.
- each of the plurality of video information streams may correspond to a single video channel (e.g., a television channel or program).
- receiving a plurality of video streams may generally mean that the plurality of video information streams arrives at a system implementing the exemplary method 600 .
- the term “receiving” is by no means, in itself, to be construed as requiring particular signal processing.
- the term “receiving” is not to be construed, in itself, to require demodulation, data detection, decoding, decrypting or converting.
- various processing activities may be implied. For example and without limitation, in a scenario where specific received data is analyzed, some type of demodulation or data detection, if necessary to access the analyzed data, may be implied.
- step 630 may comprise receiving the plurality of video information streams over a single multi-stream communication channel.
- step 630 may comprise receiving the plurality of video information streams over multiple parallel communication channels.
- step 630 may also comprise receiving information of access point timing for at least one of the plurality of video information streams.
- information of access point timing may, for example and without limitation, comprise information indicating expected time of arrival for various access points in one or more of the plurality of video information streams.
- step 630 may comprise receiving a plurality of video information streams, each of which represents the requested unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular video information stream, video information stream source, or manner of receiving a video information stream.
- the exemplary method 600 may, at step 640 , comprise identifying which of the plurality of video information streams, when processed, is expected to result in the lowest latency in presenting the unit of video information. For example and without limitation, in an exemplary scenario where the method 600 may begin processing a video information stream at the next access point, step 640 may comprise identifying which of the plurality of received video information streams will communicate the next access point.
- Step 640 may, for example, comprise identifying which of the plurality of video information streams is expected to result in the lowest latency in any of a variety of ways.
- the step 640 may comprise identifying access points in each of the received plurality of video information streams to determine which of the received plurality of video information streams will communicate the next access point.
- step 640 may comprise identifying access points in one of the plurality of video information streams and (e.g., based on a known temporal relationship between access points in the respective plurality of video information streams) determine which of the received plurality of video information streams will communicate the next access point.
- step 640 may comprise receiving information of access point timing and analyzing such information to determine which of the plurality of video information streams will communicate the next access point.
- step 640 may comprise receiving information indicating which of the plurality of video information streams has more frequent access points and would therefore be expected generally to result in the lowest latency.
- the step 640 may comprise identifying which of the received plurality of video information streams, when processed, is expected to result in the lowest latency in presenting the unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular way of identifying the lowest latency video information stream.
- the exemplary method 600 may, at step 650 , comprise processing the identified video information stream to present the unit of video information.
- Step 650 may, for example, comprise processing the identified video information stream to present the unit of video information to a user (e.g., utilizing a video display device).
- Exemplary step 650 may, for example and without limitation, comprise decoding the video information stream identified at step 640 .
- Step 650 may, for example, comprise converting the identified video information stream to a display driver signal, which may be utilized to drive a display device.
- Step 650 may also, for example, comprise performing conditional access processing related to the identified video information stream.
- step 650 may comprise processing the identified video information stream to present the unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of particular processing activities performed with video information to present such information.
- the plurality of video information streams may represent the same unit of video information.
- a first video information stream may correspond to expected lower video presentation latency, while a second video information stream may correspond to a higher video quality.
- Steps 660 and 670 of the exemplary method 600 provide a non-limiting illustration of how such streams might be processed. Note that exemplary steps 660 and 670 are merely exemplary, and their presence or absence should by no means limit the scope of various aspects of the present invention.
- Exemplary step 660 may comprise identifying a second video information stream, where the second video information stream corresponds to higher quality video information than the video information stream identified at step 640 and processed at step 650 .
- the second video information stream may comprise video information having a higher temporal, spatial and/or color resolution.
- Exemplary step 670 may then comprise processing the identified second video information stream to present the video information to the user. For example and without limitation, when an access point into the second video information stream arrives (or relatively soon after) step 670 may comprise substituting video output corresponding to the second video information stream for video output corresponding to the originally identified video information stream and output at step 650 .
- FIG. 7 is a diagram showing an exemplary video reception system 700 that provides reduced latency, in accordance with various aspects of the present invention.
- the exemplary video reception system 700 may, for example and without limitation, share various characteristics with the receiver 130 of the exemplary video communication system 100 illustrated in FIG. 1 and discussed previously. Also for example and without limitation, various components of the video reception system 700 may perform various functionality of the exemplary method 600 illustrated in FIG. 6 and discussed previously.
- the exemplary video reception system 700 may comprise an interface module 731 that receives a request to present a unit of video information.
- the interface module 731 may, for example and without limitation, perform various aspects of the exemplary method 600 (e.g., step 620 ) illustrated in FIG. 6 and discussed previously.
- a request for a unit of video information may, for example, be originated by a user directly or indirectly (e.g., through a programmed device).
- the request may, for example and without limitation, comprise a video channel change request.
- the request may comprise a television channel change request.
- the request may comprise a request for a particular unit of video information, or a request for a particular unit of video information to be presented in a particular manner (e.g., at a particular rate and/or temporal direction).
- the interface module 731 may receive such a request in any of a large variety of ways.
- the interface module 731 may receive the request through any of a variety of user interfaces or device communication interfaces.
- the interface module 731 may also, for example, receive the request from a local source or a remote source (e.g., through a communication network).
- the interface module 731 may receive a request to present a unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular request, source of a particular request, or manner of receiving a particular request.
- the exemplary video reception system 700 may comprise a receiver module 732 that receives a plurality of video information streams, each of which represents the unit of video information.
- the receiver module 732 may, for example and without limitation, perform various functionality of the exemplary method 600 (e.g., step 630 ) illustrated in FIG. 6 and discussed previously.
- each of the plurality of video information streams may correspond to a particular video channel (e.g., a television channel or program).
- the exemplary receiver module 732 may comprise a first tuner 733 and first receiver 734 . Such a first tuner/receiver pair 733 - 734 may receive one or more video information streams and convert such received video information streams into digital video data.
- the exemplary receiver module 732 may, for example and without limitation, also comprise a second tuner 735 and second receiver 736 , where the second tuner/receiver pair 735 - 736 may also receive one or more video information streams and convert such received video information streams into digital video data.
- the first tuner/receiver pair 733 - 734 may receive a plurality of video information streams.
- the first tuner/receiver pair 733 - 734 may receive the plurality of video information streams on a single multi-stream communication channel.
- the first tuner/receiver pair 733 - 734 may receive a first video information stream
- the second tuner/receiver pair 735 - 736 may receive a second video information stream.
- the exemplary receiver module 732 may receive a plurality of video information streams, each of which represents the unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular video information stream, particular video information source, particular receiver module, or by characteristics of particular methods or apparatus for receiving a plurality of video information streams.
- the exemplary video reception system 700 may comprise a processor module 737 that identifies which of the plurality of video information streams, when processed, is expected to result in the lowest latency in presenting the unit of video information.
- the processor module 737 may perform various functionality of the exemplary method 600 (e.g., steps 640 and 650 ) illustrated in FIG. 6 and discussed previously.
- the processor module 737 may, for example, identify which of the plurality of video information streams is expected to result in the lowest latency in any of a variety of ways. For example, the processor module 737 may identify access points in each of the received plurality of video information streams to determine which of the received plurality of video information streams is expected to communicate the next access point. Also for example, the processor module 737 may identify access points in one of the plurality of video information streams and (e.g., based on a known temporal relationship between access points in the respective plurality of video information streams) determine which of the received plurality of video information streams will communicate the next access point. Alternatively, for example, the processor module 737 may receive information of access point timing and analyze such information to determine which of the plurality of video information streams will communicate the next access point. Alternatively, for example, the processor module 737 may receive information indicating which of the plurality of video information streams has more frequent access points and would therefore be expected generally to result in the lowest latency.
- the processor module 737 may identify which of the received plurality of video information streams, when processed, is expected to result in the lowest latency in presenting the unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular way of identifying the lowest latency video information stream or apparatus for identifying the lowest latency video information stream.
- the exemplary processor module 737 may, for example, process the identified video information stream to present the unit of video information.
- the processor module 737 may, for example, process the identified video information stream to present the unit of video information to a user (e.g., utilizing a video display device).
- the processor module may also later process a different one of the plurality of video information streams, for example if the different video information stream is expected to result in improved video quality.
- the processor module 737 may comprise one or more video decoders 738 that decode the identified video information stream.
- the processor module 737 may, for example, convert the identified video information stream to a display driver signal, which may be utilized to drive a display device.
- the processor module 737 may also, for example, perform conditional access processing related to the identified video information stream.
- the processor module 737 may process the identified video information stream to present the unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of particular processing activities performed with video information to present such information or by characteristics of particular video processing apparatus.
- any of the various components, modules and sub-modules may be independent circuits or may be integrated into a single integrated circuit.
- various components, modules and sub-modules may be co-located or may be distributed throughout a network. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular hardware or software implementations.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Computer Graphics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
Description
- This patent application is a continuation of U.S. patent application Ser. No. 12/951,194, filed on Nov. 22, 2010, which is a continuation of U.S. patent application Ser. No. 12/605,844, filed on Oct. 26, 2009, issuing on Nov. 23, 2011, as U.S. Pat. No. 7,840,985, which is a continuation of U.S. patent application Ser. No. 11/038,728, filed on Jan. 20, 2005, issuing on Oct. 27, 2009 as U.S. Pat. No. 7,610,603, which claims the benefit of U.S. Provisional Application No. 60/556,667 filed Mar. 26, 2004. The contents of each of the aforementioned patent applications are hereby incorporated herein by reference in their entireties.
- [Not Applicable]
- [Not Applicable]
- [Not Applicable]
- In various digital video systems, there is a latency time between when a user makes a request for particular video information and when the system presents the requested video information to the user. For example and without limitation, a user may specify a viewing channel corresponding to video information that the user is interested in viewing. Further for example, a user may select a video information title from a menu, a user may enter a channel up/down request, or a user may sequence through a list of favorite video channels.
- There will generally be a latency time between when the user requests video information and when the system presents the requested video information to the user. There may be any of a large variety of causes for such latency. Such causes may comprise, without limitation, request processing delays, information communication delays and information processing delays. In general, users prefer that the latency time between a video information request and presentation of the requested video information to the user be minimized.
- Further limitations and disadvantages of conventional and traditional approaches will become apparent to one of skill in the art, through comparison of such systems with the present invention as set forth in the remainder of the present application with reference to the drawings.
- Various aspects of the present invention provide a system and method that provide reduced latency in a video signal processing system. Various aspects of the present invention may comprise transmitting a first video information stream representative of a unit of video information. The transmitted first video information stream may, for example, correspond to a video channel. A video transmitter may, for example, perform such transmitting.
- A second video information stream representative of the unit of video information may be transmitted simultaneously with the first video information stream. The transmitted second video information stream may also, for example, correspond to the video channel. A video transmitter may, for example, perform such transmitting
- The second video information stream may, for example, comprise a time delayed version of the first video information stream. A time delay module may be utilized to form such a time delayed version. The second video information stream may also, for example, be generated from the unit of information independently of the first video information stream. An encoder module may, for example, perform such generation. For example, the first video information stream may comprise a first encoded version of the unit of information, and the second video information stream may comprise a second encoded version of the unit of information. The first and second encoded versions may, for example, be formed using identical or different encoding techniques. The first and second encoded versions may, for example, be encoded at identical or different quality levels.
- The transmitted first and second video information streams may each comprise respective sets of access points. For example, the transmitted first and second video information streams may be generally temporally aligned, and the respective access points of the temporally aligned transmitted information streams may be generally temporally displaced.
- Various aspects of the present invention may comprise receiving a request for a unit of video information. Such a request may, for example, originate from a user that desired to view the unit of video information. Such a request may also, for example, originate from a device automatically. Such a request may, for example and without limitation, comprise a channel change request.
- A plurality of video information streams that are representative of the requested unit of information may be received. Such reception may, for example, occur simultaneously. A video receiver module may, for example, perform such receiving. The plurality of video information streams may, for example and without limitation, correspond to the same video channel.
- A video information stream of the received plurality of video information streams may be identified that, when processed, is expected to result in the lowest latency in presenting the requested unit of video information. A processor module may perform such a stream identification. The lowest latency video information stream may, for example, be identified according to predicted or observed time of arrival of respective access points in the received plurality of video information streams.
- The identified video information stream may then be processed to present the unit of video information. A processor module may perform such processing. The processing may, for example, generate a video display driver signal, which may be provided to a display device. The display device may then, for example, present the requested unit of video information in human-perceivable form.
- These and other advantages, aspects and novel features of the present invention, as well as details of illustrative aspects thereof, will be more fully understood from the following description and drawings.
-
FIG. 1 is a diagram showing an exemplary video communication system that provides reduced latency, in accordance with various aspects of the present invention. -
FIG. 2 is a flow diagram illustrating an exemplary method for providing reduced latency in a video transmission system, in accordance with various aspects of the present invention. -
FIG. 3 is a diagram showing an exemplary video transmission system that provides reduced latency, in accordance with various aspects of the present invention. -
FIG. 4 is a diagram showing an exemplary video transmission system that provides reduced latency, in accordance with various aspects of the present invention. -
FIG. 5 is a diagram showing an exemplary video transmission system that provides reduced latency, in accordance with various aspects of the present invention. -
FIG. 6 is a flow diagram illustrating an exemplary method for providing reduced latency in a video reception system, in accordance with various aspects of the present invention. -
FIG. 7 is a diagram showing an exemplary video reception system that provides reduced latency, in accordance with various aspects of the present invention. -
FIG. 1 is a diagram showing an exemplaryvideo communication system 100 that provides reduced latency, in accordance with various aspects of the present invention. The exemplaryvideo communication system 100 may comprise aninformation source 110, atransmitter 120 and areceiver 130. Various aspects of theinformation source 110,transmitter 120 andreceiver 130 will be discussed in more detail later. - The exemplary
video information source 110 may, for example, provide a first video information stream representative of a unit of video information. The first video information stream may, for example and without limitation, comprise a serial stream of video-related data. For example, a serial stream may comprise video data that has been encoded according to a block encoding standard (e.g., MPEG-2, MPEG-4, MPEG-4 AVC, etc.). Also, for example, a serial stream may comprise video data that has not been encoded according to a block encoding standard (e.g., digitized chroma and luma information). Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular type of video information or a particular type of video information stream. - The unit of video information may comprise any of a large variety of types of units of video information. For example and without limitation, the unit of video information may comprise information of a television program, a movie, a music video, kinetic video art, a video commercial, a teleconference, etc. A unit of video information may, for example, be requested by a user or may be communicated automatically. A unit of video information may, for example, be unicast, multicast or broadcast. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular unit of video information.
- The exemplary
video information source 110 may also, for example, provide a second video information stream representative of the unit of video information (i.e., the same unit of video information that the first video information stream is representative of). As will be discussed in more detail later, the second video information stream may share various characteristics with the first video information stream. For example and without limitation, the second video information stream may correspond to a time-shifted version of the first video information stream. - Also for example, the first and second video information streams may be formed by encoding the unit of video information according to different respective encoding methods. For example, the first and second video information streams may be encoded to provide temporally staggered (or alternating) access points when the first and second video information streams are temporally synchronized overall. Alternatively for example, the first and second video information streams may be encoded to provide different respective numbers of access points. Such different respective encodings may comprise encoding the unit of video information to generally identical respective quality levels or generally different respective quality levels.
- For this discussion, an access point may be generally considered to be a point at which decoding (or further processing) of a video stream may conveniently begin. For example and without limitation, decoding (or otherwise processing) an access point might require a minimal amount of video information communicated prior to the access point. In a non-limiting example, various block-encoding schemes may utilize inter-coded and intra-coded frames for communicating video information, where intra-coded frames may generally be decoded (or otherwise processed) with no (or minimal) knowledge of information from previously communicated video frames, and inter-coded frames are generally decoded (or otherwise processed) utilizing information from previously communicated video frames. Such an intra-coded frame may provide a non-limiting example of an access point.
- In general, the first and second video information streams are each representative of the unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of particular encoding and/or time-shifting methods, or by characteristics of particular access points.
- The exemplary
video information source 110 may comprise any of a large variety of video information source characteristics. For example and without limitation, thevideo information source 110 may comprise a transmitter of a live video broadcast or a database of video information. The exemplaryvideo information source 110 may be located in any of a large variety of geographical locations. For example and without limitation, thevideo information source 110 may be co-located with thetransmitter 120. Also for example, thevideo information source 110 may be communicatively coupled with thetransmitter 120 through a communication network. In such a scenario, thevideo information source 110 may comprise characteristics of a head-end communication node or an intermediary communication node. - Such a communication network may, for example, be based on any of a large variety of communication media (e.g., wired, wireless RF, tethered optical, non-tethered optical, etc.). Such a communication network may, for example, comprise a television network, computer network, radio network, telephone network, etc. Communication over the communication network may utilize any of a large variety of communication protocols (e.g., television protocols, telephone protocols, data communication protocols, audio protocols, etc.).
- Note that the following discussion will generally address two video information streams. However, it is stressed that the following discussion discusses two video information streams for illustrative purposes, and that various aspects of the present invention are readily extensible beyond two video information streams to N video information streams, where N is a number greater than one.
- In general, the
video information source 110 may comprise any of a large variety of video information source characteristics. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular video information source. - The
exemplary transmitter 120 may receive the first video information stream from thevideo information source 110, and may also receive the second video information stream from thevideo information source 110. Theexemplary transmitter 120 may transmit the first video information stream. Thetransmitter 120 may, for example, transmit the first video information stream in a manner in which the first video information stream will correspond to a video channel (e.g., a television channel, video program or other video communication channel). - The
exemplary transmitter 120 may also transmit the second video information stream simultaneously with the first video information stream. For example, thetransmitter 120 may transmit the second video information stream in a manner in which the second video information stream will correspond to the same video channel to which the first video information stream corresponds. - In an exemplary television scenario, the
transmitter 120 may transmit the first and second video information streams in a manner in which both the first and second video information streams correspond to television channel M. Thetransmitter 120 may, for example, transmit the first and second video information streams in this manner, even though the first and second video information streams may each comprise information of the same unit of video information. - The
exemplary transmitter 120 may transmit the first and second video information streams such that the first and second video information streams are substantially temporally aligned. For example and without limitation, the transmitted first and second video information streams may be temporally aligned to within one-to-two seconds (or one-to-two minutes). In a non-limiting exemplary scenario, where the second video information stream comprises a time-shifted version of the first video information stream, the transmitted first and second video information streams may be temporally aligned to less than the average time between access points in the first video information stream. - As mentioned previously, the first and second video information streams may each comprise respective access points. The
exemplary transmitter 120 may transmit the first and second video information streams such that access points of the transmitted first video information stream are generally temporally displaced from access points of the transmitted second video information stream. For example and without limitation, access points of the transmitted first video information stream may be generally temporally staggered (or alternated) with access points of the transmitted second video information stream. Note, however, that since access points within a video information stream may have variable temporal spacing, access points of the transmitted first and second video streams may be generally temporally displaced, while a portion of the access points may also be temporally aligned. - Also for example, such temporal displacement or staggering of access points need not be perfectly symmetrical. For example, in an exemplary scenario where the first and second video information streams have different respective numbers of access points, the access points of the transmitted streams may be temporally staggered (or alternated) asymmetrically. That is, an access point of the transmitted first video information stream may be transmitted, followed by one, two, or P access points of the transmitted second video information stream, and then followed by the next access point of the first video information stream.
- In general, the
transmitter 120 may transmit the first and second video information streams simultaneously and corresponding to the same video channel. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular temporal relationship between the transmitted video information streams or by a particular temporal relationship between access points of the transmitted video information streams. - The
exemplary transmitter 120 may, for example, transmit the first and second video information streams over any of a variety of communication network types, utilizing any of a variety of communication media, utilizing any of a variety of modulation techniques and utilizing any of a variety of communication protocols. For example, thetransmitter 120 may transmit the first and second video information streams over a television network, radio network, telephone network, computer network, etc. Thetransmitter 120 may, for example, transmit the first and second video information streams over wired, wireless or optical communication media. Thetransmitter 120 may, for example, transmit the first and second video information streams utilizing a television protocol, telephone protocol, data communication protocol, audio protocol, etc. - In an exemplary television scenario, the
transmitter 120 may transmit the first and second video information streams over a cable or satellite television network. Theexemplary transmitter 120 may, for example, transmit the first and second video information streams as components of a multi-stream communication channel (e.g., as components of a single QAM channel). Such an exemplary transmission may, for example, provide for the first and second video information streams to be more easily received using a single tuner/receiver pair. - As mentioned previously, the first and second video information streams may comprise respective access points. In an exemplary non-limiting scenario, the
transmitter 120 may also transmit information of access point timing for at least one of the first and second video information streams. As discussed later, a receiver may utilize such information to determine which of the first and second video information streams will communicate the next access point. - In general, the
transmitter 120 may transmit the first and second video information streams simultaneously and corresponding to the same video channel. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular communication network, media, modulation technique or communication protocol. - The
exemplary receiver 130 may receive video information and process at least a portion of such received video information for presentation to a user. For example and without limitation, theexemplary receiver 130 may receive a plurality of video information streams as discussed previously. - The
exemplary receiver 130 may receive a request from a user (e.g., directly or through a programmed device) to present a unit of video information. The request may, for example and without limitation, comprise a video channel change request. In a non-limiting scenario, the request may comprise a television channel change request. Thereceiver 130 may receive such a request in any of a large variety of ways. For example, thereceiver 130 may receive such a request through a variety of user interfaces or device communication interfaces. - The
receiver 130 may receive a plurality of video information streams, each of which represents the requested unit of video information. For example and without limitation, thereceiver 130 may receive the first and second video information streams discussed previously regarding theexemplary transmitter 120. Theexemplary receiver 130 may, for example, receive the plurality of video information streams over a single multi-stream communication channel or over a plurality of communication channels. - In an exemplary scenario, the
receiver 130 may also receive information of access point timing for at least one of the plurality of video information streams. Such information of access point timing may, for example and without limitation, comprise information indicating expected time of arrival for various access points in one or more of the plurality of video information streams. Such information of access point timing may, for example and without limitation, comprise information indicating which of the plurality of streams is expected to provide the next access point (i.e., the access point enabling the earliest commencement of video processing). - The
receiver 130 may identify which of the plurality of video information streams, when processed, is expected to result in the lowest latency (or delay) in presenting the unit of video information. For example, in an exemplary scenario where thereceiver 130 may begin processing a video information stream at the next access point, thereceiver 130 may identify which of the plurality of video information streams will communicate the next access point. - The
receiver 130 may identify which of the plurality of video information streams is expected to result in the lowest latency in any of a variety of ways. For example, thereceiver 130 may identify access points in each of the plurality of video information streams to determine which of the plurality of video information streams communicates the next access point. Also for example, thereceiver 130 may identify access points in one of the plurality of video information streams and (e.g., based on a known temporal relationship between access points in the respective plurality of video information streams) determine which of the plurality of video information streams will communicate the next access point. Alternatively, for example, thereceiver 130 may receive information of access point timing and analyze such information to determine which of the plurality of video information streams will communicate the next access point. - In general, the
receiver 130 may identify which of the received plurality of video information streams, when processed, is expected to result in the lowest latency in presenting the unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular way of identifying the lowest latency video information stream. - The
receiver 130 may process the identified video information stream to present the unit of video information (e.g., to a user). Thereceiver 130 may, for example and without limitation, decode the identified video information stream. Thereceiver 130 may, for example, convert the identified video information stream to a display driver signal, which thereceiver 130 may utilize to drive a display device that is coupled to thereceiver 130. Thereceiver 130 may also, for example, perform conditional access processing related to the identified video information stream. In general, thereceiver 130 may process the identified video information stream to present the unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of particular processing activities performed with video information to present such information to a user. - The
receiver 130 may also process a second video information stream. In a non-limiting exemplary scenario in which the second video information stream comprises higher quality video information than the previously identified (or “first”) video information stream, thereceiver 130 may begin processing the second video information stream concurrently with processing the first video information stream. Thereceiver 130 may cease processing the first video information stream after thereceiver 130 has begun processing the second video information stream. Alternatively, for example, thereceiver 130 may begin processing the second video information stream after commencing processing of the first video information stream without processing the two streams concurrently. For example, thereceiver 130 might process first one stream and then another stream if the second stream is expected to result in higher quality video display. - The previous discussion regarding the
exemplary system 100 illustrated inFIG. 1 describes various aspects of the exemplary system. The following discussion will discuss various methods that components of theexemplary system 100 might perform and various components that theexemplary system 100 might comprise. Accordingly, the scope of various aspects of the present invention should not be limited to aspects of theexemplary system 100 as previously discussed. -
FIG. 2 is a flow diagram illustrating anexemplary method 200 for providing reduced latency in a video transmission system, in accordance with various aspects of the present invention. Theexemplary method 200 may, for example and without limitation, be performed by various components of the exemplary system 100 (e.g., theinformation source 110 and/or the transmitter 120) illustrated inFIG. 1 and discussed previously. - The
exemplary method 200 may begin atstep 210 in response to any of a large variety of causes and conditions. For example and without limitation, in an exemplary video signal-processing scenario, themethod 200 may begin when a television transmission system implementing themethod 200 receives a request for a unit of video information. Alternatively, for example, themethod 200 may begin when a transmission system implementing themethod 200 is powered up or initialized. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of any particular initiating events or conditions. - The
exemplary method 200 may, atstep 220, comprise obtaining a first video information stream representative of a unit of video information. Step 220 may, for example and without limitation, comprise obtaining the first video information stream from an information source (e.g., an information source as discussed previously with regard to theinformation source 110 illustrated inFIG. 1 ). - The first video information stream may, for example and without limitation, comprise a serial stream of video-related data. For example, a serial stream may comprise video data that has been encoded according to a block encoding standard (e.g., MPEG-2, MPEG-4, MPEG-4 AVC, etc.). Also, for example, a serial stream may comprise video data that has not been encoded according to a block encoding standard (e.g., digitized chroma and luma information). Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular type of video information or a particular type of video information stream.
- The unit of video information may comprise any of a large variety of types of units of video information. For example and without limitation, the unit of video information may comprise information of a television program, a movie, a music video, kinetic video art, a video commercial, a teleconference, etc. A unit of video information may, for example, be requested by a user or may be communicated automatically. A unit of video information may, for example, be unicast, multicast or broadcast. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular unit of video information.
- Step 220 may comprise obtaining the first video information stream in any of a variety of manners. For example, step 220 may comprise receiving the first video information stream from a database. Such a database may, for example, be a local database or a networked database.
- Step 220 may, for example, comprise obtaining the unit of video information from a video information source and generating the first video information stream from the obtained unit of video information. Step 220 may, for example, comprise obtaining the unit of video information from a local source or through a networked source. Such generating may, for example and without limitation, comprise encoding the unit of video information into the first video information stream. Such generating may comprise encoding the unit of video information according to any of a large variety of encoding techniques and quality levels.
- In general,
step 220 may comprise obtaining a first video information stream representative of the unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of the first video information stream, the unit of video information, a source of the first video information stream, a source of the unit of video information, or a way of obtaining the first video information stream. - The
exemplary method 200 may, atstep 230, comprise obtaining a second video information stream representative of the unit of video information (i.e., the same unit of video information that the first video information stream obtained atstep 220 is representative of). Step 230 may, for example and without limitation, comprise obtaining the second video information stream from an information source (e.g., an information source as discussed previously with regard to theinformation source 110 illustrated inFIG. 1 ). The second video information stream may share various characteristics with the first video information stream discussed previously. - Step 230 may comprise obtaining the second video information stream in any of a variety of manners. For example, step 230 may comprise receiving the second video information from a database. Such a database may, for example, be a local database or a networked database.
- Step 230 may comprise generating a time-delayed version of the first video information stream, obtained at
step 220. Such a time-delayed version may, for example, be temporally delayed relative to the first video information stream by less than the average time between access points in the first video information stream. Such a time-delayed version may, for example, be delayed relative to the first video information stream by a particular temporal quantity (e.g., one or two seconds, or one or two minutes). - Step 230 may, for example, comprise obtaining the unit of video information and generating the second video information stream from the unit of video information. Step 230 may, for example, comprise obtaining the unit of video information from a local source or through a communication network. Such generating may, for example and without limitation, comprise encoding the unit of video information into the second video information stream. Such generating may comprise encoding the unit of video information according to any of a large variety of encoding techniques and quality levels.
- In an exemplary scenario where
step 220 comprises generating the first video information stream by encoding the unit of video information and step 230 comprises generating the second video information stream by encoding the unit of video information, steps 220 and 230 may comprise encoding the unit of information at respective quality levels. Such quality levels may, for example, be substantially identical or may be substantially different. - In general,
step 230 may comprise obtaining a second video information stream representative of the unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of the second video information stream, the unit of video information, a source of the second video information stream, a source of the unit of video information, or a way of obtaining the second video information stream. - The
exemplary method 200 may, atstep 240, comprise transmitting the first video information stream. For example, step 240 may comprise transmitting the first video information stream in a manner in which the first video information stream will correspond to a video channel (e.g., a television channel, video program or other video communication channel). - The
exemplary method 200 may, atstep 250, comprise transmitting the second video information stream. For example, step 250 may comprise transmitting the second video information stream in a manner in which the second video information stream will correspond to the video channel (i.e., the same channel to which the first video information stream corresponds). - In an exemplary television scenario, steps 240 and 250 may comprise transmitting the first and second video information streams in a manner in which both the first and second video information streams correspond to television channel M. The
exemplary steps -
Exemplary steps - As mentioned previously, the first and second video information streams may each comprise respective access points.
Exemplary steps - Also for example, such temporal displacement or staggering of access points need not be perfectly symmetrical. For example, in an exemplary scenario where the first and second video information streams have different respective numbers of access points, the access points of the transmitted streams may be temporally staggered (or alternated) asymmetrically. That is, an access point of the transmitted first video information stream may be transmitted, followed by one, two or P access points of the transmitted second video information stream, and then followed by the next access point of the first video information stream.
- In general, steps 240 and 250 may comprise transmitting the first and second video information streams simultaneously and corresponding to the same video channel. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular temporal relationship between the transmitted video information streams or by a particular temporal relationship between access points of the transmitted video information streams.
- The
exemplary steps steps steps - In an exemplary television scenario, steps 240 and 250 may comprise transmitting the first and second video information streams over a cable or satellite television network. The
exemplary steps - As mentioned previously, the first and second video information streams may comprise respective access points. In an exemplary non-limiting scenario, steps 240 and 250 may also comprise transmitting information of access point timing for at least one of the first and second video information streams. As discussed later, a receiver may utilize such information to determine which of the first and second video information streams will communicate the next access point.
- In general,
exemplary steps -
FIG. 3 is a diagram showing an exemplaryvideo transmission system 300 that provides reduced latency, in accordance with various aspects of the present invention. Theexemplary system 300 may comprise aninformation source 310 and atransmitter 320. Theinformation source 310 andtransmitter 320 may, for example and without limitation, share various characteristics with theinformation source 110 andtransmitter 120 illustrated inFIG. 1 and discussed previously. Also, for example and without limitation, theexemplary information source 310 andtransmitter 320 may perform various aspects of themethod 200 illustrated inFIG. 2 and discussed previously. - The
exemplary information source 310 may, for example, comprise an information source sub-module 312 and abuffer module 315. The information source sub-module 312 may provide a first video information stream. The first video information stream may share various characteristics with the first video information streams discussed previously. - The information source sub-module 312 may, for example, provide a first video information stream representative of a unit of video information. The first video information stream may, for example and without limitation, comprise a serial stream of video-related data. For example, a serial stream may comprise video data that has been encoded according to a block encoding standard (e.g., MPEG-2, MPEG-4, MPEG-4 AVC, etc.). Also, for example, a serial stream may comprise video data that has not been encoded according to a block encoding standard (e.g., digitized chroma and luma information). Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular type of video information or a particular type of video information stream.
- The unit of video information may comprise any of a large variety of types of units of video information. For example and without limitation, the unit of video information may comprise information of a television program, a movie, a music video, kinetic video art, a video commercial, a teleconference, etc. A unit of video information may be requested by a user or may be communicated automatically. A unit of video information may be unicast, multicast or broadcast. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular unit of video information.
- The information source sub-module 312 may, for example, provide the first video information stream to the
transmitter 320. The information source sub-module 312 may also, for example, provide the first video information stream to thebuffer module 315. - The buffer module 315 (or a general time delay module) may, for example, receive the first video information stream and output a second video information stream comprising a time-shifted version of the first video information stream. For example and without limitation, the
buffer module 315 may generate a time-delayed version of the first video information stream (e.g., as discussed previously regardingstep 230 of theexemplary method 200 illustrated inFIG. 2 and discussed previously). - The
transmitter 320 may receive the first video information stream and the second video information stream from the information source 310 (e.g., from the information source sub-module 312 and thebuffer module 315, respectively). Theexemplary transmitter 320 may then, for example, transmit the first and second video information streams. For example and without limitation, the transmitter may share various characteristics with theexemplary transmitter 120 illustrated inFIG. 1 and discussed previously. Also for example and without limitation, theexemplary transmitter 320 may perform various aspects of the exemplary method 200 (e.g., steps 240 and 250) illustrated inFIG. 2 and discussed previously. -
FIG. 4 is a diagram showing an exemplaryvideo transmission system 400 that provides reduced latency, in accordance with various aspects of the present invention. Theexemplary system 400 may comprise aninformation source 410 and atransmitter 420. Theinformation source 410 andtransmitter 420 may, for example and without limitation, share various characteristics with theinformation source 110 andtransmitter 120 illustrated inFIG. 1 and discussed previously, and with theinformation source 310 andtransmitter 320 illustrated inFIG. 3 and discussed previously. Also, for example and without limitation, theexemplary information source 410 andtransmitter 420 may perform various aspects of themethod 200 illustrated inFIG. 2 and discussed previously. - The
exemplary information source 410 may, for example, comprise an information source sub-module 412, anencoder module 413 and abuffer module 415. The information source sub-module 412 may provide a unit of video information. As discussed previously, such a unit of video information may comprise any of a large variety of types of units of video information and/or characteristics thereof. - The
encoder module 413 may, for example, receive the unit of video information from the information source sub-module 412 and output a first video information stream representative of the unit of video information. The first video information stream may, for example and without limitation, share various characteristics with the first video information streams discussed previously. For example, as discussed previously, the first video information stream may comprise a serial stream of video-related data. The first video information stream may, for example, comprise a stream of encoded video data corresponding to the unit of video information received from the information source sub-module 412. Theencoder module 413 may provide the first video information stream to thetransmitter 420. - The
encoder module 413 may also, for example, provide the first video information stream to thebuffer module 415. The buffer module 415 (or a general time delay module) may, for example, receive the first video information stream from theencoder module 413 and output a second video information stream comprising a time-shifted version of the first video information stream. For example and without limitation, thebuffer module 415 may generate a time-delayed version of the first video information stream (e.g., as discussed previously regardingstep 230 of theexemplary method 200 illustrated inFIG. 2 and discussed previously). Also, for example and without limitation, thebuffer module 415 may share various characteristics with thebuffer module 315 of theexemplary system 300 illustrated inFIG. 3 and discussed previously. - The
transmitter 420 may receive the first video information stream and the second video information stream from the information source 410 (e.g., from theencoder module 413 and thebuffer module 415, respectively). Theexemplary transmitter 420 may then, for example, transmit the first and second information streams. For example and without limitation, thetransmitter 420 may share various characteristics with theexemplary transmitter 120 illustrated inFIG. 1 and discussed previously and theexemplary transmitter 320 illustrated inFIG. 3 and discussed previously. Also for example and without limitation, theexemplary transmitter 420 may perform various aspects of the exemplary method 200 (e.g., steps 240 and 250) illustrated inFIG. 2 and discussed previously. -
FIG. 5 is a diagram showing an exemplaryvideo transmission system 500 that provides reduced latency, in accordance with various aspects of the present invention. Theexemplary system 500 may comprise aninformation source 510 and atransmitter 520. Theinformation source 510 andtransmitter 520 may, for example and without limitation, share various characteristics with theinformation source 110 andtransmitter 120 illustrated inFIG. 1 and discussed previously, with theinformation source 310 andtransmitter 320 illustrated inFIG. 3 and discussed previously, and with theinformation source 410 andtransmitter 420 illustrated inFIG. 4 and discussed previously. Also, for example and without limitation, theexemplary information source 510 andtransmitter 520 may perform various aspects of themethod 200 illustrated inFIG. 2 and discussed previously. - The
exemplary information source 510 may, for example, comprise an information source sub-module 512, afirst encoder module 513 and asecond encoder module 514. The information source sub-module 512 may provide a unit of video information. As discussed previously, such a unit of video information may comprise any of a large variety of units of video information and/or characteristics thereof. - The
first encoder module 513 may, for example, receive the unit of video information from the information source sub-module 512 and output a first video information stream representative of the unit of video information. Thefirst encoder module 513 may, for example, encode the unit of video information according to any of a large variety of encoding techniques and quality levels. - The first information stream may, for example and without limitation, share various characteristics with the first video information streams discussed previously (e.g., as discussed regarding
step 220 of exemplary method 200). For example, as discussed previously, the first video information stream may comprise a serial stream of video-related data. The first video information stream may, for example, comprise a stream of encoded video data corresponding to the unit of video information received from the information source sub-module 512. Thefirst encoder module 513 may provide the first video information stream to thetransmitter 520. - The
second encoder module 514 may, for example, receive the unit of video information from the information source sub-module 512 and output a second video information stream representative of the unit of video information. Thesecond encoder module 514 may, for example, encode the unit of video information according to any of a large variety of encoding techniques and quality levels. For example, thesecond encoder module 514 may encode the unit of information in a manner similar to the manner in which thefirst encoder module 513 encodes the unit of information. - The second information stream may, for example and without limitation, share various characteristics with the first and/or second video information streams discussed previously (e.g., as discussed regarding
step 230 of exemplary method 200). For example, as discussed previously, the second video information stream may comprise a serial stream of video-related data. The second video information stream may, for example, comprise a stream of encoded video data corresponding to the unit of video information received from the information source sub-module 512. Thesecond encoder module 514 may provide the second video information stream to thetransmitter 520. - In an exemplary scenario, the
first encoder module 513 and thesecond encoder module 514 may encode the first and second video information streams such that the access points of the first and second video information streams are temporally staggered (or alternating) when the first and second video information streams are temporally synchronized overall. Alternatively for example, thefirst encoder module 513 and thesecond encoder module 514 may encode the first and second video information streams such that the first and second video information streams comprise different respective numbers of access points. - In an exemplary scenario where the
first encoder module 513 generates the first video information stream by encoding the unit of video information and thesecond encoder module 514 generates the second video information stream by encoding the unit of video information, thefirst encoder module 513 andsecond encoder module 514 may encode the unit of information at respective quality levels. Such quality levels may, for example, be substantially identical or may be substantially different. - The
transmitter 520 may receive the first video information stream and the second video information stream from the information source 510 (e.g., from thefirst encoder module 513 and thesecond encoder module 514 respectively). Theexemplary transmitter 520 may then, for example, transmit the first and second information streams. For example and without limitation, thetransmitter 520 may share various characteristics with theexemplary transmitter 120 illustrated inFIG. 1 and discussed previously, theexemplary transmitter 320 illustrated inFIG. 3 and discussed previously, and theexemplary transmitter 420 illustrated inFIG. 4 and discussed previously. Also for example and without limitation, theexemplary transmitter 520 may perform various aspects of the exemplary method 200 (e.g., steps 240 and 250) illustrated inFIG. 2 and discussed previously. -
FIG. 6 is a flow diagram illustrating anexemplary method 600 for providing reduced latency in a video reception system, in accordance with various aspects of the present invention. Theexemplary method 600 may, for example and without limitation, be performed by thereceiver 130 of theexemplary system 100 illustrated inFIG. 1 and discussed previously. Theexemplary method 600 may also, for example and without limitation, receive and/or process video information streams as produced by theexemplary method 200 illustrated inFIG. 2 and discussed previously, and the exemplary systems 300-500 illustrated inFIGS. 3-5 and discussed previously. - The
exemplary method 600 may begin atstep 610 in response to any of a large variety of causes and conditions. For example and without limitation, in an exemplary video signal-processing scenario, themethod 600 may begin when a video reception system implementing themethod 600 receives a request for a unit of video information. Alternatively, for example, themethod 600 may begin when a video reception system implementing themethod 200 is powered up or initialized. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of any particular initiating events or conditions. - The
exemplary method 600 may, atstep 620, comprise receiving a request for a unit of video information. Such a request may, for example, be originated by a user directly or indirectly (e.g., through a programmed device). The request may, for example and without limitation, comprise a video channel change request. In a non-limiting exemplary scenario, the request may comprise a television channel change request. Alternatively for example, the request may comprise a request for a particular unit of video information, or a request for a particular unit of video information to be presented in a particular manner (e.g., at a particular rate and/or temporal direction). -
Exemplary step 620 may comprise receiving such a request in any of a large variety of ways. For example, step 620 may comprise receiving the request through a variety of user interfaces or device communication interfaces. Step 620 may also, for example, comprise receiving the request from a local source or a remote source (e.g., through a communication network). - In general,
exemplary step 620 may comprise receiving a request for a unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular request, source of a particular request, or manner of receiving a particular request. - The
exemplary method 600 may, atstep 630, comprise receiving a plurality of video information streams, each of which represents the requested unit of video information. For example and without limitation, each of the plurality of video information streams may correspond to a single video channel (e.g., a television channel or program). - In this discussion, “receiving a plurality of video streams” may generally mean that the plurality of video information streams arrives at a system implementing the
exemplary method 600. The term “receiving” is by no means, in itself, to be construed as requiring particular signal processing. For example and without limitation, the term “receiving” is not to be construed, in itself, to require demodulation, data detection, decoding, decrypting or converting. Note however, that in various contexts, various processing activities may be implied. For example and without limitation, in a scenario where specific received data is analyzed, some type of demodulation or data detection, if necessary to access the analyzed data, may be implied. - In an exemplary scenario, step 630 may comprise receiving the plurality of video information streams over a single multi-stream communication channel. Alternatively, for example, step 630 may comprise receiving the plurality of video information streams over multiple parallel communication channels.
- In an exemplary scenario, step 630 may also comprise receiving information of access point timing for at least one of the plurality of video information streams. Such information of access point timing may, for example and without limitation, comprise information indicating expected time of arrival for various access points in one or more of the plurality of video information streams.
- In general,
step 630 may comprise receiving a plurality of video information streams, each of which represents the requested unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular video information stream, video information stream source, or manner of receiving a video information stream. - The
exemplary method 600 may, atstep 640, comprise identifying which of the plurality of video information streams, when processed, is expected to result in the lowest latency in presenting the unit of video information. For example and without limitation, in an exemplary scenario where themethod 600 may begin processing a video information stream at the next access point, step 640 may comprise identifying which of the plurality of received video information streams will communicate the next access point. - Step 640 may, for example, comprise identifying which of the plurality of video information streams is expected to result in the lowest latency in any of a variety of ways. For example, the
step 640 may comprise identifying access points in each of the received plurality of video information streams to determine which of the received plurality of video information streams will communicate the next access point. Also for example, step 640 may comprise identifying access points in one of the plurality of video information streams and (e.g., based on a known temporal relationship between access points in the respective plurality of video information streams) determine which of the received plurality of video information streams will communicate the next access point. Alternatively, for example, step 640 may comprise receiving information of access point timing and analyzing such information to determine which of the plurality of video information streams will communicate the next access point. Alternatively, for example, step 640 may comprise receiving information indicating which of the plurality of video information streams has more frequent access points and would therefore be expected generally to result in the lowest latency. - In general, the
step 640 may comprise identifying which of the received plurality of video information streams, when processed, is expected to result in the lowest latency in presenting the unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular way of identifying the lowest latency video information stream. - The
exemplary method 600 may, atstep 650, comprise processing the identified video information stream to present the unit of video information. Step 650 may, for example, comprise processing the identified video information stream to present the unit of video information to a user (e.g., utilizing a video display device). -
Exemplary step 650 may, for example and without limitation, comprise decoding the video information stream identified atstep 640. Step 650 may, for example, comprise converting the identified video information stream to a display driver signal, which may be utilized to drive a display device. Step 650 may also, for example, comprise performing conditional access processing related to the identified video information stream. In general,step 650 may comprise processing the identified video information stream to present the unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of particular processing activities performed with video information to present such information. - As mentioned previously, in various exemplary scenarios, the plurality of video information streams may represent the same unit of video information. For example and without limitation, a first video information stream may correspond to expected lower video presentation latency, while a second video information stream may correspond to a higher video quality.
Steps exemplary method 600 provide a non-limiting illustration of how such streams might be processed. Note thatexemplary steps -
Exemplary step 660 may comprise identifying a second video information stream, where the second video information stream corresponds to higher quality video information than the video information stream identified atstep 640 and processed atstep 650. For example and without limitation, the second video information stream may comprise video information having a higher temporal, spatial and/or color resolution. -
Exemplary step 670 may then comprise processing the identified second video information stream to present the video information to the user. For example and without limitation, when an access point into the second video information stream arrives (or relatively soon after)step 670 may comprise substituting video output corresponding to the second video information stream for video output corresponding to the originally identified video information stream and output atstep 650. -
FIG. 7 is a diagram showing an exemplaryvideo reception system 700 that provides reduced latency, in accordance with various aspects of the present invention. The exemplaryvideo reception system 700 may, for example and without limitation, share various characteristics with thereceiver 130 of the exemplaryvideo communication system 100 illustrated inFIG. 1 and discussed previously. Also for example and without limitation, various components of thevideo reception system 700 may perform various functionality of theexemplary method 600 illustrated inFIG. 6 and discussed previously. - The exemplary
video reception system 700 may comprise aninterface module 731 that receives a request to present a unit of video information. Theinterface module 731 may, for example and without limitation, perform various aspects of the exemplary method 600 (e.g., step 620) illustrated inFIG. 6 and discussed previously. - A request for a unit of video information may, for example, be originated by a user directly or indirectly (e.g., through a programmed device). The request may, for example and without limitation, comprise a video channel change request. In a non-limiting exemplary scenario, the request may comprise a television channel change request. Alternatively for example, the request may comprise a request for a particular unit of video information, or a request for a particular unit of video information to be presented in a particular manner (e.g., at a particular rate and/or temporal direction).
- The
interface module 731 may receive such a request in any of a large variety of ways. For example, theinterface module 731 may receive the request through any of a variety of user interfaces or device communication interfaces. Theinterface module 731 may also, for example, receive the request from a local source or a remote source (e.g., through a communication network). - In general, the
interface module 731 may receive a request to present a unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular request, source of a particular request, or manner of receiving a particular request. - The exemplary
video reception system 700 may comprise areceiver module 732 that receives a plurality of video information streams, each of which represents the unit of video information. Thereceiver module 732 may, for example and without limitation, perform various functionality of the exemplary method 600 (e.g., step 630) illustrated inFIG. 6 and discussed previously. For example and without limitation, each of the plurality of video information streams may correspond to a particular video channel (e.g., a television channel or program). - The
exemplary receiver module 732 may comprise afirst tuner 733 andfirst receiver 734. Such a first tuner/receiver pair 733-734 may receive one or more video information streams and convert such received video information streams into digital video data. Theexemplary receiver module 732 may, for example and without limitation, also comprise asecond tuner 735 andsecond receiver 736, where the second tuner/receiver pair 735-736 may also receive one or more video information streams and convert such received video information streams into digital video data. - In an exemplary scenario, the first tuner/receiver pair 733-734 may receive a plurality of video information streams. For example, the first tuner/receiver pair 733-734 may receive the plurality of video information streams on a single multi-stream communication channel. In another exemplary scenario, the first tuner/receiver pair 733-734 may receive a first video information stream, and the second tuner/receiver pair 735-736 may receive a second video information stream.
- In general, the
exemplary receiver module 732 may receive a plurality of video information streams, each of which represents the unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular video information stream, particular video information source, particular receiver module, or by characteristics of particular methods or apparatus for receiving a plurality of video information streams. - The exemplary
video reception system 700 may comprise aprocessor module 737 that identifies which of the plurality of video information streams, when processed, is expected to result in the lowest latency in presenting the unit of video information. For example and without limitation, theprocessor module 737 may perform various functionality of the exemplary method 600 (e.g., steps 640 and 650) illustrated inFIG. 6 and discussed previously. - The
processor module 737 may, for example, identify which of the plurality of video information streams is expected to result in the lowest latency in any of a variety of ways. For example, theprocessor module 737 may identify access points in each of the received plurality of video information streams to determine which of the received plurality of video information streams is expected to communicate the next access point. Also for example, theprocessor module 737 may identify access points in one of the plurality of video information streams and (e.g., based on a known temporal relationship between access points in the respective plurality of video information streams) determine which of the received plurality of video information streams will communicate the next access point. Alternatively, for example, theprocessor module 737 may receive information of access point timing and analyze such information to determine which of the plurality of video information streams will communicate the next access point. Alternatively, for example, theprocessor module 737 may receive information indicating which of the plurality of video information streams has more frequent access points and would therefore be expected generally to result in the lowest latency. - In general, the
processor module 737 may identify which of the received plurality of video information streams, when processed, is expected to result in the lowest latency in presenting the unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular way of identifying the lowest latency video information stream or apparatus for identifying the lowest latency video information stream. - Once the video information stream that is expected to result in the lowest latency is identified, the
exemplary processor module 737 may, for example, process the identified video information stream to present the unit of video information. Theprocessor module 737 may, for example, process the identified video information stream to present the unit of video information to a user (e.g., utilizing a video display device). Note that as mentioned previously with regard to the exemplary functionality illustrated inFIG. 6 (e.g., steps 660 and 670), the processor module may also later process a different one of the plurality of video information streams, for example if the different video information stream is expected to result in improved video quality. - For example and without limitation, the
processor module 737 may comprise one ormore video decoders 738 that decode the identified video information stream. Theprocessor module 737 may, for example, convert the identified video information stream to a display driver signal, which may be utilized to drive a display device. Theprocessor module 737 may also, for example, perform conditional access processing related to the identified video information stream. In general, theprocessor module 737 may process the identified video information stream to present the unit of video information. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of particular processing activities performed with video information to present such information or by characteristics of particular video processing apparatus. - The previous discussion described various exemplary system components, modules and sub-modules. The various components, modules and sub-modules may be implemented using hardware, software, or a combination thereof. For example and without limitation, any of the various components, modules and sub-modules may be independent circuits or may be integrated into a single integrated circuit. Further for example, various components, modules and sub-modules may be co-located or may be distributed throughout a network. Accordingly, the scope of various aspects of the present invention should not be limited by characteristics of a particular hardware or software implementations.
- In summary, various aspects of the present invention provide a system and method that provide reduced latency in a video signal processing system. While the invention has been described with reference to certain aspects and embodiments, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted without departing from the scope of the invention. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the invention without departing from its scope. Therefore, it is intended that the invention not be limited to the particular embodiment disclosed, but that the invention will include all embodiments falling within the scope of the appended claims.
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/902,006 US8646014B2 (en) | 2004-03-26 | 2013-05-24 | Multistream video communication with staggered access points |
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US55666704P | 2004-03-26 | 2004-03-26 | |
US11/038,728 US7610603B2 (en) | 2004-03-26 | 2005-01-20 | Multistream video communication with staggered access points |
US12/605,844 US7840985B2 (en) | 2004-03-26 | 2009-10-26 | Multistream video communication with staggered access points |
US12/951,194 US8453187B2 (en) | 2004-03-26 | 2010-11-22 | Multistream video communication with staggered access points |
US13/902,006 US8646014B2 (en) | 2004-03-26 | 2013-05-24 | Multistream video communication with staggered access points |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/951,194 Continuation US8453187B2 (en) | 2004-03-26 | 2010-11-22 | Multistream video communication with staggered access points |
Publications (2)
Publication Number | Publication Date |
---|---|
US20130263195A1 true US20130263195A1 (en) | 2013-10-03 |
US8646014B2 US8646014B2 (en) | 2014-02-04 |
Family
ID=34991707
Family Applications (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/038,728 Active 2028-06-17 US7610603B2 (en) | 2004-03-26 | 2005-01-20 | Multistream video communication with staggered access points |
US12/605,844 Active US7840985B2 (en) | 2004-03-26 | 2009-10-26 | Multistream video communication with staggered access points |
US12/951,194 Active 2025-07-29 US8453187B2 (en) | 2004-03-26 | 2010-11-22 | Multistream video communication with staggered access points |
US13/902,006 Active US8646014B2 (en) | 2004-03-26 | 2013-05-24 | Multistream video communication with staggered access points |
Family Applications Before (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/038,728 Active 2028-06-17 US7610603B2 (en) | 2004-03-26 | 2005-01-20 | Multistream video communication with staggered access points |
US12/605,844 Active US7840985B2 (en) | 2004-03-26 | 2009-10-26 | Multistream video communication with staggered access points |
US12/951,194 Active 2025-07-29 US8453187B2 (en) | 2004-03-26 | 2010-11-22 | Multistream video communication with staggered access points |
Country Status (1)
Country | Link |
---|---|
US (4) | US7610603B2 (en) |
Families Citing this family (31)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9325998B2 (en) | 2003-09-30 | 2016-04-26 | Sharp Laboratories Of America, Inc. | Wireless video transmission system |
US8018850B2 (en) | 2004-02-23 | 2011-09-13 | Sharp Laboratories Of America, Inc. | Wireless video transmission system |
US7610603B2 (en) * | 2004-03-26 | 2009-10-27 | Broadcom Corporation | Multistream video communication with staggered access points |
US8356327B2 (en) | 2004-10-30 | 2013-01-15 | Sharp Laboratories Of America, Inc. | Wireless video transmission system |
US7797723B2 (en) | 2004-10-30 | 2010-09-14 | Sharp Laboratories Of America, Inc. | Packet scheduling for video transmission with sender queue control |
US7784076B2 (en) | 2004-10-30 | 2010-08-24 | Sharp Laboratories Of America, Inc. | Sender-side bandwidth estimation for video transmission with receiver packet buffer |
US8239902B2 (en) * | 2005-06-29 | 2012-08-07 | International Business Machines Corporation | Method and apparatus for bandwidth optimization of a content on demand service |
US8169982B2 (en) | 2005-08-10 | 2012-05-01 | Qualcomm Incorporated | Method and apparatus for creating a fingerprint for a wireless network |
US7813448B2 (en) * | 2005-10-31 | 2010-10-12 | Broadcom Corporation | Cyclic delay diversity in a wireless system |
US9544602B2 (en) | 2005-12-30 | 2017-01-10 | Sharp Laboratories Of America, Inc. | Wireless video transmission system |
US7652994B2 (en) | 2006-03-31 | 2010-01-26 | Sharp Laboratories Of America, Inc. | Accelerated media coding for robust low-delay video streaming over time-varying and bandwidth limited channels |
US8861597B2 (en) | 2006-09-18 | 2014-10-14 | Sharp Laboratories Of America, Inc. | Distributed channel time allocation for video streaming over wireless networks |
US7652993B2 (en) * | 2006-11-03 | 2010-01-26 | Sharp Laboratories Of America, Inc. | Multi-stream pro-active rate adaptation for robust video transmission |
US20080181256A1 (en) * | 2006-11-22 | 2008-07-31 | General Instrument Corporation | Switched Digital Video Distribution Infrastructure and Method of Operation |
KR100880893B1 (en) * | 2007-09-14 | 2009-01-30 | 한국전자통신연구원 | Apparatus for fast channel change using multiple multicast in iptv network and method thereof |
US20090098885A1 (en) * | 2007-10-12 | 2009-04-16 | Qualcomm Incorporated | System and method for storing information to locate a femto cell |
US9253653B2 (en) * | 2007-11-09 | 2016-02-02 | Qualcomm Incorporated | Access point configuration based on received access point signals |
EP2124451A3 (en) * | 2008-05-23 | 2014-03-26 | Sony Corporation | Content server, information processing apparatus, network device, content distribution method, information processing method, and content distribution system |
US8234668B2 (en) | 2008-12-23 | 2012-07-31 | Microsoft Corporation | Content access |
US8782267B2 (en) * | 2009-05-29 | 2014-07-15 | Comcast Cable Communications, Llc | Methods, systems, devices, and computer-readable media for delivering additional content using a multicast streaming |
US8838096B2 (en) * | 2009-05-29 | 2014-09-16 | Qualcomm Incorporated | Non-macro cell search integrated with macro-cellular RF carrier monitoring |
US20110134833A1 (en) * | 2009-12-08 | 2011-06-09 | Qualcomm Incorporated | Controlling access point functionality |
US8923892B2 (en) | 2010-05-14 | 2014-12-30 | Qualcomm Incorporated | Method and apparatus for updating femtocell proximity information |
CA2823288C (en) * | 2011-02-16 | 2019-05-07 | Panasonic Corporation | Video encoder, video encoding method, video encoding program, video reproduction device, video reproduction method, and video reproduction program |
MX2013009122A (en) * | 2011-02-17 | 2013-11-04 | Panasonic Corp | Video encoding device, video encoding method, video encoding program, video playback device, video playback method, and video playback program. |
US9071853B2 (en) * | 2012-08-31 | 2015-06-30 | Google Technology Holdings LLC | Broadcast content to HTTP client conversion |
US8923880B2 (en) * | 2012-09-28 | 2014-12-30 | Intel Corporation | Selective joinder of user equipment with wireless cell |
KR20140111859A (en) * | 2013-03-12 | 2014-09-22 | 삼성전자주식회사 | Method and device for sharing content |
US9900362B2 (en) | 2014-02-11 | 2018-02-20 | Kiswe Mobile Inc. | Methods and apparatus for reducing latency shift in switching between distinct content streams |
US11438545B2 (en) | 2019-12-23 | 2022-09-06 | Carrier Corporation | Video image-based media stream bandwidth reduction |
US11463651B2 (en) | 2019-12-23 | 2022-10-04 | Carrier Corporation | Video frame-based media stream bandwidth reduction |
Family Cites Families (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5612742A (en) * | 1994-10-19 | 1997-03-18 | Imedia Corporation | Method and apparatus for encoding and formatting data representing a video program to provide multiple overlapping presentations of the video program |
US5594491A (en) * | 1995-12-29 | 1997-01-14 | Vxl/Hcr Technology Corporation | Near-video-on-demand digital video distribution system utilizing asymmetric digital subscriber lines |
EP2271103A3 (en) * | 1996-07-15 | 2013-01-16 | Amstr. Investments 4 K.G., LLC | Video Signal Compression |
US6018359A (en) * | 1998-04-24 | 2000-01-25 | Massachusetts Institute Of Technology | System and method for multicast video-on-demand delivery system |
US7155735B1 (en) * | 1999-10-08 | 2006-12-26 | Vulcan Patents Llc | System and method for the broadcast dissemination of time-ordered data |
US7257308B2 (en) * | 2001-12-06 | 2007-08-14 | Scientific-Atlanta, Inc. | Converting time-shift buffering for personal video recording into permanent recordings |
US8565578B2 (en) * | 2001-12-06 | 2013-10-22 | Harold J. Plourde, Jr. | Dividing and managing time-shift buffering into program specific segments based on defined durations |
US7926080B2 (en) * | 2002-11-07 | 2011-04-12 | Microsoft Corporation | Trick mode support for VOD with long intra-frame intervals |
AU2003283028A1 (en) * | 2002-11-15 | 2004-06-15 | Thomson Licensing S.A. | Method and system for staggered statistical multiplexing |
AU2003282292A1 (en) * | 2002-12-04 | 2004-06-23 | Koninklijke Philips Electronics N.V. | System and method for broadcasting a video program |
US20040160974A1 (en) * | 2003-02-13 | 2004-08-19 | Read Christopher Jensen | Method and system for rapid channel change within a transport stream |
JP4863379B2 (en) * | 2003-06-16 | 2012-01-25 | トムソン ライセンシング | Encoding method and apparatus enabling high-speed channel change of compressed video |
US20050071881A1 (en) * | 2003-09-30 | 2005-03-31 | Deshpande Sachin G. | Systems and methods for playlist creation and playback |
US7430222B2 (en) * | 2004-02-27 | 2008-09-30 | Microsoft Corporation | Media stream splicer |
US7610603B2 (en) | 2004-03-26 | 2009-10-27 | Broadcom Corporation | Multistream video communication with staggered access points |
WO2006057938A2 (en) * | 2004-11-22 | 2006-06-01 | Thomson Research Funding Corporation | Method and apparatus for channel change in dsl system |
US8135040B2 (en) * | 2005-11-30 | 2012-03-13 | Microsoft Corporation | Accelerated channel change |
US7793329B2 (en) * | 2006-02-06 | 2010-09-07 | Kasenna, Inc. | Method and system for reducing switching delays between digital video feeds using multicast slotted transmission technique |
US9015782B2 (en) * | 2006-06-30 | 2015-04-21 | Alcatel Lucent | Signal distribution system with interrupt processing and trick play functionality |
-
2005
- 2005-01-20 US US11/038,728 patent/US7610603B2/en active Active
-
2009
- 2009-10-26 US US12/605,844 patent/US7840985B2/en active Active
-
2010
- 2010-11-22 US US12/951,194 patent/US8453187B2/en active Active
-
2013
- 2013-05-24 US US13/902,006 patent/US8646014B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
US20100043036A1 (en) | 2010-02-18 |
US7610603B2 (en) | 2009-10-27 |
US8453187B2 (en) | 2013-05-28 |
US20050216950A1 (en) | 2005-09-29 |
US20110093906A1 (en) | 2011-04-21 |
US7840985B2 (en) | 2010-11-23 |
US8646014B2 (en) | 2014-02-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8646014B2 (en) | Multistream video communication with staggered access points | |
US10785529B2 (en) | Anticipatory video signal reception and processing | |
US9479737B2 (en) | Systems and methods for event programming via a remote media player | |
US10694264B2 (en) | Correlating timeline information between media streams | |
JP6317872B2 (en) | Decoder for synchronizing the rendering of content received over different networks and method therefor | |
US7688384B2 (en) | Personal multimedia device video format conversion across multiple video formats | |
US20060020995A1 (en) | Fast channel change in digital media systems | |
US9860581B2 (en) | Correlating timeline information between media streams | |
US7688861B2 (en) | Media channel switching | |
US7646432B2 (en) | Multimedia signal matching system and method for performing picture-in-picture function | |
US7643508B2 (en) | Client side PID translation | |
US9137477B2 (en) | Fast channel change companion stream solution with bandwidth optimization | |
US9131281B2 (en) | Method for embedding and multiplexing audio metadata in a broadcasted analog video stream | |
KR20180109316A (en) | Input/output verification method in retransmission system and apparatus thereof | |
EP2733953A1 (en) | Content compression system | |
Demeyere et al. | Analysis and Development of an MHP Application for Live Event Broadcasting and Video Conferencing | |
EP1605702A1 (en) | Method for switching digital video programs and transmitter for carrying out the method | |
KR20100049167A (en) | System and tuning method for internet protocol tv broadcasting service |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: BROADCOM CORPORATION, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MACINNIS, ALEXANDER G.;REEL/FRAME:030735/0505 Effective date: 20050119 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: BANK OF AMERICA, N.A., AS COLLATERAL AGENT, NORTH CAROLINA Free format text: PATENT SECURITY AGREEMENT;ASSIGNOR:BROADCOM CORPORATION;REEL/FRAME:037806/0001 Effective date: 20160201 Owner name: BANK OF AMERICA, N.A., AS COLLATERAL AGENT, NORTH Free format text: PATENT SECURITY AGREEMENT;ASSIGNOR:BROADCOM CORPORATION;REEL/FRAME:037806/0001 Effective date: 20160201 |
|
AS | Assignment |
Owner name: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD., SINGAPORE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BROADCOM CORPORATION;REEL/FRAME:041706/0001 Effective date: 20170120 Owner name: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BROADCOM CORPORATION;REEL/FRAME:041706/0001 Effective date: 20170120 |
|
AS | Assignment |
Owner name: BROADCOM CORPORATION, CALIFORNIA Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:BANK OF AMERICA, N.A., AS COLLATERAL AGENT;REEL/FRAME:041712/0001 Effective date: 20170119 |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
AS | Assignment |
Owner name: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITE Free format text: MERGER;ASSIGNOR:AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.;REEL/FRAME:047230/0910 Effective date: 20180509 |
|
AS | Assignment |
Owner name: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITE Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE EFFECTIVE DATE OF THE MERGER PREVIOUSLY RECORDED AT REEL: 047230 FRAME: 0910. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER;ASSIGNOR:AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.;REEL/FRAME:047351/0384 Effective date: 20180905 |
|
AS | Assignment |
Owner name: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITE Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ERROR IN RECORDING THE MERGER IN THE INCORRECT US PATENT NO. 8,876,094 PREVIOUSLY RECORDED ON REEL 047351 FRAME 0384. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER;ASSIGNOR:AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.;REEL/FRAME:049248/0558 Effective date: 20180905 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 8 |
|
IPR | Aia trial proceeding filed before the patent and appeal board: inter partes review |
Free format text: TRIAL NO: IPR2021-01343 Opponent name: NETFLIX, INC., ANDNETFLIX STREAMING SERVICES, INC. Effective date: 20210812 |