US20020015576A1 - Method and apparatus for simultaneously producing compressed play and trick play bitstreams from a video frame sequence - Google Patents

Method and apparatus for simultaneously producing compressed play and trick play bitstreams from a video frame sequence Download PDF

Info

Publication number
US20020015576A1
US20020015576A1 US09201529 US20152998A US2002015576A1 US 20020015576 A1 US20020015576 A1 US 20020015576A1 US 09201529 US09201529 US 09201529 US 20152998 A US20152998 A US 20152998A US 2002015576 A1 US2002015576 A1 US 2002015576A1
Authority
US
Grant status
Application
Patent type
Prior art keywords
frames
bitstream
sequence
encoder
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US09201529
Other versions
US6389218B2 (en )
Inventor
Donald F. Gordon
Edward A. Ludvig
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Cox Communications Inc
Original Assignee
DIVA Systems Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/231Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/114Adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/177Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/587Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of content streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of content streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234381Processing of video elementary streams, e.g. splicing of content streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a Uniform Resource Locator [URL] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a Uniform Resource Locator [URL] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/23608Remultiplexing multiplex streams, e.g. involving modifying time stamps or remapping the packet identifiers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2387Stream processing in response to a playback request from an end-user, e.g. for trick-play
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/414Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/4147Personal Video Recorder [PVR]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network, synchronizing decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4331Caching operations, e.g. of an advertisement for later insertion during playback
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network, synchronizing decoder's clock; Client middleware
    • H04N21/434Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network, synchronizing decoder's clock; Client middleware
    • H04N21/434Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4344Remultiplexing of multiplex streams, e.g. by modifying time stamps or remapping the packet identifiers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47202End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/60Selective content distribution, e.g. interactive television, VOD [Video On Demand] using Network structure or processes specifically adapted for video distribution between server and client or between remote clients; Control signaling specific to video distribution between clients, server and network components, e.g. to video encoder or decoder; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing using dedicated Communication protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8455Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/78Television signal recording using magnetic recording
    • H04N5/782Television signal recording using magnetic recording on tape
    • H04N5/783Adaptations for reproducing at a rate different from the recording rate
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/78Television signal recording using magnetic recording
    • H04N5/782Television signal recording using magnetic recording on tape
    • H04N5/7824Television signal recording using magnetic recording on tape with rotating magnetic heads
    • H04N5/7826Television signal recording using magnetic recording on tape with rotating magnetic heads involving helical scanning of the magnetic tape
    • H04N5/78263Television signal recording using magnetic recording on tape with rotating magnetic heads involving helical scanning of the magnetic tape for recording on tracks inclined relative to the direction of movement of the tape
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/79Processing of colour television signals in connection with recording
    • H04N9/80Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/804Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
    • H04N9/8042Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/79Processing of colour television signals in connection with recording
    • H04N9/80Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/82Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
    • H04N9/8205Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
    • H04N9/8227Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal the additional signal being at least another television signal

Abstract

An “all-in-one” encoder that simultaneously produces an MPEG-2 compliant fast forward, fast reverse and play bitstreams from a sequence of video frames, e.g., 601-format video. The encoder subsamples the video sequence, extracting a plurality of frames from the video sequence and buffering the subsampled frames. Simultaneous with the subsampling and buffering, the source frames are encoded within a real-time encoder, e.g., an MPEG-2 encoder. The buffered frames are recalled from the buffer and coupled to a second real-time encoder. The second encoder forms both the fast forward and fast reverse bitstreams using a time multiplexing technique wherein a group of pictures (GOP) for the fast forward stream can be formed, followed by the compression of the same GOP having the frames organized in reverse order. As such, the compressed GOPs are represented by the fast forward and fast reverse bitstreams. The play, fast forward, and fast reverse bitstreams for each GOP are organized into a file and stored on the mass storage device (e.g., disk drive array) of the file server.

Description

    BACKGROUND OF THE DISCLOSURE
  • 1. Field of the Invention [0001]
  • The invention relates to video-on-demand systems and, more particularly, the invention relates to a method and apparatus for simultaneously generating compressed play and trick play bitstreams from a video frame sequence. [0002]
  • 2. Description of the Background Art [0003]
  • In a video-on-demand system such as the OnSet™ system manufactured by DIVA Systems Corporation, a file server is used for streaming video information to users (subscribers) of the system. The OnSet™ system is described in U.S. patent application Ser. No. 08/984,710, filed Dec. 3, 1997, and the file server is described in U.S. Pat. Nos. 5,671,377 and 5,581,778. The disclosures of this application and these patents are incorporated herein by reference. The OnSet™ system contains service provider equipment coupled through an information distribution network to subscriber equipment. This system provides subscribers VCR-like controls to enable a subscriber to select information content, for example, a movie, then play, fast forward, rewind, pause, or stop the selected movie. The subscriber enters control commands through the subscriber equipment and the service provider equipment executes the commands to fulfill the purpose of the command, e.g., play, fast forward, rewind, stop or pause the movie. [0004]
  • A file server forms a portion of the service provider equipment and stores, for a given movie, a standard play stream (i.e., an MPEG-2 compressed video bitstream), a fast forward stream and a fast reverse play (rewind) stream. The fast forward and fast reverse streams are also MPEG-2 compressed video, where the fast forward stream is a compressed signal containing only every Nth frame of the uncompressed play video and the fast reverse stream is a compressed signal containing every Nth frame of the uncompressed play video played backwards. To store the video information, each stream is divided into portions (e.g., N-byte segments of compressed data) and striped onto a disk array. The disk array stores all the information that the file server can directly access. [0005]
  • The process for generating the fast forward and fast reverse streams is time consuming and expensive. The process requires a frame by frame analysis of the video stream to enable the frames to be encoded in an MPEG-2 compliant form, yet provide a fast forward and fast reverse effect when decoded. As such, the video sequence is processed to extract every Rth frame (i.e., one of every R frames, where R is an integer greater than 1) to form a fast forward sequence and then the fast forward sequence is encoded (compressed). For a fast reverse stream, a sequence of frames in reverse order is created and encoded. Such encoding can cost $17 to $20 per minute of video. This encoding process can not be used for producing fast forward and fast reverse streams in real time such that a real time program can be encoded and stored for almost immediate use of VCR-like functions. [0006]
  • Therefore, there is a need in the art for an improved encoding system for a video-on-demand system to ensure real-time availability of fast forward and fast reverse functions. [0007]
  • SUMMARY OF THE INVENTION
  • The disadvantages associated with the prior art are overcome by the invention of an “all-in-one” encoder that simultaneously produces an MPEG-2 compliant fast forward, fast reverse and play bitstreams from a sequence of video frames, e.g., 601-format video. The encoder of the present invention subsamples the video sequence, extracting a plurality of frames from the video sequence and buffering the subsampled frames. Simultaneous with the subsampling and buffering, the source frames are encoded within a real-time encoder, e.g., an MPEG-2 encoder. The buffered frames are recalled from the buffer and coupled to a second real-time encoder. The second encoder forms both the fast forward and fast reverse bitstreams using a time multiplexing technique wherein a group of pictures (GOP) for the fast forward stream can be formed, followed by the compression of the same GOP having the frames organized in reverse order. As such, the compressed GOPs are represented by the fast forward and fast reverse bitstreams. The play, fast forward, and fast reverse bitstreams for each GOP are organized into a file and stored on the mass storage device (e.g., disk drive array) of the file server.[0008]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The teachings of the present invention can be readily understood by considering the following detailed description in conjunction with the accompanying drawings, in which: [0009]
  • FIG. 1 depicts a block diagram of the all-in-one encoder of the present invention; [0010]
  • FIG. 2 illustrates the method of the present invention used to produce a fast forward bitstream; and [0011]
  • FIG. 3 illustrates the method of the present invention used to produce a fast reverse bitstream.[0012]
  • To facilitate understanding, identical reference numerals have been used, where possible, to designate identical elements that are common to the figures. [0013]
  • DETAILED DESCRIPTION
  • FIG. 1 depicts a block diagram of an all-in-one encoder [0014] 100 comprising a first encoder 102, frame subsampler 104, a frame buffer 106, a second encoder 108 and a controller 110. The first encoder 102 encodes a source video sequence in a conventional manner, i.e., compressing the source video sequence in real-time as the frames are input to the encoder. The second encoder 108 operating in conjunction with the subsampler 104 and the buffer 106 encodes a subsampled version of the source video sequence to form a fast forward and fast reverse bitstreams (collectively referred to herein as trick play bitstreams or trick play streams). The first encoder (the play stream encoder 102) contains a real-time MPEG-2 encoder that produces an MPEG-2 compliant, compressed video bitstream (a play stream) from a sequence of 601-format video frames. The second encoder (the trick play stream encoder 104) is also an MPEG-2 real-time encoder 112.
  • For the following discussion, frame numbering is used to describe the temporal order in which frames occur in source material where [0015] 1 is the first frame in the source material frame sequence and 2 is the second frame and so on. For the following description, R is an integer and defines a play-back speed multiplier which has significance in the trick play processes. The speed multiplier R is a variable that is established by the controller 110. The controller 110 is a microprocessor or microcontroller as well as support circuits such as memory, clocks, power supplies, etc. that is programmed to perform the control functions of the all in one encoder 100.
  • Throughout this disclosure, the exemplary trick play streams are fast forward and fast reverse. Of course other forms of trick play streams may be generated using the all-in-one encoder [0016] 100 of the present invention. If the multiplier R equals 2, playback (decoding) of a fast forward stream is twice normal single speed. If R equals 3, playback is three times normal play speed and so on. Generally, the trick play streams include a nine times fast forward stream and a nine times fast reverse stream. Alternatively, 32 times normal fast forward and fast reverse streams are also available. The term source or source video is used to describe the uncompressed video material such as 601-format video from which the trick play bitstreams are generated.
  • Using the all-in-one encoder [0017] 100, a fast forward MPEG video bitstream is generated from an uncompressed video source such that when the stream is played back linearly through a standard MPEG compliant video decoder, the resulting imagery contains every Rth frame of the original video sequence. As such, the display of the sequence has a fast forward effect.
  • A fast reverse stream is simultaneously produced by the all-in-one encoder such that when linearly played back through a an MPEG compliant video decoder, the decoded stream produces a sequence of frames that play in reverse relative to the original frame sequence. [0018]
  • The play bitstream is formed using a conventional MPEG-compliant encoder [0019] 102 that compresses a plurality of frames (N frames that form a group-of-pictures (GOP)). To form the trick play streams having N frame GOPs, the subsampler 104 extracts one out of every R consecutive frames (arranged in increasing time code order) from the source sequence. The selected N frames are buffered in the frame buffer 106. For example, if R is two and the buffer stores N frames, the buffer stores frames 1, 3, 5, 7, 9, and so on up to frame 2N+1. The buffer 106 stores N successive frames that define a GOP for the trick play bitstreams.
  • To produce a fast forward stream, the N frames from the buffer [0020] 106 are recalled under the control of the controller 110 and coupled sequentially into the real-time encoder 108. The real-time encoders 102 and 108 used herein may be any form of encoder that compresses video information. One illustrative MPEG encoder is the E4 chip set available from C-Cubed of Springfield, Va. The output is a compressed bitstream representing a fast forward GOP.
  • To produce a fast reverse stream, the N frames from the buffer [0021] 106 are recalled under the control of the controller 110 and are coupled in reverse time order into the encoder 108. Although two encoders could be used to produce each of the trick play streams independently, as long as R equals two or more, a single encoder can be used to produce both trick play tracks using time multiplexing technique. To perform the multiplexed encoding, the fast forward GOP is encoded first, then the fast reverse GOP. After the buffer is filled with another N frames, the GOP pair is again encoded and so on. The recall order of the frames from the buffer and the multiplexing process are controlled by controller 110 by addressing the buffer in forward order for the fast forward GOP and in reverse order for the fast reverse GOP.
  • The forward and reverse GOPs contain sequence start and sequence end codes such that, when stored in a mass storage device, the bitstreams are clearly delimited. [0022]
  • The forward and reverse GOP bitstreams are stored with the play stream in a storage medium such as a disk drive array or magneto-optical disk. The fast forward stream is written sequentially, one GOP bitstream at a time, from the lowest address to the highest address. The reverse bitstream is stored in reverse order from highest address to lowest address. The last byte in the reverse GOP is placed in the highest address space of the reverse target file. As such, the reverse GOP precedes, in address space, the first frame of the immediately previously written reverse GOP. [0023]
  • The entire source material frame sequence is encoded in this manner to simultaneously produce a play, a fast forward, and fast reverse streams in real-time. [0024]
  • FIG. 2 illustrates the process by which a fast forward stream is produced. Sequence [0025] 200 represents the RN frames (frames 1 to RN+1) that have been subsampled from a video frame sequence at a one of R rate from a video frame sequence and stored in the buffer (e.g., R=2, then 2N frames are subsampled to form a trick play GOP). These buffered frames are recalled from memory and encoded and then associated with a normal play stream having a GOP of N frames. The encoder (at step 202) repetitively produces a sequence of GOPs 204 that are stored in increasing addresses in memory as illustrated in sequence 206. The first GOP (GOP 0) contains frames 1 to RN+1, the second GOP (GOP 1) contains frames R(N+1)+1 through 2RN+1, the third GOP (GOP 2) contains frames 2R(N+1)+1 through 3RN+1, and so on. To generalize, a GOP contains frames GR(N+1)+1 through (G+1)RN+1, where G is the GOP number (e.g., 0, 1, 2, 3, . . . ), R is the subsampling rate, and N is the number of frames in a standard play GOP.
  • FIG. 3 illustrates the process by which a fast reverse stream is produced. Sequence [0026] 300 represents the RN frames that have been buffered after subsampling at one of R rate (e.g., R=2 in FIG. 3). At step 302, these frames are selected from the buffer in reverse order as illustrated at 304. The reverse order frames are encoded, at step 306, to produce a sequence of GOPs 308 that are stored in reverse time order in memory as illustrated in sequence 310.
  • Although various embodiments which incorporate the teachings of the present invention have been shown and described in detail herein, those skilled in the art can readily devise many other varied embodiments that still incorporate these teachings. [0027]

Claims (19)

    What is claimed is:
  1. 1. Apparatus for producing a plurality of encoded video bitstreams comprising:
    a first encoder for producing a first bitstream that contains information that, when decoded, produces a standard forward play video frame sequence;
    a frame subsampler;
    a buffer that stores subsampled frames of the video sequence;
    a second encoder for producing a second bitstream that contains information that, when decoded, produces a first trick play frame sequence;
    a third encoder for producing a third bitstream that contains information that, when decoded, produces a second trick play video frame sequence; and
    a controller that selects subsampled frames from the buffer and couples to selected frames to the second and third encoders.
  2. 2. The apparatus of claim 1 wherein said first encoder is an MPEG encoder that encodes N frames of the video sequence.
  3. 3. The apparatus of claim 1 wherein said second and third encoders are MPEG encoders that encodes R/N frames of the video sequence having N frames.
  4. 4. The apparatus of claim 1 wherein said first trick play video frame sequence is a fast forward video frame sequence.
  5. 5. The apparatus of claim 1 wherein said second trick play video frame sequence is a fast reverse video frame sequence.
  6. 6. The apparatus of claim 1 wherein the controller multiplexes selection of the frames from the buffer to apply plurality of subsampled frames to said second encoder to form said second bitstream and then apply a plurality of subsampled frames to said third encoder to form said third bitstream.
  7. 7. A method of encoding frames of a video sequence to form a plurality of bitstreams comprising the steps of:
    encoding said frames to form a first bitstream;
    subsampling said frames;
    buffering said subsampled frames;
    recalling said buffered frames in a forward time sequence order;
    encoding said recalled buffered frames to form a second bitstream;
    recalling said buffered frames in a reverse time sequence order;
    encoding said recalled buffered frames to form a third bitstream.
  8. 8. The method of claim 7 wherein said first bitstream when decoded forms a standard play frame sequence.
  9. 9. The method of claim 7 wherein said second bistream, when decoded, forms a fast forward frame sequence.
  10. 10. The method of claim 5 wherein said third bitstream, when decoded, forms a fast reverse frame sequence.
  11. 11. A method of encoding frames of a video sequence to form a plurality of bitstreams comprising the steps of:
    encoding said frames to form a first bitstream;
    while encoding said frames to form said first bitstream, selecting a subsampled set of frames from said frames of said video sequence;
    encoding the subsample set of frames to form a second bitstream.
  12. 12. The method of claim 11 further comprising the steps of:
    buffering said subsampled set of frames;
    recalling said buffered frames in a forward time sequence order; and
    encoding said recalled buffered frames to form said second bitstream.
  13. 13. The method of claim 12 wherein said second bitstream, when decoded, forms a fast forward video frame sequence.
  14. 14. The method of claim 11 further comprising the steps of:
    buffering said subsampled set of frames;
    recalling said buffered frames in a reverse time sequence order; and
    encoding said recalled buffered frames to form said second bitstream.
  15. 15. The method of claim 14 wherein said second bitstream, when decoded, forms a fast reverse video frame sequence.
  16. 16. The method of claim 11 further comprising the steps of:
    buffering said subsampled frames of said frames in said video sequence;
    recalling said buffered frames in a forward time sequence order;
    encoding said recalled buffered frames to form a second bitstream;
    recalling said buffered frames in a reverse time sequence order;
    encoding said recalled buffered frames to form a third bitstream.
  17. 17. The method of claim 16 wherein said first bitstream when decoded forms a standard play frame sequence.
  18. 18. The method of claim 16 wherein said second bistream, when decoded, forms a fast forward frame sequence.
  19. 19. The method of claim 16 wherein said third bitstream, when decoded, forms a fast reverse frame sequence.
US09201529 1998-11-30 1998-11-30 Method and apparatus for simultaneously producing compressed play and trick play bitstreams from a video frame sequence Expired - Lifetime US6389218B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US09201529 US6389218B2 (en) 1998-11-30 1998-11-30 Method and apparatus for simultaneously producing compressed play and trick play bitstreams from a video frame sequence

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
US09201529 US6389218B2 (en) 1998-11-30 1998-11-30 Method and apparatus for simultaneously producing compressed play and trick play bitstreams from a video frame sequence
AU3100300A AU3100300A (en) 1998-11-30 1999-11-16 Method and apparatus for simultaneously producing compressed play and trick playbitstreams from a video frame sequence
PCT/US1999/027120 WO2000033567A1 (en) 1998-11-30 1999-11-16 Method and apparatus for simultaneously producing compressed play and trick play bitstreams from a video frame sequence
CA 2352143 CA2352143C (en) 1998-11-30 1999-11-23 Method and apparatus for producing demand real-time television
GB0111983A GB2361599B (en) 1998-11-30 1999-11-23 Method and apparatus for producing demand real-time television
AU1828800A AU1828800A (en) 1998-11-30 1999-11-23 Method and apparatus for producing demand real-time television
PCT/US1999/027755 WO2000033568A1 (en) 1998-11-30 1999-11-23 Method and apparatus for producing demand real-time television

Publications (2)

Publication Number Publication Date
US20020015576A1 true true US20020015576A1 (en) 2002-02-07
US6389218B2 US6389218B2 (en) 2002-05-14

Family

ID=22746204

Family Applications (1)

Application Number Title Priority Date Filing Date
US09201529 Expired - Lifetime US6389218B2 (en) 1998-11-30 1998-11-30 Method and apparatus for simultaneously producing compressed play and trick play bitstreams from a video frame sequence

Country Status (2)

Country Link
US (1) US6389218B2 (en)
WO (1) WO2000033567A1 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030185542A1 (en) * 2002-03-28 2003-10-02 Mcveigh Jeffrey S. Transcoding apparatus, system, and method
EP1363453A2 (en) * 2002-05-14 2003-11-19 Pioneer Corporation Image signal recording and/or reproducing apparatus and medium
US20060031892A1 (en) * 2004-08-05 2006-02-09 Bitband Technologies Ltd. Prevention of advertisement skipping
US20060127035A1 (en) * 2003-06-30 2006-06-15 Koninklijke Philips Electronics N.V. Clip based trick modes
US20070019925A1 (en) * 2005-07-21 2007-01-25 Macinnis Alexander Systems, methods, and apparatus for trick mode
US20080166100A1 (en) * 2007-01-10 2008-07-10 Tim Ross Accurate fast forward rate when performing trick play with variable distance between frames
US7412149B2 (en) 2004-10-28 2008-08-12 Bitband Technologies, Ltd. Trick mode generation in video streaming
US20120057854A1 (en) * 2010-09-07 2012-03-08 Ching-Lung Chang K rate fast-forwarding and backwarding mechanism for digital videos
US20120213363A1 (en) * 2005-12-23 2012-08-23 Koninklijke Philips Electronics N.V. Device for and a method of processing a data stream
US8265168B1 (en) * 2008-02-01 2012-09-11 Zenverge, Inc. Providing trick mode for video stream transmitted over network

Families Citing this family (51)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6865747B1 (en) * 1999-04-01 2005-03-08 Digital Video Express, L.P. High definition media storage structure and playback mechanism
CN1225131C (en) * 1999-11-10 2005-10-26 汤姆森特许公司 Picture gradual change function for digital optical disk
US7231132B1 (en) * 2000-10-16 2007-06-12 Seachange International, Inc. Trick-mode processing for digital video
GB0104785D0 (en) * 2001-02-27 2001-04-18 Pace Micro Tech Plc MPEG decoder video in the form of cue and/or review streams of data
US20030046702A1 (en) * 2001-09-03 2003-03-06 Gen Sasaki Program server and a receiver
US20030099364A1 (en) * 2001-11-28 2003-05-29 Thompson Mark R. Playback manipulation of HTTP streamed content objects
JP2003223410A (en) * 2002-01-30 2003-08-08 Toshiba Corp Computer and system configuration method
US7610606B2 (en) * 2002-05-03 2009-10-27 Time Warner Cable, Inc. Technique for effectively providing various entertainment services through a communications network
US7908626B2 (en) * 2002-05-03 2011-03-15 Time Warner Interactive Video Group, Inc. Network based digital information and entertainment storage and delivery system
US8312504B2 (en) 2002-05-03 2012-11-13 Time Warner Cable LLC Program storage, retrieval and management based on segmentation messages
US8443383B2 (en) 2002-05-03 2013-05-14 Time Warner Cable Enterprises Llc Use of messages in program signal streams by set-top terminals
US7614066B2 (en) 2002-05-03 2009-11-03 Time Warner Interactive Video Group Inc. Use of multiple embedded messages in program signal streams
US8392952B2 (en) * 2002-05-03 2013-03-05 Time Warner Cable Enterprises Llc Programming content processing and management system and method
US7363647B1 (en) * 2002-05-07 2008-04-22 Unisys Corporation Mapping process for use in sending trick-mode video streams with a high performance
US7383565B1 (en) * 2002-05-07 2008-06-03 Unisys Corporation Directing process for use in sending trick-mode video streams with a high performance
US7337460B1 (en) * 2002-05-07 2008-02-26 Unisys Corporation Combining process for use in sending trick-mode video streams with a high performance
WO2004064066A1 (en) * 2003-01-16 2004-07-29 Koninklijke Philips Electronics N.V. Method of and device for caching digital content data
JP2005285301A (en) * 2004-03-05 2005-10-13 Ricoh Co Ltd Recorder, reproducer, recording method, reproducing method and program
WO2006012418A9 (en) 2004-07-21 2007-03-08 Beach Unltd Llc Distributed storage architecture based on block map caching and vfs stackable file system modules
KR20060088303A (en) * 2005-02-01 2006-08-04 엘지전자 주식회사 Apparatus and method recording/playing moving picture in digital broadcasting receiver
US8234679B2 (en) 2005-04-01 2012-07-31 Time Warner Cable, Inc. Technique for selecting multiple entertainment programs to be provided over a communication network
US7577980B2 (en) * 2006-01-19 2009-08-18 International Business Machines Corporation Bit-rate constrained trick play through stream switching and adaptive streaming
KR100790037B1 (en) * 2006-02-10 2008-01-02 엘지전자 주식회사 Method for time shift and television receiver
US20070217759A1 (en) * 2006-03-10 2007-09-20 Microsoft Corporation Reverse Playback of Video Data
US20080201736A1 (en) * 2007-01-12 2008-08-21 Ictv, Inc. Using Triggers with Video for Interactive Content Identification
US9826197B2 (en) * 2007-01-12 2017-11-21 Activevideo Networks, Inc. Providing television broadcasts over a managed network and interactive content over an unmanaged network to a client device
US9355681B2 (en) 2007-01-12 2016-05-31 Activevideo Networks, Inc. MPEG objects and systems and methods for using MPEG objects
GB2449068A (en) * 2007-05-08 2008-11-12 Edgeware Ab Data streaming using stored control data
EP2186340B1 (en) 2007-08-09 2016-01-06 GVBB Holdings S.A.R.L A video data reproduction system
US8997161B2 (en) * 2008-01-02 2015-03-31 Sonic Ip, Inc. Application enhancement tracks
WO2010044926A3 (en) * 2008-06-25 2010-06-17 Active Video Networks, Inc. Providing television broadcasts over a managed network and interactive content over an unmanaged network to a client device
JP5681641B2 (en) 2009-01-07 2015-03-11 ソニック アイピー, インコーポレイテッド Specifically of the media guide for the online content, collection and automatic generation
CA2782825C (en) 2009-12-04 2016-04-26 Divx, Llc Elementary bitstream cryptographic material transport systems and methods
US9510029B2 (en) 2010-02-11 2016-11-29 Echostar Advanced Technologies L.L.C. Systems and methods to provide trick play during streaming playback
EP2534845A1 (en) * 2010-02-11 2012-12-19 Echostar Advanced Technologies L.L.C. Systems and methods to provide trick play during streaming playback
US8745388B2 (en) 2010-03-22 2014-06-03 EchoStar Technologies, L.L.C. Systems and methods for securely streaming media content
EP2628306B1 (en) 2010-10-14 2017-11-22 ActiveVideo Networks, Inc. Streaming digital video between video devices using a cable television system
US9247312B2 (en) 2011-01-05 2016-01-26 Sonic Ip, Inc. Systems and methods for encoding source media in matroska container files for adaptive bitrate streaming using hypertext transfer protocol
US9204203B2 (en) 2011-04-07 2015-12-01 Activevideo Networks, Inc. Reduction of latency in video distribution networks using adaptive bit rates
US8909922B2 (en) 2011-09-01 2014-12-09 Sonic Ip, Inc. Systems and methods for playing back alternative streams of protected content protected using common cryptographic information
US20130077699A1 (en) * 2011-09-23 2013-03-28 Prime Image Methods and systems for control, management and editing of digital audio/video segment duration with remapped time code
US9123084B2 (en) 2012-04-12 2015-09-01 Activevideo Networks, Inc. Graphical application integration with MPEG objects
US8914836B2 (en) 2012-09-28 2014-12-16 Sonic Ip, Inc. Systems, methods, and computer program products for load adaptive streaming
US9906785B2 (en) 2013-03-15 2018-02-27 Sonic Ip, Inc. Systems, methods, and media for transcoding video data according to encoding parameters indicated by received metadata
US9094737B2 (en) 2013-05-30 2015-07-28 Sonic Ip, Inc. Network video streaming with trick play based on separate trick play files
US9247317B2 (en) 2013-05-30 2016-01-26 Sonic Ip, Inc. Content streaming with client device trick play index
US9294785B2 (en) 2013-06-06 2016-03-22 Activevideo Networks, Inc. System and method for exploiting scene graph information in construction of an encoded video sequence
US9219922B2 (en) 2013-06-06 2015-12-22 Activevideo Networks, Inc. System and method for exploiting scene graph information in construction of an encoded video sequence
US9326047B2 (en) 2013-06-06 2016-04-26 Activevideo Networks, Inc. Overlay rendering of user interface onto source video
US9967305B2 (en) 2013-06-28 2018-05-08 Divx, Llc Systems, methods, and media for streaming media content
US9866878B2 (en) 2014-04-05 2018-01-09 Sonic Ip, Inc. Systems and methods for encoding and playing back video at different frame rates using enhancement layers

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5581778A (en) * 1992-08-05 1996-12-03 David Sarnoff Researach Center Advanced massively parallel computer using a field of the instruction to selectively enable the profiling counter to increase its value in response to the system clock
JPH07130149A (en) * 1993-10-29 1995-05-19 Toshiba Ave Corp Reproducing device with time displaying function
US5481297A (en) * 1994-02-25 1996-01-02 At&T Corp. Multipoint digital video communication system
EP0675649A3 (en) 1994-04-01 1996-05-22 Toshiba Kk Method and apparatus for recording or reproducing digital picture image signal.
JP3089160B2 (en) * 1994-05-20 2000-09-18 シャープ株式会社 Digital recording and reproducing apparatus
JPH089319A (en) * 1994-06-23 1996-01-12 Sony Corp Method and device for recording and device for reproducing digital video signal
US5606359A (en) 1994-06-30 1997-02-25 Hewlett-Packard Company Video on demand system with multiple data sources configured to provide vcr-like services
US5671377A (en) * 1994-07-19 1997-09-23 David Sarnoff Research Center, Inc. System for supplying streams of data to multiple users by distributing a data stream to multiple processors and enabling each user to manipulate supplied data stream
US5668948A (en) 1994-09-08 1997-09-16 International Business Machines Corporation Media streamer with control node enabling same isochronous streams to appear simultaneously at output ports or different streams to appear simultaneously at output ports
GB9421206D0 (en) * 1994-10-20 1994-12-07 Thomson Consumer Electronics Digital VCR MPEG- trick play processing
JP3172643B2 (en) * 1994-11-14 2001-06-04 シャープ株式会社 Digital recording and reproducing apparatus
WO1996017306A3 (en) 1994-11-21 1996-10-17 Oracle Corp Media server
JP3104570B2 (en) * 1995-03-28 2000-10-30 日本ビクター株式会社 Digital signal recording method and a recording apparatus
US5793927A (en) * 1995-06-07 1998-08-11 Hitachi America, Ltd. Methods for monitoring and modifying a trick play data stream to insure MPEG compliance
US6253375B1 (en) * 1997-01-13 2001-06-26 Diva Systems Corporation System for interactively distributing information services

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003084239A3 (en) * 2002-03-28 2004-01-22 Intel Corp Transcoding apparatus, system, and method
US7170936B2 (en) 2002-03-28 2007-01-30 Intel Corporation Transcoding apparatus, system, and method
US20030185542A1 (en) * 2002-03-28 2003-10-02 Mcveigh Jeffrey S. Transcoding apparatus, system, and method
EP1363453A2 (en) * 2002-05-14 2003-11-19 Pioneer Corporation Image signal recording and/or reproducing apparatus and medium
US20030215216A1 (en) * 2002-05-14 2003-11-20 Pioneer Corporation Recording medium, image recording apparatus, image reproduction apparatus, and image recording/reproduction apparatus
EP1363453A3 (en) * 2002-05-14 2006-07-05 Pioneer Corporation Image signal recording and/or reproducing apparatus and medium
US20060127035A1 (en) * 2003-06-30 2006-06-15 Koninklijke Philips Electronics N.V. Clip based trick modes
US9177602B2 (en) 2003-06-30 2015-11-03 Nxp, B.V. Clip based trick modes
US20060031892A1 (en) * 2004-08-05 2006-02-09 Bitband Technologies Ltd. Prevention of advertisement skipping
US7412149B2 (en) 2004-10-28 2008-08-12 Bitband Technologies, Ltd. Trick mode generation in video streaming
US20070019925A1 (en) * 2005-07-21 2007-01-25 Macinnis Alexander Systems, methods, and apparatus for trick mode
US20120213363A1 (en) * 2005-12-23 2012-08-23 Koninklijke Philips Electronics N.V. Device for and a method of processing a data stream
US8792777B2 (en) * 2007-01-10 2014-07-29 Broadcom Corporation Accurate fast forward rate when performing trick play with variable distance between frames
US20080166100A1 (en) * 2007-01-10 2008-07-10 Tim Ross Accurate fast forward rate when performing trick play with variable distance between frames
US8265168B1 (en) * 2008-02-01 2012-09-11 Zenverge, Inc. Providing trick mode for video stream transmitted over network
US20120057854A1 (en) * 2010-09-07 2012-03-08 Ching-Lung Chang K rate fast-forwarding and backwarding mechanism for digital videos

Also Published As

Publication number Publication date Type
US6389218B2 (en) 2002-05-14 grant
WO2000033567A1 (en) 2000-06-08 application

Similar Documents

Publication Publication Date Title
Haskell et al. Digital video: an introduction to MPEG-2
Chen et al. Support for fully interactive playout in disk-array-based video server
US6792047B1 (en) Real time processing and streaming of spliced encoded MPEG video and associated audio
US6671323B1 (en) Encoding device, encoding method, decoding device, decoding method, coding system and coding method
US5874997A (en) Measuring and regulating synchronization of merged video and audio data
US5721815A (en) Media-on-demand communication system and method employing direct access storage device
US7068724B1 (en) Method and apparatus for inserting digital media advertisements into statistical multiplexed streams
US6414996B1 (en) System, method and apparatus for an instruction driven digital video processor
US6148142A (en) Multi-user, on-demand video server system including independent, concurrently operating remote data retrieval controllers
US5719632A (en) Motion video compression system with buffer empty/fill look-ahead bit allocation
US7171110B1 (en) System and a method for storing audio/video programs on a hard disk drive for presentation to a viewer
US5959690A (en) Method and apparatus for transitions and other special effects in digital motion video
US5751883A (en) Multimedia direct access storage device and formatting method
US5426699A (en) Method and apparatus for digitizing a scrambled analog video signal
US7027713B1 (en) Method for efficient MPEG-2 transport stream frame re-sequencing
US6009236A (en) Digital video signal record and playback device and method for giving priority to a center of an I frame
US5864682A (en) Method and apparatus for frame accurate access of digital audio-visual information
US5721878A (en) Multimedia control system and method for controlling multimedia program presentation
US6658199B1 (en) Method for temporally smooth, minimal memory MPEG-2 trick play transport stream construction
US7236526B1 (en) Coding system and its method, coding device and its method, decoding device and its method, recording device and its method, and reproducing device and its method
US5631693A (en) Method and apparatus for providing on demand services in a subscriber system
US5956088A (en) Method and apparatus for modifying encoded digital video for improved channel utilization
US7379653B2 (en) Audio-video synchronization for digital systems
US6438317B1 (en) Encoded stream generating apparatus and method, data transmission system and method, and editing system and method
US6704359B1 (en) Efficient encoding algorithms for delivery of server-centric interactive program guide

Legal Events

Date Code Title Description
AS Assignment

Owner name: DIVA SYSTEMS CORPORATION, CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:GORDON, DONALD F.;LUDVIG, EDWARD A.;REEL/FRAME:009617/0680

Effective date: 19981124

CC Certificate of correction
CC Certificate of correction
CC Certificate of correction
AS Assignment

Owner name: TVGATEWAY, LLC, PENNSYLVANIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:DIVA SYSTEMS CORPORATION BY HOWARD B. GROBSTEIN, CHAPTER 11 TRUSTEE;REEL/FRAME:014567/0512

Effective date: 20040421

Owner name: TVGATEWAY, LLC,PENNSYLVANIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:DIVA SYSTEMS CORPORATION BY HOWARD B. GROBSTEIN, CHAPTER 11 TRUSTEE;REEL/FRAME:014567/0512

Effective date: 20040421

AS Assignment

Owner name: SEDNA PATENT SERVICES, LLC, PENNSYLVANIA

Free format text: CHANGE OF NAME;ASSIGNOR:TVGATEWAY, LLC;REEL/FRAME:015177/0980

Effective date: 20040824

Owner name: SEDNA PATENT SERVICES, LLC,PENNSYLVANIA

Free format text: CHANGE OF NAME;ASSIGNOR:TVGATEWAY, LLC;REEL/FRAME:015177/0980

Effective date: 20040824

FPAY Fee payment

Year of fee payment: 4

AS Assignment

Owner name: COX COMMUNICATIONS, GEORGIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SEDNA PATENT SERVICES, LLC;REEL/FRAME:021817/0486

Effective date: 20080913

Owner name: COX COMMUNICATIONS, INC., GEORGIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SEDNA PATENT SERVICES, LLC;REEL/FRAME:021817/0486

Effective date: 20080913

Owner name: COX COMMUNICATIONS, INC.,GEORGIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SEDNA PATENT SERVICES, LLC;REEL/FRAME:021817/0486

Effective date: 20080913

FPAY Fee payment

Year of fee payment: 8

FPAY Fee payment

Year of fee payment: 12