WO2001018658A1 - Procede et appareil pour envoyer a la demande des videoclips au ralenti de presentations video a des spectateurs finaux - Google Patents

Procede et appareil pour envoyer a la demande des videoclips au ralenti de presentations video a des spectateurs finaux Download PDF

Info

Publication number
WO2001018658A1
WO2001018658A1 PCT/US2000/040593 US0040593W WO0118658A1 WO 2001018658 A1 WO2001018658 A1 WO 2001018658A1 US 0040593 W US0040593 W US 0040593W WO 0118658 A1 WO0118658 A1 WO 0118658A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
rate
clips
internet
real
Prior art date
Application number
PCT/US2000/040593
Other languages
English (en)
Inventor
Vijnan Shastri
Ashwani Arya
Parul Gupta
Original Assignee
Hotv Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hotv Inc. filed Critical Hotv Inc.
Priority to AU77579/00A priority Critical patent/AU7757900A/en
Publication of WO2001018658A1 publication Critical patent/WO2001018658A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64746—Control signals issued by the network directed to the server or the client
    • H04N21/64761—Control signals issued by the network directed to the server or the client directed to the server
    • H04N21/64769—Control signals issued by the network directed to the server or the client directed to the server for rate control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/27—Server based end-user applications
    • H04N21/274—Storing end-user multimedia data in response to end-user request, e.g. network recorder
    • H04N21/2743—Video hosting of uploaded data from client
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6125—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8549—Creating video summaries, e.g. movie trailer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/16—Analogue secrecy systems; Analogue subscription systems
    • H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309—Transmission or handling of upstream communications
    • H04N7/17336—Handling of requests in head-ends
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications

Definitions

  • the present invention is in the field of interactive video, and pertains more particularly to methods and apparatus for editing live video steams and sending selected video clips to end viewers
  • vanous systems to provide enhanced information delivery and entertainment systems
  • developers are introducing integrated systems combining TVs with computer subsystems, so a TV may be used as a WEB browser, or a PC may be used for enhanced TV viewing
  • computer elements such as a CPU, memory, and the like, are built into the familiar chassis of a TV set In such a system, the TV screen becomes the display monitor in the computer mode
  • conventional TV elements and circuitry are incorporated along with the computer elements, and capability is provided for a user to switch modes, or to view recorded or broadcast video with added computer interaction
  • One may thus, with a properly equipped system, select to view analog TV programs, digital TV programs, conventional cable TV, satellite TV, pay TV from various sources, and browse the WWW as well, displaying WEB pages and interacting with on-screen fields and relational systems for jumping to related information, databases, and other WEB pages
  • the capabilities are often integrated into a single display, that is, one may view a broadcast presentation and also have a window on the display for WEB interaction
  • computer elements are provided in an enclosure separate from the TV, often referred to in the art as a set-top box Set-top box systems have an advantage for providers in that they may be connected to conventional television sets, so end users don't
  • Set-top boxes and computer-integrated TVs adapted as descnbed above typically have inputs for such as a TV antenna (analog), cable TV (analog or digital), more recently direct-satellite TV (digital), and may also connect to video cassette recorders and to mass storage devices such as hard disk dnves and CD-ROM dnves to provide a capability for uploading video data from such devices and presenting the dynamic result as a display on the TV screen
  • end users receive a single video stream that contains the video data and any added annotated data such as subtitling, sponsor logos, information blocks, and the like
  • annotated data such as subtitling, sponsor logos, information blocks, and the like
  • analog video such annotation may be included as data in such as the video blanking intervals of the stream
  • digital video the annotated stream may be integrated with the pnmary stream
  • hyper-video authoring is possible wherein a wide variety of added, often interactive, content is made available to viewers having an active connection, such as cable or satellite to a content video provider and also an Internet connection for facilitating interactivity with a provider by virtue of the backlink provided.
  • the system known to the inventors uses separate authoring stations or systems for use in what is termed hyper-video authoring by the inventors.
  • Hyper-video authoring includes providing hot spots (interactive hyperlinks) in a video presentation, providing interactive regions for tracked objects (method known to the inventors), inserting URL's for user interaction, providing interactive banner ads, providing interactive icons for launching instant replays of short video clips, adding audio/text annotation, and so on.
  • Annotated content may, in some instances, be delivered via alternative paths, such as the Internet, and be synchronized with a main video stream being viewed at the user's end. In other instances, added content is combined at the provider end and delivered as one stream (typically cable or digital feed) to the viewer. As a viewer interacts with provided content through hot spots, creating backlink signals to the provider, information at the provider end associated with the viewer's interaction is sent to the viewer and typically displayed on the same display containing the primary video presentation. In some cases users, if so equipped, may save and store Internet- delivered content to suitable data storage facilities at the user's premises. In other cases, such material may be saved and stored on-line at a server adapted for the purpose. In this case, a viewer may at a later time retrieve the material at his or her discretion. Again, these systems are not in the public domain, but systems developed by the inventors.
  • One of the capabilities of the authoring system is an ability to edit live video feeds wherein identifying and copying specific portions of the video is performed for the purpose of creating short video clips of sequences in the main video.
  • the authoring system uses a scene-change-detection-technology (SCDT) in order to identify and isolate individual video sequences or clips.
  • SCDT scene-change-detection-technology
  • authored video clips are stored in an Internet server adapted for the purpose, and may be delivered to a viewer upon user interaction with, for example, an icon, thumbnail, or text block, that is sent and displayed on the viewers display.
  • Such indicators are interactive in that when activated by a viewer the associated video clip is immediately delivered to the viewer over the Internet.
  • An advantage of the above system is that a user watching a video of, for example, a football game, can view replay sequences such as touchdown runs, over again by clicking on an interactive indicator thereby initiating immediate Internet delivery of the replay content.
  • the streamed replay clip may be viewed simultaneously on the same display as the primary video in, for example, a separate window.
  • video sequences obtained from the Internet cannot typically be streamed to a user at data rates that enable viewing at a comparable quality offered by cable or satellite systems' high dedicated bandwidth.
  • digital cable can deliver video at data rates in the range of more than 1 megabits per second to enable at least 30 FPS viewing, and the high dedicated bandwidth guarantees that very little, if any, data will be lost.
  • This provides a high quality video presentation that the viewer sees on the display screen.
  • Standard Internet services that must share bandwidth are at present unable to provide such high and dedicated bandwidth.
  • video quality received from the Internet is not comparable to the quality offered by such as cable or satellite systems.
  • Real-time video, such as 30 frames per second, delivered over the Internet is subject to significant data loss affecting the video quality negatively.
  • Another disadvantage of the systems known to the inventor is that after viewing a video which is streamed from the Internet or similar data-packet network, a user may want to playback the stream in slow motion.
  • the already poor frame quality will provide an even poorer slow-motion clip.
  • multimedia transmission of data over the Internet it is always desirable to conserve the shared bandwidth.
  • many interactive TV viewers, particularly related to sports presentations desire to view replays at slow-motion rates that are much slower than real-time frame speeds. Therefore, what is clearly needed is a method and apparatus that will enable an Internet server to stream slow-motion versions of requested video sequences to an end viewer who may view such slow-motion sequences with excellent quality on an interactive television device, including a PC enabled to display video, with an option of speeding the sequence up after download.
  • Such a method and apparatus would conserve bandwidth, and allow high-quality slow motion viewing which may be speeded up at the viewers end (faster frame rate) resulting in even better quality.
  • a slow-motion video replay system comprising a software-enabled, Internet-connected server storing video clips of action scenes selected from a primary video presentation; and an Internet- connected client computerized viewer station having a video display unit (VDU) and an interactive user interface.
  • the server provides displayable indicia uniquely representing individual video clips stored at the server to the client as displayable hyperlinks, and in response to the client selecting one of the displayable indicia, streams the associated video clip to the client at a rate less than the real-time video rate, such that the video clip displayed at the client's station plays at a slow-motion rate.
  • the video clip streaming rate may vary considerably, but quality improvement is improved as streaming rate decreases to a point.
  • an authoring station is coupled to both the server and to a service provider streaming the real-time primary video presentation to the client for display and also to the authoring station.
  • the authoring station enables an author to create, select, and store video clips at the server, including associating the displayable indicia with the video clips.
  • the displayable indicia comprise text strings describing the associated video clip.
  • the client station is enabled to store streamed slow-motion video clips, and the user is enabled through the interactive interface at the client station to retrieve and replay the stored clips, including adjusting the play rate from the streamed and stored rate.
  • the user is enabled to grab a selected frame from a video clip and to convert the frame to a standard still graphics format, including one or both of .gif and jpg.
  • a video authoring and server system comprising an authoring station including software enabling tools for an author to monitor a video presentation, to select video clips from the presentation for storage, and to prepare and associate an displayable indicia identifier with each video clip; and an Internet-connected server including software enabling pushing of the identifiers for video clips to clients as hyperlinks, and streaming of video clips to clients in response to signals from clients resulting from selecting the hyperlinks, the video clips streamed to clients on the Internet at a rate less than the real-time video rate.
  • the video clip streaming rate may vary widely, with quality improvement associated with lower streaming rate.
  • the displayable indicia may comprise text strings describing the associated video clip.
  • a client system for video display comprising a computerized video display apparatus; a high-bandwidth dedicated port for receiving a primary video stream; and an Internet port for requesting and receiving video clips of sequences selected from the primary video stream.
  • the video display system displays a primary video stream received on the dedicated high- bandwidth port and interactive hyperlinks uniquely associated with individual ones of the video clips, the hyperlinks received on the Internet port, and wherein upon selection of a hyperlink the apparatus receives on the Internet port a secondary data stream for the video clip associated with the hyperlink, the secondary data stream received and displayed at a rate less than the real-time rate.
  • the video streaming rate for chps may vary widely, but higher quality is associated with generally lower streaming rate
  • the hyperlinks may comprise text strings describing the associated video clip
  • the computerized apparatus is enabled to store streamed slow-motion video clips, and the user is enabled to retrieve and replay the stored clips, including adjusting the play rate from the streamed and stored rate
  • the user is enabled to grab a selected frame from a video clip and to convert the frame to a standard still graphics format, including one or both of gif and
  • JPg In another aspect of the invention a method for providing video clips over an
  • Internet connection with high frame quality comprising steps of (a) receiving a request for a stored clip at an Internet-connected server, and (b) streaming the stored clip to the requester at a rate less than the real-time rate
  • the rate may vary widely, with quality generally improving with lower streaming rate
  • the identifiers may comprise displayable indicia pushed to clients on the Internet as hyperlinks associated with stored clips, and the hyperlinks may be text strings describing the associated video clips
  • Fig 1 is an overview of a video authoring and delivery system according to an embodiment of the present invention
  • Fig 2A is an exemplary author interface at an authoring station shown in Fig 1
  • Fig 2B is the authoring interface of Fig 2 A with an optional text window enabled
  • Fig 3 is a user interface display at an end-user station of Fig 1 before a replay screen is presented
  • Fig 4 shows the user interface screen with a replay screen open playing a slow- motion replay while a main video continues to play in a separate window
  • Fig 5A is flow diagram illustrating steps in practicing one embodiment of the present invention wherein there is a relatively high bandwidth connection between a server and a client
  • Fig 5B is a flow diagram illustrating steps in practicing an embodiment of the present invention wherein there is a relatively low bandwidth connection between a server and a client
  • Fig 6 is a block diagram of an architecture for practicing the present invention in a preferred embodiment
  • a system adapted for creating video clips from live video feeds and streaming them to end users on demand is already known to the inventors
  • the system known to the inventors streams the selected video clips at standard frame rates with full-speed motion That is, at standard frame rates the events in the video clips play back at real-time speed
  • selected video clips are streamed over the Internet to users at a significantly reduced bit rate, providing two distinct advantages The first is that the clip received by the end viewer may be played directly, providing a high-quality slow motion clip The clip is high quality because there is significantly less data loss at the slower streaming rate, and because video quality is not compromised at encoding The second is that, once a clip is downloaded at the reduced bit rate, now the streamed clip may be speeded up at the viewers end, providing high- quality real-time viewing not possible with higher Internet streaming rates
  • FIG. 9 is an overview of a video authoring and delivery system 9 according to an embodiment of the present invention
  • System 9 represents an exemplary service-system for authoring live video for the purpose of creating short slow-motion video clips that may be sent to a plurality of subscriber viewers over the Internet System 9 comprises, basically, a cable network 13, an Internet network 17, an Internet Service Provider (ISP) 21, and a viewer premise 23
  • ISP Internet Service Provider
  • a live event 1 1 is provided in this example as a suitable video source from the field
  • Event 11 may be any event such as a sporting event, a concert, or any event that viewers may subscribe to or obtain according to a published schedule, but the invention is most particularly applicable to sporting events for which viewers may be interested in slow-motion replay Further, the invention is not limited to live broadcasts, but may be applied as well to stored video sent by any content provider
  • a participating broadcast entity 15, hereinafter termed studio 15 is provided and adapted to receive a primary data stream from event 11 , which is delivered as a raw feed to studio 15 by a digital cable 25
  • delivery will be by satellite or other means
  • Studio 15 is adapted to serve video to end users, in this example to user premise 23 by means of cable connection 27
  • this primary video feed may be by satellite, or by any other high-bandwidth dedicated channel means
  • presentations that are targeted for video authoring according to embodiments of the present invention are simultaneously cast to viewers and an authoring station
  • viewers may receive a primary video stream by one path, and annotated, often interactive content, including short video clips taken from the live event via an alternate path, in this example the Internet
  • Premise 23 contains CPE equipment enabled to practice the present invention
  • a cable-ready television 29 is provided and adapted to display delivered content as is known in the art
  • a TV-connected set-top box 31 provides enhanced interactive capability to television 23
  • television 23 may contain the required circuitry and software enabling interactive TV Set-top box 31 contains input ports for cable, satellite TV, and a port for connecting to the Internet Set-top box 31 contains all of the required circuitry and software for enabling a subscriber interactive television service wherein one may watch TV and obtain interactive content associated with viewed programs, browse the Internet, and so on
  • a digital cable 27 provides cable connection for receiving video/ Audio content delivered by studio 15 as is known in the art for cable services
  • a software application 38 is provided and executable in set-top box 31
  • Application 38 consists of a software video player, communication and display routines for accepting and displaying content from, in this example, Internet 17
  • Software 38 also contains a means for notifying service-providing entities when a viewer is participating by viewing a service-covered event
  • Studio 15 has a digital cable connection 28 to a video authoring station 19 located in Internet cloud 17
  • Authoring station 19 is adapted by virtue of computer and software capability to receive primary video content from studio 15 over cable 28
  • An instance of software (SW) 37 resident in station 19 provides a capability for editing and authoring video content that is received from studio 15 Such editing is in this example performed in real time, as the same video content is being transmitted to viewers
  • SW software
  • Authoring station 19 may comprise a single editing station or a plurality of linked editing stations (not shown) which may be automated to perform some editing functions, and manned by personnel (authors) for performing other editing functions
  • station 19 contains at least one manned computer enabled by software 37 to for selection of short video sequences taken from a main video stream
  • Video clips created by authoring station 19 are uploaded in this embodiment to a server 39 having an Internet connection 41
  • an Internet connection 43 provides connection to Internet network 17 through an Internet service provider (ISP) 21 via standard modem protocol (modem 35)
  • Line 43 may be a single phone line or an integrated services digital network (ISDN) connection, for example Other known connection methods to the Internet may also be used
  • ISP server 33 is provided and has conventional service capability including access to server 39 that is accessible to authoring station 19 as previously described
  • video feeds such as representative feed 25 from event 1 1 are delivered to broadcast entity 15
  • a cable network 13 is used in this example, satellite networks may also apply
  • more than one studio may be involved in editing a video feed
  • the stream is delivered to viewer 23, over such as a cable network represented by line 27
  • the primary video feed is delivered to premise 23 by way of cable 27, it is also delivered to station 19 by way of cable 28
  • An author at station 19 by virtue of software 37 and suitable computer equipment, selects sequences from the video presentation and creates short video clips Typically in embodiments of the invention SCDT technology is used to isolate and select sequences from the primary video for production of the clips During creation of a clip, all available frames of the main video are included in the created version In this way optimum quality is maintained Other annotation and editing functions known to the inventor may also be performed
  • Created video clips represent such as instant replay material of events that have occurred in the main video Touchdowns in football games, important baskets in basketball games, controversial plays, a knockout punch in boxing and the like, are representative of material that would be selected from the main video for producing clips
  • a time pipeline may provided for this process
  • Fig 2A is an exemplary author interface at an authoring station shown in Fig 1 In this interface a window 201 plays the primary video feed from which replays are selected Control buttons 203 enable an author to select and review candidate sequences
  • scene-detection software automatically selects scenes and, in one embodiment uses the first frame of a scene as a representative frame for the clip
  • Field 205 lists the URL source for the primary video in this example
  • Field 207 allows the author to enter a filename for the clip selected
  • Field 209 allows the author to enter a URL address for the clip
  • Field 21 1 allows the author to enter a play rate for the clip when downloaded to a subscriber
  • the play rate is 2, which indicates 1/5 of the real-time rate If the real time rate is 30 frames per second, the streaming rate to the subscriber will be, in this case, 6 frames per second
  • the real time streaming rate is 1 2 megabits per second on a dedicated, high bandwidth connection, the streaming rate on the Internet to a subscriber for the slow- motion clip will be 240 kilobits per second
  • FIG 2 A window 210 provides a default text for an authored clip, and check box 212, if checked, causes a selected clip to begin to stream to the server as soon as a start point is marked If this box is left unchecked the streaming will not occur until the end of the clip is selected
  • Area 215 is an area for display of first frames of scenes as detected by scene- detection software, from which an author may select for storing as slow-motion clips to be available for subscribers
  • Fig 2B is another view of the authoring interface of Fig 2 A, showing a floating window 213 for the author to enter an alternative text annotation, which will be replace the default text annotation of window 210 of Fig 2A
  • the annotation may be as simple as that shown in window 213
  • Fig 3 illustrates an exemplary interactive display at a user's premise (Fig 1, element 23) before a replay window opens Region 301 in this display is a window for playing the primary video, and region 303 is a region reserved for replay video Region 305 is for display of interactive text annotations as described above
  • One such annotation "Terry to Wright" is displayed in this region in Fig 3
  • the text annotations are pushed to subscribers as slow-motion replays become available, and are displayed as hyperlinks, such that selection (by
  • Fig 4 shows the user interface screen of Fig 3 with a replay window open playing a slow-motion replay while a main video continues to play in a separate window
  • the provider server 39 begins to stream the requested clip, and window 401 opens and plays the slow motion clip
  • the clip is played as received and not stored, and therefore may be seen from beginning to end each time the clip is requested
  • the clip is stored at the user end, and may therefore be stopped, rewound, replayed, and so forth
  • a set of control buttons as shown just below the replay window 401 are for this purpose
  • the clip may be recalled, and replayed at adjusted speeds, including slower, and at speeds up to and beyond the real-time rate
  • the quality at all other adjusted speeds will be better than for any video streamed on the Internet originally at a much faster rate, because the individual frames streamed at the slower rate will have significantly lower loss Region 403 in Fig 4 continues to play the primary video stream, and a control 405 is provided for the viewer to revert to just the primary video
  • facility is provided at the user's equipment for frame capture, wherein a user may stop replay of a clip, and grab and store and/or print a frame converted from the video data to a graphics format
  • Internet network 17 may be a private wide area network (WAN) instead Cable network 13 may instead be a satellite network
  • WAN wide area network
  • Cable network 13 may instead be a satellite network
  • There may be more than one editing station or broadcast studio in line from the video source (1 1) to the end viewer at premise 23
  • system 9 be exemplary of only one example of many possible architectures
  • connection between the server and the client will be a relatively high-bandwidth connection, and in some embodiments that connection may be a relatively low-bandwidth connection accordingly, the way in which replay video clips are streamed may differ somewhat Provision is made in some embodiments, where the connection is a relatively high bandwidth connection, to send only text annotation to the client immediately, which the client may use to select the clips to be downloaded In the case of relatively low bandwidth connections, in other embodiments, the clips are all streamed to the client and stored locally at the clients premises for later selection and viewing
  • Fig 5A is a process flow chart illustrating logical steps for creating, delivering, and viewing authored slow-motion video sequences according to an embodiment of the present invention wherein the client-to-server connection is relatively high bandwidth
  • a viewer orders a video in step 69
  • An order of a video such as a service-covered pay-per-view video sends notification to software 38 to activate the viewer's Internet connection if not already activated
  • a means for initiating Internet connection and notifying service providers of the viewers status is similarly activated
  • the primary video which may be a live sports event, (feed) is received and prepared for broadcast/multicast to viewers such as at premise 23 of Fig 1
  • a viewer receives the video from a studio such as studio 15 of Fig 1 and begins viewing the edited video Within an acceptable time frame, the primary stream feed is also delivered, in step 75, to an author
  • step 77 an author selects and creates video clips and associated text indicators as described above, often with the aid of software and hardware tools
  • created clips are stored in an on-line server such as server 39 of Fig 1 while the associated text indicators are pushed to viewers over their Internet connections in step 81
  • text indicators begin appearing in the viewer's display As each indicator appears, it represents an available video clip that is ready to be streamed
  • step 85 a user decides to initiate a request by selecting and activating a text indicator, which represents an available clip This action sends a backlink command over the Internet to a server 39 to commence streaming the requested video clip back over the same Internet path in step 89
  • step 89 a viewer begins receiving a slow motion video clip at a rate of approximately 200 Kbps, which immediately appears on a suitable display as a slow motion replay of an event that has occurred in the main video
  • a user receives the clip
  • Fig 5B is a process flow diagram illustrating operation in an embodiment having a low-bandwidth connection between the server and a client
  • block 68 represents the video feed
  • the video feed goes to the authoring station
  • the author creates Replay clips and sends Replay information, l e Replay media file url, filetype, annotation, timestamp, etc , as XML data
  • text indicators and video clips are sent to the server
  • the Text indicators for a new Replay are delivered and stored in a user's local cache area
  • the new Replay clip is downloaded into the replay storage location on the user's local hard disk or other mass storage device
  • the text indicators are displayed for a user to select associated clips
  • the user selects one of the text indicators and thereby selects a Replay clip
  • the Replay clip is played from the user's storage area
  • Fig 6 is a block diagram of a hardware architecture in more detail than the diagram of Fig 1, illustrating an architecture according to an embodiment of the present invention
  • the architecture in this example is divided into three logical groups as Authoring Side 93, Head End 95 and Client (user) end 97, which may be generally equated to elements 19, 15 and 23 of Fig 1
  • a video source 99 is provides a video stream, and the source may be of any conventional sort, such as a live video cam, a VCR, or some other source, such as a digital file stored on a server by a content provider
  • Video from the source typically digitized at 30 frames per second (FPS) at an encoding bit rate of 800 to 1200 kbps, goes to MPEG encoder 101 and to a Microsoft Advanced Streaming Format (ASF)TM encoder 103
  • the ASF encoder is an example of one of several encoders that might be used to encode the main video stream
  • a replay-autho ⁇ ng console 105 on the Authoring side receives the MPEG stream from MPEG encoder 101, and executes software for authoring functions as described above
  • the author at the console can make the selections for video selections (clips) to be replayed by clicking on scene thumbnails in the Replay authoring console display, as also described above
  • the replay stream from the replay authoring console goes in some embodiments to MPEG Astra Transfer Protocol (ASTP) server 107 in head end 95
  • the ASTP is an example, and there are other protocols that might be used
  • This streaming is at a controlled rate The rate depends on the available bandwidth between the authoring station and the MPEG server at the Head end With a dedicated T 1 link the rate can be 1 544 Mbps
  • a control information is sent saying that replay is ready to be streamed from the Authoring server to an Astra Control Distribution (ACSD)server 113 (in this example) at the Head End
  • the mam video stream from ASF encoder 103 at the Authoring side goes to Netshow server 109 at Head End 95
  • a parallel stream may go the an independent authoring station, and the authored stream then goes to the ACSD server 113 at the Head End
  • Fig 6 shows two situations, one in which there is a relatively high bandwidth connection to the user's premise, such as may be the case with a set top box receiving cable TV
  • the high bandwidth premise is represented by element number 115
  • These separate displays are indicated by elements 117 and 1 19 Netshow server 109 at the Head End streams the main video to main video display 117
  • the Theatre client connects to the MPEG video server at the Head End, which then streams high bit-rate- encoded video at a low bit rate of 150 to 400 kbps
  • the Theatre client will now show the video clip at low effective frame rate to the end user
  • the video, which at real-time rate lasts for 1 min (for example), is now displayed for a longer time, such as 2 min for 0 5 rate to 5 min for 0 2 rate
  • there will be a low bandwidth connection to the user premise and the low-bandwidth user
  • the bandwidth is too low for effective display of the main video stream, so the main video is not displayed
  • the main video can be displayed but it will be of low quality and encoded at bit-rates of 28 8 or 56 Kbps This will result in delay m downloading of replay video
  • the replay clips can be downloaded through vertical blanking interval (VBI) or MPEG-2 transport stream if the equipment offers local storage capability, and the clips can be eventually played from there

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

Un système vidéo (9) comprend un serveur connecté à Internet (39) et activé par un logiciel, possédant en mémoire des vidéoclips de scènes d'action provenant d'une présentation vidéo primaire (11) et une station client de spectateur informatisée connectée à Internet (23) dotée d'une unité d'affichage vidéo (VDU)(29) et d'une interface utilisateur interactive. Le serveur fournit au client des repères affichables, représentant de manière spécifique les vidéoclips mémorisés dans le serveur sous forme d'hyperliens affichables, et en réponse à la sélection par le client d'un des repères affichables, le serveur émet en continu le vidéoclip pour le client, à un débit binaire inférieur au débit de la vidéo en temps réel, de sorte que le vidéoclip affiché au niveau de la station du client soit affiché au ralenti. Plus le débit en temps réel est faible plus la perte de données est réduite, ce qui permet d'améliorer la qualité des trames. La réduction sensible du débit d'émission en continu pour lesdits clips permet l'amélioration sensible de la qualité, et pour les événements tels que les manifestations sportives, les clips émis en continu peuvent être affichés directement au ralenti. De plus, les clips peuvent être ensuite mémorisés et accélérés, de sorte que des lectures de vidéo à débit en temps réel de qualité nettement meilleure par rapport aux clips émis en continu sur Internet à des débits en temps réel soient assurées.
PCT/US2000/040593 1999-09-03 2000-08-07 Procede et appareil pour envoyer a la demande des videoclips au ralenti de presentations video a des spectateurs finaux WO2001018658A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU77579/00A AU7757900A (en) 1999-09-03 2000-08-07 Method and apparatus for sending slow motion video-clips from video presentations to end viewers upon request

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US39059999A 1999-09-03 1999-09-03
US09/390,599 1999-09-03

Publications (1)

Publication Number Publication Date
WO2001018658A1 true WO2001018658A1 (fr) 2001-03-15

Family

ID=23543132

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/040593 WO2001018658A1 (fr) 1999-09-03 2000-08-07 Procede et appareil pour envoyer a la demande des videoclips au ralenti de presentations video a des spectateurs finaux

Country Status (2)

Country Link
AU (1) AU7757900A (fr)
WO (1) WO2001018658A1 (fr)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1324610A2 (fr) * 2001-12-22 2003-07-02 Humax Co., Ltd. Méthode pour rejouer un programme de télédiffusion dans un récepteur numérique
WO2005067296A1 (fr) * 2003-12-29 2005-07-21 Koninklijke Philips Electronics N.V. Procede et systeme pour generer des segments specifiques d'un programme
EP1592237A3 (fr) * 2004-04-27 2007-11-07 Microsoft Corporation Présentation spécialisée de média au moyen d'un guide électronique de programmes
AU2005202356B2 (en) * 2005-05-31 2008-01-10 Canon Kabushiki Kaisha Frame scattering for video scrubbing
US10956766B2 (en) 2016-05-13 2021-03-23 Vid Scale, Inc. Bit depth remapping based on viewing parameters
US11272237B2 (en) 2017-03-07 2022-03-08 Interdigital Madison Patent Holdings, Sas Tailored video streaming for multi-device presentations
US11503314B2 (en) 2016-07-08 2022-11-15 Interdigital Madison Patent Holdings, Sas Systems and methods for region-of-interest tone remapping
US11765150B2 (en) 2013-07-25 2023-09-19 Convida Wireless, Llc End-to-end M2M service layer sessions
US11765406B2 (en) 2017-02-17 2023-09-19 Interdigital Madison Patent Holdings, Sas Systems and methods for selective object-of-interest zooming in streaming video
US11871451B2 (en) 2018-09-27 2024-01-09 Interdigital Patent Holdings, Inc. Sub-band operations in unlicensed spectrums of new radio
US11877308B2 (en) 2016-11-03 2024-01-16 Interdigital Patent Holdings, Inc. Frame structure in NR

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5237648A (en) * 1990-06-08 1993-08-17 Apple Computer, Inc. Apparatus and method for editing a video recording by selecting and displaying video clips
US6139197A (en) * 1997-03-04 2000-10-31 Seeitfirst.Com Method and system automatically forwarding snapshots created from a compressed digital video stream
US6154771A (en) * 1998-06-01 2000-11-28 Mediastra, Inc. Real-time receipt, decompression and play of compressed streaming video/hypervideo; with thumbnail display of past scenes and with replay, hyperlinking and/or recording permissively intiated retrospectively

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5237648A (en) * 1990-06-08 1993-08-17 Apple Computer, Inc. Apparatus and method for editing a video recording by selecting and displaying video clips
US6139197A (en) * 1997-03-04 2000-10-31 Seeitfirst.Com Method and system automatically forwarding snapshots created from a compressed digital video stream
US6154771A (en) * 1998-06-01 2000-11-28 Mediastra, Inc. Real-time receipt, decompression and play of compressed streaming video/hypervideo; with thumbnail display of past scenes and with replay, hyperlinking and/or recording permissively intiated retrospectively

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1324610A3 (fr) * 2001-12-22 2003-12-17 Humax Co., Ltd. Méthode pour rejouer un programme de télédiffusion dans un récepteur numérique
EP1324610A2 (fr) * 2001-12-22 2003-07-02 Humax Co., Ltd. Méthode pour rejouer un programme de télédiffusion dans un récepteur numérique
WO2005067296A1 (fr) * 2003-12-29 2005-07-21 Koninklijke Philips Electronics N.V. Procede et systeme pour generer des segments specifiques d'un programme
EP1592237A3 (fr) * 2004-04-27 2007-11-07 Microsoft Corporation Présentation spécialisée de média au moyen d'un guide électronique de programmes
US7962938B2 (en) 2004-04-27 2011-06-14 Microsoft Corporation Specialized media presentation via an electronic program guide (EPG)
US8863163B2 (en) 2004-04-27 2014-10-14 Microsoft Corporation Specialized media presentation via an electronic program guide (EPG)
US9445157B2 (en) 2004-04-27 2016-09-13 Microsoft Technology Licensing, Llc Specialized media presentation via an electronic program guide (EPG)
AU2005202356B2 (en) * 2005-05-31 2008-01-10 Canon Kabushiki Kaisha Frame scattering for video scrubbing
US11765150B2 (en) 2013-07-25 2023-09-19 Convida Wireless, Llc End-to-end M2M service layer sessions
US10956766B2 (en) 2016-05-13 2021-03-23 Vid Scale, Inc. Bit depth remapping based on viewing parameters
US11503314B2 (en) 2016-07-08 2022-11-15 Interdigital Madison Patent Holdings, Sas Systems and methods for region-of-interest tone remapping
US11949891B2 (en) 2016-07-08 2024-04-02 Interdigital Madison Patent Holdings, Sas Systems and methods for region-of-interest tone remapping
US11877308B2 (en) 2016-11-03 2024-01-16 Interdigital Patent Holdings, Inc. Frame structure in NR
US11765406B2 (en) 2017-02-17 2023-09-19 Interdigital Madison Patent Holdings, Sas Systems and methods for selective object-of-interest zooming in streaming video
US11272237B2 (en) 2017-03-07 2022-03-08 Interdigital Madison Patent Holdings, Sas Tailored video streaming for multi-device presentations
US11871451B2 (en) 2018-09-27 2024-01-09 Interdigital Patent Holdings, Inc. Sub-band operations in unlicensed spectrums of new radio

Also Published As

Publication number Publication date
AU7757900A (en) 2001-04-10

Similar Documents

Publication Publication Date Title
US11081143B2 (en) Providing enhanced content
JP6150442B2 (ja) デジタルメディアコンテンツ共有方法およびシステム
US8832756B2 (en) Systems and methods for providing a multi-perspective video display
US7743399B1 (en) Network-based service to provide on-demand video summaries of television programs
JP4165686B2 (ja) デジタルコンテンツの配信方法およびシステム
US20140199053A1 (en) Systems and methods to modify playout or playback
US20030095790A1 (en) Methods and apparatus for generating navigation information on the fly
US20010047516A1 (en) System for time shifting live streamed video-audio distributed via the internet
US20030145338A1 (en) System and process for incorporating, retrieving and displaying an enhanced flash movie
US20090089846A1 (en) System and method providing enhanced features for streaming video-on-demand
US20010027475A1 (en) Displaying images and other information
JP2002501346A (ja) 一方向データ・ストリームに対し双方向接続をシミュレートする携帯通信装置
JP2002501347A (ja) 一方向データ・ストリームに対して双方向接続性をシミュレーションするホスト装置
JP2004529588A (ja) 同期配信のウェブコンテンツを有する放送番組の時間シフト方法および装置
US7043747B1 (en) Methods and apparatus for information broadcasting and reception
WO2001018658A1 (fr) Procede et appareil pour envoyer a la demande des videoclips au ralenti de presentations video a des spectateurs finaux
KR100915314B1 (ko) 웹 애플리케이션들에 동기화된 ｔｖ 방송 컨텐트를 관리하는 방법 및 장치
KR100384757B1 (ko) 카메라와 화면 캡쳐를 이용한 인터넷 분산 방송 시스템 및방법
KR101078701B1 (ko) 아이피티브이 프로그램의 서브 콘텐츠 선택 재생 방법 및 장치
US20050289620A1 (en) Method and apparatus for generating an application data signal
KR20150027745A (ko) 상호작용 오디오/비디오 브로드캐스트 시스템, 이 시스템을 동작시키기 위한 방법 및 상호작용 오디오/비디오 브로드캐스트 시스템에서의 동작을 위한 사용자 디바이스
AU777778B2 (en) Methods and apparatus for information broadcasting and reception
KR20030070932A (ko) 네트워크를 통한 상호 연관된 두개 이상의 멀티미디어데이타의 전송방법 및 장치
Balachandran et al. Rapid video browsing on a VCR using a TV set-top box.
WO2001019078A1 (fr) Synchronisation de flux video analogiques et numeriques distincts a un site spectateur au moyen de sous-titres codes

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP