New! View global litigation for patent families

US20010010523A1 - Audiovisual information management system - Google Patents

Audiovisual information management system Download PDF

Info

Publication number
US20010010523A1
US20010010523A1 US09804612 US80461201A US2001010523A1 US 20010010523 A1 US20010010523 A1 US 20010010523A1 US 09804612 US09804612 US 09804612 US 80461201 A US80461201 A US 80461201A US 2001010523 A1 US2001010523 A1 US 2001010523A1
Authority
US
Grant status
Application
Patent type
Prior art keywords
lt
description
scheme
user
program
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US09804612
Inventor
M. Sezan
Richard Qian
Peter Beek
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sharp Laboratories of America Inc
Original Assignee
Sharp Laboratories of America Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F17/00Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/30Information retrieval; Database structures therefor ; File system structures therefor
    • G06F17/30017Multimedia data retrieval; Retrieval of more than one type of audiovisual media
    • G06F17/30023Querying
    • G06F17/30029Querying by filtering; by personalisation, e.g. querying making use of user profiles
    • G06F17/30035Administration of user profiles, e.g. generation, initialisation, adaptation, distribution
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F17/00Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/30Information retrieval; Database structures therefor ; File system structures therefor
    • G06F17/30017Multimedia data retrieval; Retrieval of more than one type of audiovisual media
    • G06F17/30058Retrieval by browsing and visualisation of multimedia data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Structure of client; Structure of client peripherals using peripherals receiving signals from specially adapted client devices
    • H04N21/4126Structure of client; Structure of client peripherals using peripherals receiving signals from specially adapted client devices portable device, e.g. remote control with a display, PDA, mobile phone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/414Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/4147Personal Video Recorder [PVR]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/418External card to be used in combination with the client device, e.g. for conditional access
    • H04N21/4182External card to be used in combination with the client device, e.g. for conditional access for identification purposes, e.g. storing user identification data, preferences, personal settings or data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Structure of client; Structure of client peripherals using Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. Global Positioning System [GPS]
    • H04N21/4223Cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network, synchronizing decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network, synchronizing decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • H04N21/4394Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network, synchronizing decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508Management of client or end-user data
    • H04N21/4532Management of client or end-user data involving end-user characteristics, e.g. viewer profile, preferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/454Content or additional data filtering, e.g. blocking advertisements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/482End-user interface for program selection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/60Selective content distribution, e.g. interactive television, VOD [Video On Demand] using Network structure or processes specifically adapted for video distribution between server and client or between remote clients; Control signaling specific to video distribution between clients, server and network components, e.g. to video encoder or decoder; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6582Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8106Monomedia components thereof involving special audio data, e.g. different tracks for different languages
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8126Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
    • H04N21/8133Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84Generation or processing of descriptive data, e.g. content descriptors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/854Content authoring
    • H04N21/8543Content authoring using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/854Content authoring
    • H04N21/8549Creating video summaries, e.g. movie trailer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/44Receiver circuitry
    • H04N5/445Receiver circuitry for displaying additional information
    • H04N5/44543Menu-type displays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of content streams, manipulating MPEG-4 scene graphs
    • H04N21/23412Processing of video elementary streams, e.g. splicing of content streams, manipulating MPEG-4 scene graphs for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network, synchronizing decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB, inside the home ; Interfacing an external card to be used in combination with the client device
    • H04N21/43615Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network, synchronizing decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44012Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4728End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments

Abstract

Providing at least one description scheme. For audio and/or video programs a program description scheme provides information regarding the associated program. For the user a user description scheme provides information regarding the user's preferences. For the system a system description scheme provides information regarding the system. The description schemes are independent of one another. Preferably, the program description scheme, user description scheme, and system description scheme are independent of one another.

Description

    BACKGROUND OF THE INVENTION
  • [0001]
    The present invention relates to a system for managing audiovisual information, and in particular to a system for audiovisual information browsing, filtering, searching, archiving, and personalization.
  • [0002]
    Video cassette recorders (VCRs) may record video programs in response to pressing a record button or may be programmed to record video programs based on the time of day. However, the viewer must program the VCR based on information from a television guide to identify relevant programs to record. After recording, the viewer scans through the entire video tape to select relevant portions of the program for viewing using the functionality provided by the VCR, such as fast forward and fast reverse. Unfortunately, the searching and viewing is based on a linear search, which may require significant time to locate the desired portions of the program(s) and fast forward to the desired portion of the tape. In addition, it is time consuming to program the VCR in light of the television guide to record desired programs. Also, unless the viewer recognizes the programs from the television guide as desirable it is unlikely that the viewer will select such programs to be recorded.
  • [0003]
    RePlay TV and TiVo have developed hard disk based systems that receive, record, and play television broadcasts in a manner similar to a VCR. The systems may be programmed with the viewer's viewing preferences. The systems use a telephone line interface to receive scheduling information similar to that available from a television guide. Based upon the system programming and the scheduling information, the system automatically records programs that may be of potential interest to the viewer. Unfortunately, viewing the recorded programs occurs in a linear manner and may require substantial time. In addition, each system must be programmed for an individual's preference, likely in a different manner.
  • [0004]
    Freeman et al., U.S. Pat. No. 5,861,881, disclose an interactive computer system where subscribers can receive individualized content.
  • [0005]
    With all the aforementioned systems, each individual viewer is required to program the device according to his particular viewing preferences. Unfortunately, each different type of device has different capabilities and limitations which limit the selections of the viewer. In addition, each device includes a different interface which the viewer may be unfamiliar with. Further, if the operator's manual is inadvertently misplaced it may be difficult for the viewer to efficiently program the device.
  • SUMMARY OF THE INVENTION
  • [0006]
    The present invention overcomes the aforementioned drawbacks of the prior art by providing at least one description scheme. For audio and/or video programs a program description scheme provides information regarding the associated program. For the user a user description scheme provides information regarding the user's preferences. For the system a system description scheme provides information regarding the system. The description schemes are independent of one another. In the preferred embodiment the system may use a combination of the description schemes to enhance its ability to search, filter, and browse audiovisual information in a personalized and effective manner.
  • [0007]
    The foregoing and other objectives, features and advantages of the invention will be more readily understood upon consideration of the following detailed description of the invention, taken in conjunction with the accompanying drawings.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • [0008]
    [0008]FIG. 1 is an exemplary embodiment of a program, a system, and a user, with associated description schemes, of an audiovisual system of the present invention.
  • [0009]
    [0009]FIG. 2 is an exemplary embodiment of the audiovisual system, including an analysis module, of FIG. 1.
  • [0010]
    [0010]FIG. 3 is an exemplary embodiment of the analysis module of FIG. 2.
  • [0011]
    [0011]FIG. 4 is an illustration of a thumbnail view (category) for the audiovisual system.
  • [0012]
    [0012]FIG. 5 is an illustration of a thumbnail view (channel) for the audiovisual system.
  • [0013]
    [0013]FIG. 6 is an illustration of a text view (channel) for the audiovisual system.
  • [0014]
    [0014]FIG. 7 is an illustration of a frame view for the audiovisual system.
  • [0015]
    [0015]FIG. 8 is an illustration of a shot view for the audiovisual system.
  • [0016]
    [0016]FIG. 9 is an illustration of a key frame view the audiovisual system.
  • [0017]
    [0017]FIG. 10 is an illustration of a highlight view for the audiovisual system.
  • [0018]
    [0018]FIG. 11 is an illustration of an event view for the audiovisual system.
  • [0019]
    [0019]FIG. 12 is an illustration of a character/object view for the audiovisual system.
  • [0020]
    [0020]FIG. 13 is an alternative embodiment of a program description scheme including a syntactic structure description scheme, a semantic structure description scheme, a visualization description scheme, and a meta information description scheme.
  • [0021]
    [0021]FIG. 14 is an exemplary embodiment of the visualization description scheme of FIG. 13.
  • [0022]
    [0022]FIG. 15 is an exemplary embodiment of the meta information description scheme of FIG. 13.
  • [0023]
    [0023]FIG. 16 is an exemplary embodiment of a segment description scheme for the syntactic structure description scheme of FIG. 13.
  • [0024]
    [0024]FIG. 17 is an exemplary embodiment of a region description scheme for the syntactic structure description scheme of FIG. 13.
  • [0025]
    [0025]FIG. 18 is an exemplary embodiment of a segment/region relation description scheme for the syntactic structure description scheme of FIG. 13.
  • [0026]
    [0026]FIG. 19 is an exemplary embodiment of an event description scheme for the semantic structure description scheme of FIG. 13.
  • [0027]
    [0027]FIG. 20 is an exemplary embodiment of an object description scheme for the semantic structure description scheme of FIG. 13.
  • [0028]
    [0028]FIG. 21 is an exemplary embodiment of an event/object relation graph description scheme for the syntactic structure description scheme of FIG. 13.
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
  • [0029]
    Many households today have many sources of audio and video information, such as multiple television sets, multiple VCR's, a home stereo, a home entertainment center, cable television, satellite television, internet broadcasts, world wide web, data services, specialized Internet services, portable radio devices, and a stereo in each of their vehicles. For each of these devices, a different interface is normally used to obtain, select, record, and play the video and/or audio content. For example, a VCR permits the selection of the recording times but the user has to correlate the television guide with the desired recording times. Another example is the user selecting a preferred set of preselected radio stations for his home stereo and also presumably selecting the same set of preselected stations for each of the user's vehicles. If another household member desires a different set of preselected stereo selections, the programming of each audio device would need to be reprogrammed at substantial inconvenience.
  • [0030]
    The present inventors came to the realization that users of visual information and listeners to audio information, such as for example radio, audio tapes, video tapes, movies, and news, desire to be entertained and informed in more than merely one uniform manner. In other words, the audiovisual information presented to a particular user should be in a format and include content suited to their particular viewing preferences. In addition, the format should be dependent on the content of the particular audiovisual information. The amount of information presented to a user or a listener should be limited to only the amount of detail desired by the particular user at the particular time. For example with the ever increasing demands on the user's time, the user may desire to watch only 10 minutes of or merely the highlights of a basketball game. In addition, the present inventors came to the realization that the necessity of programming multiple audio and visual devices with their particular viewing preferences is a burdensome task, especially when presented with unfamiliar recording devices when traveling. When traveling, users desire to easily configure unfamiliar devices, such as audiovisual devices in a hotel room, with their viewing and listening preferences in a efficient manner.
  • [0031]
    The present inventors came to the further realization that a convenient technique of merely recording the desired audio and video information is not sufficient because the presentation of the information should be in a manner that is time efficient, especially in light of the limited time frequently available for the presentation of such information. In addition, the user should be able to access only that portion of all of the available information that the user is interested in, while skipping the remainder of the information.
  • [0032]
    A user is not capable of watching or otherwise listening to the vast potential amount of information available through all, or even a small portion of, the sources of audio and video information. In addition, with the increasing information potentially available, the user is not likely even aware of the potential content of information that he may be interested in. In light of the vast amount of audio, image, and video information, the present inventors came to the realization that a system that records and presents to the user audio and video information based upon the user's prior viewing and listening habits, preferences, and personal characteristics, generally referred to as user information, is desirable. In addition, the system may present such information based on the capabilities of the system devices. This permits the system to record desirable information and to customize itself automatically to the user and/or listener. It is to be understood that user, viewer, and/or listener terms may be used interchangeability for any type of content. Also, the user information should be portable between and usable by different devices so that other devices may likewise be configured automatically to the particular user's preferences upon receiving the viewing information.
  • [0033]
    In light of the foregoing realizations and motivations, the present inventors analyzed a typical audio and video presentation environment to determine the significant portions of the typical audiovisual environment. First, referring to FIG. 1 the video, image, and/or audio information 10 is provided or otherwise made available to a user and/or a (device) system. Second, the video, image, and/or audio information is presented to the user from the system 12 (device), such as a television set or a radio. Third, the user interacts both with the system (device) 12 to view the information 10 in a desirable manner and has preferences to define which audio, image, and/or video information is obtained in accordance with the user information 14. After the proper identification of the different major aspects of an audiovisual system the present inventors then realized that information is needed to describe the informational content of each portion of the audiovisual system 16.
  • [0034]
    With three portions of the audiovisual presentation system 16 identified, the functionality of each portion is identified together with its interrelationship to the other portions. To define the necessary interrelationships, a set of description schemes containing data describing each portion is defined. The description schemes include data that is auxiliary to the programs 10, the system 12, and the user 14, to store a set of information, ranging from human readable text to encoded data, that can be used in enabling browsing, filtering, searching, archiving, and personalization. By providing a separate description scheme describing the program(s) 10, the user 14, and the system 12, the three portions (program, user, and system) may be combined together to provide an interactivity not previously achievable. In addition, different programs 10, different users 14, and different systems 12 may be combined together in any combination, while still maintaining full compatibility and functionality. It is to be understood that the description scheme may contain the data itself or include links to the data, as desired.
  • [0035]
    A program description scheme 18 related to the video, still image, and/or audio information 10 preferably includes two sets of information, namely, program views and program profiles. The program views define logical structures of the frames of a video that define how the video frames are potentially to be viewed suitable for efficient browsing. For example the program views may contain a set of fields that contain data for the identification of key frames, segment definitions between shots, highlight definitions, video summary definitions, different lengths of highlights, thumbnail set of frames, individual shots or scenes, representative frame of the video, grouping of different events, and a close-up view. The program view descriptions may contain thumbnail, slide, key frame, highlights, and close-up views so that users can filter and search not only at the program level but also within a particular program. The description scheme also enables users to access information in varying detail amounts by supporting, for example, a key frame view as a part of a program view providing multiple levels of summary ranging from coarse to fine. The program profiles define distinctive characteristics of the content of the program, such as actors, stars, rating, director, release date, time stamps, keyword identification, trigger profile, still profile, event profile, character profile, object profile, color profile, texture profile, shape profile, motion profile, and categories. The program profiles are especially suitable to facilitate filtering and searching of the audio and video information. The description scheme enables users to have the provision of discovering interesting programs that they may be unaware of by providing a user description scheme. The user description scheme provides information to a software agent that in turn performs a search and filtering on behalf of the user by possibly using the system description scheme and the program description scheme information. It is to be understood that in one of the embodiments of the invention merely the program description scheme is included.
  • [0036]
    Program views contained in the program description scheme are a feature that supports a functionality such as close-up view. In the close-up view, a certain image object, e.g., a famous basketball player such as Michael Jordan, can be viewed up close by playing back a close-up sequence that is separate from the original program. An alternative view can be incorporated in a straightforward manner. Character profile on the other hand may contain spatio-temporal position and size of a rectangular region around the character of interest. This region can be enlarged by the presentation engine, or the presentation engine may darken outside the region to focus the user's attention to the characters spanning a certain number of frames. Information within the program description scheme may contain data about the initial size or location of the region, movement of the region from one frame to another, and duration and terms of the number of frames featuring the region. The character profile also provides provision for including text annotation and audio annotation about the character as well as web page information, and any other suitable information. Such character profiles may include the audio annotation which is separate from and in addition to the associated audio track of the video.
  • [0037]
    The program description scheme may likewise contain similar information regarding audio (such as radio broadcasts) and images (such as analog or digital photographs or a frame of a video).
  • [0038]
    The user description scheme 20 preferably includes the user's personal preferences, and information regarding the user's viewing history such as for example browsing history, filtering history, searching history, and device setting history. The user's personal preferences includes information regarding particular programs and categorizations of programs that the user prefers to view. The user description scheme may also include personal information about the particular user, such as demographic and geographic information, e.g. zip code and age. The explicit definition of the particular programs or attributes related thereto permits the system 16 to select those programs from the information contained within the available program description schemes 18 that may be of interest to the user. Frequently, the user does not desire to learn to program the device nor desire to explicitly program the device. In addition, the user description scheme 20 may not be sufficiently robust to include explicit definitions describing all desirable programs for a particular user. In such a case, the capability of the user description scheme 20 to adapt to the viewing habits of the user to accommodate different viewing characteristics not explicitly provided for or otherwise difficult to describe is useful. In such a case, the user description scheme 20 may be augmented or any technique can be used to compare the information contained in the user description scheme 20 to the available information contained in the program description scheme 18 to make selections. The user description scheme provides a technique for holding user preferences ranging from program categories to program views, as well as usage history. User description scheme information is persistent but can be updated by the user or by an intelligent software agent on behalf of the user at any arbitrary time. It may also be disabled by the user, at any time, if the user decides to do so. In addition, the user description scheme is modular and portable so that users can carry or port it from one device to another, such as with a handheld electronic device or smart card or transported over a network connecting multiple devices. When user description scheme is standardized among different manufacturers or products, user preferences become portable. For example, a user can personalize the television receiver in a hotel room permitting users to access information they prefer at any time and anywhere. In a sense, the user description scheme is persistent and timeless based. In addition, selected information within the program description scheme may be encrypted since at least part of the information may be deemed to be private (e.g., demographics). A user description scheme may be associated with an audiovisual program broadcast and compared with a particular user's description scheme of the receiver to readily determine whether or not the program's intended audience profile matches that of the user. It is to be understood that in one of the embodiments of the invention merely the user description scheme is included.
  • [0039]
    The system description scheme 22 preferably manages the individual programs and other data. The management may include maintaining lists of programs, categories, channels, users, videos, audio, and images. The management may include the capabilities of a device for providing the audio, video, and/or images. Such capabilities may include, for example, screen size, stereo, AC3, DTS, color, black/white, etc. The management may also include relationships between any one or more of the user, the audio, and the images in relation to one or more of a program description scheme(s) and a user description scheme(s). In a similar manner the management may include relationships between one or more of the program description scheme(s) and user description scheme(s). It is to be understood that in one of the embodiments of the invention merely the system description scheme is included.
  • [0040]
    The descriptors of the program description scheme and the user description scheme should overlap, at least partially, so that potential desirability of the program can be determined by comparing descriptors representative of the same information. For example, the program and user description scheme may include the same set of categories and actors. The program description scheme has no knowledge of the user description scheme, and vice versa, so that each description scheme is not dependant on the other for its existence. It is not necessary for the description schemes to be fully populated. It is also beneficial not to include the program description scheme with the user description scheme because there will likely be thousands of programs with associated description schemes which if combined with the user description scheme would result in a unnecessarily large user description scheme. It is desirable to maintain the user description scheme small so that it is more readily portable. Accordingly, a system including only the program description scheme and the user description scheme would be beneficial.
  • [0041]
    The user description scheme and the system description scheme should include at least partially overlapping fields. With overlapping fields the system can capture the desired information, which would otherwise not be recognized as desirable. The system description scheme preferably includes a list of users and available programs. Based on the master list of available programs, and associated program description scheme, the system can match the desired programs. It is also beneficial not to include the system description scheme with the user description scheme because there will likely be thousands of programs stored in the system description schemes which if combined with the user description scheme would result in a unnecessarily large user description scheme. It is desirable to maintain the user description scheme small so that it is more readily portable. For example, the user description scheme may include radio station preselected frequencies and/or types of stations, while the system description scheme includes the available stations for radio stations in particular cities. When traveling to a different city the user description scheme together with the system description scheme will permit reprogramming the radio stations. Accordingly, a system including only the system description scheme and the user description scheme would be beneficial.
  • [0042]
    The program description scheme and the system description scheme should include at least partially overlapping fields. With the overlapping fields, the system description scheme will be capable of storing the information contained within the program description scheme, so that the information is properly indexed. With proper indexing, the system is capable of matching such information with the user information, if available, for obtaining and recording suitable programs. If the program description scheme and the system description scheme were not overlapping then no information would be extracted from the programs and stored. System capabilities specified within the system description scheme of a particular viewing system can be correlated with a program description scheme to determine the views that can be supported by the viewing system. For instance, if the viewing device is not capable of playing back video, its system description scheme may describe its viewing capabilities as limited to keyframe view and slide view only. Program description scheme of a particular program and system description scheme of the viewing system are utilized to present the appropriate views to the viewing system. Thus, a server of programs serves the appropriate views according to a particular viewing system's capabilities, which may be communicated over a network or communication channel connecting the server with user's viewing device. It is preferred to maintain the program description scheme separate from the system description scheme because the content providers repackage the content and description schemes in different styles, times, and formats. Preferably, the program description scheme is associated with the program, even if displayed at a different time. Accordingly, a system including only the system description scheme and the program description scheme would be beneficial.
  • [0043]
    By preferably maintaining the independence of each of the three description schemes while having fields that correlate the same information, the programs 10, the users 14, and the system 12 may be interchanged with one another while maintaining the functionality of the entire system 16. Referring to FIG. 2, the audio, visual, or audiovisual program 38, is received by the system 16. The program 38 may originate at any suitable source, such as for example broadcast television, cable television, satellite television, digital television, Internet broadcasts, world wide web, digital video discs, still images, video cameras, laser discs, magnetic media, computer hard drive, video tape, audio tape, data services, radio broadcasts, and microwave communications. The program description stream may originate from any suitable source, such as for example PSIP/DVB-SI information in digital television broadcasts, specialized digital television data services, specialized Internet services, world wide web, data files, data over the telephone, and memory, such as computer memory. The program, user, and/or system description scheme may be transported over a network (communication channel). For example, the system description scheme may be transported to the source to provide the source with views or other capabilities that the device is capable of using. In response, the source provides the device with image, audio, and/or video content customized or otherwise suitable for the particular device. The system 16 may include any device(s) suitable to receive any one or more of such programs 38. An audiovisual program analysis module 42 performs an analysis of the received programs 38 to extract and provide program related information (descriptors) to the description scheme (DS) generation module 44. The program related information may be extracted from the data stream including the program 38 or obtained from any other source, such as for example data transferred over a telephone line, data already transferred to the system 16 in the past, or data from an associated file. The program related information preferably includes data defining both the program views and the program profiles available for the particular program 38. The analysis module 42 performs an analysis of the programs 38 using information obtained from (i) automatic audio-video analysis methods on the basis of low-level features that are extracted from the program(s), (ii) event detection techniques, (iii) data that is available (or extractable) from data sources or electronic program guides (EPGs, DVB-SI, and PSIP), and (iv) user information obtained from the user description scheme 20 to provide data defining the program description scheme.
  • [0044]
    The selection of a particular program analysis technique depends on the amount of readily available data and the user preferences. For example, if a user prefers to watch a 5 minute video highlight of a particular program, such as a basketball game, the analysis module 42 may invoke a knowledge based system 90 (FIG. 3) to determine the highlights that form the best 5 minute summary. The knowledge based system 90 may invoke a commercial filter 92 to remove commercials and a slow motion detector 54 to assist in creating the video summary. The analysis module 42 may also invoke other modules to bring information together (e.g., textual information) to author particular program views. For example, if the program 38 is a home video where there is no further information available then the analysis module 42 may create a key-frame summary by identifying key-frames of a multi-level summary and passing the information to be used to generate the program views, and in particular a key frame view, to the description scheme. Referring also to FIG. 3, the analysis module 42 may also include other sub-modules, such as for example, a de-mux/decoder 60, a data and service content analyzer 62, a text processing and text summary generator 64, a close caption analyzer 66, a title frame generator 68, an analysis manager 70, an audiovisual analysis and feature extractor 72, an event detector 74, a key-frame summarizer 76, and a highlight summarizer 78.
  • [0045]
    The generation module 44 receives the system information 46 for the system description scheme. The system information 46 preferably includes data for the system description scheme 22 generated by the generation module 44. The generation module 44 also receives user information 48 including data for the user description scheme. The user information 48 preferably includes data for the user description scheme generated within the generation module 44. The user input 48 may include, for example, meta information to be included in the program and system description scheme. The user description scheme (or corresponding information) is provided to the analysis module 42 for selective analysis of the program(s) 38. For example, the user description scheme may be suitable for triggering the highlight generation functionality for a particular program and thus generating the preferred views and storing associated data in the program description scheme. The generation module 44 and the analysis module 42 provide data to a data storage unit 50. The storage unit 50 may be any storage device, such as memory or magnetic media.
  • [0046]
    A search, filtering, and browsing (SFB) module 52 implements the description scheme technique by parsing and extracting information contained within the description scheme. The SFB module 52 may perform filtering, searching, and browsing of the programs 38, on the basis of the information contained in the description schemes. An intelligent software agent is preferably included within the SFB module 52 that gathers and provides user specific information to the generation module 44 to be used in authoring and updating the user description scheme (through the generation module 44). In this manner, desirable content may be provided to the user though a display 80. The selections of the desired program(s) to be retrieved, stored, and/or viewed may be programmed, at least in part, through a graphical user interface 82. The graphical user interface may also include or be connected to a presentation engine for presenting the information to the user through the graphical user interface.
  • [0047]
    The intelligent management and consumption of audiovisual information using the multi-part description stream device provides a next-generation device suitable for the modern era of information overload. The device responds to changing lifestyles of individuals and families, and allows everyone to obtain the information they desire anytime and anywhere they want.
  • [0048]
    An example of the use of the device may be as follows. A user comes home from work late Friday evening being happy the work week is finally over. The user desires to catch up with the events of the world and then watch ABC's 20/20 show later that evening. It is now 9 PM and the 20/20 show will start in an hour at 10 PM. The user is interested in the sporting events of the week, and all the news about the Microsoft case with the Department of Justice. The user description scheme may include a profile indicating a desire that the particular user wants to obtain all available information regarding the Microsoft trial and selected sporting events for particular teams. In addition, the system description scheme and program description scheme provide information regarding the content of the available information that may selectively be obtained and recorded. The system, in an autonomous manner, periodically obtains and records the audiovisual information that may be of interest to the user during the past week based on the three description schemes. The device most likely has recorded more than one hour of audiovisual information so the information needs to be condensed in some manner. The user starts interacting with the system with a pointer or voice commands to indicate a desire to view recorded sporting programs. On the display, the user is presented with a list of recorded sporting events including Basketball and Soccer. Apparently the user's favorite Football team did not play that week because it was not recorded. The user is interested in basketball games and indicates a desire to view games. A set of title frames is presented on the display that captures an important moment of each game. The user selects the Chicago Bulls game and indicates a desire to view a 5 minute highlight of the game. The system automatically generates highlights. The highlights may be generated by audio or video analysis, or the program description scheme includes data indicating the frames that are presented for a 5 minute highlight. The system may have also recorded web-based textual information regarding the particular Chicago-Bulls game which may be selected by the user for viewing. If desired, the summarized information may be recorded onto a storage device, such as a DVD with a label. The stored information may also include an index code so that it can be located at a later time. After viewing the sporting events the user may decide to read the news about the Microsoft trial. It is now 9:50 PM and the user is done viewing the news. In fact, the user has selected to delete all the recorded news items after viewing them. The user then remembers to do one last thing before 10 PM in the evening. The next day, the user desires to watch the VHS tape that he received from his brother that day, containing footage about his brother's new baby girl and his vacation to Peru last summer. The user wants to watch the whole 2-hour tape but he is anxious to see what the baby looks like and also the new stadium built in Lima, which was not there last time he visited Peru. The user plans to take a quick look at a visual summary of the tape, browse, and perhaps watch a few segments for a couple of minutes, before the user takes his daughter to her piano lesson at 10 AM the next morning. The user plugs in the tape into his VCR, that is connected to the system, and invokes the summarization functionality of the system to scan the tape and prepare a summary. The user can then view the summary the next morning to quickly discover the baby's looks, and playback segments between the key-frames of the summary to catch a glimpse of the crying baby. The system may also record the tape content onto the system hard drive (or storage device) so the video summary can be viewed quickly. It is now 10:10 PM, and it seems that the user is 10 minutes late for viewing 20/20. Fortunately, the system, based on the three description schemes, has already been recording 20/20 since 10 PM. Now the user can start watching the recorded portion of 20/20 as the recording of 20/20 proceeds. The user will be done viewing 20/20 at 11:10 PM.
  • [0049]
    The average consumer has an ever increasing number of multimedia devices, such as a home audio system, a car stereo, several home television sets, web browsers, etc. The user currently has to customize each of the devices for optimal viewing and/or listening preferences. By storing the user preferences on a removable storage device, such as a smart card, the user may insert the card including the user preferences into such media devices for automatic customization. This results in the desired programs being automatically recorded on the VCR, and setting of the radio stations for the car stereo and home audio system. In this manner the user only has to specify his preferences at most once, on a single device and subsequently, the descriptors are automatically uploaded into devices by the removable storage device. The user description scheme may also be loaded into other devices using a wired or wireless network connection, e.g. that of a home network. Alternatively, the system can store the user history and create entries in the user description scheme based on the's audio and video viewing habits. In this manner, the user would never need to program the viewing information to obtain desired information. In a sense, the user descriptor scheme enables modeling of the user by providing a central storage for the user's listening, viewing, browsing preferences, and user's behavior. This enables devices to be quickly personalized, and enables other components, such as intelligent agents, to communicate on the basis of a standardized description format, and to make smart inferences regarding the user's preferences.
  • [0050]
    Many different realizations and applications can be readily derived from FIGS. 2 and 3 by appropriately organizing and utilizing their different parts, or by adding peripherals and extensions as needed. In its most general form, FIG. 2 depicts an audiovisual searching, filtering, browsing, and/or recording appliance that is personalizable. The list of more specific applications/implementations given below is not exhaustive but covers a range.
  • [0051]
    The user description scheme is a major enabler for personalizable audiovisual appliances. If the structure (syntax and semantics) of the description schemes is known amongst multiple appliances, the user (user) can carry (or otherwise transfer) the information contained within his user description scheme from one appliance to another, perhaps via a smart card—where these appliances support smart card interface—in order to personalize them. Personalization can range from device settings, such as display contrast and volume control, to settings of television channels, radio stations, web stations, web sites, geographic information, and demographic information such as age, zip code etc. Appliances that can be personalized may access content from different sources. They may be connected to the web, terrestrial or cable broadcast, etc., and they may also access multiple or different types of single media such as video, music, etc.
  • [0052]
    For example, one can personalize the car stereo using a smart card plugged out of the home system and plugged into the car stereo system to be able to tune to favorite stations at certain times. As another example, one can also personalize television viewing, for example, by plugging the smart card into a remote control that in turn will autonomously command the television receiving system to present the user information about current and future programs that fits the user's preferences. Different members of the household can instantly personalize the viewing experience by inserting their own smart card into the family remote. In the absence of such a remote, this same type of personalization can be achieved by plugging in the smart card directly to the television system. The remote may likewise control audio systems. In another implementation, the television receiving system holds user description schemes for multiple users (users) in local storage and identify different users (or group of users) by using an appropriate input interface. For example an interface using user-voice identification technology. It is noted that in a networked system the user description scheme may be transported over the network.
  • [0053]
    The user description scheme is generated by direct user input, and by using a software that watches the user to determine his/her usage pattern and usage history. User description scheme can be updated in a dynamic fashion by the user or automatically. A well defined and structured description scheme design allows different devices to interoperate with each other. A modular design also provides portability.
  • [0054]
    The description scheme adds new functionality to those of the current VCR. An advanced VCR system can learn from the user via direct input of preferences, or by watching the usage pattern and history of the user. The user description scheme holds user's preferences users and usage history. An intelligent agent can then consult with the user description scheme and obtain information that it needs for acting on behalf of the user. Through the intelligent agent, the system acts on behalf of the user to discover programs that fit the taste of the user, alert the user about such programs, and/or record them autonomously. An agent can also manage the storage in the system according to the user description scheme, i.e., prioritizing the deletion of programs (or alerting the user for transfer to a removable media), or determining their compression factor (which directly impacts their visual quality) according to user's preferences and history.
  • [0055]
    The program description scheme and the system description scheme work in collaboration with the user description scheme in achieving some tasks. In addition, the program description scheme and system description scheme in an advanced VCR or other system will enable the user to browse, search, and filter audiovisual programs. Browsing in the system offers capabilities that are well beyond fast forwarding and rewinding. For instance, the user can view a thumbnail view of different categories of programs stored in the system. The user then may choose frame view, shot view, key frame view, or highlight view, depending on their availability and user's preference. These views can be readily invoked using the relevant information in the program description scheme, especially in program views. The user at any time can start viewing the program either in parts, or in its entirety.
  • [0056]
    In this application, the program description scheme may be readily available from many services such as: (i) from broadcast (carried by EPG defined as a part of ATSC-PSIP (ATSC-Program Service Integration Protocol) in U.S.A. or DVB-SI (Digital Video Broadcast-Service Information) in Europe); (ii) from specialized data services (in addition to PSIP/DVB-SI); (iii) from specialized web sites; (iv) from the media storage unit containing the audiovisual content (e.g., DVD); (v) from advanced cameras (discussed later), and/or may be generated (i.e., for programs that are being stored) by the analysis module 42 or by user input 48.
  • [0057]
    Contents of digital still and video cameras can be stored and managed by a system that implements the description schemes, e.g., a system as shown in FIG. 2. Advanced cameras can store a program description scheme, for instance, in addition to the audiovisual content itself. The program description scheme can be generated either in part or in its entirety on the camera itself via an appropriate user input interface (e.g., speech, visual menu drive, etc.). Users can input to the camera the program description scheme information, especially those high-level (or semantic) information that may otherwise be difficult to automatically extract by the system. Some camera settings and parameters (e.g., date and time), as well as quantities computed in the camera (e.g., color histogram to be included in the color profile), can also be used in generating the program description scheme. Once the camera is connected, the system can browse the camera content, or transfer the camera content and its description scheme to the local storage for future use. It is also possible to update or add information to the description scheme generated in the camera.
  • [0058]
    The IEEE 1394 and Havi standard specifications enable this type of “audiovisual content” centric communication among devices. The description scheme API's can be used in the context of Havi to browse and/or search the contents of a camera or a DVD which also contain a description scheme associated with their content, i.e., doing more than merely invoking the PLAY API to play back and linearly view the media.
  • [0059]
    The description schemes may be used in archiving audiovisual programs in a database. The search engine uses the information contained in the program description scheme to retrieve programs on the basis of their content. The program description scheme can also be used in navigating through the contents of the database or the query results. The user description scheme can be used in prioritizing the results of the user query during presentation. It is possible of course to make the program description scheme more comprehensive depending on the nature of the particular application.
  • [0060]
    The description scheme fulfills the user's desire to have applications that pay attention and are responsive to their viewing and usage habits, preferences, and personal demographics. The proposed user description scheme directly addresses this desire in its selection of fields and interrelationship to other description schemes. Because the description schemes are modular in nature, the user can port his user description scheme from one device to another in order to “personalize” the device.
  • [0061]
    The proposed description schemes can be incorporated into current products similar to those from TiVo and Replay TV in order to extend their entertainment informational value. In particular, the description scheme will enable audiovisual browsing and searching of programs and enable filtering within a particular program by supporting multiple program views such as the highlight view. In addition, the description scheme will handle programs coming from sources other than television broadcasts for which TiVo and Replay TV are not designed to handle. In addition, by standardization of TiVo and Replay TV type of devices, other products may be interconnected to such devices to extend their capabilities, such as devices supporting an MPEG 7 description. MPEG-7 is the Moving Pictures Experts Group—7, acting to standardize descriptions and description schemes for audiovisual information. The device may also be extended to be personalized by multiple users, as desired.
  • [0062]
    Because the description scheme is defined, the intelligent software agents can communicate among themselves to make intelligent inferences regarding the user's preferences. In addition, the development and upgrade of intelligent software agents for browsing and filtering applications can be simplified based on the standardized user description scheme.
  • [0063]
    The description scheme is multi-modal in the following sense that it holds both high level (semantic) and low level features and/or descriptors. For example, the high and low level descriptors are actor name and motion model parameters, respectively. High level descriptors are easily readable by humans while low level descriptors are more easily read by machines and less understandable by humans. The program description scheme can be readily harmonized with existing EPG, PSIP, and DVB-SI information facilitating search and filtering of broadcast programs. Existing services can be extended in the future by incorporating additional information using the compliant description scheme.
  • [0064]
    For example, one case may include audiovisual programs that are prerecorded on a media such as a digital video disc where the digital video disc also contains a description scheme that has the same syntax and semantics of the description scheme that the FSB module uses. If the FSB module uses a different description scheme, a transcoder (converter) of the description scheme may be employed. The user may want to browse and view the content of the digital video disc. In this case, the user may not need to invoke the analysis module to author a program description. However, the user may want to invoke his or her user description scheme in filtering, searching and browsing the digital video disc content. Other sources of program information may likewise be used in the same manner.
  • [0065]
    It is to be understood that any of the techniques described herein with relation to video are equally applicable to images (such as still image or a frame of a video) and audio (such as radio).
  • [0066]
    An example of an audiovisual interface is shown in FIGS. 4-12 which is suitable for the preferred audiovisual description scheme. Referring to FIG. 4, by selecting the thumbnail function as a function of category provides a display with a set of categories on the left hand side. Selecting a particular category, such as news, provides a set of thumbnail views of different programs that are currently available for viewing. In addition, the different programs may also include programs that will be available at a different time for viewing. The thumbnail views are short video segments that provide an indication of the content of the respective actual program that it corresponds with. Referring to FIG. 5, a thumbnail view of available programs in terms of channels may be displayed, if desired. Referring to FIG. 6, a text view of available programs in terms of channels may be displayed, if desired. Referring to FIG. 7, a frame view of particular programs may be displayed, if desired. A representative frame is displayed in the center of the display with a set of representative frames of different programs in the left hand column. The frequency of the number of frames may be selected, as desired. Also a set of frames are displayed on the lower portion of the display representative of different frames during the particular selected program. Referring to FIG. 8, a shot view of particular programs may be displayed, as desired. A representative frame of a shot is displayed in the center of the display with a set of representative frames of different programs in the left hand column. Also a set of shots are displayed on the lower portion of the display representative of different shots (segments of a program, typically sequential in nature) during the particular selected program. Referring to FIG. 9, a key frame view of particular programs may be displayed, as desired. A representative frame is displayed in the center of the display with a set of representative frames of different programs in the left hand column. Also a set of key frame views are displayed on the lower portion of the display representative of different key frame portions during the particular selected program. The number of key frames in each key frame view can be adjusted by selecting the level. Referring to FIG. 10, a highlight view may likewise be displayed, as desired. Referring to FIG. 11, an event view may likewise be displayed, as desired. Referring to FIG. 12, a character/object view may likewise be displayed, as desired.
  • [0067]
    An example of the description schemes is shown below in XML. The description scheme may be implemented in any language and include any of the included descriptions (or more), as desired.
  • [0068]
    The proposed program description scheme includes three major sections for describing a video program. The first section identifies the described program. The second section defines a number of views which may be useful in browsing applications. The third section defines a number of profiles which may be useful in filtering and search applications. Therefore, the overall structure of the proposed description scheme is as follows:
  • [0069]
    <?XML version=“1.0”>
  • [0070]
    <!DOCTYPE MPEG-7 SYSTEM “mpeg-7.dtd”>
  • [0071]
    <ProgramIdentity>
  • [0072]
    <ProgramID> . . . </ProgramID>
  • [0073]
    <ProgramName> . . . </ProgramName>
  • [0074]
    <SourceLocation> . . . </SourceLocation>
  • [0075]
    </ProgramIdentity>
  • [0076]
    <ProgramViews>
  • [0077]
    <ThumbnailView> . . . </ThumbnailView>
  • [0078]
    <SlideView> . . . </SlideView>
  • [0079]
    <FrameView> . . . </FrameView>
  • [0080]
    <ShotView> . . . </ShotView>
  • [0081]
    <KeyFrameView> . . . </KeyFrameView>
  • [0082]
    <HighlightView> . . . </HighlightView>
  • [0083]
    <EventView> . . . </EventView>
  • [0084]
    <CloseUpView> . . . </CloseUpview>
  • [0085]
    <AlternateView> . . . </AlternateView>
  • [0086]
    </ProgramViews>
  • [0087]
    <ProgramProfiles>
  • [0088]
    <GeneralProfile> . . . </GeneralProfile>
  • [0089]
    <CategoryProfile> . . . </CategoryProfile>
  • [0090]
    <DateTimeProfile> . . . </DateTimeProfile>
  • [0091]
    <KeywordProfile> . . . </KeywordProfile>
  • [0092]
    <TriggerProfile> . . . </TriggerProfile>
  • [0093]
    <StillProfile> . . . </StillProfile>
  • [0094]
    <EventProfile> . . . </EventProfile>
  • [0095]
    <CharacterProfile> . . . </CharacterProfile>
  • [0096]
    <ObjectProfile> . . . </ObjectProfile>
  • [0097]
    <ColorProfile> . . . </ColorProfile>
  • [0098]
    <TextureProfile> . . . </TextureProfile>
  • [0099]
    <ShapeProfile> . . . </ShapeProfile>
  • [0100]
    <MotionProfile> . . . </MotionProfile>
  • [0101]
    </ProgramProfiles>
  • [0102]
    Program Identity
  • [0103]
    Program ID
  • [0104]
    <ProgramID> program-id </ProgramID>
  • [0105]
    The descriptor <ProgramID> contains a number or a string to identify a program.
  • [0106]
    Program name
  • [0107]
    <ProgramName> program-name </ProgramName>
  • [0108]
    The descriptor <ProgramName> specifies the name of a program.
  • [0109]
    Source location
  • [0110]
    <SourceLocation> source-url </SourceLocation>
  • [0111]
    The descriptor <SourceLocation> specifies the location of a program in URL format.
  • [0112]
    Program Views
  • [0113]
    Thumbnail view
  • [0114]
    <ThumbnailView>
  • [0115]
    <Image> thumbnail-image </Image>
  • [0116]
    </ThumbnailView>
  • [0117]
    The descriptor <ThumbnailView> specifies an image as the thumbnail representation of a program.
  • [0118]
    Slide view
  • [0119]
    <SlideView> frame-id . . . </Slideview>
  • [0120]
    The descriptor <SlideView> specifies a number of frames in a program which may be viewed as snapshots or in a slide show manner.
  • [0121]
    Frame view
  • [0122]
    <FrameView> start-frame-id end-frame-id </FrameView>
  • [0123]
    The descriptor <FrameView> specifies the start and end frames of a program. This is the most basic view of a program and any program has a frame view.
  • [0124]
    Shot view
  • [0125]
    <ShotView>
  • [0126]
    <Shot id=″″> start-frame-id end-frame-id display-frame-id </Shot>
  • [0127]
    <Shot id=″″> start-frame-id end-frame-id display-frame-id </Shot> . . .
  • [0128]
    </ShotView>
  • [0129]
    The descriptor <ShotView> specifies a number of shots in a program. The <Shot> descriptor defines the start and end frames of a shot. It may also specify a frame to represent the shot.
  • [0130]
    Key-frame view
  • [0131]
    <KeyFrameView>
  • [0132]
    <KeyFrames level=″″>
  • [0133]
    <Clip id=″″> start-frame-id end-frame-id display-frame-id </Clip>
  • [0134]
    <Clip id=″″> start-frame-id end-frame-id display-frame-id </Clip> . . .
  • [0135]
    </KeyFrames>
  • [0136]
    <KeyFrames level=″″>
  • [0137]
    <Clip id=″″> start-frame-id end-frame-id display-frame-id </Clip>
  • [0138]
    <Clip id=″″> start-frame-id end-frame-id display-frame-id </Clip> . . .
  • [0139]
    </KeyFrames> . . .
  • [0140]
    </KeyFrameView>
  • [0141]
    The descriptor <KeyFrameView> specifies key frames in a program. The key frames may be organized in a hierarchical manner and the hierarchy is captured by the descriptor <KeyFrames> with a level attribute. The clips which are associated with each key frame are defined by the descriptor <Clip>. Here the display frame in each clip is the corresponding key frame.
  • [0142]
    <Highlight view>
  • [0143]
    <HighlightView>
  • [0144]
    <Highlight length=″″>
  • [0145]
    <Clip id=″″> start-frame-id end-frame-id display-frame-id </Clip>
  • [0146]
    <Clip id=″″> start-frame-id end-frame-id display-frame-id </Clip> . . .
  • [0147]
    </Highlight>
  • [0148]
    <Highlight length=″″>
  • [0149]
    <Clip id=″″> start-frame-id end-frame-id display-frame-id </Clip>
  • [0150]
    <Clip id=″″> start-frame-id end-frame-id display-frame-id </Clip> . . .
  • [0151]
    </Highlight> . . .
  • [0152]
    </HighlightView>
  • [0153]
    The descriptor <HighlightView> specifies clips to form highlights of a program. A program may have different versions of highlights which are tailored into various time length. The clips are grouped into each version of highlight which is specified by the descriptor <Highlight> with a length attribute.
  • [0154]
    Event view
  • [0155]
    <EventView>
  • [0156]
    <Events name=″″>
  • [0157]
    <clip id=″″> start-frame-id end-frame-id display-frame-id </Clip>
  • [0158]
    <Clip id=″″> start-frame-id end-frame-id display-frame-id </Clip> . . .
  • [0159]
    </Events>
  • [0160]
    <Events name=″″>
  • [0161]
    <Clip id=″″> start-frame-id end-frame-id display-frame-id </Clip>
  • [0162]
    <Clip id=″″> start-frame-id end-frame-id display-frame-id </Clip> . . .
  • [0163]
    </Events> . . .
  • [0164]
    </EventView>
  • [0165]
    The descriptor <EventView> specifies clips which are related to certain events in a program. The clips are grouped into the corresponding events which are specified by the descriptor <Event> with a name attribute.
  • [0166]
    Close-up view
  • [0167]
    <CloseUpView>
  • [0168]
    <Target name=″″>
  • [0169]
    <Clip id=″″> start-frame-id end-frame-id display-frame-id </Clip>
  • [0170]
    <Clip id=″″> start-frame-id end-frame-id display-frame-id </Clip> . . .
  • [0171]
    </Target>
  • [0172]
    <Target name=″″>
  • [0173]
    <Clip id=″″> start-frame-id end-frame-id display-frame-id </Clip>
  • [0174]
    <Clip id=″″> start-frame-id end-frame-id display-frame-id </Clip> . . .
  • [0175]
    </Target> . . .
  • [0176]
    </CloseUpView>
  • [0177]
    The descriptor <CloseUpView> specifies clips which may be zoomed in to certain targets in a program. The clips are grouped into the corresponding targets which are specified by the descriptor <Target> with a name attribute.
  • [0178]
    Alternate view
  • [0179]
    <AlternateView>
  • [0180]
    <AlternateSource id=″″>source-url </AlternateSource>
  • [0181]
    <AlternateSource id=″″>source-url </AlternateSource> . . .
  • [0182]
    </AlternateView>
  • [0183]
    The descriptor <AlternateView> specifies sources which may be shown as alternate views of a program. Each alternate view is specified by the descriptor <AlternateSource> with an id attribute. The locate of the source may be specified in URL format.
  • [0184]
    Program Profiles
  • [0185]
    General profile
  • [0186]
    <GeneralProfile>
  • [0187]
    <Title> title-text </Title>
  • [0188]
    <Abstract> abstract-text </Abstract>
  • [0189]
    <Audio> voice-annotation </Audio>
  • [0190]
    <Www> web-page-url </Www>
  • [0191]
    <ClosedCaption> yes/no </ClosedCaption>
  • [0192]
    <Language> language-name </Language>
  • [0193]
    <Rating> rating </Rating>
  • [0194]
    <Length> time </Length>
  • [0195]
    <Authors> author-name . . . </Authors>
  • [0196]
    <Producers> producer-name . . . </Producers>
  • [0197]
    <Directors> director-name . . . </Directors>
  • [0198]
    <Actors> actor-name . . . </Actors> . . .
  • [0199]
    </Generalprofile>
  • [0200]
    The descriptor <GeneralProfile> describes the general aspects of a program.
  • [0201]
    Category profile
  • [0202]
    <CategoryProfile> category-name . . . </CategoryProfile>
  • [0203]
    The descriptor <CategoryProfile> specifies the categories under which a program may be classified.
  • [0204]
    Date-time profile
  • [0205]
    <DateTimeProfile>
  • [0206]
    <ProductionDate> date </ProductionDate>
  • [0207]
    <ReleaseDate> date </ReleaseDate>
  • [0208]
    <RecordingDate> date </RecordingDate>
  • [0209]
    <RecordingTime> time </RecordingTime> . . .
  • [0210]
    </DateTimeProfile>
  • [0211]
    The descriptor <DateTimeProfile> specifies various date and time information of a program.
  • [0212]
    Keyword profile
  • [0213]
    <KeywordProfile> keyword . . . </KeywordProfile>
  • [0214]
    The descriptor <KeywordProfile> specifies a number of keywords which may be used to filter or search a program.
  • [0215]
    Trigger profile
  • [0216]
    <TriggerProfile> trigger-frame-id . . . </TriggerProfile>
  • [0217]
    The descriptor <TriggerProfile> specifies a number of frames in a program which may be used to trigger certain actions while the playback of the program.
  • [0218]
    Still profile
  • [0219]
    <StillProfile>
  • [0220]
    <Still id=″″>
  • [0221]
    <HotRegion id=″″>
  • [0222]
    <Location> x1 y1 x2 y2 </Location>
  • [0223]
    <Text> text-annotation </Text>
  • [0224]
    <Audio> voice-annotation </Audio>
  • [0225]
    <Www> web-page-url </Www>
  • [0226]
    </HotRegion>
  • [0227]
    <HotRegion id=″″>
  • [0228]
    <Location> x1 y1 x2 y2 </Location>
  • [0229]
    <Text> text-annotation </Text>
  • [0230]
    <Audio> voice-annotation </Audio>
  • [0231]
    <Www> web-page-url </Www>
  • [0232]
    </HotRegion> . . .
  • [0233]
    </Still>
  • [0234]
    <Still id=″″>
  • [0235]
    <HotRegion id=″″>
  • [0236]
    <Location> x1 y1 x2 y2 </Location>
  • [0237]
    <Text> text-annotation </Text>
  • [0238]
    <Audio> voice-annotation </Audio>
  • [0239]
    <Www> web-page-url </Www>
  • [0240]
    </HotRegion>
  • [0241]
    <HotRegion id=″″>
  • [0242]
    <Location> x1 y1 x2 y2 </Location>
  • [0243]
    <Text> text-annotation </Text>
  • [0244]
    <Audio> voice-annotation </Audio>
  • [0245]
    <Www> web-page-url </Www>
  • [0246]
    </HotRegion> . . .
  • [0247]
    </Still> . . .
  • [0248]
    </StillProfile>
  • [0249]
    The descriptor <StillProfile> specifies hot regions or regions of interest within a frame. The frame is specified by the descriptor <Still> with an id attribute which corresponds to the frame-id. Within a frame, each hot region is specified by the descriptor <HotRegion> with an id attribute.
  • [0250]
    Event profile
  • [0251]
    <Event Profile>
  • [0252]
    <EventList> event-name . . . </EventList>
  • [0253]
    <Event name=″″>
  • [0254]
    <Www> web-page-url </Www>
  • [0255]
    <Occurrence id=″″>
  • [0256]
    <Duration> start-frame-id end-frame-id </Duration>
  • [0257]
    <Text> text-annotation </Text>
  • [0258]
    <Audio> voice-annotation </Audio>
  • [0259]
    </Occurrence>
  • [0260]
    <Occurrence id=″″>
  • [0261]
    <Duration> start-frame-id end-frame-id </Duration>
  • [0262]
    <Text> text-annotation </Text>
  • [0263]
    <Audio> voice-annotation </Audio>
  • [0264]
    </Occurrence> . . .
  • [0265]
    </Event>
  • [0266]
    <Event name=″″>
  • [0267]
    <Www> web-page-url </Www>
  • [0268]
    <Occurrence id=″″>
  • [0269]
    <Duration> start-frame-id end-frame-id </Duration>
  • [0270]
    <Text> text-annotation </Text>
  • [0271]
    <Audio> voice-annotation </Audio>
  • [0272]
    </Occurrence>
  • [0273]
    <Occurrence id=″″>
  • [0274]
    <Duration> start-frame-id end-frame-id </Duration>
  • [0275]
    <Text> text-annotation </Text>
  • [0276]
    <Audio> voice-annotation </Audio>
  • [0277]
    </Occurrence> . . .
  • [0278]
    </Event> . . .
  • [0279]
    </EventProfile>
  • [0280]
    The descriptor <EventProfile> specifies the detailed information for certain events in a program. Each event is specified by the descriptor <Event> with a name attribute. Each occurrence of an event is specified by the descriptor <Occurrence> with an id attribute which may be matched with a clip id under <EventView>.
  • [0281]
    Character profile
  • [0282]
    <CharacterProfile>
  • [0283]
    <CharacterList> character-name . . . </CharacterList>
  • [0284]
    <Character name=″″>
  • [0285]
    [0285]21 ActorName> actor-name </ActorName>
  • [0286]
    <Gender> male </Gender>
  • [0287]
    <Age> age </Age>
  • [0288]
    <Www> web-page-url </Www>
  • [0289]
    <Occurrence id=″″>
  • [0290]
    <Duration> start-frame-id end-frame-id </Duration>
  • [0291]
    <Location> frame: [x1 y1 x2 y2] . . . </Location>
  • [0292]
    <Motion> vxvyvzvαvβvγ </Motion>
  • [0293]
    <Text> text-annotation </Text>
  • [0294]
    <Audio> voice-annotation </Audio>
  • [0295]
    </Occurrence>
  • [0296]
    <Occurrence id=″″>
  • [0297]
    <Duration> start-frame-id end-frame-id </Duration>
  • [0298]
    <Location> frame: [x1 y1 x2 y2] . . . </Location>
  • [0299]
    <Motion> vxvyvzvαvβvγ </Motion>
  • [0300]
    <Text> text-annotation </Text>
  • [0301]
    <Audio> voice-annotation </Audio>
  • [0302]
    </Occurrence> . . .
  • [0303]
    </Character>
  • [0304]
    <Character name=″″>
  • [0305]
    <ActorName> actor-name </ActorName>
  • [0306]
    <Gender> male </Gender>
  • [0307]
    <Age> age </Age>
  • [0308]
    <Www> web-page-url </Www>
  • [0309]
    <Occurrence id=″″>
  • [0310]
    <Duration> start-frame-id end-frame-id </Duration>
  • [0311]
    <Location> frame: [x1 y1 x2 y2] . . . </Location>
  • [0312]
    <Motion> vxvyvzvαvβvγ </Motion>
  • [0313]
    <Text> text-annotation </Text>
  • [0314]
    <Audio> voice-annotation </Audio>
  • [0315]
    </Occurrence>
  • [0316]
    <Occurrence id=″″>
  • [0317]
    <Duration> start-frame-id end-frame-id </Duration>
  • [0318]
    <Location> frame: [x1 y1 x2 y2] . . . </Location>
  • [0319]
    <Motion> vxvyvzvαvβvγ </Motion>
  • [0320]
    <Text> text-annotation </Text>
  • [0321]
    <Audio> voice-annotation </Audio>
  • [0322]
    </Occurrence> . . .
  • [0323]
    </Character> . . .
  • [0324]
    </CharacterProfile>
  • [0325]
    The descriptor <CharacterProfile> specifies the detailed information for certain characters in a program. Each character is specified by the descriptor <Character> with a name attribute. Each occurrence of a character is specified by the descriptor <Occurrence> with an id attribute which may be matched with a clip id under <CloseUpView>.
  • [0326]
    Object profile
  • [0327]
    <ObjectProfile>
  • [0328]
    <ObjectList> object-name . . . </ObjectList>
  • [0329]
    <Object name=″″>
  • [0330]
    <Www> web-page-url </Www>
  • [0331]
    <Occurrence id=″″>
  • [0332]
    <Duration> start-frame-id end-frame-id </Duration>
  • [0333]
    <Location> frame: [x1 y1 x2 y2] . . . </Location>
  • [0334]
    <Motion> vxvyvzvαvβvγ </Motion>
  • [0335]
    <Text> text-annotation </Text>
  • [0336]
    <Audio> voice-annotation </Audio>
  • [0337]
    </Occurrence>
  • [0338]
    <Occurrence id=″″>
  • [0339]
    <Duration> start-frame-id end-frame-id </Duration>
  • [0340]
    <Location> frame: [x1 y1 x2 y2] . . . </Location>
  • [0341]
    <Motion> vxvyvzvαvβvγ </Motion>
  • [0342]
    <Text> text-annotation </Text>
  • [0343]
    <Audio> voice-annotation </Audio>
  • [0344]
    </Occurrence> . . .
  • [0345]
    </Object>
  • [0346]
    <Object name=″″>
  • [0347]
    <Www> web-page-url </Www>
  • [0348]
    <Occurrence id=″″>
  • [0349]
    <Duration> start-frame-id end-frame-id </Duration>
  • [0350]
    <Location> frame: [x1 y1 x2 y2] . . . </Location>
  • [0351]
    <Motion> vxvyvzvαvβvγ </Motion>
  • [0352]
    <Text> text-annotation </Text>
  • [0353]
    <Audio> voice-annotation </Audio>
  • [0354]
    </Occurrence>
  • [0355]
    <Occurrence id=″″>
  • [0356]
    <Duration> start-frame-id end-frame-id </Duration>
  • [0357]
    <Location> frame: [x1 y1 x2 y2] . . . </Location>
  • [0358]
    <Motion> vxvyvzvαvβvγ </Motion>
  • [0359]
    <Text> text-annotation </Text>
  • [0360]
    <Audio> voice-annotation </Audio>
  • [0361]
    </Occurrence> . . .
  • [0362]
    </Object> . . .
  • [0363]
    </ObjectProfile>
  • [0364]
    The descriptor <ObjectProfile> specifies the detailed information for certain objects in a program. Each object is specified by the descriptor <Object> with a name attribute. Each occurrence of a object is specified by the descriptor <Occurrence> with an id attribute which may be matched with a clip id under <CloseUpView>.
  • [0365]
    Color profile
  • [0366]
    <ColorProfile> . . .
  • [0367]
    </ColorProfile>
  • [0368]
    The descriptor <ColorProfile> specifies the detailed color information of a program. All MPEG-7 color descriptors may be placed under here.
  • [0369]
    Texture profile
  • [0370]
    <TextureProfile> . . .
  • [0371]
    </TextureProfile>
  • [0372]
    The descriptor <TextureProfile> specifies the detailed texture information of a program.
  • [0373]
    All MPEG-7 texture descriptors may be placed under here.
  • [0374]
    Shape profile
  • [0375]
    <ShapeProfile> . . .
  • [0376]
    </ShapeProfile>
  • [0377]
    The descriptor <ShapeProfile> specifies the detailed shape information of a program. All MPEG-7 shape descriptors may be placed under here.
  • [0378]
    Motion profile
  • [0379]
    <MotionProfile> . . .
  • [0380]
    </MotionProfile>
  • [0381]
    The descriptor <MotionProfile> specifies the detailed motion information of a program.
  • [0382]
    All MPEG-7 motion descriptors may be placed under here.
  • [0383]
    User Description Scheme
  • [0384]
    The proposed user description scheme includes three major sections for describing a user. The first section identifies the described user. The second section records a number of settings which may be preferred by the user. The third section records some statistics which may reflect certain usage patterns of the user. Therefore, the overall structure of the proposed description scheme is as follows:
  • [0385]
    <?XML version=“1.0”>
  • [0386]
    <!DOCTYPE MPEG-7 SYSTEM “mpeg-7.dtd”>
  • [0387]
    <UserIdentity>
  • [0388]
    <UserID> . . . </UserID>
  • [0389]
    <UserName> . . . </UserName>
  • [0390]
    </UserIdentity>
  • [0391]
    <UserPreferences>
  • [0392]
    <BrowsingPreferences> . . . </BrowsingPreferences>
  • [0393]
    <FilteringPreferences> . . . </FilteringPreferences>
  • [0394]
    <SearchPreferences> . . . </SearchPreferences>
  • [0395]
    <DevicePreferences> . . . </DevicePreferences>
  • [0396]
    </UserPreferences>
  • [0397]
    <UserHistory>
  • [0398]
    <BrowsingHistory> . . . </BrowsingHistory>
  • [0399]
    <FilteringHistory> . . . </FilteringHistory>
  • [0400]
    <SearchHistory> . . . </SearchHistory>
  • [0401]
    <DeviceHistory> . . . </DeviceHistory>
  • [0402]
    </UserHistory>
  • [0403]
    <UserDemographics>
  • [0404]
    <Age> . . . </Age>
  • [0405]
    <Gender> . . . </Gender>
  • [0406]
    <ZIP> . . . </ZIP>
  • [0407]
    </UserDemographics>
  • [0408]
    User Identity
  • [0409]
    User ID
  • [0410]
    <UserID> user-id </UserID>
  • [0411]
    The descriptor <UserID> contains a number or a string to identify a user.
  • [0412]
    User name
  • [0413]
    <UserName> user-name </UserName>
  • [0414]
    The descriptor <UserName> specifies the name of a user.
  • [0415]
    User Preferences
  • [0416]
    Browsing preferences
  • [0417]
    <BrowsingPreferences>
  • [0418]
    <Views>
  • [0419]
    <ViewCategory id=″″> view-id . . . </ViewCategory>
  • [0420]
    <ViewCategory id=″″>view-id . . . </ViewCategory> . . .
  • [0421]
    </Views>
  • [0422]
    <FrameFrequency> frequency . . . <FrameFrequency>
  • [0423]
    <ShotFrequency> frequency . . . <ShotFrequency>
  • [0424]
    <KeyFrameLevel> level-id . . .<KeyFrameLevel>
  • [0425]
    <HighlightLength> length . . .<HighlightLength> . . .
  • [0426]
    </BrowsingPreferences>
  • [0427]
    The descriptor <BrowsingPreferences> specifies the browsing preferences of a user. The user's preferred views are specified by the descriptor <Views>. For each category, the preferred views are specified by the descriptor <ViewCategory> with an id attribute which corresponds to the category id. The descriptor <FrameFrequency> specifies at what interval the frames should be displayed on a browsing slider under the frame view. The descriptor <ShotFrequency> specifies at what interval the shots should be displayed on a browsing slider under the shot view. The descriptor <KeyFrameLevel> specifies at what level the key frames should be displayed on a browsing slider under the key frame view. The descriptor <HighlightLength> specifies which version of the highlight should be shown under the highlight view.
  • [0428]
    Filtering preferences
  • [0429]
    <FilteringPreferences>
  • [0430]
    <Categories> category-name . . . </Categories>
  • [0431]
    <Channels> channel-number . . . </Channels>
  • [0432]
    <Ratings> rating-id . . . </Ratings>
  • [0433]
    <Shows> show-name . . . </Shows>
  • [0434]
    <Authors> author-name . . . </Authors>
  • [0435]
    <Producers> producer-name . . . </Producers>
  • [0436]
    <Directors> director-name . . . </Directors>
  • [0437]
    <Actors> actor-name . . . </Actors>
  • [0438]
    <Keywords> keyword . . . </Keywords>
  • [0439]
    <Titles> title-text . . . </Titles> . . .
  • [0440]
    </FilteringPreferences>
  • [0441]
    The descriptor <FilteringPreferences> specifies the filtering related preferences of a user.
  • [0442]
    Search preferences
  • [0443]
    <SearchPreferences>
  • [0444]
    <Categories> category-name . . . </Categories>
  • [0445]
    <Channels> channel-number . . . </Channels>
  • [0446]
    <Ratings> rating-id . . . </Ratings>
  • [0447]
    <Shows> show-name . . . </Shows>
  • [0448]
    <Authors> author-name . . . </Authors>
  • [0449]
    <Producers> producer-name . . . </Producers>
  • [0450]
    <Directors> director-name . . . </Directors>
  • [0451]
    <Actors> actor-name . . . </Actors>
  • [0452]
    <Keywords> keyword . . . </Keywords>
  • [0453]
    <Titles> title-text . . . </Titles> . . .
  • [0454]
    </SearchPreferences>
  • [0455]
    The descriptor <SearchPreferences> specifies the search related preferences of a user.
  • [0456]
    Device preferences
  • [0457]
    <DevicePreferences>
  • [0458]
    <Brightness> brightness-value </Brightness>
  • [0459]
    <Contrast> contrast-value </Contrast>
  • [0460]
    <Volume> volume-value </Volume>
  • [0461]
    </DevicePreferences>
  • [0462]
    The descriptor <DevicePreferences> specifies the device preferences of a user.
  • [0463]
    Usage History
  • [0464]
    Browsing history
  • [0465]
    <BrowsingHistory>
  • [0466]
    <Views>
  • [0467]
    <ViewCategory id=″″> view-id . . . </ViewCategory>
  • [0468]
    <ViewCategory id=″″> view-id . . . </ViewCategory> . . .
  • [0469]
    </Views>
  • [0470]
    <FrameFrequency> frequency . . . <FrameFrequency>
  • [0471]
    <ShotFrequency> frequency . . . <ShotFrequency>
  • [0472]
    <KeyFrameLevel> level-id . . . <KeyFrameLevel>
  • [0473]
    <HighlightLength> length . . . <HighlightLength> . . .
  • [0474]
    </BrowsingHistory>
  • [0475]
    The descriptor <BrowsingHistory> captures the history of a user's browsing related activities.
  • [0476]
    <Filtering history>
  • [0477]
    <FilteringHistory>
  • [0478]
    <Categories> category-name . . . </Categories>
  • [0479]
    <Channels> channel-number . . . </Channels>
  • [0480]
    <Ratings> rating-id . . . </Ratings>
  • [0481]
    <Shows> show-name . . . </Shows>
  • [0482]
    <Authors> author-name . . . </Authors>
  • [0483]
    <Producers> producer-name . . . </Producers>
  • [0484]
    <Directors> director-name . . . </Directors>
  • [0485]
    <Actors> actor-name . . . </Actors>
  • [0486]
    <Keywords> keyword . . . </Keywords>
  • [0487]
    <Titles> title-text . . . </Titles> . . .
  • [0488]
    </FilteringHistory>
  • [0489]
    The descriptor <FilteringHistory> captures the history of a user's filtering related activities.
  • [0490]
    Search history
  • [0491]
    <SearchHistory>
  • [0492]
    <Categories> category-name . . . </Categories>
  • [0493]
    <Channels> channel-number . . . </Channels>
  • [0494]
    <Ratings> rating-id . . . </Ratings>
  • [0495]
    <Shows> show-name . . . </Shows>
  • [0496]
    <Authors> author-name . . . </Authors>
  • [0497]
    <Producers> producer-name . . . </Producers>
  • [0498]
    <Directors> director-name . . . </Directors>
  • [0499]
    <Actors> actor-name . . . </Actors>
  • [0500]
    <Keywords> keyword . . . </Keywords>
  • [0501]
    <Titles> title-text . . . </Titles> . . .
  • [0502]
    </SearchHistory>
  • [0503]
    The descriptor <SearchHistory> captures the history of a user's search related activities.
  • [0504]
    Device history
  • [0505]
    <DeviceHistory>
  • [0506]
    <Brightness> brightness-value . . . </Brightness>
  • [0507]
    <Contrast> contrast-value . . . </Contrast>
  • [0508]
    <Volume> volume-value . . . </Volume>
  • [0509]
    </DeviceHistory>
  • [0510]
    The descriptor <DeviceHistory> captures the history of a user's device related activities.
  • [0511]
    User demographics
  • [0512]
    Age
  • [0513]
    <Age> age </Age>
  • [0514]
    The descriptor <Age> specifies the age of a user.
  • [0515]
    Gender
  • [0516]
    <Gender> . . . </Gender>
  • [0517]
    The descriptor <Gender> specifies the gender of a user.
  • [0518]
    ZIP code
  • [0519]
    <ZIP> . . . </ZIP>
  • [0520]
    The descriptor <ZIP> specifies the ZIP code of where a user lives.
  • [0521]
    System Description Scheme
  • [0522]
    The proposed system description scheme includes four major sections for describing a user.
  • [0523]
    The first section identifies the described system. The second section keeps a list of all known users. The third section keeps lists of available programs. The fourth section describes the capabilities of the system. Therefore, the overall structure of the proposed description scheme is as follows:
  • [0524]
    <?XML version=“1.0”>
  • [0525]
    <!DOCTYPE MPEG-7 SYSTEM “mpeg-7.dtd”>
  • [0526]
    <SystemIdentity>
  • [0527]
    <SystemID> . . . </SystemID>
  • [0528]
    <SystemName> . . . </SystemName>
  • [0529]
    <SystemSerialNumber> . . . </SystemSerialNumber>
  • [0530]
    </SystemIdentity>
  • [0531]
    <SystemUsers>
  • [0532]
    <Users> . . . </Users>
  • [0533]
    <SystemUsers>
  • [0534]
    <SystemPrograms>
  • [0535]
    <Categories> . . . </Categories>
  • [0536]
    <Channels> . . . </Channels>
  • [0537]
    <Programs> . . . </Programs>
  • [0538]
    </SystemPrograms>
  • [0539]
    <SystemCapabilities>
  • [0540]
    <Views> . . . </Views>
  • [0541]
    </SystemCapabilities>
  • [0542]
    System Identity
  • [0543]
    System ID
  • [0544]
    <SystemID> system-id </SystemID>
  • [0545]
    The descriptor <SystemID> contains a number or a string to identify a video system or device.
  • [0546]
    System name
  • [0547]
    <SystemName> system-name </SystemName>
  • [0548]
    The descriptor <SystemName> specifies the name of a video system or device.
  • [0549]
    System serial number
  • [0550]
    <SystemSerialNumber> system-serial-number </SystemSerialNumber>
  • [0551]
    The descriptor <SystemSerialNumber> specifies the serial number of a video system or device.
  • [0552]
    System Users
  • [0553]
    Users
  • [0554]
    <Users>
  • [0555]
    <User>
  • [0556]
    <UserID> user-id </UserID>
  • [0557]
    <UserName> user-name </UserName>
  • [0558]
    </User>
  • [0559]
    <User>
  • [0560]
    <UserID> user-id </UserID>
  • [0561]
    <UserName> user-name </UserName>
  • [0562]
    </User> . . .
  • [0563]
    </Users>
  • [0564]
    The descriptor <SystemUsers> lists a number of users who have registered on a video system or device. Each user is specified by the descriptor <User>. The descriptor <UserID> specifies a number or a string which should match with the number or string specified in <UserID> in one of the user description schemes.
  • [0565]
    Programs in the System
  • [0566]
    Categories
  • [0567]
    <Categories>
  • [0568]
    <Category>
  • [0569]
    <CategoryID> category-id </CategoryID>
  • [0570]
    <CategoryName> category-name </CategoryName>
  • [0571]
    <Subcategories> sub-category-id . . . </SubCategories>
  • [0572]
    </Category>
  • [0573]
    <Category>
  • [0574]
    <Category1D> category-id </CategoryID>
  • [0575]
    <CategoryName> category-name </CategoryName>
  • [0576]
    <SubCategories> sub-category-id . . . </SubCategories>
  • [0577]
    </Category> . . .
  • [0578]
    </Categories>
  • [0579]
    The descriptor <Categories> lists a number of categories which have been registered on a video system or device. Each category is specified by the descriptor <Category>. The major-sub relationship between categories is captured by the descriptor <SubCategories>.
  • [0580]
    Channels
  • [0581]
    <Channels>
  • [0582]
    <Channel>
  • [0583]
    <ChannelID> channel-id </ChannelID>
  • [0584]
    <ChannelName> channel-name </ChannelName>
  • [0585]
    <SubChannels> sub-channel-id . . . </SubChannels>
  • [0586]
    </Channel>
  • [0587]
    <Channel>
  • [0588]
    <ChannelID> channel-id </ChannelID>
  • [0589]
    <ChannelName> channel-name </ChannelName>
  • [0590]
    <SubChannels> sub-channel-id . . . </SubChannels>
  • [0591]
    </Channel> . . .
  • [0592]
    </Channels>
  • [0593]
    The descriptor <Channels> lists a number of channels which have been registered on a video system or device. Each channel is specified by the descriptor <Channel>. The major-sub relationship between channels is captured by the descriptor <SubChannels>.
  • [0594]
    Programs
  • [0595]
    <Programs>
  • [0596]
    <CategoryPrograms>
  • [0597]
    <CategoryID> category-id </CategoryID>
  • [0598]
    <Programs> program-id . . . </Programs>
  • [0599]
    </CategoryPrograms>
  • [0600]
    <CategoryPrograms>
  • [0601]
    <CategoryID> category-id </CategoryID>
  • [0602]
    <Programs> program-id . . . </Programs>
  • [0603]
    </CategoryPrograms> . . .
  • [0604]
    <ChannelPrograms>
  • [0605]
    <ChannelID> channel-id </ChannelID>
  • [0606]
    <Programs> program-id . . . </Programs>
  • [0607]
    </Channel Programs>
  • [0608]
    <ChannelPrograms>
  • [0609]
    <ChannelID> channel-id </ChannelID>
  • [0610]
    <Programs> program-id . . . </Programs>
  • [0611]
    </ChannelPrograms> . . .
  • [0612]
    </Programs>
  • [0613]
    The descriptor <Programs> lists programs who are available on a video system or device. The programs are grouped under corresponding categories or channels. Each group of programs are specified by the descriptor <CategoryPrograms> or <ChannelPrograms>. Each program id contained in the descriptor <Programs> should match with the number or string specified in <ProgramID> in one of the program description schemes.
  • [0614]
    System Capabilities
  • [0615]
    Views
  • [0616]
    <Views>
  • [0617]
    <View>
  • [0618]
    <ViewID> view-id </ViewID>
  • [0619]
    <ViewName> view-name </ViewName>
  • [0620]
    </View>
  • [0621]
    <View>
  • [0622]
    <ViewID> view-id </ViewID>
  • [0623]
    <ViewName> view-name </ViewName>
  • [0624]
    </view> . . .
  • [0625]
    </Views>
  • [0626]
    The descriptor <Views> lists views which are supported by a video system or device. Each view is specified by the descriptor <View>. The descriptor <ViewName> contains a string which should match with one of the following views used in the program description schemes: ThumbnailView, SlideView, FrameView, ShotView, KeyFrameView, HighlightView, EventView, and CloseUpView.
  • [0627]
    The present inventors came to the realization that the program description scheme may be further modified to provide additional capabilities. Referring to FIG. 13, the modified program description scheme 400 includes four separate types of information, namely, a syntactic structure description scheme 402, a semantic structure description scheme 404, a visualization description scheme 406, and a meta information description scheme 408. It is to be understood that in any particular system one or more of the description schemes may be included, as desired.
  • [0628]
    Referring to FIG. 14, the visualization description scheme 406 enables fast and effective browsing of video program (and audio programs) by allowing access to the necessary data, preferably in a one-step process. The visualization description scheme 406 provides for several different presentations of the video content (or audio), such as for example, a thumbnail view description scheme 410, a key frame view description scheme 412, a highlight view description scheme 414, an event view description scheme 416, a close-up view description scheme 418, and an alternative view description scheme 420. Other presentation techniques and description schemes may be added, as desired. The thumbnail view description scheme 410 preferably includes an image 422 or reference to an image representative of the video content and a time reference 424 to the video. The key frame view description scheme 412 preferably includes a level indicator 426 and a time reference 428. The level indicator 426 accommodates the presentation of a different number of key frames for the same video portion depending on the user's preference. The highlight view description scheme 414 includes a length indicator 430 and a time reference 432. The length indicator 430 accommodates the presentation of a different highlight duration of a video depending on the user's preference. The event view description scheme 416 preferably includes an event indicator 434 for the selection of the desired event and a time reference 436. The close-up view description scheme 418 preferably includes a target indicator 438 and a time reference 440. The alternate view description scheme preferably includes a source indicator 442. To increase performance of the system it is preferred to specify the data which is needed to render such views in a centralized and straightforward manner. By doing so, it is then feasible to access the data in a simple one-step process without complex parsing of the video.
  • [0629]
    Referring to FIG. 15, the meta information description scheme 408 generally includes various descriptors which carry general information about a video (or audio) program such as the title, category, keywords, etc. Additional descriptors, such as those previously described, may be included, as desired.
  • [0630]
    Referring again to FIG. 13, the syntactic structure description scheme 402 specifies the physical structure of a video program (or audio), e.g., a table of contents. The physical features, may include for example, color, texture, motion, etc. The syntactic structure description scheme 402 preferably includes three modules, namely a segment description scheme 450, a region description scheme 452, and a segment/region relation graph description scheme 454. The segment description scheme 450 may be used to define relationships between different portions of the video consisting of multiple frames of the video. A segment description scheme 450 may contain another segment description scheme 450 and/or shot description scheme to form a segment tree. Such a segment tree may be used to define a temporal structure of a video program. Multiple segment trees may be created and thereby create multiple table of contents. For example, a video program may be segmented into story units, scenes, and shots, from which the segment description scheme 450 may contain such information as a table of contents. The shot description scheme may contain a number of key frame description schemes, a mosaic description scheme(s), a camera motion description scheme(s), etc. The key frame description scheme may contain a still image description scheme which may in turn contains color and texture descriptors. It is noted that various low level descriptors may be included in the still image description scheme under the segment description scheme. Also, the visual descriptors may be included in the region description scheme which is not necessarily under a still image description scheme. On example of a segment description scheme 450 is shown in FIG. 16.
  • [0631]
    Referring to FIG. 17, the region description scheme 452 defines the interrelationships between groups of pixels of the same and/or different frames of the video. The region description scheme 452 may also contain geometrical features, color, texture features, motion features, etc.
  • [0632]
    Referring to FIG. 18, the segment/region relation graph description scheme 454 defines the interrelationships between a plurality of regions (or region description schemes), a plurality of segments (or segment description schemes), and/or a plurality of regions (or description schemes) and segments (or description schemes).
  • [0633]
    Referring again to FIG. 13, the semantic structure description scheme 404 is used to specify semantic features of a video program (or audio), e.g. semantic events. In a similar manner to the syntactic structure description scheme, the semantic structure description scheme 404 preferably includes three modules, namely an event description scheme 480, an object description scheme 482, and an event/objection relation graph description scheme 484. The event description scheme 480 may be used to form relationships between different events of the video normally consisting of multiple frames of the video. An event description scheme 480 may contain another event description scheme 480 to form a segment tree. Such an event segment tree may be used to define a semantic index table for a video program. Multiple event trees may be created and thereby creating multiple index tables. For example, a video program may include multiple events, such as a basketball dunk, a fast break, and a free throw, and the event description scheme may contain such information as an index table. The event description scheme may also contain references which link the event to the corresponding segments and/or regions specified in the syntactic structure description scheme. On example of an event description scheme is shown in FIG. 19.
  • [0634]
    Referring to FIG. 20, the object description scheme 482 defines the interrelationships between groups of pixels of the same and/or different frames of the video representative of objects. The object description scheme 482 may contain another object description scheme and thereby form an object tree. Such an object tree may be used to define an object index table for a video program. The object description scheme may also contain references which link the object to the corresponding segments and/or regions specified in the syntactic structure description scheme.
  • [0635]
    Referring to FIG. 21, the event/object relation graph description scheme 484 defines the interrelationships between a plurality of events (or event description schemes), a plurality of objects (or object description schemes), and/or a plurality of events (or description schemes) and objects (or description schemes).
  • [0636]
    The terms and expressions that have been employed in the foregoing specification are sued as terms of description and not of limitation, and there is no intention, in the use of such terms and expressions, of excluding equivalents of the features shown and described or portions thereof, it being recognized that the scope of the invention is defined and limited only by the claims that follow.

Claims (20)

    What is claimed is:
  1. 1. A method of using a system with at least one of audio, image, and a video comprising a plurality of frames comprising the steps of:
    (a) providing at least two of the following:
    (i) a program description scheme containing information related to at least one of information regarding interrelationships between a plurality of said frames, characteristics of the content of a plurality of said frames, characteristics of the content of said audio, characteristics of the content of said image, characteristics of the content of said video;
    (ii) a user description scheme containing information related to at least one of a user's personal preferences, information related to said user, a user's viewing history, and a user's listening history;
    (iii) a system description scheme containing information regarding at least one of available videos, available categories, available channels, available users, available images, capabilities of a device for providing said at least one of said audio, said image, and said video to a user, relationship between at least two of said video, said program description scheme, and said user description scheme, relationship between at least two of said audio, said program description scheme, and said user description scheme, relationship between at least two of said image, said program description scheme, and said user description scheme; and
    (b) selecting at least one of a video, an image, and audio based upon said at least two of said program description scheme, said user description scheme, and said system description scheme.
  2. 2. The method of
    claim 1
    wherein said program description scheme contains information related to said interrelationships of said plurality of said frames.
  3. 3. The method of
    claim 2
    wherein said interrelationships include the identification of key frames of said video.
  4. 4. The method of
    claim 2
    wherein said interrelationships include the identification of a plurality of said frames representative of the highlights of at least a portion of said video.
  5. 5. The method of
    claim 2
    wherein said interrelationships include the identification of a set of frames, each of which is representative of a different portion of said video.
  6. 6. The method of
    claim 5
    wherein said different portion of said video is non-overlapping.
  7. 7. The method of
    claim 2
    wherein said interrelationships include the identification of a plurality of sequential frames of said video that represent at least one of a shot and a scene.
  8. 8. The method of
    claim 7
    wherein said identification further includes a plurality of said at least one of said shot and said scene.
  9. 9. The method of
    claim 4
    wherein said interrelationships includes a plurality of highlights of the same portion of said video having different durations.
  10. 10. The method of
    claim 3
    wherein said interrelationships includes a plurality of key frames of the same portion of said video having a different number of frames of said portion of said video.
  11. 11. The method of
    claim 1
    wherein said program description scheme contains characteristics of said content of said plurality of said frames.
  12. 12. The method of
    claim 11
    wherein said characteristics include at least one of an actor within said video, and a classification of the genre of said video.
  13. 13. The method of
    claim 11
    wherein said characteristics include at least one of a color profile of at least a portion of said video, a texture profile of at least a portion of said video, a shape profile of at least a portion of said video, and a motion profile of at least a portion of said video.
  14. 14. The method of
    claim 1
    wherein said program description scheme identifies a portion of each of a plurality of said frames of said video that is to be presented to a user at a size larger than it would have been presented within said video.
  15. 15. The method of
    claim 1
    wherein said program description scheme identifies a second video segment separate from said video that includes a close up view of a portion of said video.
  16. 16. The method of
    claim 1
    wherein said program description scheme identifies a second audio track separate from the normal audio track of said video.
  17. 17. The method of
    claim 1
    wherein said program description scheme includes textual annotation related to said video.
  18. 18. The method of
    claim 17
    wherein said textual annotation is related to an object within said video.
  19. 19. The method of
    claim 18
    wherein said object is an actor within said video.
  20. 20. The method of
    claim 1
    wherein said program description scheme identifies Internet based information related to said video.
US09804612 1999-02-01 2001-03-12 Audiovisual information management system Abandoned US20010010523A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US11819199 true 1999-02-01 1999-02-01
US12412599 true 1999-03-12 1999-03-12
US09299811 US6236395B1 (en) 1999-02-01 1999-04-26 Audiovisual information management system
US09804612 US20010010523A1 (en) 1999-02-01 2001-03-12 Audiovisual information management system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US09804612 US20010010523A1 (en) 1999-02-01 2001-03-12 Audiovisual information management system

Publications (1)

Publication Number Publication Date
US20010010523A1 true true US20010010523A1 (en) 2001-08-02

Family

ID=27382114

Family Applications (2)

Application Number Title Priority Date Filing Date
US09299811 Active US6236395B1 (en) 1999-02-01 1999-04-26 Audiovisual information management system
US09804612 Abandoned US20010010523A1 (en) 1999-02-01 2001-03-12 Audiovisual information management system

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US09299811 Active US6236395B1 (en) 1999-02-01 1999-04-26 Audiovisual information management system

Country Status (4)

Country Link
US (2) US6236395B1 (en)
EP (1) EP1026887B1 (en)
JP (3) JP2005025776A (en)
DE (2) DE60021443D1 (en)

Cited By (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020156860A1 (en) * 2000-02-25 2002-10-24 Finke Alan D. Personal server system
US20030120667A1 (en) * 2001-12-20 2003-06-26 Yeon Jeong Jeong Apparatus for processing method-embedded content and method thereof
US20030140313A1 (en) * 1999-04-26 2003-07-24 Smith Kim C. Method of creating default lists of content of probable interest
US20030182627A1 (en) * 2002-03-09 2003-09-25 Samsung Electronics Co., Ltd. Reproducing method and apparatus for interactive mode using markup documents
US20040028382A1 (en) * 2002-08-08 2004-02-12 Choi Hye-Jin Video recording/reproducing apparatus and program list displaying method thereof
US6697523B1 (en) * 2000-08-09 2004-02-24 Mitsubishi Electric Research Laboratories, Inc. Method for summarizing a video using motion and color descriptors
US20040128402A1 (en) * 2000-09-27 2004-07-01 Weaver David John Architecture for optimizing audio and video output states for multimeda devices
US20040194612A1 (en) * 2003-04-04 2004-10-07 International Business Machines Corporation Method, system and program product for automatically categorizing computer audio files
US20060090183A1 (en) * 2004-10-26 2006-04-27 David Zito Method and apparatus for a search-enabled remote control device
US20060140223A1 (en) * 2004-12-06 2006-06-29 Lee Jung M Method and apparatus for establishing environment of digital device using portable memory
US20070140662A1 (en) * 2005-11-08 2007-06-21 Takashi Nunomaki Information processing apparatus, imaging device, information processing method, and computer program
US20070204238A1 (en) * 2006-02-27 2007-08-30 Microsoft Corporation Smart Video Presentation
US20070230485A1 (en) * 2006-03-30 2007-10-04 Fujitsu Limited Service providing method, computer-readable recording medium containing service providing program, and service providing apparatus
US20070300265A1 (en) * 2006-06-21 2007-12-27 Nokia Corporation User behavior adapted electronic service guide update
EP1909495A2 (en) * 2006-10-03 2008-04-09 Sony Corporation Program information retrieval system and method
US20080235586A1 (en) * 2007-03-19 2008-09-25 Hung-Te Chou Method and related system for multiple displays
US20090100462A1 (en) * 2006-03-10 2009-04-16 Woon Ki Park Video browsing based on thumbnail image
US20100083113A1 (en) * 2008-09-26 2010-04-01 Thomson Licensing Inc. Architecture For Optimizing Audio and Video Output States for Multimedia Devices
US7725829B1 (en) 2002-01-23 2010-05-25 Microsoft Corporation Media authoring and presentation
US7974714B2 (en) 1999-10-05 2011-07-05 Steven Mark Hoffberg Intelligent electronic appliance system and method
US8046313B2 (en) 1991-12-23 2011-10-25 Hoffberg Steven M Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
US20120206606A1 (en) * 2000-03-14 2012-08-16 Joseph Robert Marchese Digital video system using networked cameras
US20130086611A1 (en) * 2011-09-29 2013-04-04 Infosys Limited Dynamic header in an interactive application on television
EP2560380A4 (en) * 2010-11-24 2015-05-20 Jvc Kenwood Corp Chapter creation device, chapter creation method, and chapter creation program
US9166883B2 (en) 2006-04-05 2015-10-20 Joseph Robert Marchese Network device detection, identification, and management
USRE46310E1 (en) 1991-12-23 2017-02-14 Blanding Hovenweep, Llc Ergonomic man-machine interface incorporating adaptive pattern recognition based control system

Families Citing this family (329)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0872120A1 (en) 1995-03-07 1998-10-21 Interval Research Corporation System and method for selective recording of information
US20040255336A1 (en) * 1999-03-30 2004-12-16 Gotuit Video, Inc. Methods and apparatus for simultaneous program viewing
US20030093790A1 (en) 2000-03-28 2003-05-15 Logan James D. Audio and video program recording, editing and playback systems using metadata
US6263507B1 (en) 1996-12-05 2001-07-17 Interval Research Corporation Browser for use in navigating a body of information, with particular application to browsing information represented by audiovisual data
US5893062A (en) 1996-12-05 1999-04-06 Interval Research Corporation Variable rate video playback with synchronized audio
US6735253B1 (en) 1997-05-16 2004-05-11 The Trustees Of Columbia University In The City Of New York Methods and architecture for indexing and editing compressed video over the world wide web
US6360234B2 (en) 1997-08-14 2002-03-19 Virage, Inc. Video cataloger system with synchronized encoders
US6819863B2 (en) * 1998-01-13 2004-11-16 Koninklijke Philips Electronics N.V. System and method for locating program boundaries and commercial boundaries using audio categories
US8352984B2 (en) 1998-06-12 2013-01-08 Thomson Licensing System and method for generating and managing user preference information for scheduled and stored television programs
US7146627B1 (en) 1998-06-12 2006-12-05 Metabyte Networks, Inc. Method and apparatus for delivery of targeted video programming
US6614987B1 (en) * 1998-06-12 2003-09-02 Metabyte, Inc. Television program recording with user preference determination
CN1867068A (en) 1998-07-14 2006-11-22 联合视频制品公司 Client-server based interactive television program guide system with remote server recording
US6833865B1 (en) * 1998-09-01 2004-12-21 Virage, Inc. Embedded metadata engines in digital capture devices
US6694482B1 (en) * 1998-09-11 2004-02-17 Sbc Technology Resources, Inc. System and methods for an architectural framework for design of an adaptive, personalized, interactive content delivery system
US7143434B1 (en) * 1998-11-06 2006-11-28 Seungyup Paek Video description system and method
US6320623B1 (en) * 1998-11-13 2001-11-20 Philips Electronics North America Corporation Method and device for detecting an event in a program of a video and/ or audio signal and for providing the program to a display upon detection of the event
US6859799B1 (en) 1998-11-30 2005-02-22 Gemstar Development Corporation Search engine for video and graphics
US6602297B1 (en) * 1998-12-05 2003-08-05 Lg Electronics Inc. Motional video browsing data structure and browsing method therefor
US7209942B1 (en) * 1998-12-28 2007-04-24 Kabushiki Kaisha Toshiba Information providing method and apparatus, and information reception apparatus
US6584496B1 (en) * 1999-01-29 2003-06-24 Sony Corporation Distributed help system for consumer electronic devices
DE60045699D1 (en) * 1999-01-29 2011-04-21 Sony Corp Data Description procedures and data-processing apparatus
US7185049B1 (en) * 1999-02-01 2007-02-27 At&T Corp. Multimedia integration description scheme, method and system for MPEG-7
WO2000048397A1 (en) * 1999-02-15 2000-08-17 Sony Corporation Signal processing method and video/audio processing device
WO2000055962A3 (en) 1999-03-15 2001-06-21 Sony Electronics Inc Electronic media system, method and device
US6993789B1 (en) * 1999-04-23 2006-01-31 Sharp Laboratories Of America DTV data service application and receiver mechanism
JP4378576B2 (en) * 1999-05-18 2009-12-09 ソニー株式会社 Reception apparatus and method, the supply apparatus and method, two-way communication system and method, and recording medium
US7224790B1 (en) * 1999-05-27 2007-05-29 Sbc Technology Resources, Inc. Method to identify and categorize customer's goals and behaviors within a customer service center environment
US7086007B1 (en) * 1999-05-27 2006-08-01 Sbc Technology Resources, Inc. Method for integrating user models to interface design
US6954217B1 (en) * 1999-07-02 2005-10-11 Pentax Corporation Image processing computer system for photogrammetric analytical measurement
US6847980B1 (en) * 1999-07-03 2005-01-25 Ana B. Benitez Fundamental entity-relationship models for the generic audio visual data signal description
US7313808B1 (en) * 1999-07-08 2007-12-25 Microsoft Corporation Browsing continuous multimedia content
US7293280B1 (en) 1999-07-08 2007-11-06 Microsoft Corporation Skimming continuous multimedia content
US8464302B1 (en) * 1999-08-03 2013-06-11 Videoshare, Llc Method and system for sharing video with advertisements over a network
US6615248B1 (en) * 1999-08-16 2003-09-02 Pitney Bowes Inc. Method and system for presenting content selection options
US6633859B1 (en) * 1999-08-17 2003-10-14 Authoria, Inc. Knowledge system with distinct presentation and model structure
US6513006B2 (en) * 1999-08-26 2003-01-28 Matsushita Electronic Industrial Co., Ltd. Automatic control of household activity using speech recognition and natural language
KR100370247B1 (en) * 1999-08-26 2003-01-29 엘지전자 주식회사 Video browser based on character relation
US7383504B1 (en) * 1999-08-30 2008-06-03 Mitsubishi Electric Research Laboratories Method for representing and comparing multimedia content according to rank
US7996878B1 (en) * 1999-08-31 2011-08-09 At&T Intellectual Property Ii, L.P. System and method for generating coded video sequences from still media
GB9921234D0 (en) * 1999-09-08 1999-11-10 Sony Uk Ltd A system and method for editing source content to produce an edited content sequence
US7509580B2 (en) * 1999-09-16 2009-03-24 Sharp Laboratories Of America, Inc. Audiovisual information management system with preferences descriptions
KR100350792B1 (en) * 1999-09-22 2002-09-09 엘지전자 주식회사 Multimedia data browsing system based on user profile
KR100304482B1 (en) * 1999-09-22 2001-11-02 구자홍 Method and apparatus for user adaptive information presentation using multiple hierarchical preference information structure and the data structure of multiple hierarchical preference information
US7339993B1 (en) * 1999-10-01 2008-03-04 Vidiator Enterprises Inc. Methods for transforming streaming video data
US7143432B1 (en) 1999-10-01 2006-11-28 Vidiator Enterprises Inc. System for transforming streaming video data
US7114174B1 (en) 1999-10-01 2006-09-26 Vidiator Enterprises Inc. Computer program product for transforming streaming video data
US7155735B1 (en) 1999-10-08 2006-12-26 Vulcan Patents Llc System and method for the broadcast dissemination of time-ordered data
US7181757B1 (en) * 1999-10-11 2007-02-20 Electronics And Telecommunications Research Institute Video summary description scheme and method and system of video summary description data generation for efficient overview and browsing
US6675158B1 (en) * 1999-11-30 2004-01-06 Sony Corporation Method and apparatus for organizing data pertaining to audiovisual content
US6845487B1 (en) * 1999-11-30 2005-01-18 Sony Corporation Method and an apparatus for implementing a key frame
JP2001160940A (en) * 1999-12-01 2001-06-12 Sony Corp Broadcast system and receiver
US8051446B1 (en) * 1999-12-06 2011-11-01 Sharp Laboratories Of America, Inc. Method of creating a semantic video summary using information from secondary sources
US7212972B2 (en) * 1999-12-08 2007-05-01 Ddi Corporation Audio features description method and audio video features description collection construction method
US7340457B1 (en) * 1999-12-16 2008-03-04 Texas Instruments Incorporated Apparatus and method to facilitate the customization of television content with supplemental data
US6727914B1 (en) * 1999-12-17 2004-04-27 Koninklijke Philips Electronics N.V. Method and apparatus for recommending television programming using decision trees
JP2001184842A (en) * 1999-12-28 2001-07-06 Hitachi Ltd Information reproducing device
CN1161984C (en) * 2000-01-10 2004-08-11 Lg电子株式会社 Method and system for synchronizing video index between audio-frequency/video-frequency signals and datas
US20010049826A1 (en) * 2000-01-19 2001-12-06 Itzhak Wilf Method of searching video channels by content
US7032237B2 (en) * 2000-01-19 2006-04-18 Sony Corporation Data communication system and receiving apparatus to be used for such system
US6757682B1 (en) 2000-01-28 2004-06-29 Interval Research Corporation Alerting users to items of current interest
US7073128B2 (en) * 2000-01-31 2006-07-04 Canon Kabushiki Kaisha Video browser data magnifier
US6574279B1 (en) * 2000-02-02 2003-06-03 Mitsubishi Electric Research Laboratories, Inc. Video transcoding using syntactic and semantic clues
US7788686B1 (en) * 2000-03-01 2010-08-31 Andrews Christopher C Method of and apparatus for describing, promoting, publishing, aggregating, distributing and accessing live content information
WO2001069445A3 (en) * 2000-03-14 2004-01-08 Sony Electronics Inc A method and device for forming a semantic description
US7284064B1 (en) 2000-03-21 2007-10-16 Intel Corporation Method and apparatus to determine broadcast content and scheduling in a broadcast system
US20020056102A1 (en) * 2000-03-23 2002-05-09 Hughes Electronics Corporation Personal video on-demand system and method
US20070127887A1 (en) * 2000-03-23 2007-06-07 Adrian Yap Digital video recorder enhanced features
US8312490B2 (en) 2000-03-23 2012-11-13 The Directv Group, Inc. DVR with enhanced functionality
US20070300258A1 (en) * 2001-01-29 2007-12-27 O'connor Daniel Methods and systems for providing media assets over a network
US7222163B1 (en) * 2000-04-07 2007-05-22 Virage, Inc. System and method for hosting of video content over a network
JP3810268B2 (en) * 2000-04-07 2006-08-16 シャープ株式会社 Audio-visual system
US8171509B1 (en) 2000-04-07 2012-05-01 Virage, Inc. System and method for applying a database to video multimedia
US7260564B1 (en) * 2000-04-07 2007-08-21 Virage, Inc. Network video guide and spidering
US7962948B1 (en) * 2000-04-07 2011-06-14 Virage, Inc. Video-enabled community building
JP4587416B2 (en) * 2000-04-25 2010-11-24 富士通株式会社 Digital video content viewing apparatus and method
US6678737B1 (en) * 2000-04-28 2004-01-13 Webtv Networks, Inc. Home network appliance and method
JP4730571B2 (en) * 2000-05-01 2011-07-20 ソニー株式会社 The information processing apparatus and method, and program storage medium
JP4431918B2 (en) * 2000-05-01 2010-03-17 ソニー株式会社 The information processing apparatus, information processing method, and recording medium
JP4487383B2 (en) 2000-05-01 2010-06-23 ソニー株式会社 The information processing apparatus and method, and program storage medium
US6993626B2 (en) * 2000-05-01 2006-01-31 Sony Corporation Apparatus and method for processing information, and program and medium used therefor
US6968366B1 (en) * 2000-05-12 2005-11-22 International Business Machines Corporation System and method for management, creation, storage, search and delivery of rich media optimized for e-commerce in a distributed information network
US6829781B1 (en) * 2000-05-24 2004-12-07 At&T Corp. Network-based service to provide on-demand video summaries of television programs
US7013477B2 (en) * 2000-05-25 2006-03-14 Fujitsu Limited Broadcast receiver, broadcast control method, and computer readable recording medium
US8028314B1 (en) 2000-05-26 2011-09-27 Sharp Laboratories Of America, Inc. Audiovisual information management system
JP3865194B2 (en) * 2000-05-26 2007-01-10 Kddi株式会社 How to write and browsing method of summary information of the audio / video
US6701014B1 (en) * 2000-06-14 2004-03-02 International Business Machines Corporation Method and apparatus for matching slides in video
FR2810832B1 (en) * 2000-06-27 2006-06-16 Interactif Delta Production Interactive digital television network
US7647340B2 (en) 2000-06-28 2010-01-12 Sharp Laboratories Of America, Inc. Metadata in JPEG 2000 file format
US8087051B2 (en) * 2000-06-30 2011-12-27 Thomson Licensing Database management system and method for electronic program guide and television channel lineup organization
US8302127B2 (en) * 2000-09-25 2012-10-30 Thomson Licensing System and method for personalized TV
US6763069B1 (en) * 2000-07-06 2004-07-13 Mitsubishi Electric Research Laboratories, Inc Extraction of high-level features from low-level features of multimedia content
US7571244B2 (en) * 2000-07-15 2009-08-04 Filippo Costanzo Audio-video data switching and viewing system
EP1174879A3 (en) 2000-07-21 2004-10-27 Sony Corporation Information signal processing apparatus, information signal processing method, and information signal recording apparatus
US20050193408A1 (en) * 2000-07-24 2005-09-01 Vivcom, Inc. Generating, transporting, processing, storing and presenting segmentation information for audio-visual programs
JP2002044555A (en) * 2000-07-28 2002-02-08 Sony Corp Information display controller and its method
US8191103B2 (en) 2000-08-30 2012-05-29 Sony Corporation Real-time bookmarking of streaming media assets
US6748375B1 (en) * 2000-09-07 2004-06-08 Microsoft Corporation System and method for content retrieval
US8020183B2 (en) 2000-09-14 2011-09-13 Sharp Laboratories Of America, Inc. Audiovisual management system
US7103906B1 (en) 2000-09-29 2006-09-05 International Business Machines Corporation User controlled multi-device media-on-demand system
WO2002031701A9 (en) 2000-10-11 2004-05-06 United Video Properties Inc Systems and methods for providing storage of data on servers in an on-demand media delivery system
CN1401188B (en) * 2000-10-17 2011-06-08 皇家菲利浦电子有限公司 Binary format for MPEG-7 instances
US7398275B2 (en) * 2000-10-20 2008-07-08 Sony Corporation Efficient binary coding scheme for multimedia content descriptions
US7206853B2 (en) * 2000-10-23 2007-04-17 Sony Corporation content abstraction layer for use in home network applications
US7890989B1 (en) * 2000-10-24 2011-02-15 Sony Corporation Automated context-sensitive updating on content in an audiovisual storage system
US6973256B1 (en) * 2000-10-30 2005-12-06 Koninklijke Philips Electronics N.V. System and method for detecting highlights in a video program using audio properties
FR2816156B1 (en) * 2000-10-31 2003-01-10 Thomson Multimedia Sa A method of detecting an idling sequence in an audio-visual transmission and apparatus embodying the METHOD
FR2816157A1 (en) * 2000-10-31 2002-05-03 Thomson Multimedia Sa Method for processing video data distinees for viewing on screen and device embodying the METHOD
US6931595B2 (en) * 2000-11-02 2005-08-16 Sharp Laboratories Of America, Inc. Method for automatic extraction of semantically significant events from video
WO2002039245A3 (en) * 2000-11-09 2005-02-03 Change Tools Inc A user definable interface system, method and computer program product
US7444660B2 (en) * 2000-11-16 2008-10-28 Meevee, Inc. System and method for generating metadata for video programming events
EP1346559A4 (en) * 2000-11-16 2006-02-01 Mydtv Inc System and methods for determining the desirability of video programming events
US20020083468A1 (en) * 2000-11-16 2002-06-27 Dudkiewicz Gil Gavriel System and method for generating metadata for segments of a video program
US20020100046A1 (en) * 2000-11-16 2002-07-25 Dudkiewicz Gil Gavriel System and method for determining the desirability of video programming events
US7127736B2 (en) * 2000-11-17 2006-10-24 Sony Corporation Content processing apparatus and content processing method for digest information based on input of a content user
US7020888B2 (en) * 2000-11-27 2006-03-28 Intellocity Usa, Inc. System and method for providing an omnimedia package
WO2002048920A3 (en) * 2000-12-12 2003-09-04 Time Warner Entertainm Co Lp Digital asset data type definitions
US6964061B2 (en) * 2000-12-28 2005-11-08 International Business Machines Corporation Squeezable rebroadcast files
US6903655B2 (en) * 2000-12-29 2005-06-07 Bellsouth Intellectual Property Corp. Remote control device with illumination
US7653926B2 (en) * 2000-12-29 2010-01-26 At&T Intellectual Property I, L.P. Remote control device with event notifier
US6946970B2 (en) * 2000-12-29 2005-09-20 Bellsouth Intellectual Property Corp. Remote control device with smart card capability
US20020100045A1 (en) * 2001-01-23 2002-07-25 Rafey Richter A. System and method for enabling anonymous personalization
US20020101454A1 (en) * 2001-01-30 2002-08-01 Hong Marcus Suhwa Pre-audition CD
US20030038796A1 (en) * 2001-02-15 2003-02-27 Van Beek Petrus J.L. Segmentation metadata for audio-visual content
US20020120929A1 (en) * 2001-02-28 2002-08-29 Schwalb Eddie M. Method and system for mass customization of digital television broadcasts
US7689901B2 (en) * 2001-03-01 2010-03-30 Sony Corporation Multiple updates to content descriptions using a single command
US7240285B2 (en) * 2001-03-01 2007-07-03 Sony Corporation Encoding and distribution of schema for multimedia content descriptions
US20020166123A1 (en) * 2001-03-02 2002-11-07 Microsoft Corporation Enhanced television services for digital video recording and playback
US20020133821A1 (en) * 2001-03-08 2002-09-19 Koninklijke Philips Electronics N.V. Activity schedule controls personalized electronic content guide
JP4191932B2 (en) * 2001-03-08 2008-12-03 パナソニック株式会社 Media delivery device and a media delivery method
EP1241587A1 (en) * 2001-03-12 2002-09-18 THOMSON multimedia Method for processing content data
US7248778B1 (en) 2001-03-16 2007-07-24 Gateway Inc. Automated video editing system and method
US20020140805A1 (en) * 2001-03-28 2002-10-03 Koninklijke Philips Electronics N.V. Television program selection system
US8290351B2 (en) 2001-04-03 2012-10-16 Prime Research Alliance E., Inc. Alternative advertising in prerecorded media
US20020178447A1 (en) * 2001-04-03 2002-11-28 Plotnick Michael A. Behavioral targeted advertising
US20020184047A1 (en) * 2001-04-03 2002-12-05 Plotnick Michael A. Universal ad queue
US20030163815A1 (en) * 2001-04-06 2003-08-28 Lee Begeja Method and system for personalized multimedia delivery service
US8060906B2 (en) * 2001-04-06 2011-11-15 At&T Intellectual Property Ii, L.P. Method and apparatus for interactively retrieving content related to previous query results
US20030088687A1 (en) * 2001-12-28 2003-05-08 Lee Begeja Method and apparatus for automatically converting source video into electronic mail messages
US7904814B2 (en) 2001-04-19 2011-03-08 Sharp Laboratories Of America, Inc. System for presenting audio-video content
US7930624B2 (en) * 2001-04-20 2011-04-19 Avid Technology, Inc. Editing time-based media with enhanced content
US7110458B2 (en) * 2001-04-27 2006-09-19 Mitsubishi Electric Research Laboratories, Inc. Method for summarizing a video using motion descriptors
US20020162101A1 (en) * 2001-04-27 2002-10-31 Koninklijke Philips Electronics N.V. Method of and apparatus for enabling recommendations to be made to users of entertainment receivers
US7305691B2 (en) * 2001-05-07 2007-12-04 Actv, Inc. System and method for providing targeted programming outside of the home
CA2386303C (en) 2001-05-14 2005-07-05 At&T Corp. Method for content-based non-linear control of multimedia playback
US20020174445A1 (en) * 2001-05-17 2002-11-21 Koninklijke Philips Electronics N.V. Video playback device with real-time on-line viewer feedback capability and method of operation
US7734997B2 (en) * 2001-05-29 2010-06-08 Sony Corporation Transport hint table for synchronizing delivery time between multimedia content and multimedia content descriptions
US7143354B2 (en) 2001-06-04 2006-11-28 Sharp Laboratories Of America, Inc. Summarization of baseball video content
US7499077B2 (en) * 2001-06-04 2009-03-03 Sharp Laboratories Of America, Inc. Summarization of football video content
US7716704B2 (en) * 2001-06-12 2010-05-11 Thomson Licensing Television program selection apparatus and method
US7380262B2 (en) * 2001-06-12 2008-05-27 Thomson Licensing Method and apparatus for generating a list of suggested scheduled television programs
US6918132B2 (en) * 2001-06-14 2005-07-12 Hewlett-Packard Development Company, L.P. Dynamic interface method and system for displaying reduced-scale broadcasts
DE10129446A1 (en) * 2001-06-19 2003-01-02 Bosch Gmbh Robert Method of initializing a distributed software architecture and electronic system
US8818871B2 (en) * 2001-06-21 2014-08-26 Thomson Licensing Method and system for electronic purchases using an intelligent data carrier medium, electronic coupon system, and interactive TV infrastructure
JP3952302B2 (en) * 2001-06-22 2007-08-01 ノキア コーポレイション Digital video recording automatic indexing system
US20030004934A1 (en) * 2001-06-29 2003-01-02 Richard Qian Creating and managing portable user preferences for personalizion of media consumption from device to device
US20030005466A1 (en) * 2001-06-29 2003-01-02 Hsinchao Liao Content personalization system for mobile users
US20030005431A1 (en) * 2001-07-02 2003-01-02 Sony Corporation PVR-based system and method for TV content control using voice recognition
US20030009371A1 (en) * 2001-07-03 2003-01-09 Ravi Gauba Interactive decision-making scenarios in an audio/video broadcast
US7574723B2 (en) * 2001-07-19 2009-08-11 Macrovision Corporation Home media network
US20030028871A1 (en) * 2001-07-20 2003-02-06 Annie Wang Behavior profile system and method
US7065201B2 (en) * 2001-07-31 2006-06-20 Sbc Technology Resources, Inc. Telephone call processing in an interactive voice response call management system
US8515773B2 (en) 2001-08-01 2013-08-20 Sony Corporation System and method for enabling distribution and brokering of content information
US20030025720A1 (en) * 2001-08-03 2003-02-06 Clement Lau System and method for common interest analysis among multiple users
US20030033602A1 (en) * 2001-08-08 2003-02-13 Simon Gibbs Method and apparatus for automatic tagging and caching of highlights
US7091989B2 (en) * 2001-08-10 2006-08-15 Sony Corporation System and method for data assisted chroma-keying
US7636931B2 (en) * 2001-08-17 2009-12-22 Igt Interactive television devices and systems
US7139470B2 (en) * 2001-08-17 2006-11-21 Intel Corporation Navigation for MPEG streams
WO2003021414A1 (en) * 2001-08-29 2003-03-13 Digeo, Inc. System and method for focused navigation within an interactive television user interface
US20030061611A1 (en) * 2001-09-26 2003-03-27 Ramesh Pendakur Notifying users of available content and content reception based on user profiles
US8943540B2 (en) 2001-09-28 2015-01-27 Intel Corporation Method and apparatus to provide a personalized channel
US20030074447A1 (en) * 2001-10-16 2003-04-17 Rafey Richter A. Intuitive mapping between explicit and implicit personalization
US7474698B2 (en) 2001-10-19 2009-01-06 Sharp Laboratories Of America, Inc. Identification of replay segments
US6865555B2 (en) * 2001-11-21 2005-03-08 Digeo, Inc. System and method for providing conditional access to digital content
US20030105880A1 (en) * 2001-12-04 2003-06-05 Koninklijke Philips Electronics N.V. Distributed processing, storage, and transmision of multimedia information
US7339992B2 (en) * 2001-12-06 2008-03-04 The Trustees Of Columbia University In The City Of New York System and method for extracting text captions from video and generating video summaries
WO2003050670A1 (en) * 2001-12-07 2003-06-19 Predictive Media Corporation Recommendation-based electronic program guide with multiple modes of operation
US20030110501A1 (en) * 2001-12-12 2003-06-12 Rafey Richter A. Personalizing media presentations based on a target duration
US20030110297A1 (en) * 2001-12-12 2003-06-12 Tabatabai Ali J. Transforming multimedia data for delivery to multiple heterogeneous devices
US20030112276A1 (en) * 2001-12-19 2003-06-19 Clement Lau User augmentation of content
US7284032B2 (en) * 2001-12-19 2007-10-16 Thomson Licensing Method and system for sharing information with users in a network
KR20040073511A (en) * 2001-12-25 2004-08-19 마츠시타 덴끼 산교 가부시키가이샤 Apparatus, method, and computer-readable program for playing back content
US7751628B1 (en) 2001-12-26 2010-07-06 Reisman Richard R Method and apparatus for progressively deleting media objects from storage
KR100411437B1 (en) * 2001-12-28 2003-12-18 엘지전자 주식회사 Intelligent news video browsing system
KR100493674B1 (en) * 2001-12-29 2005-06-03 엘지전자 주식회사 Multimedia data searching and browsing system
EP1333671A1 (en) 2002-01-22 2003-08-06 Philips Electronics N.V. Interface device to be used with a multimedia content restore device in order to search for the multimedia content being restored
US7251790B1 (en) 2002-01-23 2007-07-31 Microsoft Corporation Media browsing system displaying thumbnails images based on preferences of plurality of users and placing the thumbnails images at a scene change
US7120873B2 (en) * 2002-01-28 2006-10-10 Sharp Laboratories Of America, Inc. Summarization of sumo video content
US7305070B2 (en) * 2002-01-30 2007-12-04 At&T Labs, Inc. Sequential presentation of long instructions in an interactive voice response system
US20030149975A1 (en) * 2002-02-05 2003-08-07 Charles Eldering Targeted advertising in on demand programming
US7333712B2 (en) * 2002-02-14 2008-02-19 Koninklijke Philips Electronics N.V. Visual summary for scanning forwards and backwards in video content
US8214741B2 (en) 2002-03-19 2012-07-03 Sharp Laboratories Of America, Inc. Synchronization of video and data
US20030187820A1 (en) 2002-03-29 2003-10-02 Michael Kohut Media management system and process
US20030191776A1 (en) * 2002-04-05 2003-10-09 Pere Obrador Media object management
JP4352653B2 (en) * 2002-04-12 2009-10-28 三菱電機株式会社 The video content management and operation system
US7818180B2 (en) * 2002-04-29 2010-10-19 Medtronic, Inc. Personalization software for implanted medical device patients
US7305436B2 (en) * 2002-05-17 2007-12-04 Sap Aktiengesellschaft User collaboration through discussion forums
US7346668B2 (en) * 2002-05-17 2008-03-18 Sap Aktiengesellschaft Dynamic presentation of personalized content
US7370276B2 (en) 2002-05-17 2008-05-06 Sap Aktiengesellschaft Interface for collecting user preferences
US20040003097A1 (en) * 2002-05-17 2004-01-01 Brian Willis Content delivery system
US7127473B2 (en) * 2002-05-17 2006-10-24 Sap Aktiengesellschaft Methods and systems for providing supplemental contextual content
US7200801B2 (en) 2002-05-17 2007-04-03 Sap Aktiengesellschaft Rich media information portals
US20040002963A1 (en) * 2002-06-28 2004-01-01 Cynkin Laurence H. Resolving query terms based on time of submission
US20040003394A1 (en) * 2002-07-01 2004-01-01 Arun Ramaswamy System for automatically matching video with ratings information
GB0215624D0 (en) * 2002-07-05 2002-08-14 Colthurst James R Razor head
US7657836B2 (en) 2002-07-25 2010-02-02 Sharp Laboratories Of America, Inc. Summarization of soccer video content
US7149755B2 (en) * 2002-07-29 2006-12-12 Hewlett-Packard Development Company, Lp. Presenting a collection of media objects
EP1540555A1 (en) * 2002-09-09 2005-06-15 Philips Electronics N.V. A data network, user terminal and method for providing recommendations
US7321887B2 (en) * 2002-09-30 2008-01-22 Sap Aktiengesellschaft Enriching information streams with contextual content
US7657907B2 (en) 2002-09-30 2010-02-02 Sharp Laboratories Of America, Inc. Automatic user profiling
US7900229B2 (en) * 2002-10-15 2011-03-01 Opentv, Inc. Convergence of interactive television and wireless technologies
JP4633464B2 (en) 2002-10-21 2011-02-23 エヌエックスピー ビー ヴィNxp B.V. Operation of the sub-images in a compressed video signal
US20040088723A1 (en) * 2002-11-01 2004-05-06 Yu-Fei Ma Systems and methods for generating a video summary
US7116716B2 (en) * 2002-11-01 2006-10-03 Microsoft Corporation Systems and methods for generating a motion attention model
US8931010B2 (en) * 2002-11-04 2015-01-06 Rovi Solutions Corporation Methods and apparatus for client aggregation of media in a networked media system
US8712218B1 (en) 2002-12-17 2014-04-29 At&T Intellectual Property Ii, L.P. System and method for providing program recommendations through multimedia searching based on established viewer preferences
US7131059B2 (en) * 2002-12-31 2006-10-31 Hewlett-Packard Development Company, L.P. Scalably presenting a collection of media objects
US7493646B2 (en) 2003-01-30 2009-02-17 United Video Properties, Inc. Interactive television systems with digital video recording and adjustable reminders
US7164798B2 (en) 2003-02-18 2007-01-16 Microsoft Corporation Learning-based automatic commercial content detection
US7213228B2 (en) * 2003-03-17 2007-05-01 Macrovision Corporation Methods and apparatus for implementing a remote application over a network
US7574691B2 (en) * 2003-03-17 2009-08-11 Macrovision Corporation Methods and apparatus for rendering user interfaces and display information on remote client devices
US7262772B2 (en) * 2003-03-21 2007-08-28 Sap Aktiengesellschaft Visual content summary
US7076616B2 (en) * 2003-03-24 2006-07-11 Sony Corporation Application pre-launch to reduce user interface latency
US8392834B2 (en) * 2003-04-09 2013-03-05 Hewlett-Packard Development Company, L.P. Systems and methods of authoring a multimedia file
JP2004336343A (en) * 2003-05-07 2004-11-25 Canon Inc Image processing system
US8290948B2 (en) * 2003-06-30 2012-10-16 Hoshiko, Llc Method and apparatus for content filtering
US20050028199A1 (en) * 2003-07-30 2005-02-03 Borden George R. Personal video recorder user interface
US7372991B2 (en) * 2003-09-26 2008-05-13 Seiko Epson Corporation Method and apparatus for summarizing and indexing the contents of an audio-visual presentation
EP1531458B1 (en) * 2003-11-12 2008-04-16 Sony Deutschland GmbH Apparatus and method for automatic extraction of important events in audio signals
JP4047267B2 (en) * 2003-11-21 2008-02-13 キヤノン株式会社 Program selection method and program selection controller
US20050120383A1 (en) * 2003-12-02 2005-06-02 Ozaki Arthur H. System for saving settings of an audiovisual system
JP2007519321A (en) * 2003-12-18 2007-07-12 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Method and circuit for creating a multimedia summary of audiovisual data stream
US20050149965A1 (en) * 2003-12-31 2005-07-07 Raja Neogi Selective media storage based on user profiles and preferences
US7343375B1 (en) 2004-03-01 2008-03-11 The Directv Group, Inc. Collection and correlation over time of private viewing usage data
US8356317B2 (en) 2004-03-04 2013-01-15 Sharp Laboratories Of America, Inc. Presence based technology
US7594245B2 (en) 2004-03-04 2009-09-22 Sharp Laboratories Of America, Inc. Networked video devices
US8949899B2 (en) 2005-03-04 2015-02-03 Sharp Laboratories Of America, Inc. Collaborative recommendation system
US7529870B1 (en) 2004-04-27 2009-05-05 Apple Inc. Communication between an accessory and a media player with multiple lingoes
US7441062B2 (en) 2004-04-27 2008-10-21 Apple Inc. Connector interface system for enabling data communication with a multi-communication device
US7895378B2 (en) 2004-04-27 2011-02-22 Apple Inc. Method and system for allowing a media player to transfer digital audio to an accessory
US7529872B1 (en) 2004-04-27 2009-05-05 Apple Inc. Communication between an accessory and a media player using a protocol with multiple lingoes
US8117651B2 (en) 2004-04-27 2012-02-14 Apple Inc. Method and system for authenticating an accessory
US7526588B1 (en) 2004-04-27 2009-04-28 Apple Inc. Communication between an accessory and a media player using a protocol with multiple lingoes
US8006019B2 (en) * 2006-05-22 2011-08-23 Apple, Inc. Method and system for transferring stored data between a media player and an accessory
US7673083B2 (en) * 2004-04-27 2010-03-02 Apple Inc. Method and system for controlling video selection and playback in a portable media player
US20060031879A1 (en) * 2004-04-30 2006-02-09 Vulcan Inc. Management and non-linear presentation of news-related broadcasted or streamed multimedia content
US20060053470A1 (en) * 2004-04-30 2006-03-09 Vulcan Inc. Management and non-linear presentation of augmented broadcasted or streamed multimedia content
US7970263B1 (en) * 2004-05-28 2011-06-28 Adobe Systems Incorporated Seamless integration of video capture in demonstration applications
US7373604B1 (en) * 2004-05-28 2008-05-13 Adobe Systems Incorporated Automatically scalable presentation of video demonstration content
US9053754B2 (en) * 2004-07-28 2015-06-09 Microsoft Technology Licensing, Llc Thumbnail generation and presentation for recorded TV programs
US7986372B2 (en) * 2004-08-02 2011-07-26 Microsoft Corporation Systems and methods for smart media content thumbnail extraction
US7543068B2 (en) * 2004-08-26 2009-06-02 At&T Intellectual Property I, Lp Filtering information at a data network based on filter rules associated with consumer processing devices
US8086575B2 (en) 2004-09-23 2011-12-27 Rovi Solutions Corporation Methods and apparatus for integrating disparate media formats in a networked media system
US20060075441A1 (en) * 2004-10-06 2006-04-06 Sony Corporation Method and system for a personal video recorder comprising multiple removable storage/tuner units
US8768844B2 (en) * 2004-10-06 2014-07-01 Sony Corporation Method and system for content sharing and authentication between multiple devices
JP4277782B2 (en) * 2004-11-09 2009-06-10 ソニー株式会社 The display control unit of the broadcast data receiving apparatus, and a display control method
JP2006155828A (en) * 2004-11-30 2006-06-15 Toshiba Corp Reproducer and reproduction method
GB0427032D0 (en) * 2004-12-09 2005-01-12 Sony Uk Ltd Video display
US7480701B2 (en) * 2004-12-15 2009-01-20 Microsoft Corporation Mixed-media service collections for multimedia platforms
US7768388B2 (en) 2005-01-05 2010-08-03 Rovi Solutions Corporation Methods and apparatus for providing notifications in a media system
US7823214B2 (en) 2005-01-07 2010-10-26 Apple Inc. Accessory authentication for electronic devices
US20060218573A1 (en) * 2005-03-04 2006-09-28 Stexar Corp. Television program highlight tagging
WO2006096612A3 (en) * 2005-03-04 2007-07-05 Univ Columbia System and method for motion estimation and mode decision for low-complexity h.264 decoder
KR100707189B1 (en) * 2005-04-29 2007-04-13 삼성전자주식회사 Apparatus and method for detecting advertisment of moving-picture, and compter-readable storage storing compter program controlling the apparatus
JP4492462B2 (en) * 2005-06-30 2010-06-30 ソニー株式会社 Electronic apparatus, image processing apparatus and image processing method
US20070011718A1 (en) * 2005-07-08 2007-01-11 Nee Patrick W Jr Efficient customized media creation through pre-encoding of common elements
JP4830379B2 (en) * 2005-07-13 2011-12-07 ソニー株式会社 The information processing apparatus, information processing method, and program
KR20070027070A (en) * 2005-08-29 2007-03-09 삼성전자주식회사 Apparatus and method for transmitting and receiving of broadcasting and communication combined service information
KR100719023B1 (en) * 2005-10-08 2007-05-17 삼성전자주식회사 Display Apparatus And Contents Information Displaying Method
US20070112811A1 (en) * 2005-10-20 2007-05-17 Microsoft Corporation Architecture for scalable video coding applications
US7688686B2 (en) * 2005-10-27 2010-03-30 Microsoft Corporation Enhanced table of contents (TOC) identifiers
US7773813B2 (en) 2005-10-31 2010-08-10 Microsoft Corporation Capture-intention detection for video content analysis
US8180826B2 (en) * 2005-10-31 2012-05-15 Microsoft Corporation Media sharing and authoring on the web
US20070101394A1 (en) * 2005-11-01 2007-05-03 Yesvideo, Inc. Indexing a recording of audiovisual content to enable rich navigation
US8196032B2 (en) * 2005-11-01 2012-06-05 Microsoft Corporation Template-based multimedia authoring and sharing
JP2007150724A (en) * 2005-11-28 2007-06-14 Toshiba Corp Video viewing support system and method
US9467322B2 (en) * 2005-12-27 2016-10-11 Rovi Solutions Corporation Methods and apparatus for integrating media across a wide area network
US9681105B2 (en) 2005-12-29 2017-06-13 Rovi Guides, Inc. Interactive media guidance system having multiple devices
US8607287B2 (en) 2005-12-29 2013-12-10 United Video Properties, Inc. Interactive media guidance system having multiple devices
US7599918B2 (en) * 2005-12-29 2009-10-06 Microsoft Corporation Dynamic search with implicit user intention mining
WO2007098068B1 (en) * 2006-02-17 2008-01-17 Directv Group Inc Amalgamation of user data for geographical trending
WO2007098069A8 (en) * 2006-02-17 2008-08-28 Jon M Dean Mirroring of live data to guide data in a broadcast system
US8689253B2 (en) 2006-03-03 2014-04-01 Sharp Laboratories Of America, Inc. Method and system for configuring media-playing sets
US20070219832A1 (en) * 2006-03-18 2007-09-20 Interactive Travel Group, Inc. Travel profile access system and method
US8682654B2 (en) * 2006-04-25 2014-03-25 Cyberlink Corp. Systems and methods for classifying sports video
US7929551B2 (en) * 2006-06-01 2011-04-19 Rovi Solutions Corporation Methods and apparatus for transferring media across a network using a network interface device
US7415563B1 (en) 2006-06-27 2008-08-19 Apple Inc. Method and system for allowing a media player to determine if it supports the capabilities of an accessory
US7441058B1 (en) 2006-09-11 2008-10-21 Apple Inc. Method and system for controlling an accessory having a tuner
US7558894B1 (en) 2006-09-11 2009-07-07 Apple Inc. Method and system for controlling power provided to an accessory
KR100850791B1 (en) * 2006-09-20 2008-08-06 삼성전자주식회사 System for generating summary of broadcasting program and method thereof
US7721312B2 (en) * 2007-03-19 2010-05-18 Sony Corporation System and method for scrolling through TV video icons by category
US7465241B2 (en) * 2007-03-23 2008-12-16 Acushnet Company Functionalized, crosslinked, rubber nanoparticles for use in golf ball castable thermoset layers
US9542394B2 (en) * 2007-06-14 2017-01-10 Excalibur Ip, Llc Method and system for media-based event generation
FR2917523B1 (en) 2007-06-15 2010-01-29 Alcatel Lucent Method for Cooperative description of media objects
US20090019492A1 (en) * 2007-07-11 2009-01-15 United Video Properties, Inc. Systems and methods for mirroring and transcoding media content
US8453188B2 (en) * 2008-01-22 2013-05-28 Avaya Inc. Open cable application platform set-top box (STB) personal profiles and communications applications
US9378286B2 (en) * 2008-03-14 2016-06-28 Microsoft Technology Licensing, Llc Implicit user interest marks in media content
US20090241158A1 (en) * 2008-03-18 2009-09-24 Avaya Technology Llc Open cable application platform set-top box (stb) personal profiles and communications applications
US20090241153A1 (en) * 2008-03-18 2009-09-24 Avaya Technology Llc Open cable application platform set-top box (stb) personal profiles and communications applications
US20090241159A1 (en) * 2008-03-18 2009-09-24 Avaya Technology Llc Open cable application platform set-top box (stb) personal profiles and communications applications
WO2009126785A3 (en) 2008-04-10 2010-01-07 The Trustees Of Columbia University In The City Of New York Systems and methods for image archaeology
US8601526B2 (en) 2008-06-13 2013-12-03 United Video Properties, Inc. Systems and methods for displaying media content and media guidance information
WO2009155281A1 (en) * 2008-06-17 2009-12-23 The Trustees Of Columbia University In The City Of New York System and method for dynamically and interactively searching media data
JP4924565B2 (en) * 2008-08-01 2012-04-25 沖電気工業株式会社 The information processing system, and the viewing effect measuring method
US8238811B2 (en) 2008-09-08 2012-08-07 Apple Inc. Cross-transport authentication
US8208853B2 (en) 2008-09-08 2012-06-26 Apple Inc. Accessory device authentication
US8259082B2 (en) 2008-09-12 2012-09-04 At&T Intellectual Property I, L.P. Multimodal portable communication interface for accessing video content
US8194102B2 (en) * 2008-10-06 2012-06-05 Microsoft Corporation Rendering annotations for images
US9237295B2 (en) * 2008-10-15 2016-01-12 Samsung Electronics Co., Ltd. System and method for keyframe analysis and distribution from broadcast television
US20100095345A1 (en) * 2008-10-15 2010-04-15 Samsung Electronics Co., Ltd. System and method for acquiring and distributing keyframe timelines
US8671069B2 (en) 2008-12-22 2014-03-11 The Trustees Of Columbia University, In The City Of New York Rapid image annotation via brain state decoding and visual pattern mining
KR20100072847A (en) * 2008-12-22 2010-07-01 한국전자통신연구원 Apparatus and method for control of digital appliances according to parking management
US8635694B2 (en) 2009-01-10 2014-01-21 Kaspersky Lab Zao Systems and methods for malware classification
US8769589B2 (en) * 2009-03-31 2014-07-01 At&T Intellectual Property I, L.P. System and method to create a media content summary based on viewer annotations
US9578271B2 (en) * 2009-08-18 2017-02-21 Sony Corporation Integrated user interface for internet-enabled TV
US9014546B2 (en) 2009-09-23 2015-04-21 Rovi Guides, Inc. Systems and methods for automatically detecting users within detection regions of media devices
US20120090009A1 (en) * 2010-10-12 2012-04-12 Comcast Cable Communications, Llc Video Assets Having Associated Graphical Descriptor Data
US8498595B2 (en) * 2011-02-09 2013-07-30 Toyota Motor Engineering & Manufacturing North America, Inc. Apparatus and methods for automatic preset
US8559793B2 (en) 2011-05-26 2013-10-15 Avid Technology, Inc. Synchronous data tracks in a media editing system
US20130097643A1 (en) * 2011-10-17 2013-04-18 Microsoft Corporation Interactive video
US8805418B2 (en) 2011-12-23 2014-08-12 United Video Properties, Inc. Methods and systems for performing actions based on location-based rules
US8787726B2 (en) 2012-02-26 2014-07-22 Antonio Rossi Streaming video navigation systems and methods
US9674563B2 (en) 2013-11-04 2017-06-06 Rovi Guides, Inc. Systems and methods for recommending content
US20150221112A1 (en) * 2014-02-04 2015-08-06 Microsoft Corporation Emotion Indicators in Content
US20150312652A1 (en) * 2014-04-24 2015-10-29 Microsoft Corporation Automatic generation of videos via a segment list
US9449229B1 (en) 2014-07-07 2016-09-20 Google Inc. Systems and methods for categorizing motion event candidates
US9501915B1 (en) 2014-07-07 2016-11-22 Google Inc. Systems and methods for analyzing a video stream
US9158974B1 (en) 2014-07-07 2015-10-13 Google Inc. Method and system for motion vector-based video monitoring and event categorization
US9779307B2 (en) 2014-07-07 2017-10-03 Google Inc. Method and system for non-causal zone search in video monitoring
USD782495S1 (en) 2014-10-07 2017-03-28 Google Inc. Display screen or portion thereof with graphical user interface

Citations (98)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US616A (en) * 1838-02-24 Artificial horizon foe
US88872A (en) * 1869-04-13 Improvement in velocipede
US177503A (en) * 1876-05-16 Improvement in plows
US4183056A (en) * 1977-05-23 1980-01-08 Kewp Electronic Systems, Inc. Apparatus and method for monitoring sports contests
US4253108A (en) * 1979-06-04 1981-02-24 Zenith Radio Corporation Control for color killer and automatic color limiter
US4321635A (en) * 1979-04-20 1982-03-23 Teac Corporation Apparatus for selective retrieval of information streams or items
US4324402A (en) * 1979-01-05 1982-04-13 Mattel, Inc. Electronic baseball game
US4520404A (en) * 1982-08-23 1985-05-28 Kohorn H Von System, apparatus and method for recording and editing broadcast transmissions
US4729044A (en) * 1985-02-05 1988-03-01 Lex Computing & Management Corporation Method and apparatus for playing serially stored segments in an arbitrary sequence
US5101364A (en) * 1990-02-09 1992-03-31 Massachusetts Institute Of Technology Method and facility for dynamic video composition and viewing
US5109482A (en) * 1989-01-11 1992-04-28 David Bohrman Interactive video control system for displaying user-selectable clips
US5200825A (en) * 1992-07-01 1993-04-06 Beam Laser Systems, Inc. Commercial insertion system remotely controlling multiple video switches
US5288069A (en) * 1992-11-20 1994-02-22 Susan Matsumoto Talking football
US5381477A (en) * 1993-02-16 1995-01-10 Scientific-Atlanta, Inc. Method of selecting cable television converter groups
US5404316A (en) * 1992-08-03 1995-04-04 Spectra Group Ltd., Inc. Desktop digital video processing system
US5410344A (en) * 1993-09-22 1995-04-25 Arrowsmith Technologies, Inc. Apparatus and method of selecting video programs based on viewers' preferences
US5521841A (en) * 1994-03-31 1996-05-28 Siemens Corporate Research, Inc. Browsing contents of a given video sequence
US5600781A (en) * 1994-09-30 1997-02-04 Intel Corporation Method and apparatus for creating a portable personalized operating environment
US5717923A (en) * 1994-11-03 1998-02-10 Intel Corporation Method and apparatus for dynamically customizing electronic information to individual end users
US5717879A (en) * 1995-11-03 1998-02-10 Xerox Corporation System for the capture and replay of temporal data representing collaborative activities
US5732216A (en) * 1996-10-02 1998-03-24 Internet Angles, Inc. Audio message exchange system
US5751953A (en) * 1995-08-31 1998-05-12 U.S. Philips Corporation Interactive entertainment personalisation
US5758257A (en) * 1994-11-29 1998-05-26 Herz; Frederick System and method for scheduling broadcast of and access to video programs and other data using customer profiles
US5857190A (en) * 1996-06-27 1999-01-05 Microsoft Corporation Event logging system and method for logging events in a network system
US5875107A (en) * 1996-12-05 1999-02-23 Mitsubishi Denki Kabushiki Kaisha Inverter apparatus
US5877821A (en) * 1997-01-30 1999-03-02 Motorola, Inc. Multimedia input and control apparatus and method for multimedia communications
US5907324A (en) * 1995-06-07 1999-05-25 Intel Corporation Method for saving and accessing desktop conference characteristics with a persistent conference object
US6014183A (en) * 1997-08-06 2000-01-11 Imagine Products, Inc. Method and apparatus for detecting scene changes in a digital video stream
US6041323A (en) * 1996-04-17 2000-03-21 International Business Machines Corporation Information search method, information search device, and storage medium for storing an information search program
US6055018A (en) * 1997-11-04 2000-04-25 Ati Technologies, Inc. System and method for reconstructing noninterlaced captured content for display on a progressive screen
US6055569A (en) * 1998-01-27 2000-04-25 Go Ahead Software Inc. Accelerating web access by predicting user action
US6060167A (en) * 1994-03-02 2000-05-09 E. I. Du Pont De Nemours And Company Non-chalking release/wear coating
US6064449A (en) * 1997-10-31 2000-05-16 Webtv Networks, Inc. Automatic characterization of a television signal
US6064385A (en) * 1997-09-30 2000-05-16 Compaq Computer Corporation Systems with user preference setting schemes
US6070167A (en) * 1997-09-29 2000-05-30 Sharp Laboratories Of America, Inc. Hierarchical method and system for object-based audiovisual descriptive tagging of images for information retrieval, editing, and manipulation
US6169542B1 (en) * 1998-12-14 2001-01-02 Gte Main Street Incorporated Method of delivering advertising through an interactive video distribution system
US6177931B1 (en) * 1996-12-19 2001-01-23 Index Systems, Inc. Systems and methods for displaying and recording control interface with television programs, video, advertising information and program scheduling information
US6195497B1 (en) * 1993-10-25 2001-02-27 Hitachi, Ltd. Associated image retrieving apparatus and method
US6199076B1 (en) * 1996-10-02 2001-03-06 James Logan Audio program player including a dynamic program selection controller
US6212527B1 (en) * 1996-07-08 2001-04-03 Survivors Of The Shoah Visual History Foundation Method and apparatus for cataloguing multimedia data
US6216129B1 (en) * 1998-12-03 2001-04-10 Expanse Networks, Inc. Advertisement selection system supporting discretionary target market characteristics
US6219837B1 (en) * 1997-10-23 2001-04-17 International Business Machines Corporation Summary frames in video
US6226678B1 (en) * 1995-09-25 2001-05-01 Netspeak Corporation Method and apparatus for dynamically defining data communication utilities
US6230172B1 (en) * 1997-01-30 2001-05-08 Microsoft Corporation Production of a video stream with synchronized annotations over a computer network
US6233586B1 (en) * 1998-04-01 2001-05-15 International Business Machines Corp. Federated searching of heterogeneous datastores using a federated query object
US6233289B1 (en) * 1996-07-17 2001-05-15 Seagate Technolgy, Inc. High rate trellis code for partial response channels
US6339842B1 (en) * 1998-06-10 2002-01-15 Dennis Sunga Fernandez Digital television with subscriber conference overlay
US6342904B1 (en) * 1998-12-17 2002-01-29 Newstakes, Inc. Creating a slide presentation from full motion video
US20020013943A1 (en) * 2000-04-07 2002-01-31 Seth Haberman System and method for simultaneous broadcast for personalized messages
US20020018594A1 (en) * 2000-07-06 2002-02-14 Mitsubishi Electric Research Laboratories, Inc. Method and system for high-level structure analysis and event detection in domain specific videos
US20020026345A1 (en) * 2000-03-08 2002-02-28 Ari Juels Targeted delivery of informational content with privacy protection
US6353444B1 (en) * 1998-03-05 2002-03-05 Matsushita Electric Industrial Co., Ltd. User interface apparatus and broadcast receiving apparatus
US6363380B1 (en) * 1998-01-13 2002-03-26 U.S. Philips Corporation Multimedia computer system with story segmentation capability and operating program therefor including finite automation video parser
US6363160B1 (en) * 1999-01-22 2002-03-26 Intel Corporation Interface using pattern recognition and tracking
US6370688B1 (en) * 1999-05-26 2002-04-09 Enounce, Inc. Method and apparatus for server broadcast of time-converging multi-media streams
US6370504B1 (en) * 1997-05-29 2002-04-09 University Of Washington Speech recognition on MPEG/Audio encoded files
US6374404B1 (en) * 1998-12-16 2002-04-16 Sony Corporation Of Japan Intelligent device having background caching of web pages from a digital television broadcast signal and method of same
US20030001880A1 (en) * 2001-04-18 2003-01-02 Parkervision, Inc. Method, system, and computer program product for producing and distributing enhanced media
US20030007555A1 (en) * 2001-04-27 2003-01-09 Mitsubishi Electric Research Laboratories, Inc. Method for summarizing a video using motion descriptors
US20030026592A1 (en) * 2000-12-28 2003-02-06 Minoru Kawahara Content creating device and method
US20030033288A1 (en) * 2001-08-13 2003-02-13 Xerox Corporation Document-centric system with auto-completion and auto-correction
US6522342B1 (en) * 1999-01-27 2003-02-18 Hughes Electronics Corporation Graphical tuning bar for a multi-program data stream
US6530082B1 (en) * 1998-04-30 2003-03-04 Wink Communications, Inc. Configurable monitoring of program viewership and usage of interactive applications
US6535639B1 (en) * 1999-03-12 2003-03-18 Fuji Xerox Co., Ltd. Automatic video summarization using a measure of shot importance and a frame-packing method
US6542546B1 (en) * 2000-02-02 2003-04-01 Mitsubishi Electric Research Laboratories, Inc. Adaptable compressed bitstream transcoder
US20030066068A1 (en) * 2001-09-28 2003-04-03 Koninklijke Philips Electronics N.V. Individual recommender database using profiles of others
US6546555B1 (en) * 1998-07-23 2003-04-08 Siemens Corporate Research, Inc. System for hypervideo filtering based on end-user payment interest and capability
US20030067554A1 (en) * 2000-09-25 2003-04-10 Klarfeld Kenneth A. System and method for personalized TV
US6549643B1 (en) * 1999-11-30 2003-04-15 Siemens Corporate Research, Inc. System and method for selecting key-frames of video data
US20030072440A1 (en) * 2000-06-02 2003-04-17 Murray Thomas A. Communication device having illuminated audio indicator
US6553178B2 (en) * 1992-02-07 2003-04-22 Max Abecassis Advertisement subsidized video-on-demand system
US6556767B2 (en) * 1995-12-15 2003-04-29 Hitachi Ltd Video capture device
US20040003041A1 (en) * 2002-04-02 2004-01-01 Worldcom, Inc. Messaging response system
US6675158B1 (en) * 1999-11-30 2004-01-06 Sony Corporation Method and apparatus for organizing data pertaining to audiovisual content
US6678659B1 (en) * 1997-06-20 2004-01-13 Swisscom Ag System and method of voice information dissemination over a network using semantic representation
US6681395B1 (en) * 1998-03-20 2004-01-20 Matsushita Electric Industrial Company, Ltd. Template set for generating a hypertext for displaying a program guide and subscriber terminal with EPG function using such set broadcast from headend
US6678965B2 (en) * 2000-11-29 2004-01-20 Athan Corporation Method and apparatus for aligning a drum assembly used in a video recording device
US20040015569A1 (en) * 2002-07-16 2004-01-22 Mikko Lonnfors System and method for providing partial presence notifications
US20040017389A1 (en) * 2002-07-25 2004-01-29 Hao Pan Summarization of soccer video content
US6685423B1 (en) * 2000-09-25 2004-02-03 Starcon International, Inc. Method and apparatus for extracting and installing heat exchanger bundles
US6691126B1 (en) * 2000-06-14 2004-02-10 International Business Machines Corporation Method and apparatus for locating multi-region objects in an image or video database
US20040030750A1 (en) * 2002-04-02 2004-02-12 Worldcom, Inc. Messaging response system
US20040032486A1 (en) * 2002-08-16 2004-02-19 Shusman Chad W. Method and apparatus for interactive programming using captioning
US6697523B1 (en) * 2000-08-09 2004-02-24 Mitsubishi Electric Research Laboratories, Inc. Method for summarizing a video using motion and color descriptors
US6704929B1 (en) * 1999-08-18 2004-03-09 Webtv Networks, Inc. Tracking viewing behavior of a home entertainment system
US6724933B1 (en) * 2000-07-28 2004-04-20 Microsoft Corporation Media segmentation system and related methods
US20050021784A1 (en) * 2001-09-07 2005-01-27 Christian Prehofer Device and method for the automatic configuration of user profiles
US20050028194A1 (en) * 1998-01-13 2005-02-03 Elenbaas Jan Hermanus Personalized news retrieval system
US6868440B1 (en) * 2000-02-04 2005-03-15 Microsoft Corporation Multi-level skimming of multimedia content using playlists
US6880171B1 (en) * 1996-12-05 2005-04-12 Interval Research Corporation Browser for use in navigating a body of information, with particular application to browsing information represented by audiovisual data
US6983478B1 (en) * 2000-02-01 2006-01-03 Bellsouth Intellectual Property Corporation Method and system for tracking network use
US6990679B2 (en) * 2000-03-31 2006-01-24 Matsushita Electric Industrial Co., Ltd. Program surf grid
US6993245B1 (en) * 1999-11-18 2006-01-31 Vulcan Patents Llc Iterative, maximally probable, batch-mode commercial detection for audiovisual content
US7003792B1 (en) * 1998-11-30 2006-02-21 Index Systems, Inc. Smart agent based on habit, statistical inference and psycho-demographic profiling
US7026964B2 (en) * 2002-01-31 2006-04-11 Microsoft Corporation Generating and searching compressed data
US7185355B1 (en) * 1998-03-04 2007-02-27 United Video Properties, Inc. Program guide system with preference profiles
US7199798B1 (en) * 1999-01-26 2007-04-03 International Business Machines Corp Method and device for describing video contents
US7343381B2 (en) * 2002-07-23 2008-03-11 Samsung Electronics Co., Ltd. Index structure for TV-Anytime Forum metadata having location information for defining a multi-key

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4602279A (en) * 1984-03-21 1986-07-22 Actv, Inc. Method for providing targeted profile interactive CATV displays
US5012334B1 (en) * 1990-01-29 1997-05-13 Grass Valley Group Video image bank for storing and retrieving video image sequences
US5861881A (en) * 1991-11-25 1999-01-19 Actv, Inc. Interactive computer system for providing an interactive presentation with personalized video, audio and graphics responses for multiple viewers
US5798785A (en) * 1992-12-09 1998-08-25 Discovery Communications, Inc. Terminal for suggesting programs offered on a television program delivery system
CA2106222C (en) * 1993-09-15 2000-10-31 Russell D. N. Mackinnon Object oriented communication network
CA2140850C (en) * 1994-02-24 1999-09-21 Howard Paul Katseff Networked system for display of multimedia presentations
US6029195A (en) * 1994-11-29 2000-02-22 Herz; Frederick S. M. System for customized electronic identification of desirable objects
US5710815A (en) * 1995-06-07 1998-01-20 Vtech Communications, Ltd. Encoder apparatus and decoder apparatus for a television signal having embedded viewer access control data
JPH11506250A (en) * 1996-03-04 1999-06-02 フィリップス エレクトロニクス ネムローゼ フェンノートシャップ Multimedia presentation system of user-oriented
US5828402A (en) * 1996-06-19 1998-10-27 Canadian V-Chip Design Inc. Method and apparatus for selectively blocking audio and video signals
US6163316A (en) * 1997-01-03 2000-12-19 Texas Instruments Incorporated Electronic programming system and method
GB9703193D0 (en) * 1997-02-15 1997-04-02 Philips Electronics Nv Television
GB2325537B8 (en) * 1997-03-31 2000-01-31 Microsoft Corp Query-based electronic program guide

Patent Citations (99)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US616A (en) * 1838-02-24 Artificial horizon foe
US88872A (en) * 1869-04-13 Improvement in velocipede
US177503A (en) * 1876-05-16 Improvement in plows
US4183056A (en) * 1977-05-23 1980-01-08 Kewp Electronic Systems, Inc. Apparatus and method for monitoring sports contests
US4324402A (en) * 1979-01-05 1982-04-13 Mattel, Inc. Electronic baseball game
US4321635A (en) * 1979-04-20 1982-03-23 Teac Corporation Apparatus for selective retrieval of information streams or items
US4253108A (en) * 1979-06-04 1981-02-24 Zenith Radio Corporation Control for color killer and automatic color limiter
US4520404A (en) * 1982-08-23 1985-05-28 Kohorn H Von System, apparatus and method for recording and editing broadcast transmissions
US4729044A (en) * 1985-02-05 1988-03-01 Lex Computing & Management Corporation Method and apparatus for playing serially stored segments in an arbitrary sequence
US5109482A (en) * 1989-01-11 1992-04-28 David Bohrman Interactive video control system for displaying user-selectable clips
US5101364A (en) * 1990-02-09 1992-03-31 Massachusetts Institute Of Technology Method and facility for dynamic video composition and viewing
US6553178B2 (en) * 1992-02-07 2003-04-22 Max Abecassis Advertisement subsidized video-on-demand system
US5200825A (en) * 1992-07-01 1993-04-06 Beam Laser Systems, Inc. Commercial insertion system remotely controlling multiple video switches
US5404316A (en) * 1992-08-03 1995-04-04 Spectra Group Ltd., Inc. Desktop digital video processing system
US5288069A (en) * 1992-11-20 1994-02-22 Susan Matsumoto Talking football
US5381477A (en) * 1993-02-16 1995-01-10 Scientific-Atlanta, Inc. Method of selecting cable television converter groups
US5410344A (en) * 1993-09-22 1995-04-25 Arrowsmith Technologies, Inc. Apparatus and method of selecting video programs based on viewers' preferences
US6195497B1 (en) * 1993-10-25 2001-02-27 Hitachi, Ltd. Associated image retrieving apparatus and method
US6060167A (en) * 1994-03-02 2000-05-09 E. I. Du Pont De Nemours And Company Non-chalking release/wear coating
US5521841A (en) * 1994-03-31 1996-05-28 Siemens Corporate Research, Inc. Browsing contents of a given video sequence
US5600781A (en) * 1994-09-30 1997-02-04 Intel Corporation Method and apparatus for creating a portable personalized operating environment
US5717923A (en) * 1994-11-03 1998-02-10 Intel Corporation Method and apparatus for dynamically customizing electronic information to individual end users
US5758257A (en) * 1994-11-29 1998-05-26 Herz; Frederick System and method for scheduling broadcast of and access to video programs and other data using customer profiles
US6020883A (en) * 1994-11-29 2000-02-01 Fred Herz System and method for scheduling broadcast of and access to video programs and other data using customer profiles
US5907324A (en) * 1995-06-07 1999-05-25 Intel Corporation Method for saving and accessing desktop conference characteristics with a persistent conference object
US5751953A (en) * 1995-08-31 1998-05-12 U.S. Philips Corporation Interactive entertainment personalisation
US6226678B1 (en) * 1995-09-25 2001-05-01 Netspeak Corporation Method and apparatus for dynamically defining data communication utilities
US5717879A (en) * 1995-11-03 1998-02-10 Xerox Corporation System for the capture and replay of temporal data representing collaborative activities
US6556767B2 (en) * 1995-12-15 2003-04-29 Hitachi Ltd Video capture device
US6041323A (en) * 1996-04-17 2000-03-21 International Business Machines Corporation Information search method, information search device, and storage medium for storing an information search program
US5857190A (en) * 1996-06-27 1999-01-05 Microsoft Corporation Event logging system and method for logging events in a network system
US6212527B1 (en) * 1996-07-08 2001-04-03 Survivors Of The Shoah Visual History Foundation Method and apparatus for cataloguing multimedia data
US6233289B1 (en) * 1996-07-17 2001-05-15 Seagate Technolgy, Inc. High rate trellis code for partial response channels
US5732216A (en) * 1996-10-02 1998-03-24 Internet Angles, Inc. Audio message exchange system
US6199076B1 (en) * 1996-10-02 2001-03-06 James Logan Audio program player including a dynamic program selection controller
US5875107A (en) * 1996-12-05 1999-02-23 Mitsubishi Denki Kabushiki Kaisha Inverter apparatus
US6880171B1 (en) * 1996-12-05 2005-04-12 Interval Research Corporation Browser for use in navigating a body of information, with particular application to browsing information represented by audiovisual data
US6177931B1 (en) * 1996-12-19 2001-01-23 Index Systems, Inc. Systems and methods for displaying and recording control interface with television programs, video, advertising information and program scheduling information
US6230172B1 (en) * 1997-01-30 2001-05-08 Microsoft Corporation Production of a video stream with synchronized annotations over a computer network
US5877821A (en) * 1997-01-30 1999-03-02 Motorola, Inc. Multimedia input and control apparatus and method for multimedia communications
US6370504B1 (en) * 1997-05-29 2002-04-09 University Of Washington Speech recognition on MPEG/Audio encoded files
US6678659B1 (en) * 1997-06-20 2004-01-13 Swisscom Ag System and method of voice information dissemination over a network using semantic representation
US6014183A (en) * 1997-08-06 2000-01-11 Imagine Products, Inc. Method and apparatus for detecting scene changes in a digital video stream
US6070167A (en) * 1997-09-29 2000-05-30 Sharp Laboratories Of America, Inc. Hierarchical method and system for object-based audiovisual descriptive tagging of images for information retrieval, editing, and manipulation
US6064385A (en) * 1997-09-30 2000-05-16 Compaq Computer Corporation Systems with user preference setting schemes
US6219837B1 (en) * 1997-10-23 2001-04-17 International Business Machines Corporation Summary frames in video
US6064449A (en) * 1997-10-31 2000-05-16 Webtv Networks, Inc. Automatic characterization of a television signal
US6055018A (en) * 1997-11-04 2000-04-25 Ati Technologies, Inc. System and method for reconstructing noninterlaced captured content for display on a progressive screen
US20050028194A1 (en) * 1998-01-13 2005-02-03 Elenbaas Jan Hermanus Personalized news retrieval system
US6363380B1 (en) * 1998-01-13 2002-03-26 U.S. Philips Corporation Multimedia computer system with story segmentation capability and operating program therefor including finite automation video parser
US6055569A (en) * 1998-01-27 2000-04-25 Go Ahead Software Inc. Accelerating web access by predicting user action
US7185355B1 (en) * 1998-03-04 2007-02-27 United Video Properties, Inc. Program guide system with preference profiles
US6353444B1 (en) * 1998-03-05 2002-03-05 Matsushita Electric Industrial Co., Ltd. User interface apparatus and broadcast receiving apparatus
US6681395B1 (en) * 1998-03-20 2004-01-20 Matsushita Electric Industrial Company, Ltd. Template set for generating a hypertext for displaying a program guide and subscriber terminal with EPG function using such set broadcast from headend
US6233586B1 (en) * 1998-04-01 2001-05-15 International Business Machines Corp. Federated searching of heterogeneous datastores using a federated query object
US6530082B1 (en) * 1998-04-30 2003-03-04 Wink Communications, Inc. Configurable monitoring of program viewership and usage of interactive applications
US6339842B1 (en) * 1998-06-10 2002-01-15 Dennis Sunga Fernandez Digital television with subscriber conference overlay
US6546555B1 (en) * 1998-07-23 2003-04-08 Siemens Corporate Research, Inc. System for hypervideo filtering based on end-user payment interest and capability
US7003792B1 (en) * 1998-11-30 2006-02-21 Index Systems, Inc. Smart agent based on habit, statistical inference and psycho-demographic profiling
US6216129B1 (en) * 1998-12-03 2001-04-10 Expanse Networks, Inc. Advertisement selection system supporting discretionary target market characteristics
US6169542B1 (en) * 1998-12-14 2001-01-02 Gte Main Street Incorporated Method of delivering advertising through an interactive video distribution system
US6374404B1 (en) * 1998-12-16 2002-04-16 Sony Corporation Of Japan Intelligent device having background caching of web pages from a digital television broadcast signal and method of same
US6342904B1 (en) * 1998-12-17 2002-01-29 Newstakes, Inc. Creating a slide presentation from full motion video
US6363160B1 (en) * 1999-01-22 2002-03-26 Intel Corporation Interface using pattern recognition and tracking
US7199798B1 (en) * 1999-01-26 2007-04-03 International Business Machines Corp Method and device for describing video contents
US6522342B1 (en) * 1999-01-27 2003-02-18 Hughes Electronics Corporation Graphical tuning bar for a multi-program data stream
US6535639B1 (en) * 1999-03-12 2003-03-18 Fuji Xerox Co., Ltd. Automatic video summarization using a measure of shot importance and a frame-packing method
US6370688B1 (en) * 1999-05-26 2002-04-09 Enounce, Inc. Method and apparatus for server broadcast of time-converging multi-media streams
US6704929B1 (en) * 1999-08-18 2004-03-09 Webtv Networks, Inc. Tracking viewing behavior of a home entertainment system
US6993245B1 (en) * 1999-11-18 2006-01-31 Vulcan Patents Llc Iterative, maximally probable, batch-mode commercial detection for audiovisual content
US6549643B1 (en) * 1999-11-30 2003-04-15 Siemens Corporate Research, Inc. System and method for selecting key-frames of video data
US6675158B1 (en) * 1999-11-30 2004-01-06 Sony Corporation Method and apparatus for organizing data pertaining to audiovisual content
US6983478B1 (en) * 2000-02-01 2006-01-03 Bellsouth Intellectual Property Corporation Method and system for tracking network use
US6542546B1 (en) * 2000-02-02 2003-04-01 Mitsubishi Electric Research Laboratories, Inc. Adaptable compressed bitstream transcoder
US6868440B1 (en) * 2000-02-04 2005-03-15 Microsoft Corporation Multi-level skimming of multimedia content using playlists
US20020026345A1 (en) * 2000-03-08 2002-02-28 Ari Juels Targeted delivery of informational content with privacy protection
US6990679B2 (en) * 2000-03-31 2006-01-24 Matsushita Electric Industrial Co., Ltd. Program surf grid
US20020013943A1 (en) * 2000-04-07 2002-01-31 Seth Haberman System and method for simultaneous broadcast for personalized messages
US20030072440A1 (en) * 2000-06-02 2003-04-17 Murray Thomas A. Communication device having illuminated audio indicator
US6691126B1 (en) * 2000-06-14 2004-02-10 International Business Machines Corporation Method and apparatus for locating multi-region objects in an image or video database
US20020018594A1 (en) * 2000-07-06 2002-02-14 Mitsubishi Electric Research Laboratories, Inc. Method and system for high-level structure analysis and event detection in domain specific videos
US6724933B1 (en) * 2000-07-28 2004-04-20 Microsoft Corporation Media segmentation system and related methods
US6697523B1 (en) * 2000-08-09 2004-02-24 Mitsubishi Electric Research Laboratories, Inc. Method for summarizing a video using motion and color descriptors
US6685423B1 (en) * 2000-09-25 2004-02-03 Starcon International, Inc. Method and apparatus for extracting and installing heat exchanger bundles
US20030067554A1 (en) * 2000-09-25 2003-04-10 Klarfeld Kenneth A. System and method for personalized TV
US6678965B2 (en) * 2000-11-29 2004-01-20 Athan Corporation Method and apparatus for aligning a drum assembly used in a video recording device
US20030026592A1 (en) * 2000-12-28 2003-02-06 Minoru Kawahara Content creating device and method
US20030001880A1 (en) * 2001-04-18 2003-01-02 Parkervision, Inc. Method, system, and computer program product for producing and distributing enhanced media
US20030007555A1 (en) * 2001-04-27 2003-01-09 Mitsubishi Electric Research Laboratories, Inc. Method for summarizing a video using motion descriptors
US20030033288A1 (en) * 2001-08-13 2003-02-13 Xerox Corporation Document-centric system with auto-completion and auto-correction
US20050021784A1 (en) * 2001-09-07 2005-01-27 Christian Prehofer Device and method for the automatic configuration of user profiles
US20030066068A1 (en) * 2001-09-28 2003-04-03 Koninklijke Philips Electronics N.V. Individual recommender database using profiles of others
US7026964B2 (en) * 2002-01-31 2006-04-11 Microsoft Corporation Generating and searching compressed data
US20040003041A1 (en) * 2002-04-02 2004-01-01 Worldcom, Inc. Messaging response system
US20040030750A1 (en) * 2002-04-02 2004-02-12 Worldcom, Inc. Messaging response system
US20040015569A1 (en) * 2002-07-16 2004-01-22 Mikko Lonnfors System and method for providing partial presence notifications
US7343381B2 (en) * 2002-07-23 2008-03-11 Samsung Electronics Co., Ltd. Index structure for TV-Anytime Forum metadata having location information for defining a multi-key
US20040017389A1 (en) * 2002-07-25 2004-01-29 Hao Pan Summarization of soccer video content
US20040032486A1 (en) * 2002-08-16 2004-02-19 Shusman Chad W. Method and apparatus for interactive programming using captioning

Cited By (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USRE46310E1 (en) 1991-12-23 2017-02-14 Blanding Hovenweep, Llc Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
US8046313B2 (en) 1991-12-23 2011-10-25 Hoffberg Steven M Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
US20030140313A1 (en) * 1999-04-26 2003-07-24 Smith Kim C. Method of creating default lists of content of probable interest
US7974714B2 (en) 1999-10-05 2011-07-05 Steven Mark Hoffberg Intelligent electronic appliance system and method
US20020156860A1 (en) * 2000-02-25 2002-10-24 Finke Alan D. Personal server system
US9374405B2 (en) * 2000-03-14 2016-06-21 Joseph Robert Marchese Digital video system using networked cameras
US20120206606A1 (en) * 2000-03-14 2012-08-16 Joseph Robert Marchese Digital video system using networked cameras
US6697523B1 (en) * 2000-08-09 2004-02-24 Mitsubishi Electric Research Laboratories, Inc. Method for summarizing a video using motion and color descriptors
US20040128402A1 (en) * 2000-09-27 2004-07-01 Weaver David John Architecture for optimizing audio and video output states for multimeda devices
US7447815B2 (en) 2000-09-27 2008-11-04 Thomson Licensing Architecture for optimizing audio and video operating modes for multimedia devices based on predetermined hierarchical order of available audio and video operating modes
US20030120667A1 (en) * 2001-12-20 2003-06-26 Yeon Jeong Jeong Apparatus for processing method-embedded content and method thereof
US7757171B1 (en) * 2002-01-23 2010-07-13 Microsoft Corporation Media authoring and presentation
US7739601B1 (en) 2002-01-23 2010-06-15 Microsoft Corporation Media authoring and presentation
US7725829B1 (en) 2002-01-23 2010-05-25 Microsoft Corporation Media authoring and presentation
US20040243927A1 (en) * 2002-03-09 2004-12-02 Samsung Electronics Co. Ltd. Reproducing method and apparatus for interactive mode using markup documents
US20030182627A1 (en) * 2002-03-09 2003-09-25 Samsung Electronics Co., Ltd. Reproducing method and apparatus for interactive mode using markup documents
US20040247292A1 (en) * 2002-03-09 2004-12-09 Samsung Electronics Co. Ltd. Reproducing method and apparatus for interactive mode using markup documents
US20040028382A1 (en) * 2002-08-08 2004-02-12 Choi Hye-Jin Video recording/reproducing apparatus and program list displaying method thereof
US20040194612A1 (en) * 2003-04-04 2004-10-07 International Business Machines Corporation Method, system and program product for automatically categorizing computer audio files
US8015184B2 (en) * 2004-10-26 2011-09-06 Yahoo! Inc. Method and apparatus for a search-enabled remote control device
US20060090183A1 (en) * 2004-10-26 2006-04-27 David Zito Method and apparatus for a search-enabled remote control device
US20060140223A1 (en) * 2004-12-06 2006-06-29 Lee Jung M Method and apparatus for establishing environment of digital device using portable memory
US8265146B2 (en) * 2005-11-08 2012-09-11 Sony Corporation Information processing apparatus, imaging device, information processing method, and computer program
US20070140662A1 (en) * 2005-11-08 2007-06-21 Takashi Nunomaki Information processing apparatus, imaging device, information processing method, and computer program
US20070204238A1 (en) * 2006-02-27 2007-08-30 Microsoft Corporation Smart Video Presentation
US20090100462A1 (en) * 2006-03-10 2009-04-16 Woon Ki Park Video browsing based on thumbnail image
US20070230485A1 (en) * 2006-03-30 2007-10-04 Fujitsu Limited Service providing method, computer-readable recording medium containing service providing program, and service providing apparatus
US9166883B2 (en) 2006-04-05 2015-10-20 Joseph Robert Marchese Network device detection, identification, and management
US20070300265A1 (en) * 2006-06-21 2007-12-27 Nokia Corporation User behavior adapted electronic service guide update
EP1909495A2 (en) * 2006-10-03 2008-04-09 Sony Corporation Program information retrieval system and method
EP1909495A3 (en) * 2006-10-03 2013-11-20 Sony Corporation Program information retrieval system and method
US20080235586A1 (en) * 2007-03-19 2008-09-25 Hung-Te Chou Method and related system for multiple displays
US20100083113A1 (en) * 2008-09-26 2010-04-01 Thomson Licensing Inc. Architecture For Optimizing Audio and Video Output States for Multimedia Devices
EP2560380A4 (en) * 2010-11-24 2015-05-20 Jvc Kenwood Corp Chapter creation device, chapter creation method, and chapter creation program
US9094650B2 (en) 2010-11-24 2015-07-28 JVC Kenwood Corporation Chapter creating device, chapter creating method, and computer program product therefor
US20130086611A1 (en) * 2011-09-29 2013-04-04 Infosys Limited Dynamic header in an interactive application on television

Also Published As

Publication number Publication date Type
JP4408768B2 (en) 2010-02-03 grant
DE60021443D1 (en) 2005-09-01 grant
EP1026887A2 (en) 2000-08-09 application
JP2004357334A (en) 2004-12-16 application
JP2005065272A (en) 2005-03-10 application
EP1026887A3 (en) 2003-07-30 application
JP2005025776A (en) 2005-01-27 application
EP1026887B1 (en) 2005-07-27 grant
DE60021443T2 (en) 2006-05-24 grant
JP2000253377A (en) 2000-09-14 application
US6236395B1 (en) 2001-05-22 grant

Similar Documents

Publication Publication Date Title
US20030097657A1 (en) Method and system for delivery of targeted programming
US20060253874A1 (en) Mobile interface for manipulating multimedia content
US20030088872A1 (en) Advanced television system
US20070067800A1 (en) Advanced television system
US20030115274A1 (en) Method and system for sharing information with users in a network
US20090254823A1 (en) Bookmark Interpretation Service
US20030093790A1 (en) Audio and video program recording, editing and playback systems using metadata
US20080115169A1 (en) Client-server electronic program guide
US20080066100A1 (en) Enhancing media system metadata
US7028331B2 (en) Content proxy method and apparatus for digital television environment
US20060242161A1 (en) Dvd-linked internet bookmarking
US20100299701A1 (en) Media content retrieval system and personal virtual channel
US20050125823A1 (en) Promotional philosophy for a video-on-demand-related interactive display within an interactive television application
US20060242664A1 (en) Content providing server, information processing device and method, and computer program
US20060117365A1 (en) Stream output device and information providing device
US20030023975A1 (en) Enhanced music services for television
US20030112467A1 (en) Apparatus and method for multimedia navigation
US20030041159A1 (en) Systems and method for presenting customizable multimedia presentations
US20090019488A1 (en) System and method for providing personal content recommendations
US6744729B2 (en) Intelligent fabric
US20030113100A1 (en) Interface and method for managing multimedia content and related information
US20070220580A1 (en) User interface for a media convergence platform
US20050262533A1 (en) User interface having a cycling display of content representations
US8196168B1 (en) Method and apparatus for exchanging preferences for replaying a program on a personal video recorder
US20050182852A1 (en) Intelligent fabric

Legal Events

Date Code Title Description
AS Assignment

Owner name: SHARP LABORATORIES OF AMERICA, INC., WASHINGTON

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SEZAN, MUHAMMED IBRIHAM;QIAN, RICHARD;VAN BEEK, PETRUS J.L.;REEL/FRAME:011603/0898

Effective date: 19990422