WO2001060072A2 - Interface utilisateur multimedia interactive utilisant une categorisation par affinite - Google Patents

Interface utilisateur multimedia interactive utilisant une categorisation par affinite Download PDF

Info

Publication number
WO2001060072A2
WO2001060072A2 PCT/IB2001/000438 IB0100438W WO0160072A2 WO 2001060072 A2 WO2001060072 A2 WO 2001060072A2 IB 0100438 W IB0100438 W IB 0100438W WO 0160072 A2 WO0160072 A2 WO 0160072A2
Authority
WO
WIPO (PCT)
Prior art keywords
character
content
interface
affinity
user
Prior art date
Application number
PCT/IB2001/000438
Other languages
English (en)
Other versions
WO2001060072A3 (fr
Inventor
Steven Ericsson Zenith
Original Assignee
The Kiss Principle Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US09/504,327 external-priority patent/US7284202B1/en
Application filed by The Kiss Principle Inc. filed Critical The Kiss Principle Inc.
Priority to AU2001239483A priority Critical patent/AU2001239483A1/en
Publication of WO2001060072A2 publication Critical patent/WO2001060072A2/fr
Publication of WO2001060072A3 publication Critical patent/WO2001060072A3/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254—Management at additional data server, e.g. shopping server, rights management server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
    • H04N21/4381—Recovering the multiplex stream from a specific network, e.g. recovering MPEG packets from ATM cells
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H04N21/4438—Window management, e.g. event handling following interaction with the user interface
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508—Management of client data or end-user data
    • H04N21/4532—Management of client data or end-user data involving end-user characteristics, e.g. viewer profile, preferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/454—Content or additional data filtering, e.g. blocking advertisements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • H04N21/4668—Learning process for intelligent management, e.g. learning user preferences for recommending movies for recommending content, e.g. movies
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/47805—Electronic banking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4782—Web browsing, e.g. WebTV
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4786—Supplemental services, e.g. displaying phone caller identification, shopping application e-mailing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H04N21/64322—IP
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/812—Monomedia components thereof involving advertisement data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/445—Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/16—Analogue secrecy systems; Analogue subscription systems
    • H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309—Transmission or handling of upstream communications
    • H04N7/17318—Direct or substantially direct transmission and handling of requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/16—Analogue secrecy systems; Analogue subscription systems
    • H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309—Transmission or handling of upstream communications
    • H04N7/17327—Transmission or handling of upstream communications with deferred transmission or handling of upstream communications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4884—Data services, e.g. news ticker for displaying subtitles

Definitions

  • the field of the invention is related generally to computing devices; internetworking, television, television-based entertainment (including prerecorded, recorded on request, and live broadcast television viewing); the Internet and television broadcast services (including over-air broadcast, cable and satellite television systems). More particularly, the field of the invention relates to an interactive multi media user interface (MMUI), which interacts with a user and conveys information through affinity character based presentation of Internet and broadcast media based content and is capable of aggregating second level content including ecommerce opportunities.
  • MMUI interactive multi media user interface
  • the invention of a method for chat interaction using a simple television remote control "click chat" - which allows viewers in command of a conventional television remote control or other simple selection device to respond to dialog without requiring the use of a keyboard.
  • senders can incorporate optional responses into the chat stream using a simple encoding.
  • Viewers can customize their own responses to arbitrary questions, statements or exclamations. These viewer-defined responses are offered to the viewer when the click-chat system identifies a question, statement or exclamation in the chat system (in the simplest case by the detection of a query [?], period [.], or exclamation mark [!] in the incoming chat stream).
  • Chattercast is a more conventional chat experience where pre-scripted dialog is used to hide connection latency and connection state, to provide the viewer, in a mix of live and scripted dialog, with a seamless contextual dialog experience concurrent to television viewing, and to enhance advertising.
  • Future Radio is a fuller embodiment of the invention, including a universe of characters that not only entertain and inform as they communicate with the viewer but also are able to provide an interface to applications and services.
  • the first is the architecture represented by the first Web TV Plus deployments.
  • This architecture combines an Internet client with a slow connection via a telephony modem with hardware that permits the reception of Television broadcasts in which ATVEF triggers are present.
  • the second architecture is an extension of the first and permits the client to also receive broadband broadcasts of data (typically via satellite).
  • the third architecture is broadband - i.e., a fast connection in both directions.
  • the fourth architecture is wireless (permitting mobility).
  • connection state is whether a network connection is established by the client.
  • Latency is the time required to complete the delivery of a required communication.
  • the goal of our methods is to provide the viewer with a continuous, instant-on, dialog experience. High latency and a disconnected state are hidden, to the degree possible, from the viewer.
  • the presentation of the information can frequently be more important than the actual substance of the information. It is the presentation that focuses, maintains our attention.
  • TV commercials attempt to draw immediate attention through the increase in sound volume, a cheap mechanism to obtain user attention. It is the fluctuation of sound volume and intensity, tone of voice, personal quirks and gesturers, characteristic pauses or speaker delivery techniques and antics that keep us absorbed and interested in media content.
  • Interfaces can make or break an otherwise very good and useful technology.
  • the design of any good interface starts with understanding of the end user and how best they would like to interact with a technology. This begins with the attempt to ease the learning of the functionality of the technology and how to interact with it, thus the more comfortable a user is with the interface, the quicker they learn to use the technology and be proficient. Not just proficient, but to enjoy, obtain satisfaction from and master. For this reason, most tutorials start out very simple and progress to the more difficult in stages.
  • This mechanism may be in the form of a character provided from a list of a variety of celebrity, historical, personalities, stereotypical caricatures and the like, figures, that bring with them not only a domain of knowledge, but culture, mannerisms, attributes, method of speaking, personality, presentation techniques etc which a user can be comfortable with in interacting with the web TV and PC technology.
  • the integration of the media content with the presentation from a personality or character of a users choice will contain the substance and emotional content that is missing from conventional GUIs.
  • Emotional content can contain and convey the subliminal messages, which are vital to a user's interaction with a MMUI.
  • the addition of emotional content captures, maintains, and focuses a users interest. This emotional content comes through from the affinity character chosen by the user to deliver what ever it is the user is interested in.
  • Consumer Behavior Data Collection raise substantial privacy issues. These include gathering information on the users under the guise of the need to learn how best to present the user with opportunities relevant or of interest to the user quicker. This leads to implementation of extensive database record keeping and constitute a severe invasion of privacy depending on the dept and detail of dossier kept on individuals.
  • a character affiliated with a body of knowledge or a particular personality a user defines their possible likes, dislikes, interests, needs, market segments, purchasing behavior, specific affinity groups, behavior associations and more. These are unobtrusive means by which a users potential needs and requirements can be better and more efficiently discovered and served. What are needed are unobtrusive methods by which we can identify users preferences and needs.
  • MMUI multimedia user interface
  • MMUI which provides a user friendly way for a viewer to select content of particular interest and at the same time enable the program sponsors, internet service providers and other media advertisers to target specific audiences with advertising content tailored to the preferences of that audience. It would be desirable to provide a user friendly MMUI with a way to automatically segregate viewers into affinity groups with like preferences as this would greatly streamline content scanning and filtering of information.
  • a person interested in financial investment may prefer presentation through an investor personality such as Louis Rukeyser, Bob Brinker or the like, depending on the area of interest or personality preferred.
  • Content is immersive because a user is conversing with a character he finds interesting, stimulating and or provocative. This "conversation" takes place with a character on the multi media device through a variety of dimensions, those being visual, audio and emotional. The mechanisms for visual and audio are well known, but the emotional dimension is carried via the character, the character's attributes and delivery style. These together provide immersion in the media interface.
  • affinity group character interface which enables a user to identify with a character and affinity group such that a virtual relationship between the user and character can develop and grow over time.
  • a user can access information that is most relevant to the user, at his option via an interface which represents the user's affinity group.
  • a virtual relationship grows between the user and affinity group character.
  • the user can interact with the character representative of the user's selected affinity group, thereby facilitating the transfer of information.
  • a MMUI which comprises a plurality of characters, each character being emblematic of a specific affinity group which a user identifies with or is drawn to..
  • the user selects an affinity-based character, which commands a domain or body of broadcast media or Internet content. This content can be recalled, selected, translated and presented to a user in the format of that particular character's presentation style.
  • Another aspect of the invention provides e commerce applications, since an affinity based character "guide" is capable of merging broadcast media with internet business opportunities by filtering second level or sponsor/commercial content through users' preferences or users' choices based on knowledge about the users' selected character based affinity group.
  • the character conveys content from a plurality of secondary information sources selected and filtered through character's affinity group to the user via a virtual relationship.
  • Each client includes computers with television tuners, games machines, portable enhanced television devices, enhanced recording devices, and televisions enhanced with "set-top-box" devices supporting an enhanced TV standard (e.g., ATNEF) or any similar capability for the display and presentation of content concurrent to an audio/video viewing capability.
  • ATNEF enhanced TV standard
  • These devices are connected either permanently or intermittently to a network such as the Internet.
  • Each client contains some amount of data storage implemented by software, memory and/or other Mass Storage Device.
  • the client and network architecture includes clients infrequently connected to the network (such as via wireless or telephony modem), mobile devices (such as those devices using Java technology such as Jini or similar), clients permanently connected to the network (such as via Ethernet or cable modem), clients able to receive broadcast data (such as via satellite or otlier wireless broadcast) connected also via a "narrow band" back channel, and any combination of the forgoing with more or less data storage.
  • a set of servers provides sources of data and services (including a transient and permanent storage service) to the clients over these network architectures.
  • these sources include a system for the delivery of formatted media (such as ATVEF), a system capable of providing support for scheduled and unscheduled synchronization of data with the clients, and a system capable of delivering a real-time text, or audio, or audio/video chat stream.
  • These sources can optionally include a system capable of providing deferred short messaging support, a database system containing information such as a viewers identity and characteristics of value for or about the viewer, a database system containing content programming data and other information (about television or otherwise), a system capable of providing any other application (such as email messaging) or service (such as online banking)
  • a production service produces chat dialog for delivery to the clients that is contextual to programmed content, can provide information about programming, and/or is scripted to provide an interface to the other services available.
  • a user interacts with the text, audio, or audio/video chat stream. Dialog is overlaid on the primary content or is displayed alongside the primary content.
  • the chat stream provides supplemental entertainment and informational programming and acts as an interface to available applications and services.
  • Pre-scripted dialog (in the form of authored interactive transcripts) is delivered to the clients ahead of play back, delivered immediately prior to requirements or delivered on demand.
  • Pre-scripted dialog is triggered by time scheduled play back, trigger events attached to the content being viewed by the viewer (for example, using ATVEF triggers), or in response to an interaction with the viewer.
  • trigger events attached to the content being viewed by the viewer for example, using ATVEF triggers
  • pre- scripted dialog is played to hide the connection state and high communication latency.
  • Viewer's responses to chat dialog are delivered in real-time or are deferred for subsequent delivery. For example, if the viewer's client is disconnected a response can be collected by the client and delivery deferred until the client next connects or participates in a scheduled synchronization with the service. Viewer responses are also deferred when a viewer is connected - for example, if the response is prompted by a broadcast response request (say to an advertisement) then, to avoid high traffic spikes on the network, the response is deferred.
  • the pre-scripted dialog is associated with (contextual to) content, service or application. The pre-scripted dialog can refer to and provide information pertaining to programmed content (subsuming or supplementing the role of a conventional entertainment programming guide - EPG).
  • the pre-scripted dialog can refer the viewer to other content; provide links or reminders to other available programmed content - for example, while watching one television program the dialog can refer the viewer to other content.
  • the dialog may similarly capture a response from the viewer that expresses an interest in later viewing of supplemental content; permitting the dialog to present supporting material in subsequent interaction with the viewer (either during the same "session” of interaction or in subsequent "sessions.")
  • the pre-scripted dialog provides support to programmed advertising and product placement - for example, offering to purchase or provide additional information on an advertised product or service on a user's behalf
  • the dialog also provides notifications of events of interest to the viewer - these events include notification the new availability of programmed content (e.g., the start of a television program), incoming email, availability of an offer for a product the viewer has expressed an interest in (acting upon the viewer's personal preferences).
  • Real-time chat runs concurrent to the pre-scripted dialog and is available subject to the timing and availability of a real-time connection. Real-time connections are scheduled by an encoding in the pre-scripted dialog stream.
  • Pre-scripted dialog is fixed or variable. A richer experience is provided if the pre-scripted dialog stream provides multiple paths. For example, pre- scripted dialog should vary when viewing repeat showings of content.
  • a client records the path taken through a previous viewing to avoid repetition.
  • the pre-scripted and real-time dialog mix to form a single experience that is conversational in nature.
  • Pre-scripted dialog hides connection latency and connection state.
  • a multimedia user interface as specified in claim 1 and/or any one or more of the claims dependent thereon.
  • the invention is also directed to a method by which the described apparatus operates and including method steps for carrying out every function of the apparatus.
  • FIG 1 illustrates several Future Radio clients connected to a Future Radio server system and enhanced content broadcasts in accordance with an aspect of the invention.
  • FIG 2 illustrates a Future Radio server architecture in accordance with an aspect of the invention.
  • FIG 3 illustrates a Future Radio client architecture based on a Microsoft TV platform in accordance with an aspect of the invention.
  • FIG 4 is a block diagram showing the primary components of a typical client platform and it's external connections in accordance with an aspect of the invention.
  • FIG 5 illustrates the functional relationship between hardware and software in the client processing system in accordance with an aspect of the invention.
  • FIG 6 illustrates the functional components of the client software in accordance with an aspect of the invention.
  • FIG 7 is a flow diagram illustrating how an event (in this case a viewer changing channels) triggers the playback of transcripts and the scheduling of connections to broadcast and live chat servers in accordance with an aspect of the invention.
  • an event in this case a viewer changing channels
  • FIG 8 is a flow diagram illustrating a connection management routine that establishes valid connections concurrent to transcript playback in accordance with an aspect of the invention.
  • FIG 9 is a flow diagram illustrating transcript playback triggered by an enhanced television standard trigger in accordance with an aspect of the invention.
  • FIG 10 is a flow diagram illustrating transcript playback triggered by an application event trigger in accordance with an aspect of the invention.
  • FIG 11 is a flow diagram illustrating transcript playback triggered by a transcript event (item) in accordance with an aspect of the invention.
  • FIG 12 is a flow diagram illustrating a routine for transcript playback in accordance with an aspect of the invention.
  • FIG 13 is a flow diagram illustrating a routine for displaying transcripts, waiting for offered responses and executing them and checking if the failure of a response requires the execution of a further transcript in accordance with an aspect of the invention.
  • FIG 14 is a block diagram that illustrates the functional components of the Future Radio server in accordance with an aspect of the invention.
  • FIG 15 is a flow diagram illustrating the fetching of the next transcript item in accordance with an aspect of the invention.
  • FIG 16 illustrates a transcript with offered responses and how they can be displayed in accordance with an aspect of the invention.
  • FIG 17 illustrates a transcript with embedded directives, offered responses and associated executable functions in accordance with an aspect of the invention.
  • FIG 18 illustrates the functional relationship of the affinity character in the Future Radio Client and Future Radio server architecture in accordance with an aspect of the invention.
  • FIG 19 illustrates an example of an affinity character multimedia user interface and its components in accordance with an aspect of the invention.
  • a method and apparatus for delivering a social interface over a network, supplemental to and concurrent with television (or any similarly broadcast content) are described in the following description, for the purpose of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be evident, however, to one skilled in the art that the present invention may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to facilitate description.
  • steps according to the present invention are embodied in machine-executable software instructions, and the present invention is carried out in a processor executing the instructions, as will be described in detail below.
  • hardwired circuitry may be used in place of, or in combination with, software instructions to implement the present invention.
  • An aspect of the present invention relates to a system in which a computing device is integrated with an enhanced television receiver and display (client) and is connected to one or more servers over a network (such as the Internet).
  • the client includes a processing system that executes browser software, integrates broadcast media and enhanced television features.
  • the client provides a platform to deliver an interactive dialog (chat) interface for viewers (a.k.a. users) that provides supplemental entertainment, information regarding content (programmed and otherwise), enhancements to advertising, a community experience, and an interface to applications on the clients and available by access to the
  • an aspect of the present invention is implemented as a system known as "Future Radio" on a platform known as Microsoft TV Pale with TV Chat.
  • Microsoft TV Pal uses a standard television display to view enhanced television.
  • Microsoft TV Pak permits the construction of consumer electronic devices supporting enhanced television standards.
  • TV Chat is a TV Pal application that permits the presentation of chat and the playback of pre-scripted dialog.
  • the Microsoft TV Pak client permits television broadcasts to be overlaid with HTML and JavaScript functionality, for triggers (references to JavaScript functions) embedded in the broadcast television signal to be received.
  • TV Chat manages the network connection to a chat server and permits real-time chat dialog and pre-scripted chat dialog to be displayed using the TV Pak client.
  • the "Future Radio” client is implemented as an application written in HTML and JavaScript, it uses the API (Application Program Interface) provided by TV Chat and the Internet to make connections to Future Radio servers, receive chat and playback pre-scripted dialog. Triggers embedded in the broadcast content synchronize and coordinate dialog with content.
  • a viewer of a Microsoft TV Pak client with TV Chat can use "Future Radio" network applications and services provided by one or more remote “Future Radio” servers.
  • the “Future Radio” network services are used in conjunction with software running on the Microsoft TV client system to provide, through an evolving dialog, supplemental entertainment, information regarding programmed content (television shows and internet events), guidance through and supplemental enhancement of content (including advertising).
  • the evolving dialog provides an interface to applications such as messaging services, online banking services, educational applications, and e-commerce.
  • the evolving dialog incorporates notifications of various kinds. Dialog enhancements, applications and services are coordinated in the context of broadcast content that contains triggers to direct the course of the dialog. Dialog is also directed by interaction with the viewer.
  • FIG. 1 illustrates a configuration of the Future Radio network according to one embodiment.
  • a number of clients 1 are coupled to a modem pool 2 via a direct-dial, bi-directional data connections 306a, 306b, which may be Telephone, ISDN, DSL, Cable, Wireless or any other similar type of connection.
  • the modem pool 2 is coupled typically through a router, such as that conventionally l ⁇ iown in the art, to a number of remote servers 4 via a conventional network infrastructure 3, such as the Internet.
  • the Future Radio system also includes a Future Radio server 5 that specifically supports the Future Radio application running on the clients; i.e., the server 5 provides the Future Radio service to the Future Radio clients.
  • the modem pool 2 is a conventional modem pool, such as tliose found today throughout the world providing access to the Internet, and private networks, and may be provided by a local Internet Service Provider (ISP).
  • ISP Internet Service Provider
  • the Future Radio server 5 provides bi-directional access to a content broadcaster 7 typically a cable head end, such as that conventionally known in the art.
  • the server 5 provides the content broadcaster 7 the Future Radio service for transmission to the clients 1 over the enhanced content broadcast 6 typically a cable network, terrestrial broadcast, or satellite broadcast.
  • the Future Radio service is integrated with broadcast content 6 using an enhanced television standard.
  • that standard is provided by the Advanced Television Enhancement Forum (ATVEF) that permits the embedding of triggers in the broadcast 6 by the content broadcaster.
  • ATVEF Advanced Television Enhancement Forum
  • Triggers in this embodiment take the form of calls to JavaScript function calls to functions defined and executed on the clients 1.
  • the Future Radio application running on the clients 1 display and otherwise present interactive transcript and live dialog to viewers.
  • the Future Radio server 5 generally includes one or more computer systems generally having the architecture illustrated in FIG 2.
  • the illustrated architecture is only exemplary; a Future Radio server is not constrained to the illustrated architecture (for example, the architecture can be a more distributed system than illustrated here).
  • the illustrated architecture includes a central processing unit (CPU) 201, random access memory (RAM) 203, read-only memory (ROM) 202, a mass storage device 204, a modem 205, a network interface card (NIC) 206, and various other input/output devices 207.
  • Mass storage device 204 include magnetic, optical or other equivalent storage medium.
  • I/O devices 207 include any or all devices such as a display monitor, keyboard, cursor control device, etc.
  • Modem 205 is used to communicate data to and from remote servers 4.
  • the server 5 may actually comprise multiple physical and logical devices connected through distributed system architecture. Accordingly, NIC 206 is used to provide data communication with other devices that are a part of the Future Radio service.
  • FIG. 14 illustrates a Future Radio server 5 and the application services provided to deliver live and pre-scripted transcripts (described in detail below) to the clients 1.
  • Server 5 provides a synchronized remote application store 1405 that is periodically accessed by the clients 1 to update the local store 701, 702. Transcripts are produced (written) and managed from the production console 1401 and placed in the remote application store
  • Transcripts are also provided by the production console 1401 to the IRC chat server 1403 for live delivery to clients 1 and to the broadcast chat server 1404 for on-demand delivery to the clients 1.
  • the Future Radio service is integrated with broadcast content 6 using the triggers specified by an enhanced television standard.
  • the specification of those triggers - exactly what the trigger does, which content to include the triggers in, and precisely where in the content to include them - is specified by the Future Radio production team. That team uses production console 1401 (that may consist of multiple workstations attached to the server 5) and stored on the broadcast server 1404 for on- demand delivery to the content broadcaster 7 or the offline content postproduction team that may receive the trigger specification by any means - including land mail.
  • a deferred response manager 1406 gathers and processes responses that arrive at the remote application store 1405 from the clients 1 during the previously mentioned client update of the remote application store
  • a viewer may have made a response to a transcript associated with an advertisement during the course of their television viewing. If the client box 303 were not connected at that time to the Future Radio server 5 the response would have been stored in the client's deferred response store 702 and subsequently have arrived at the server 5 remote application store 1405 during an update.
  • the deferred response manager propagates those responses to their target destination - in this example case the destination could be a remote server 4 maintained by the advertiser and accessible to the Future Radio service via the Internet 3.
  • the deferred response manager 1406 places replies to deferred responses in the remote application store 1405 for later propagation to the client.
  • Chat server 1403 provides the live and interactive broadcast of transcripts, enabling the Future Radio production team using production console 1401 and moderators console 1402 to interact with viewers in real- time. Chat server 1403 also enables viewers to exchange real-time dialog when using the TV Chat client of the Microsoft TV, TV Pak.
  • the real-time chat server 1403 is typically an Internet Relay Chat (IRC) server. IRC is a standard Internet protocol for the exchange of real-time chat messages - any protocol providing similar functionality could be used.
  • Broadcast chat server 1404 delivers transcripts on-demand to clients 1 and processes requests from the Future Radio clients 1 using standard web server technology known in the art.
  • FIG. 3 illustrates a Future Radio client system 1 according to one embodiment.
  • the client system 1 includes an electronics unit 303 (hereafter referred to as "the Microsoft TV box” or “the box 303”), and ordinary television set 301, and a hand-held remote control 309.
  • the Microsoft TV box 303 is built into the television set 301 as an integral unit.
  • the box 303 includes hardware and software for providing the user with a multimedia graphical user interface that overlay or integrate alongside television content. This interface presents the Future Radio dialog by which the viewer can access presentation of information regarding programmed content (television shows and internet events), guidance through and supplemental enhancement of content
  • the Future Radio client system 1 uses the television 301 as a multimedia display device.
  • the box is coupled to the television set 301 by a link 302.
  • the link 302 includes an audio channel for generating sound from the television's speaker and a video channel in the form of RF (radio frequency), S-video, composite video, or other format.
  • the communication link 306a, 306b between box 303 and the server 5 is telephone, cable modem, or Ethernet.
  • the box 303 receives AC (alternating current) power through and AC power line 307.
  • the Microsoft TV box 303 is built into the television set 301 as an integral unit, and further integrated with a wireless communication link 306 and battery power in place of the AC power line 307.
  • the client is reduced size to create a portable embodiment of the invention - creating a PDA
  • Remote control 309 is operated by the viewer in order to control the client system 1 to select optional responses presented by the dialog.
  • the Future Radio service includes optional responses in the dialog for presentation by Microsoft TN Pak TV Chat "click chat" enabling the viewer to interact with Future Radio services and participate in the on-going dialog (chat).
  • the box 303 receives commands from the remote control 309 via an infrared (IR) communication link.
  • IR infrared
  • the link between the remote control 309 and the box 303 may be RF or any equivalent mode of transmission.
  • the input device in alternative embodiments may be a keyboard, touch screen or other equivalent input device.
  • the box 303 includes other application software that, when executed by a processor on the box 303, provides the viewer with an interface (using the multimedia and graphical capabilities of the box) that provides the viewer with access to the Future Radio services.
  • the application software is automatically available upon the application of power to the box 303.
  • FIG. 4 shows the internal components of the Microsoft TV box 303. Operation of the client system 1 is controlled by a CPU 401 that is in turn connected to other electronic circuitry 406.
  • the CPU 401 executes software designed to implement features of the present invention.
  • Other circuitry 406 implements the other functions of the Microsoft TV box 303 and provides interconnection between the box components.
  • Random Access Memory 403 provides transitory storage of executable programs and data.
  • Flash memory 404 provides storage of certain programs and data storage.
  • a mass storage device 405 is included in the Microsoft TV box.
  • FIG. 6 illustrates the principle internal structures of the Future Radio application that runs on the client box 303.
  • a transcript store 601 provides local storage of transcripts on the client box 303 and is implemented in this embodiment as a Windows CE storage partition in flash memory 404 or mass storage 405 - the particular storage implementation being dependent on the specification of the particular box 303 manufacturer.
  • Typical box 303 architecture today where the enhanced content broadcast 6 is transported over a cable television network is likely to have smaller amounts of flash memory 404 but be permanently connected by a relatively fast connection with low latency to the Internet 3 via a cable modem 407.
  • a box 303 architecture where the enhanced content broadcast 6 is transported by a satellite broadcast is likely to have a telephony "back channel" modem 407 that is relatively slow, has high latency to establish an initial network connection to the Internet 3, and provides a larger mass storage 405 capable of storing many more transcripts than when implemented in limited flash memory storage 404.
  • the Future Radio service balances the delivery of transcripts. Boxes 303 that are permanently connected to the Internet 3 via a low latency modem 407 connection and have low storage capacity are delivered most transcripts on-demand, while boxes with high latency are delivered transcripts ahead of requirements using the remote application storage 1405 noted above. In both cases however, locally stored transcripts are used to hide connection latencies; i.e., transcripts from local storage, if available, are played back while the Future Radio client attempts to initiate, reestablish, or wait for a connection to the internet 3.
  • Other events that may trigger transcript playback include events associated with other applications (such as a messaging [email], as illustrated in FIG 17 or personal information manager [PIM] application). It is important to note that FIG 16 and FIG 17 static snapshots of a continuous dialog (chat) experience.
  • Transcripts illustrated in FIG 16 and FIG 17, consist of a sequence of items - dialog 1702, offered responses 1601, and directives 1701.
  • FIG 16 shows a transcript that describes a conversation between "Nico” and “Zelda” and ends with a click-chat message 1601.
  • the string format shown in FIG 16 is the one used in the current embodiment - the format specifies separators between click-chat groupings and their items 1601 (in this case, the tilde and vertical bar character), a token used to introduce directives 1701 (the hash character). All other items are treated as dialog.
  • FIG 16 illustrates how an offered response 1601, is overlaid on the television screen
  • buttons 1603 are used to represent the groupings.
  • FIG 17 illustrates directives 1701 included in a transcript for processing by the Future Radio client program illustrated in FIG 12. Offered responses are processed by d e JavaScript of the interface FIG 13. In this embodiment, the JavaScript obtains the dialog
  • FIG 12 illustrates how transcript items are processed. Each item is fetched 1201 and parsed for directives that isolate a transcript 1202, 1211
  • transcript atomic 1207, 1212, 1208, 1213 makes a transcript atomic 1207, 1212, 1208, 1213 (causes the transcript to pause all other transcripts and prevent any new transcripts from proceeding until it completes), to flush the chat buffer 1209 (delete all historical dialog), schedule a connection 1210, 1215 (cause a connection to the network to be established at a later time to enable the reception of a broadcast chat from the broadcast chat server 1404, or to enable a live connection to the chat server 1404).
  • Connection schedules are stored in a list of scheduled connections 605 that cause the Future Radio client 303 to ensure a connection to the Internet is established and an associated transcript is executed.
  • FIG 12 illustrates the function of a transcript playback thread.
  • Dialog is added to the TV Chat buffer 607 and subsequently displayed by the interface illustrated in FIG 13.
  • the interface checks for offered responses 1302 and if a response is received, 1307 executes the response 1311.
  • the response 1311 will be stored in deferred response storage 602 if the box 303 is not connected to d e Internet 3. Any JavaScript function associated with the response e.g., as shown 1705, will also be executed.
  • the Microsoft TV platform and service in this embodiment typically maintains schedule 604 for client application storage, including 601, 602, 603, to be updated with its supporting services (of which Future Radio is one) during the early hours of the morning. Updates can generally be performed at any time at either the viewer's request or at an application's request. These updates synchronize the application stores 601, 602 on the client 303 with application storage on the server 5, 1405 causing transcripts to be propagated to the clients and deferred responses to be propagated to the Future Radio server 5. Transcripts sent to d e box 1 during these updates are played back when triggered by various triggers in broadcast content, transcripts, and applications. In another embodiment of the invention, triggers are associated with other content such as HTML pages available on the Internet and in local store.
  • TV Database 603 contains data related to scheduled content programming and is accessible to transcripts that can include data from the TV Database 603 or utilize the information in the database in its processing 605 to identify Future Radio service events that are scheduled with content.
  • Chattercast is an interactive contextual chat experience concurrent with television programming. Chattercast contextual dialogue enhances program sponsorship and paid advertising, is designed to enhance the viewer's TV viewing experience and works both online and offline. Viewers, using only a remote control to respond, are led down a path of interactive dialogue that prepares them for interaction with the show's producers, advertisers and sponsors.
  • Chattercast dialogue is a combination of pre-scripted and real-time chat - dialogue is delivered to Microsoft TV clients before it is required. Triggered mass responses (for example, to advertising) are collected on a deferred basis.
  • Future Radio produces and authors a mix of live and pre-scripted dialog for the purpose of delivering a social interface to community, entertainment, information, services and applications that run concurrent to broadcast content.
  • Transcripts that represent a given character represent an "actors voice" applying the well-known rules of theatre and elaborated on in the previously mentioned work of Nass and Reeves.
  • Future Radio can be implemented on a Multimedia Personal Computer where it becomes a desktop supplement or replacement.
  • Future Radio transcripts frequently utilize d e "Radio Talk Show” metaphor whereby viewers are mostly spectators and when they wish to contribute to the ongoing dialog "call in” - connect to the Future Radio server - and contributes dialog via a moderator (editor) that previews the dialog before it is broadcast.
  • moderator editor
  • the interaction stream can be broken down into "atomic" interactions whereby the viewer can finish the program and the character can give notification of new information.
  • An example of how the dialog interacts with a viewer is in the presentation of second level content. Dialog of the character and viewer can continue concurrently with the dialog and program on screen. Dialog provides for the introduction of the advertisement. An advertisement can be displayed on the MMUI and character then can make comments about the content on the screen. This mechanism allows the viewer to become an active participant in the advertisement at their own choosing.
  • the freedom to choose removes any subconscious or conscience sales pressure and enables a negotiation and a more personal connection to be made.
  • the character can then continue dialog witii viewer regarding die content and d e advertising content can be linked directly to the character's dialog. Chat can also refer to the advertisement where the user selects an icon expressing preferences for affinity group.
  • a MMUI provides a plurality of affinity based categorizations, each categorization represented by a specific fictional character. Each character is emblematic of an affinity based category. The user then selects a particular character which he identifies with in accordance with the user's personal preferences and personality. The character that the user selects acts as a demographic filter, and scans incoming broadcast content and determines the programs or channels to be provided to the users selecting that character.
  • Internet cloud 1800 represents all available content on the Internet and some broadcast TV content. This source of content is accessed by die Future Radio Server 1802 which also communicates bi-directionally with the Content Broadcaster 1804 using the available transmission media and standards. Content is received by the Enhanced Content Broadcaster 1806.
  • the Enhanced Content Broadcaster 1806 provides the Future Radio service after integrating the broadcast content using the enhanced television standard.
  • the current standard used in the embodiment is the ATVEF standard, and enables the embedding of triggers in the broadcast by the Content Broadcaster in real-time or in advance of content type triggers.
  • the Future Radio service is then available to Future Radio clients 1810.
  • a plurality of affinity group characters 1814 are displayed to a Future Radio client 1810 on a multimedia display 1820.
  • the user selects a particular affinity group character which he identifies with based upon the user's own preferences and personality.
  • the selected affinity group character is then displayed on the multimedia display 1820.
  • Also shown on the display 1820 are the text 1816, web
  • the selected character acts as a filter and scans incoming content by selecting channels , programming ,or second level content for the viewer to watch.
  • the affinity character also provides a simple and effective means for filtering and selecting programs to be recorded for later playback to a viewer. The content is naturally preferred by the user , because the selection of program content is based in accordance with the selected affinity group category and the predetermined preferences of the user that the affinity character represents.
  • the affinity group character acts as a demographic filter which optimizes the selection of content presented to a viewer.
  • Each affinity group character represents a lifestyle, personality type, presentation style and corresponding broadcast content with which a user can identify.
  • the selection of a particular affinity group character provides pre selected broadcast content for real time or delayed recording and playback to a user.
  • the affinity group character facilitates the selection of internet content and broadcast content by exploiting the viewer's preferences.
  • Each affinity group character is associated with a corresponding set of channels carrying specific broadcast content related to the lifestyle, personality, preferences or other characteristics represented by the affinity group character.
  • the viewer's preferences are known by the viewer's selection of a particular character.
  • broadcast content for a user can be pre selected automatically through selection of a particular affinity group character.
  • the interaction history of the affinity group character with a viewer can provide direction for selection of content based on prior indication of interest and non-interest in any particular area.
  • This aspect of the invention advantageously can create e commerce opportunities as well as provide second level content tailored to a specific audience. This also provides the sponsor of programming content with crucial information concerning where to allocate advertising resources.
  • an aspect of the invention significantly enhances e commerce opportunities since the user identifies witii and naturally wants to view and assimilate the content mediated through the corresponding affinity group character which the user has selected. This also establishes a virtual relationship between a viewer and the specific affinity character the viewer has selected from the list of affinity-based characters.
  • the affinity group characteristics filter 1811 filters the universe of broadcast content and information, talcing only the programming, content or channels relevant to the selected affinity group. From d e implementation point of view, the producer of each character makes an editorial decision about broadcast content that fits the character's affmity group.
  • tire producer may bias or preferentially select content for mediation tlirough the character on the basis of sponsorship.
  • This content stream is then engaged with a regulation means 1812 which provides a means for switching information stream content from chat to commercial, called second level content, which can be directed by users
  • a user could select on a displayed feature of a female affinity group character to ascertain what brand of coat, lipstick, tooth paste, hair coloring etc, the character is using or which appears on the screen.
  • the response then could be displayed on the text portion 1816, vocalized by the affinity group character or displayed on web TV 1818 portion with additional purchase or ordering information.
  • any item can be selected for secondary information.
  • the secondary information is mediated or filtered through the affinity group parameters and reflects the preferences and content of the selected affinity group and thus the user.
  • the sponsors also can determine the relative popularity of each affmity group character.
  • the sponsors then can target the largest possible receptive viewer audience with advertising content by filtering that content through the most popular affinity group character. For example, a viewer watching "Private Ryan” could select a feature such as a tank and activate a dialogue with the corresponding affinity group character concerning tank battles of World War II, such as El Alemain, Kursk-Orel and so forth.
  • the affinity group character doesn't overly distract the viewer; he simply can register interest.
  • the affinity character also can present second level content at a later time later for playback after it has been selected by user 1809. In this way, the affinity character acts as a filter for mediating content based on a user's expressed interest.
  • Future Radio characters would recognize viewer preferences and pass information on to content broadcasters for future display of content. From a service point of view, affinity group characters have popularity through use, which provides sponsors with valuable market and e commerce information.
  • an active feedback loop is provided at 1822 ( Figure 19) from the Future Radio Client 1810 to the Future Radio Server 1802.
  • This provides a means for determining a viewer's personal preferences, while securing the viewer's privacy.
  • Tracking each affinity group character's popularity witii multiple viewer's provides information about a viewer's preferences without the need to resort to record keeping on a user's interactions with Ms computer or other intrusive or covert means for gathering personal information.
  • the aspect of gathering information about an audience by tracking the affinity group character's popularity provides a non invasive, non intrusive means to collect information on a user's needs and wants without having to collect, assemble, store and mine large databases to determine consumer needs and preferences.
  • Fig 19 illustrates an example affinity character multimedia user interface and its components.
  • the affinity group categories 1902 can be displayed by many modes, one being the a display button 1904 which unrolls a list or universe of characters 1906 from which a user can select a character emblematic of a particular affinity group. This can also be accomplished aurally via a wireless pickup 1910 using a wireless technology such as Blue Tooth. This adds to and extends the multimedia interface to other control devices.
  • a microphone 1912 which will respond to voice commands can be used as well.
  • a possible screen layout is shown at 1900 with the affinity character displayed in a smaller window 1914 on the upper right of d e screen 1900. For example, when selecting a character associated with MIN, the MTV "show" is displayed at 1918 on the major portion of the display screen with the text 1916 displayed on the bottom of the screen.
  • Feedback loop 1822 signals which affinity group characters are preferred. This provides a non-intrusive, non- invasive method of determining a character's popularity which is useful in determining not only users' preferred viewing content, but also producer, sponsor and advertiser content.
  • the affinity character interface itself is provided with a means for storing each character's interactions with the user. Thus , it is the character's actions that are tracked, not the user, thereby protecting the user's privacy.
  • the affinity group character provides sponsor information and ecommerce opportunities with respect to a to user without burdening the user with myriad choice overload.
  • interaction between the viewer and the affinity group character can be spoken, initiated by a mouse click, or by any other convenient means of initiating communication. Therefore, persons of ordinary skill in this field are to understand that all such equivalent arrangements are included within the scope of the following claims.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Software Systems (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • General Engineering & Computer Science (AREA)
  • Information Transfer Between Computers (AREA)
  • Computer And Data Communications (AREA)

Abstract

La présente invention concerne des dispositifs informatiques qui peuvent travailler sur l'Internet, recevoir et stocker un contenu d'écoute de télévision programmé (à horaire fixe) et un contenu multimédia, qui offrent une plate-forme permettant d'accéder à une combinaison de contenus et de services Internet et de télévision. Sur cette plate-forme, un mélange de dialogues interactifs en direct et pré-écrits (discussions avec réponses offertes) est diffusé par un serveur ou des serveurs connectés de façon à offrir des divertissements supplémentaires, des informations relatives à un contenu programmé, des améliorations de publicités de télévision programmées, une expérience communautaire et une interface destinée à des applications et des services Internet. Le dialogue fournit une «interface sociale» permettant à des personnages de fiction ou non d'interagir avec des visionneurs. Ces personnages de fiction ou non sont tous emblématiques d'une catégorisation par groupes d'affinité spécifique, avec lequel un utilisateur s'identifie personnellement et pour lequel il se sent attiré. La sélection d'un personnage par affinité permet aussi de filtrer une sélection de contenu diffusés et de contenu Internet associée à ce personnage. Un contenu de second niveau est également associé à ce personnage et induit par celui-ci. Ceci offre des possibilités de commerce électronique dans lequel des sponsors peuvent diriger un contenu publicitaire fondé sur des facteurs tels que la popularité relative de chaque personnage ou le groupe démographique associé à chaque personnage.
PCT/IB2001/000438 2000-02-14 2001-02-14 Interface utilisateur multimedia interactive utilisant une categorisation par affinite WO2001060072A2 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2001239483A AU2001239483A1 (en) 2000-02-14 2001-02-14 Interactive multi media user interface using affinity based categorization

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/504,327 US7284202B1 (en) 1998-10-09 2000-02-14 Interactive multi media user interface using affinity based categorization
US09/504,327 2000-02-14

Publications (2)

Publication Number Publication Date
WO2001060072A2 true WO2001060072A2 (fr) 2001-08-16
WO2001060072A3 WO2001060072A3 (fr) 2002-05-30

Family

ID=24005783

Family Applications (2)

Application Number Title Priority Date Filing Date
PCT/IB2001/000438 WO2001060072A2 (fr) 2000-02-14 2001-02-14 Interface utilisateur multimedia interactive utilisant une categorisation par affinite
PCT/IB2001/000437 WO2001060071A2 (fr) 2000-02-14 2001-02-14 Interface interactive consommateur/multimedia mettant en oeuvre une categorisation basee sur des affinites

Family Applications After (1)

Application Number Title Priority Date Filing Date
PCT/IB2001/000437 WO2001060071A2 (fr) 2000-02-14 2001-02-14 Interface interactive consommateur/multimedia mettant en oeuvre une categorisation basee sur des affinites

Country Status (2)

Country Link
AU (2) AU2001239483A1 (fr)
WO (2) WO2001060072A2 (fr)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003052626A1 (fr) * 2001-12-14 2003-06-26 Activesky, Inc. Systeme d'edition multimedia pour dispositifs sans fil
EP1579616A2 (fr) * 2002-09-13 2005-09-28 Opentv, Inc. Procede et systeme de creation et de transmission de donnees de conception associees a un contenu reparti pour inclusion dans un contenu cree
KR100626665B1 (ko) 2004-08-03 2006-09-25 한국전자통신연구원 아이피 기반의 디지털 멀티미디어 방송 데이터 변환 장치및 그 방법과 그를 이용한 디지털 멀티미디어 방송 수신시스템
CN100481934C (zh) * 2001-11-08 2009-04-22 汤姆森许可贸易公司 进行用户间通信的模块和方法
US7937740B2 (en) 2002-08-16 2011-05-03 MediaIP, Inc. Method and apparatus for interactive programming using captioning
US8255966B2 (en) 2002-04-15 2012-08-28 Shusman Chad W Method and apparatus for internet-based interactive programming
US8893000B2 (en) 2009-08-26 2014-11-18 International Business Machines Corporation Relocation between virtual environments based upon promotional and alert conditions
US9117193B2 (en) 2009-09-04 2015-08-25 International Business Machines Corporation Method and system for dynamic detection of affinity between virtual entities
US10856031B2 (en) 2003-04-15 2020-12-01 MedialP, Inc. Method and apparatus for generating interactive programming in a communication network

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6684217B1 (en) * 2000-11-21 2004-01-27 Hewlett-Packard Development Company, L.P. System and method for generating a profile from which a publication may be created
US7296055B2 (en) * 2001-09-11 2007-11-13 Sony Corporation Information providing system, information providing apparatus, information providing method, information processing apparatus, information processing method, and program
US7962011B2 (en) 2001-12-06 2011-06-14 Plourde Jr Harold J Controlling substantially constant buffer capacity for personal video recording with consistent user interface of available disk space
ITTO20030445A1 (it) * 2003-06-13 2004-12-14 Massimo Pintore Locale interattivo.
US8406341B2 (en) 2004-01-23 2013-03-26 The Nielsen Company (Us), Llc Variable encoding and detection apparatus and methods
US8522293B2 (en) 2004-12-15 2013-08-27 Time Warner Cable Enterprises Llc Method and apparatus for high bandwidth data transmission in content-based networks
US8028322B2 (en) 2005-03-14 2011-09-27 Time Warner Cable Inc. Method and apparatus for network content download and recording
US8280982B2 (en) 2006-05-24 2012-10-02 Time Warner Cable Inc. Personal content server apparatus and methods
US9386327B2 (en) 2006-05-24 2016-07-05 Time Warner Cable Enterprises Llc Secondary content insertion apparatus and methods
US8024762B2 (en) 2006-06-13 2011-09-20 Time Warner Cable Inc. Methods and apparatus for providing virtual content over a network
US10885543B1 (en) 2006-12-29 2021-01-05 The Nielsen Company (Us), Llc Systems and methods to pre-scale media content to facilitate audience measurement
US8181206B2 (en) 2007-02-28 2012-05-15 Time Warner Cable Inc. Personal content server apparatus and methods
US9503691B2 (en) 2008-02-19 2016-11-22 Time Warner Cable Enterprises Llc Methods and apparatus for enhanced advertising and promotional delivery in a network
US9094713B2 (en) 2009-07-02 2015-07-28 Time Warner Cable Enterprises Llc Method and apparatus for network association of content
KR101758869B1 (ko) 2014-01-10 2017-07-18 한국전자통신연구원 멀티미디어 콘텐츠 분류장치 및 이를 이용한 분류방법
CN109618230B (zh) * 2018-12-21 2022-03-11 深圳Tcl数字技术有限公司 广告过滤方法、智能终端及计算机可读存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0822535A2 (fr) * 1996-08-01 1998-02-04 AT&T Corp. Publicité interactive multimédia et commerce électronique sur un réseau hypertexte
EP0902383A2 (fr) * 1997-09-10 1999-03-17 Ncr International Inc. Réseau de communication
WO1999016003A1 (fr) * 1997-09-22 1999-04-01 Belarc, Inc. Systeme et procede permettant de fournir une personnalisation client du contenu de pages web et analogues
US5991735A (en) * 1996-04-26 1999-11-23 Be Free, Inc. Computer program apparatus for determining behavioral profile of a computer user

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998032082A1 (fr) * 1997-01-17 1998-07-23 Taxi Interactive Ltd. Ordinateur et reseaux informatiques
US6167441A (en) * 1997-11-21 2000-12-26 International Business Machines Corporation Customization of web pages based on requester type
US6698020B1 (en) * 1998-06-15 2004-02-24 Webtv Networks, Inc. Techniques for intelligent video ad insertion

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5991735A (en) * 1996-04-26 1999-11-23 Be Free, Inc. Computer program apparatus for determining behavioral profile of a computer user
EP0822535A2 (fr) * 1996-08-01 1998-02-04 AT&T Corp. Publicité interactive multimédia et commerce électronique sur un réseau hypertexte
EP0902383A2 (fr) * 1997-09-10 1999-03-17 Ncr International Inc. Réseau de communication
WO1999016003A1 (fr) * 1997-09-22 1999-04-01 Belarc, Inc. Systeme et procede permettant de fournir une personnalisation client du contenu de pages web et analogues

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100481934C (zh) * 2001-11-08 2009-04-22 汤姆森许可贸易公司 进行用户间通信的模块和方法
WO2003052626A1 (fr) * 2001-12-14 2003-06-26 Activesky, Inc. Systeme d'edition multimedia pour dispositifs sans fil
US8661490B2 (en) 2002-04-15 2014-02-25 MediaIP, Inc. Method and apparatus for internet-based interactive programming
USRE48579E1 (en) 2002-04-15 2021-06-01 Media Ip, Inc. Method and apparatus for internet-based interactive programming
US8255966B2 (en) 2002-04-15 2012-08-28 Shusman Chad W Method and apparatus for internet-based interactive programming
US8826361B2 (en) 2002-08-16 2014-09-02 Media Ip, Inc. Method and apparatus for interactive programming using captioning
US7937740B2 (en) 2002-08-16 2011-05-03 MediaIP, Inc. Method and apparatus for interactive programming using captioning
US8402504B2 (en) 2002-08-16 2013-03-19 Media Ip, Inc. Method and apparatus for interactive programming using captioning
EP1579616A4 (fr) * 2002-09-13 2010-07-07 Opentv Inc Procede et systeme de creation et de transmission de donnees de conception associees a un contenu reparti pour inclusion dans un contenu cree
EP1579616A2 (fr) * 2002-09-13 2005-09-28 Opentv, Inc. Procede et systeme de creation et de transmission de donnees de conception associees a un contenu reparti pour inclusion dans un contenu cree
US10856031B2 (en) 2003-04-15 2020-12-01 MedialP, Inc. Method and apparatus for generating interactive programming in a communication network
US11076190B2 (en) 2003-04-15 2021-07-27 MedialP, Inc. Method and apparatus for generating interactive programming in a communication network
US11477506B2 (en) 2003-04-15 2022-10-18 MediaIP, LLC Method and apparatus for generating interactive programming in a communication network
US11575955B2 (en) 2003-04-15 2023-02-07 MediaIP, LLC Providing interactive video on demand
KR100626665B1 (ko) 2004-08-03 2006-09-25 한국전자통신연구원 아이피 기반의 디지털 멀티미디어 방송 데이터 변환 장치및 그 방법과 그를 이용한 디지털 멀티미디어 방송 수신시스템
US8893000B2 (en) 2009-08-26 2014-11-18 International Business Machines Corporation Relocation between virtual environments based upon promotional and alert conditions
US9878251B2 (en) 2009-08-26 2018-01-30 International Business Machines Corporation Relocation between virtual environments based upon promotional and alert conditions
US9117193B2 (en) 2009-09-04 2015-08-25 International Business Machines Corporation Method and system for dynamic detection of affinity between virtual entities

Also Published As

Publication number Publication date
AU2001239483A1 (en) 2001-08-20
WO2001060071A2 (fr) 2001-08-16
WO2001060072A3 (fr) 2002-05-30
AU2001239482A1 (en) 2001-08-20
WO2001060071A3 (fr) 2002-05-23

Similar Documents

Publication Publication Date Title
US7284202B1 (en) Interactive multi media user interface using affinity based categorization
WO2001060072A2 (fr) Interface utilisateur multimedia interactive utilisant une categorisation par affinite
Harboe et al. The uses of social television
Ducheneaut et al. Social TV: Designing for distributed, sociable television viewing
US9423945B2 (en) Avatar integrated shared media experience
US7409639B2 (en) Intelligent collaborative media
US11107122B2 (en) Targeted advertisement content presentation methods and systems
US20160029094A1 (en) Enabling interaction between social network users during synchronous display of video channgel
US20110106536A1 (en) Systems and methods for simulating dialog between a user and media equipment device
US20110107215A1 (en) Systems and methods for presenting media asset clips on a media equipment device
CN112601100A (zh) 一种直播互动方法、装置、设备及介质
US20050132420A1 (en) System and method for interaction with television content
US20100070858A1 (en) Interactive Media System and Method Using Context-Based Avatar Configuration
Tussey The procrastination economy: The big business of downtime
CA2460332A1 (fr) Procede et appareil permettant de badauder dans un bavardoir sans se connecter dans un environnement interactif de television
FR2910772A1 (fr) Procede de communication interactive entre terminaux de communication, serveur et reseau de television interactive
JP2003515267A (ja) ライブカスタマーサービスを用いる双方向テレビシステム
Van Vliet Where television and Internet meet
JP2012042503A (ja) インターアクティブ・ビデオシステム
Zamora-Medina Politainment as dance: visual storytelling on TikTok among Spanish political parties
US20220272416A1 (en) Virtual platform for recording and displaying responses and reactions to audiovisual contents
Stewart Interactive television at home: Television meets the Internet
US20150371276A1 (en) Method, system and application for providing second screen advertisments and reward opportunities to a user device
Schatz et al. “What Are You Viewing?” Exploring the Pervasive Social TV Experience
Head Just click play: A content analysis of YouTubers

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AU JP

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
AK Designated states

Kind code of ref document: A3

Designated state(s): AU JP

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP