Classifications

• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
  • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/16—Analogue secrecy systems; Analogue subscription systems
  • H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
  • H04N7/17309—Transmission or handling of upstream communications
  • H04N7/17318—Direct or substantially direct transmission and handling of requests
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/27—Server based end-user applications
  • H04N21/274—Storing end-user multimedia data in response to end-user request, e.g. network recorder
  • H04N21/2743—Video hosting of uploaded data from client
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
  • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
  • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
  • H04N21/4314—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
  • H04N21/4318—Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/439—Processing of audio elementary streams
  • H04N21/4396—Processing of audio elementary streams by muting the audio signal
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
  • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
  • H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/47—End-user applications
  • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
  • H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/47—End-user applications
  • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
  • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L67/00—Network arrangements or protocols for supporting network services or applications
  • H04L67/01—Protocols
  • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
  • H04L69/30—Definitions, standards or architectural aspects of layered protocol stacks
  • H04L69/32—Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level
  • H04L69/322—Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions
  • H04L69/329—Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions in the application layer [OSI layer 7]

Definitions

• the present invention relates generally to a system and method of creating and sharing enhancements to and in connection with a broadcast program to enhance the viewing experience of a number of viewers of the broadcast program. More particularly, the present invention concerns a method of synchronously controlling another party's media (computer, television, etc.) in a peer-to-peer network configuration.
• Prior art systems which integrate television broadcasts with other video or audio content such as a stream of data broadcast over the internet. Additionally, instant messaging and/or chat room interfacing over the internet, World-Wide-Web or other network is also known. Such prior art, however, does not allow one party to synchronously and dynamically control another party' s media in a peer-to-peer network to create a truly interactive display for a user.
• FIG. 1 is a schematic diagram of one exemplary system embodying the principles of the present invention, wherein multiple users view a broadcast program and simultaneously share information over a wide area network;
• FIG. 2 is a more detailed schematic diagram of each viewer display and manipulation system according to the present invention.
• FIG. 3 is a more detailed schematic diagram illustrating the inputs to a dynamic display controller of the present invention and an exemplary dynamically changed output;
• FIG. 4 is diagram showing the multiple layers that are displayed on a viewer display device;
• FIG. 5 shows a converged display including the multiple layers of FIG. 4, including a background layer for displaying a broadcast program and a user-prepared enhancement overlay layer;
• FIG. ⁇ is a schematic diagram of another exemplary system embodying the principles of the present invention, wherein multiple system users enhance a broadcast program via a set of multi-media tools provided by a Web server over the Internet;
• FIG. 7 is another diagram showing the multiple layers that are displayed on a viewer display in the embodiment of FIG. 6;
• FIG. 8 shows a converged display including the multiple layers of FIG. 7, including a broadcast program (background) layer, a user-prepared enhancement overlay layer and a multi-media tool overlay layer; and
• FIG. 9 is a flow chart of one exemplary method of generating, providing and displaying user-prepared enhancements to a plurality of viewers of a broadcast program.
• workstations workstations
• the term user and viewer will be used interchangeably in the remainder of this description and should be construed to mean a person who perceives a broadcast program using his or her senses, including but not limited to sight and hearing.
• the term multi-media presentation system is used herein to indicate a system capable or presenting audio and video information to a user. However, the presentation of more than one media should not be construed as a limitation of the present invention.
• multi-media presentation systems 12 include personal computer (PC) systems, PC televisions (PCTVs) and the like.
• Each multi-media presentation system 12 typically includes a viewer computer 14, at least one display device 16, such as a monitor or television set, and at least one audio output 18, such as one or more speaker that may be an internal component of a television set display device or provided as a separate speaker or multiple speakers.
• Each user multi-media presentation system 12 also includes at least one input device 20, such as a keyboard, mouse, digitizer pad, writing pad, microphone, camera or other pointing or input generating device which allows the user to provide user input the workstations 12.
• each multi-media presentation system 12 is typically adapted to receive at least one broadcast program signal 22, which may be provided in the form of broadcast television programming (including cable and satellite television) , closed circuit television, Internet web-TV or the like, received by means of a standard television broadcast signal over the air waves, cable television or satellite television, utilizing a tuner in each user computer 14.
• each multi-media presentation system interfaces with a computer network 24, which may be provided in the form of a local area network (LAN) , a wide area network (WAN) , telephone network or a global computer network, such as the Internet (World-Wide-Web) .
• LAN local area network
• WAN wide area network
• telephone network such as the Internet
• World-Wide-Web the Internet
• Each user computer includes a central processing unit (CPU) 26, which controls the functions of the presentation system.
• the CPU interfaces a broadcast receiver 28, which itself receives, as its input, the broadcast program signal 22.
• the broadcast receiver 28 is a broadcast channel tuner that receives broadcast signals from a source such as a television broadcasting station or other programming provider or source.
• Each user computer 14 also includes one or more internal storage devices 30, such as a disk drive, memory or CD ROM where data, including user input from other users or from within the same workstation, overlays, or other data related to the display on the user workstation may be stored.
• a communications controller 32 is also provided in each user computer 14, to control inputs received from and outputs transmitted to the other viewers via computer network 24.
• the communications controller 32 may act as a second receiver for receiving a second data stream provided to the user computer over the computer network.
• the communications controller 32 may include a device such as a modem (for example, a telephone, RF, wireless or cable modem) and/or a network interface card that receives information from a local or wide area network.
• a dynamic display controller 34 (also referred to herein as a broadcast browser) is also provided with each user computer 14.
• the dynamic display controller interfaces the CPU 26, broadcast receiver 28 and communications controller 32 and receives, as input, the multiple data streams provided to the user computer by one or more of the broadcast program signal 22, the computer network 22 (via the communications controller 32) and the internal storage device 30.
• the dynamic display controller 34 merges the multiple input signals and outputs a merged data signal to the display device 16.
• An audio processor 36 may also be provided, as necessary, to receive audio data from the multiple data sources and to provide the same to the audio output device (s) 18.
• the dynamic display controller 34 is implemented as computer software in the form of a browser user interface operating on the user computer 14, which is typically a personal computer or other similar individual computer workstation.
• Other embodiments contemplated include a client server configuration whereby a user computer 14 is connected to a server (not shown) that contains all or at least part of such computer software forming the dynamic display controller 34.
• Each multi-media presentation system 12 also includes at least one input device 20, which allows a first user to direct input to the dynamic display controller 34 to control what is displayed on the display device 16, thereby allowing the user to control (i.e. generate) their viewing experience and in addition, to control the saving and/or displaying of the experience to the remaining users of the system 10, as will be explained in greater detail below.
• each user computer CPU 26 receives, as a first input, a first data stream, such as a multi-media broadcast program signal 22 via broadcast receiver 28. It may also receive, as a second input, a data stream 40 including one or more third party, user-prepared, enhancements or additions to the broadcast signal input by a system user using one or more input device 20. Typically the user would interject images (video, hand drawn images, pictures, clip art, or the like) , objects, audio (voice or other sound(s)) and/or text (instant message (IM) or chat, which will be displayed on his or her display device 16. In this manner, a user can dynamically create a user experience in accordance with his or her personal preferences.
• a first data stream such as a multi-media broadcast program signal 22 via broadcast receiver 28. It may also receive, as a second input, a data stream 40 including one or more third party, user-prepared, enhancements or additions to the broadcast signal input by a system user using one or more input device 20.
• the user would interject images
• this user can also share his or her dynamically created user-prepared enhancements with other system users, to enhance their viewing experience or allow others to further modify and share their experience as well.
• the user an also create a data stream which can control another user' s viewing experience such as by controlling the broadcast station that another user's display device is tuned to, or store data to another user' s storage device for later recall and displaying.
• each user computer CPU may receive, via communications controller 32, a third data stream 42, which is made up of shared enhancements to the broadcast program signal which were created by other user(s) of the system and transmitted to the user' s computer over the computer network 24.
• the user computer CPU 26 merges the two or more data streams and provides a merged signal 44 to the display device 16.
• the CPU also provides, to communications controller 32 and under control of the dynamic display controller, a data stream made up of the user-prepared enhancements, which the communications controller 32, in turn, transmits as a shared enhancement data stream 42' to the other users of the system.
• the user enhanced data stream 42' can include information to be displayed on a display as well as trigger or alignment indications 47 which can be used to synchronize the user enhanced data stream 42' with a broadcast presentation on another user's display device.
• the system may include, on one or more user workstations 12 pattern recognition software or other means to align the user enhanced data stream 42' with an image pattern on a broadcast signal using one or more well known pattern recognition or "signature" type algorithms.
• the enhanced data stream 42' may also be stored on the creating user's or receiving user's internal storage device 30 for later replay or later transmission to others.
• a user can enhance not only his or her viewing experience by preparing user- prepared enhancements, but he or she can also enhance the viewing experience of any or all users of the system by sharing his or her user-prepared enhancements to the other users of the system or by forcing the display device of another user to be switched to another display (i.e. television channel) with or without enhancement, thereby creating a "community" viewing experience for any or all connected/subscribed users.
• FIGS. 4 and 5 show how a layering or "overlay” strategy is utilized by the dynamic display controller 34 to control the display of the data provided by a broadcast signal and data representing user-prepared enhancements so that all of the data may be displayed in a single window or screen on each display device 16.
• the dynamic display controller displays, in a "background” layer 50, the broadcast signal. Then, an overlay is displayed in the same window in at least one additional layer 54 on top of the background layer 50.
• the second layer utilizes a substantially transparent background 56 or, as is disclosed herein, a background from a tool set called or named "broadcast" to signify the source of the background information.
• the system also provided a plurality of user-selectable multimedia tools 56, which are provided in the form of a toolbar 58, typically although not necessarily displayed on the overlay layer 54.
• the toolbar 58 may be positioned to any portion of the screen as the user desires as is well known in the art.
• the user-selectable tools 56 allow a user to manipulate the overlay to modify the layers displayed on his or her display device.
• Examples of user-selectable tools include drawing tools that allow a user to reference or comment on one or more objects appearing in the underlying broadcast signal on the background layer of the display. Such drawing tools may include lines, arrows, and text boxes, thought bubbles, speech bubbles and the like.
• the user-selectable tools may also include one or more graphic insertion tools, which are responsive to a user input, to insert a graphic (image, picture, drawing, video clip, etc.) obtained from a graphic library into the overlay being displayed in the additional layer 54.
• Such graphics libraries may be stored in internal storage 30 provided by the user computer or may be stored in remote databases, which are accessible via the computer network.
• the user-selectable multi-media tools may also include an audio device to receive, store, edit and/or otherwise provide user-prepared auditory enhancements to the broadcast program.
• user-prepared auditory enhancements can also be transmitted to the additional system users over the computer network where they would be output on audio output devices included at each user's multi-media presentation system.
• the toolbar may also include a user-selectable delivery icon, which can be used by the user to trigger the delivery of any user-prepared enhancements to those of the plurality of additional system users who are included on a delivery list maintained by the user of the system that has created the user-prepared enhancements.
• the user created enhanced broadcast may be stored on a storage device of another user for viewing at la later time by the user.
• the resulting display appearing on the display device will appear in a single window 60, where the user-prepared enhancements will directly coincide with the portions of the underlying broadcast data stream to which they are directed if the user creating the enhancement creates and sends/stores them as they coincide with the broadcast signal the.
• speech bubbles 62 or thought bubbles 64 can be positioned adjacent a character 66 to which the speech or thought is to be attributed, text or speech inserted, and then transmitted (such as by hitting the return key or clicking the "mouse" button) or stored such that the respective alignment of the enhancements with the broadcast signal is maintained.
• Text boxes 68 may be positioned where they will minimize interference with important objects appearing in the underlying broadcast.
• Text boxes 68 may include an "instant message" or a chat window, both of which can also be used to change or affect the display of another user.
• An additional tool may also include a tool to change the display of another user to a channel of the first user's choice either immediately or later.
• FIGS. 6-8 show an alternative embodiment of a system 10 for communicating between a plurality of multi-media presentation participants.
• each user multi-media presentation system 12 interfaces with a Web server 70 via the Internet 72.
• the Web server 70 provides a multi-media tool overlay 74 as well as a user-prepared enhancement overlay 76.
• Each user multi-media presentation system 12 is similar to those described above with respect to the embodiment of FIGS. 1 and 2.
• each user computer accesses the web server 70, where the overlay information is maintained. Nonetheless, each user computer would still include a dynamic display controller 34 for merging the overlay information accessed and manipulated via the web server with the broadcast presentation 22 received directly by each user system.
• a display strategy utilizing three or more layers may be utilized.
• each system user can access the same tool overlay and use the tool overlay to create and store user-prepared enhancements to the broadcast signal that are stored on a third display layer 52.
• Each user will have a unique third display layer 52, which may also be referred to as a user-prepared enhancement overlay.
• a user-prepared enhancement overlay While there will be a common multi-media tools overlay, each user will create his or her own user-prepared enhancement overlay.
• the user-prepared enhancement overlay will then be transmitted to the other users of the system in a manner similar to that described above with respect to the self-contained, peer-to- peer system of FIGS. 1 and 2.
• the use of transparent backgrounds on the each overlay layer will allow the display to appear as if the user-prepared enhancements were simply inserted into the underlying broadcast as is shown in FIG. 8.
• a special tool may be provided with the plurality of multi-media tools. This tool will be referred to as a "broadcast mute" tool.
• the purpose of the broadcast mute "tool” is to dampen or otherwise minimize the interference of the underlying broadcast signal so that the user-prepared enhancement overlay appear more prominently in the merged display.
• One means by which the broadcast mute feature may emphasize the user-prepared enhancement overlay is to provide a video mute feature.
• the video mute feature may be implemented as a control for the brightness and/or contrast signal of the underlying broadcast signal sent to the display device.
• the video mute feature By lowering either or both of the brightness or contrast signal to the display device, the appearance of the broadcast data in the merged display will be dampened so that the user-prepared enhancements will be more prominent. Since the purpose of the broadcast mute tool is to provide emphasis to the user-prepared enhancements, when such enhancements are provided to the remainder of the users as shared enhancements, selection of the broadcast mute tool will affect the underlying broadcast signal of all users to whom the enhancement is shared.
• the tool set 58 may also include an audio mute tool.
• the audio mute tool will operate generally in a similar manner to the video mute tool. However, instead of affecting the underlying broadcast's video signal, it would allow audio enhancements to be highlighted by reducing the volume of the underlying broadcast signal. Of course both the video mute and audio mute features could be used together.
• FIG. 9 A method of generating and providing user-prepared enhancements to a plurality of viewers of a broadcast program 100 is shown in FIG. 9.
• a plurality of viewers of the broadcast program will utilize a display device for viewing the broadcast program.
• Each viewer will also have a computer for controlling the display device and for interfacing each user to the other viewers over a computer network.
• the method 100 begins by displaying a broadcast program in a background layer on at least one viewer display device, act 110.
• at least one overlay layer is provided on each viewer display device, act 120.
• Each overlay layer includes a transparent background to allow the broadcast program being displayed on the background layer to "bleed through”.
• At least one of the overlay layers includes a plurality of user selectable multi-media tools, which are responsive to user input, for manipulating at least one overlay layer by including user-prepared enhancements thereupon.
• any user-prepared enhancements input by a viewer using the tools is stored, act 130.
• the user-prepared enhancements are then transmitted to any additional users of the system who are viewing the underlying broadcast presentation, act 140.
• the user-prepared enhancements are transmitted in response to a user selectable delivery icon so that the user can complete the user-prepared enhancement and then deliver the enhancement when he or she so desires and to whom he or she desires.
• the user-prepared enhancement that has been transmitted to the additional system users is either displayed on at least one overlay layer on top of the broadcast layer being displayed on a display device at a receiving user' s system or stored on a storage device which is part of the receiving user's system.
• the user prepared enhancement that has been received can be used to control the display of the receiving user including changing a broadcast channel of the user either immediately of at a predetermined time or date in the future .

Applications Claiming Priority (3)

Publications (1)

Family

ID=22912669

Family Applications (1)

Country Status (5)

Families Citing this family (14)

Family Cites Families (4)

• 2001
  • 2001-10-19 KR KR10-2003-7005563A patent/KR20030094214A/ko not_active Application Discontinuation
  • 2001-10-19 CA CA002426917A patent/CA2426917A1/en not_active Abandoned
  • 2001-10-19 EP EP01986238A patent/EP1337989A2/de not_active Withdrawn
  • 2001-10-19 WO PCT/US2001/051410 patent/WO2002037943A2/en not_active Application Discontinuation
  • 2001-10-19 AU AU2002236689A patent/AU2002236689A1/en not_active Abandoned

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events