EP2659666A1 - Procédé et système permettant de fournir un contenu supplémentaire lié à un contenu affiché - Google Patents

Procédé et système permettant de fournir un contenu supplémentaire lié à un contenu affiché

Info

Publication number
EP2659666A1
EP2659666A1 EP11852866.0A EP11852866A EP2659666A1 EP 2659666 A1 EP2659666 A1 EP 2659666A1 EP 11852866 A EP11852866 A EP 11852866A EP 2659666 A1 EP2659666 A1 EP 2659666A1
Authority
EP
European Patent Office
Prior art keywords
content
screen device
screen
display
additional content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP11852866.0A
Other languages
German (de)
English (en)
Other versions
EP2659666A4 (fr
Inventor
Robert GEKCHYAN
Charles B. PARKER
Gokul MOHAN
Peter TRENNUM
Elizabeth WITHSTANDLEY
Scott Lee SILL
Jason Douglas PICKERSGILL
Charles Blake MCWHIRTER
Mark Leroy Walker
Sylvia PARK-EKECS
Edwin Curmie PRICE III
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thomson Licensing SAS
Original Assignee
Thomson Licensing SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing SAS filed Critical Thomson Licensing SAS
Publication of EP2659666A1 publication Critical patent/EP2659666A1/fr
Publication of EP2659666A4 publication Critical patent/EP2659666A4/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43079—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of additional data with content streams on multiple devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
    • H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/025—Systems for the transmission of digital non-picture data, e.g. of text during the active part of a television frame
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34—Indicating arrangements 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • H04N21/41265—The peripheral being portable, e.g. PDAs or mobile phones having a remote control device for bidirectional communication between the remote control device and client device
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42208—Display device provided on the remote control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/4222—Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42222—Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42224—Touch pad or touch panel provided on the remote control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4882—Data services, e.g. news ticker for displaying messages, e.g. warnings, reminders
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8126—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
    • H04N21/8133—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/835—Generation of protective data, e.g. certificates
    • H04N21/8358—Generation of protective data, e.g. certificates involving watermark
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/765—Interface circuits between an apparatus for recording and another apparatus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47214—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/78—Television signal recording using magnetic recording
    • H04N5/782—Television signal recording using magnetic recording on tape
    • H04N5/783—Adaptations for reproducing at a rate different from the recording rate

Definitions

  • the present invention generally relates to providing additional content related to displayed content.
  • additional content related to a displayed movie or program (such as supplemental materials on a DVD or Blue Ray disc) has to be viewed separately from the main movie or program. That is, the user has to stop or otherwise interrupt the playback of the main movie or program to access the supplemental materials. In many such cases, there is no correlation between the supplemental materials and the main movie or program. In other instances, a picture in picture format is employed to display supplemental materials, but this still interferes with the display and viewing of the main movie or program.
  • the present disclosure is directed towards a method and system for providing content related to a displayed program.
  • the method and system of the present disclosure includes a second screen application for a second screen device, such as a tablet (e.g., iPad) that provides rich content experiences in conjunction with displayed primary content (e.g., a movie from a Blu-Ray disc).
  • the second screen displays deep dive metadata, alternate scenes, other companion video material, or other related information that is synched to the main displayed program without disrupting a user's program viewing experience.
  • a method of displaying additional content related to primary content being viewed is disclosed.
  • the method includes the steps of displaying primary content on a first screen device; providing, in association with the display of the primary content on the first screen, a synching mechanism to synch additional content; and displaying, on a second screen device, additional content related to the primary content on the first screen that is synched to the content displayed on the first screen device according to the synching mechanism.
  • a system for displaying additional content related to primary content being viewed is disclosed.
  • the system includes a first screen device and a second screen device.
  • the first screen device is configured to display primary content.
  • the second screen device is configured to display additional content related to the primary content on the first screen that is synched to the content displayed on the first screen device according to a synching mechanism.
  • Figure 1 is a system diagram outlining the delivery of video and audio content to the home in accordance with one embodiment.
  • Figure 2 is system diagram showing further detail of a representative set top box receiver.
  • Figure 3 is a diagram depicting a touch panel control device in accordance with one embodiment.
  • Figure 4 is a diagram depicting some exemplary user interactions for use with a touch panel control device in accordance with one embodiment.
  • Figure 5 is system diagram depicting one embodiment of a system for
  • Figure 6 is a flow diagram depicting an exemplary process in accordance with one embodiment.
  • Figure 7 is a diagram depicting an exemplary methodology of synching
  • Figure 8 is a diagram depicting an exemplary methodology of synching
  • Figures 9A-9F are exemplary skeletal screen views depicting features in
  • Figures 10A-10D are exemplary skeletal screen views depicting features in accordance with one embodiment when used in active mode.
  • Figures 1 lA-11C are exemplary skeletal views depicting a social media
  • Figures 12A and 12B are exemplary skeletal views depicting a content
  • Figures 13A-13E are exemplary skeletal views depicting additional features in accordance with one embodiment.
  • Figures 14A-14L are exemplary skinned screen views depicting how certain features could appear to a user.
  • FIG. 1 a block diagram of an embodiment of a system 100 for delivering content to a home or end user is shown.
  • the content originates from a content source 102, such as a movie studio or production house.
  • the content may be supplied in at least one of two forms.
  • One form may be a broadcast form of content.
  • the broadcast content is provided to the broadcast affiliate manager 104, which is typically a national broadcast service, such as the American Broadcasting Company (ABC), National
  • the broadcast affiliate manager may collect and store the content, and may schedule delivery of the content over a deliver network, shown as delivery network 1 (106).
  • Delivery network 1 (106) may include satellite link transmission from a national center to one or more regional or local centers. Delivery network 1 (106) may also include local content delivery using local delivery systems such as over the air broadcast, satellite broadcast, or cable broadcast.
  • the locally delivered content is provided to a receiving device 108 in a user's home, where the content will subsequently be searched by the user. It is to be appreciated that the receiving device 108 can take many forms and may be embodied as a set top box/digital video recorder (DVR), a gateway, a modem, etc.
  • DVR set top box/digital video recorder
  • the receiving device 108 may act as entry point, or gateway, for a home network system that includes additional devices configured as either client or peer devices in the home network.
  • a second form of content is referred to as special or additional content.
  • Special or additional content may include content delivered as premium viewing, pay-per-view, or other content otherwise not provided to the broadcast affiliate manager, e.g., movies, video games or other video elements.
  • the special content may be content requested by the user.
  • the special content may be delivered to a content manager 110.
  • the content manager 110 may be a service provider, such as an Internet website, affiliated, for instance, with a content provider, broadcast service, or delivery network service.
  • the content manager 110 may also incorporate Internet content into the delivery system.
  • the content manager 110 may deliver the content to the user's receiving device 108 over a separate delivery network, delivery network 2 (112).
  • Delivery network 2 (112) may include high-speed broadband Internet type communications systems. It is important to note that the content from the broadcast affiliate manager 104 may also be delivered using all or parts of delivery network 2 (112) and content from the content manager 110 may be delivered using all or parts of delivery network 1 (106).
  • the user may also obtain content directly from the Internet via delivery network 2 (112) without necessarily having the content managed by the content manager 110.
  • the additional content is provided as an augmentation to the broadcast content, providing alternative displays, purchase and merchandising options, enhancement material, etc.
  • the additional content may completely replace some programming content provided as broadcast content.
  • the additional content may be completely separate from the broadcast content, and may simply be a media alternative that the user may choose to utilize.
  • the additional content may be a library of movies that are not yet available as broadcast content.
  • the receiving device 108 may receive different types of content from one or both of delivery network 1 and delivery network 2.
  • the receiving device 108 processes the content, and provides a separation of the content based on user preferences and commands.
  • the receiving device 108 may also include a storage device, such as a hard drive or optical disk drive, for recording and playing back audio and video content. Further details of the operation of the receiving device 108 and features associated with playing back stored content will be described below in relation to FIG. 2.
  • the processed content is provided to a display device 114.
  • the display device 114 may be a conventional 2-D type display or may alternatively be an advanced 3-D display.
  • the receiving device 108 may also be interfaced to a second screen such as a touch screen control device 116.
  • the touch screen control device 116 may be adapted to provide user control for the receiving device 108 and/or the display device 114.
  • the touch screen device 116 may also be capable of displaying video content.
  • the video content may be graphics entries, such as user interface entries, or may be a portion of the video content that is delivered to the display device 114.
  • the touch screen control device 116 may interface to receiving device 108 using any well known signal transmission system, such as infra-red (IR) or radio frequency (RF) communications and may include standard protocols such as infra-red data association (IRDA) standard, Wi-Fi, Bluetooth and the like, or any other proprietary protocols.
  • IR infra-red
  • RF radio frequency
  • the touch screen control device 116 can be interfaced directly with delivery networks 1 and 2. Operations of touch screen control device 116 will be described in further detail below.
  • the system 100 also includes a back end server 118 and a usage database 120.
  • the back end server 118 includes a personalization engine that analyzes the usage habits of a user and makes recommendations based on those usage habits.
  • the usage database 120 is where the usage habits for a user are stored. In some cases, the usage database 120 may be part of the back end server 118 a.
  • the back end server 118 (as well as the usage database 120) is connected to the system the system 100 and accessed through the delivery network 2 (112).
  • Receiving device 200 may operate similar to the receiving device described in FIG. 1 and may be included as part of a gateway device, modem, set-top box, or other similar communications device.
  • the device 200 shown may also be incorporated into other systems including an audio device or a display device. In either case, several components necessary for complete operation of the system are not shown in the interest of conciseness, as they are well known to those skilled in the art.
  • the input signal receiver 202 may be one of several known receiver circuits used for receiving, demodulation, and decoding signals provided over one of the several possible networks including over the air, cable, satellite, Ethernet, fiber and phone line networks.
  • the desired input signal may be selected and retrieved by the input signal receiver 202 based on user input provided through a control interface or touch panel interface 222.
  • Touch panel interface 222 may include an interface for a touch screen device. Touch panel interface 222 may also be adapted to interface to a cellular phone, a tablet, a mouse, a high end remote or the like.
  • the decoded output signal is provided to an input stream processor 204.
  • the input stream processor 204 performs the final signal selection and processing, and includes separation of video content from audio content for the content stream.
  • the audio content is provided to an audio processor 206 for conversion from the received format, such as compressed digital signal, to an analog waveform signal.
  • the analog waveform signal is provided to an audio interface 208 and further to the display device or audio amplifier.
  • the audio interface 208 may provide a digital signal to an audio output device or display device using a High-Definition Multimedia Interface (HDMI) cable or alternate audio interface such as via a Sony/Philips Digital Interconnect Format (SPDIF).
  • HDMI High-Definition Multimedia Interface
  • SPDIF Sony/Philips Digital Interconnect Format
  • the audio interface may also include amplifiers for driving one more sets of speakers.
  • the audio processor 206 also performs any necessary conversion for the storage of the audio signals.
  • the video output from the input stream processor 204 is provided to a video processor 210.
  • the video signal may be one of several formats.
  • the video processor 210 provides, as necessary a conversion of the video content, based on the input signal format.
  • the video processor 210 also performs any necessary conversion for the storage of the video signals.
  • a storage device 212 stores audio and video content received at the input.
  • the storage device 212 allows later retrieval and playback of the content under the control of a controller 214 and also based on commands, e.g., navigation instructions such as fast- forward (FF) and rewind (Rew), received from a user interface 216 and/or touch panel interface 222.
  • FF fast- forward
  • Rew rewind
  • the storage device 212 may be a hard disk drive, one or more large capacity integrated electronic memories, such as static RAM (SRAM), or dynamic RAM (DRAM), or may be an interchangeable optical disk storage system such as a compact disk (CD) drive or digital video disk (DVD) drive.
  • SRAM static RAM
  • DRAM dynamic RAM
  • CD compact disk
  • DVD digital video disk
  • the converted video signal from the video processor 210, either originating from the input or from the storage device 212, is provided to the display interface 218.
  • the display interface 218 further provides the display signal to a display device of the type described above.
  • the display interface 218 may be an analog signal interface such as red- green-blue (RGB) or may be a digital interface such as HDMI. It is to be appreciated that the display interface 218 will generate the various screens for presenting the search results in a three dimensional gird as will be described in more detail below.
  • the controller 214 is interconnected via a bus to several of the components of the device 200, including the input stream processor 202, audio processor 206, video processor 210, storage device 212, and a user interface 216.
  • the controller 214 manages the conversion process for converting the input stream signal into a signal for storage on the storage device or for display.
  • the controller 214 also manages the retrieval and playback of stored content.
  • the controller 214 performs searching of content and the creation and adjusting of the gird display representing the content, either stored or to be delivered via the delivery networks, described above.
  • the controller 214 is further coupled to control memory 220 (e.g., volatile or nonvolatile memory, including RAM, SRAM, DRAM, ROM, programmable ROM (PROM), flash memory, electronically programmable ROM (EPROM) , electronically erasable programmable ROM (EEPROM), etc.) for storing information and instruction code for controller 214.
  • Control memory 220 may store instructions for controller 214.
  • Control memory may also store a database of elements, such as graphic elements containing content. The database may be stored as a pattern of graphic elements. Alternatively, the memory may store the graphic elements in identified or grouped memory locations and use an access or location table to identify the memory locations for the various portions of information related to the graphic elements. Additional details related to the storage of the graphic elements will be described below.
  • control memory 220 may include several possible embodiments, such as a single memory device or, alternatively, more than one memory circuit communicatively connected or coupled together to form a shared or common memory. Still further, the memory may be included with other circuitry, such as portions of bus communications circuitry, in a larger circuit.
  • the user interface process of the present disclosure employs an input device that can be used to express functions, such as fast forward, rewind, etc.
  • a touch panel device 300 may be interfaced via the user interface 216 and/or touch panel interface 222 of the receiving device 200, as shown in FIG. 3.
  • the touch panel device 300 allows operation of the receiving device or set top box based on hand movements, or gestures, and actions translated through the panel into commands for the set top box or other control device.
  • the touch panel 300 may simply serve as a navigational tool to navigate the gird display.
  • the touch panel 300 will additionally serve as the display device allowing the user to more directly interact with the navigation through the grid display of content.
  • the touch panel device may be included as part of a remote control device containing more conventional control functions such as actuator or activator buttons.
  • the touch panel 300 can also includes at least one camera element. In some embodiments, the touch panel 300 may also include a microphone.
  • FIG. 4 the use of a gesture sensing controller or touch screen, such as shown, provides for a number of types of user interaction.
  • the inputs from the controller are used to define gestures and the gestures, in turn, define specific contextual commands.
  • the configuration of the sensors may permit defining movement of a user's fingers on a touch screen or may even permit defining the movement of the controller itself in either one dimension or two dimensions.
  • Two-dimensional motion, such as a diagonal, and a combination of yaw, pitch and roll can be used to define any three-dimensional motion, such as a swing.
  • a number of gestures are illustrated in FIG. 4. Gestures are interpreted in context and are identified by defined movements made by the user.
  • Bumping 420 is defined by a two-stroke drawing indicating pointing in one direction, either up, down, left or right.
  • the bumping gesture is associated with specific commands in context. For example, in a TimeShifting mode, a left-bump gesture 420 indicates rewinding, and a right-bump gesture indicates fast-forwarding. In other contexts, a bump gesture 420 is interpreted to increment a particular value in the direction designated by the bump.
  • Checking 440 is defined as in drawing a checkmark. It is similar to a downward bump gesture 420. Checking is identified in context to designate a reminder, user tag or to select an item or element. Circling 440 is defined as drawing a circle in either direction. It is possible that both directions could be distinguished.
  • Dragging 450 is defined as an angular movement of the controller (a change in pitch and/or yaw) while pressing a button (virtual or physical) on the tablet 300 (i.e., a "trigger drag").
  • the dragging gesture 450 may be used for navigation, speed, distance, time-shifting, rewinding, and forwarding.
  • Dragging 450 can be used to move a cursor, a virtual cursor, or a change of state, such as highlighting outlining or selecting on the display.
  • Dragging 450 can be in any direction and is generally used to navigate in two dimensions. However, in certain interfaces, it is preferred to modify the response to the dragging command.
  • Nodding 460 is defined by two fast trigger-drag up-and- down vertical movements. Nodding 460 is used to indicate “Yes” or “Accept.”
  • X-ing 470 is defined as in drawing the letter “X.” X-ing 470 is used for "Delete” or “Block” commands.
  • Wagging 480 is defined by two trigger-drag fast back-and-forth horizontal movements. The wagging gesture 480 is used to indicate "No" or "Cancel.”
  • a simple right or left movement on the sensor as shown here may produce a fast forward or rewind function.
  • multiple sensors could be included and placed at different locations on the touch screen. For instance, a horizontal sensor for left and right movement may be placed in one spot and used for volume up/down, while a vertical sensor for up and down movement may be place in a different spot and used for channel up/down. In this way specific gesture mappings may be used.
  • the system and methodology can be implemented in any number of ways depending on the hardware and the content involved. Examples of such deployment include DVD, Blu-Ray disc (BD); streaming video or video on demand (VOD), and broadcast (satellite, cable, over the air).
  • BD Blu-Ray disc
  • VOD streaming video or video on demand
  • broadcast satellite, cable, over the air.
  • Each of these deployments would have different architectures but one could standardize the triggers for each of these events (the additional content) that represents what would be queued by the application running on the second screen. For example, event A and event B would be triggered by a synching mechanism associated with any of these sources of a video.
  • event A the program running on the second screen device
  • the program running on the second screen device e.g. tablet
  • the program running on the second screen device would do "event B".
  • Figure 5 depicts a generic system 500 on which such methodology could be implemented.
  • the system 500 includes a first screen device 510, a second screen device 520, a playback device 530, a network 540 and server 550. Each of these elements will be discussed in more detail below.
  • the first screen device 510 is a display device, such as display device 114 described above in relation to Figure 1, for displaying content such as television programs, movies, and websites. Examples of such first screen display devices include, but are not limited to, a television, monitor, projector, or the like.
  • the first screen device 510 is connected to the playback device 530 which can provide the primary content to the first screen device 510 for display. Examples of such communication include, but are not limited to HDMI, VGA, Display port, USB, component, composite, radio frequency (RF), and infrared (IR), and the like.
  • the first screen display device 510 may be connected to the network 540, in either a wired or wireless (WiFi) manner, providing additional connection to the second screen device 520 and server 550.
  • WiFi wireless
  • the first display device 510 may include the functionality of the playback device 530.
  • the first screen display device 510 may be in non-networked communication 560 with the second screen device 520. Examples of such non-networked communication 560 include, but are not limited to, RF, IR, Blue-Tooth, and other audio communication techniques and protocols.
  • the second screen device 520 is device capable of displaying additional content related to the primary content being displayed on the first screen device 510.
  • the second screen device may be a touch screen control device 116 or touch screen device 300 as described above. Examples of second screen devices include, but are not limited to, a smart phone, tablet, laptop, personal media player (e.g. ipod), or the like.
  • the second screen device 520 is in communication with playback device 530 using either network 540, non-networked communication 560, or both.
  • the second screen device 550 is also in communication with the server 550 via the network 540 for requesting and receiving additional content related to the primary content being displayed on the first screen device 510.
  • the second screen device 520 may be in networked or non- networked communication 560 with the first screen device 510.
  • non- networked communication 560 include, but are not limited to, RF, IR, Blue-Tooth (BT), audio communication techniques and protocols, or the like.
  • the playback device 530 is device capable of providing primary content for display on the first screen device 510.
  • Examples of such playback display devices include, but are not limited to, a DVD player, Blue -Ray Disc (BD) player, game console, receiver device (cable or satellite), Digital Video Recorder (DVR), streaming device, personal computer, or the like.
  • the playback device 530 is connected to the first screen device 510 for providing the primary content to the first screen device 510 for display. Examples of such
  • connections include, but are not limited to HDMI, VGA, Display port, USB, component, composite, radio frequency (RF), and infrared (IR), and the like.
  • the playback device 530 is also connected to the network 540, in either a wired or wireless (WiFi) manner, providing connection to the second screen device 520 and server 550.
  • WiFi wireless
  • the functionality of the playback device 530 may be included in the first screen display device 510.
  • the playback device 530 may be in non-networked communication 560 with the second screen device 520.
  • non-networked communication 560 include, but are not limited to, RF, IR, Blue -Tooth (BT), and other audio communication techniques and protocols.
  • the network 540 can be a wired or wireless communication network implemented using Ethernet, MoCA, and wireless protocols or a combination thereof. Examples of such a network include, but are not limited to, delivery network 1 (106) and delivery network 2 (112) discussed above.
  • the server 550 is a content server configured to provide additional content to the second screen device 520. In certain embodiments, the server may also provide the primary content for display on the first screen device 510.
  • the service is connected to the network 540 and can communicate with any of the devices that are also connected.
  • Examples of such a server include, but are not limited to, content source 102, broadcast affiliate manager 104, content manager 110, and the back end server described above.
  • Figure 6 depicts a flow diagram 600 for a methodology for displaying additional content related to primary content being viewed is disclosed.
  • the method includes the following steps: Displaying primary content on a first screen device 510 (step 610).
  • the method also includes the steps of receiving commands from the second screen device 520 to control the display of primary content on the first screen device 510 (step 640) and controlling the display of the primary content on the first screen device 510 based on the commands received from the second screen device 520 (step 650). Each of these steps will be described in more detail below.
  • the step of displaying primary content is performed on the first screen device 510.
  • the primary content can be provided by the playback device 530 or be received directly from a content provider at the first screen display device 510.
  • the primary content is then shown or otherwise displayed on the first screen device 510.
  • the display of the primary content also includes the control of the content being displayed. This can include the traditional playback commands of play, stop, pause, rewind, and fast forward as well as the navigation of on screen menus to select the content and other playback options.
  • the display on the first screen device 510 (step 620) further includes displaying an indicator of the type of additional content being displayed on the second screen device 520.
  • the provided synching mechanism can be implemented in a number of ways.
  • the synching mechanism is performed by an application running on the second screen device 520, the playback mechanism 530, the first screen device 510 or any combination thereof.
  • the second screen device 520 is configured (via an application) to detect synching signals, cues, or other type of indicators that directs the second screen device 520 to update the display of additional content to coincide with the primary content being displayed on the first screen 510.
  • the synching signals, cues or other type of indicators can be provided as part of the primary content or can be generated by the playback device 530 of first screen device 510 (via an application) in accordance with the chapter, scene, time-code, subject matter, or content being displayed.
  • the synching signals, cues or other type of indicators can be transmitted to the second screen device 520 using the network, in either a wired or wireless (WiFi) manner, or using non-networked communication 560 such as audio signals. Examples of some of the implementations are given below. Other possible implementations will be apparent given the benefit of this disclosure.
  • the step of displaying the additional content is performed on the second screen device 520.
  • the additional content can be stored locally on the second screen device 520 or be provided by the server 550, playback device 530, or first screen device 510.
  • the display of the addition content is synched to the primary content being displayed on the first screen device 510 according to the synching mechanism. For example, when the second screen device 520 detects a synching signal, cue or other type of indicator, the second screen device 520 updates the display of the additional content accordingly. In some embodiments, this further involves contacting and requesting the additional content from the server 550, playback device 530, or first screen device 510 and subsequently downloading and displaying the additional content.
  • the addition content to be displayed can be selected, modified, or omitted based on the user using the system.
  • the display on the second screen device 520 (step 630) further includes displaying the status of the display of the primary content on the first screen device 510 such as whether the display of the primary content on the first screen device 510 has been paused.
  • the display on the second screen device 520 (step 630) further includes displaying the status of the synch between the additional content on the second screen device 520 and the primary content on the first screen device 510.
  • the second screen device 520 is capable of transmitting as well as receiving.
  • the optional steps 640 and 650 address this capability.
  • commands are received from the second screen device 520. Ideally, these commands are received at the device controlling the playback of the primary content on the first screen device 510.
  • the playback device 530 is the device receiving the commands. The commands can be sent via the network 540 or non-networked
  • the commands can control the display of the primary content (step 650). Examples of such control include, but are not limited to, play, stop, pause, rewind, fast-forward, as well as chapter, scene, and selection. These commands can also be used to synch the primary content displayed on the first screen device 510 with the additional content being displayed on the second screen device 520.
  • Figure 7 provides a high level overview of one example of system 700 with a synching mechanism implemented using a non-networked communication 560.
  • the non-networked communication synching mechanism is audio
  • audio watermarking 710 involves inserting a high- frequency signal, cue, or other indicator into the audio signal of the primary content being displayed on the first screen device 510.
  • the audio watermark is inaudible to humans but can be detected by a microphone in the second screen device 520.
  • the second screen device 520 detects an audio watermark
  • the displayed additional content is updated to synch with the primary content being displayed on the first screen device 510 based on the detected watermark.
  • the audio watermarks can be incorporated into the primary content at the source of the content or inserted locally by the playback device 520 or first screen device 510.
  • Figure 8 provides a high-level overview of one example of a system 800 with a synching mechanism implemented using the network 540.
  • the synching mechanism is wireless communication (WiFi) 810 between a playback device 530 (a Blu- Ray Disc player) and the second screen device 520 (an iOS device running an application).
  • WiFi wireless communication
  • the features and protocols of a BD-Live enabled device are used. There are two main components of this protocol: connection and communication. Both are described below.
  • the second screen iOS application will be referred to as the "iPad” and the BD-Live enabled device will be referred to as the "disc”.
  • Connection occurs when an iOS enabled device 520 first launches the second screen application and attempts to connect to a BD-Live enabled device 530 on the same Wi-Fi network 540.
  • iPad establishes direct TCP socket communication with disc based on IP and PORT provided.
  • TCP socket communication is maintained for the duration of the applications lifecycle.
  • Such a wireless communication as seen in this example is that it is bi-directional allowing the second screen device to transmit as well as receive commands. This allows for two way synching as well as control of playback from the second screen device 520.
  • the application of the second screen device 520 could be specific to a specific program or movie on a specific system (e.g. BD).
  • the second screen application could be generic to a studio with available plug-ins to configure the application to a particular program or movie.
  • the second screen application could be universal to system (BD, VOD, broadcast), content, or both.
  • the system can be operated in with a passive approach or an interactive approach.
  • icons displayed on first screen device 510 prompt the user to look at the second screen device 520 for an additional content event being displayed that is related to the primary content displayed on the first screen device 510.
  • the icon preferably indicates what type of additional content event is available on the second screen device 520 (e.g., a shopping cart icon indicates a purchase event, an "I" icon indicates an information event, a stickman icon indicates a character information event, etc.)
  • Figure 9A-F depicts some of the aspects that may be displayed to the user in passive mode.
  • Figures 9A-F depict skeletal examples of what may be displayed on the screen 900 of the second screen device to a user when using an application in passive mode that provides additional content on the second screen device 520 that is synched with the primary content on the first screen device 510.
  • Figure 9A depicts a splash screen that may be displayed to the user when the application is launched. It includes the product logo and indication of the primary content 902. Here new content screens transition in from right in a conveyer-belt like manner as indicate by arrow 904.
  • Figure 9B depicts a pop-up message 906 that is displayed to a user when no playback device 530 is detected by second screen device 520.
  • the screen 900 of Figure 9C shows a synch button/icon 908, chapter timeline 910, active chapter indicator 912, chapter-event indicator 914, chapter number indicator 916, event timeline 918, chapter background 920, event card 922, and timeline view icons 924.
  • the synch button 908 provides a mechanism to synch the content between the first and second screen devices 510, 520.
  • the synch button 908 may also indicate the status of the synch between the content on the first and second screen devices 510, 520.
  • the chapter timeline 910 indicates the chapters of the primary content.
  • the movie title leader is in the background of the chapter timeline 910 and indicates the primary content.
  • the chapter-event indicator 914 indicates that events displayed in the event timeline 918 are part of the active chapter shown in the chapter timeline 910.
  • the event timeline 918 displays event cards 922 indicating events that correspond to what is transpiring in the current chapter of the primary content. For each chapter, the first displayed event card 922 indicates the chapter that the following events occur in.
  • the timeline view icon/button 924 indicates that the viewer is in timeline view showing the chapter timeline 910 and event timeline 918 as well as provides a mechanism to access the timeline view.
  • the screens 900 of Figure 9D and 9E depict how event cards 922 progress across the event timeline 918.
  • the synch button/icon 908 indicates that the timeline view of the additional content is in synch with the primary content on the first screen device 510.
  • the current triggered event card 926 is shown in the center position of the event timeline 918 and represents the first triggered event.
  • To the left of the current triggered event card 926 in the event timeline 918 is the previous event card 928, in this case the card indicating the chapter.
  • To the right of the current triggered event card 926 in the event timeline 918 is the next event card 930, in this case the card indicating the next scheduled event.
  • the current triggered event card 926 includes the additional content 932 related to the primary content.
  • the current triggered event card 926 also provides an indicator 934 as to what type of additional content is displayed. In certain embodiments this indicator matches an indicator shown on the first screen display 510.
  • the current event card 926 also includes
  • buttons/icons for synching 936 and sharing 938 are similar to the elements of Figure 9D except that the current triggered event card 926 is for an event that happens later in the timeline as indicated by the chapter indicator 916 which indicates the current chapter is chapter 3.
  • Figure 9F depicts examples of other possible functionality that may be provided as part of display on the second screen device 920.
  • the chapter timeline 910 is provided with a collapse icon/button 940 which provides a mechanism to toggle the chapter timeline between visible 940a and hidden 940b.
  • the synch button/icon 908 can toggle between status indicating whether synch is currently active 908a and status indicating synch has been lost and re-synching is available 908b.
  • a volume button icon 942 is provided. The volume button/icon 942 provides a mechanism to turn the sound of the first screen display "OFF" or "ON".
  • the volume button 942 may also indicate the status of whether the volume is "ON" indicating muting is available 942a, or "OFF" indicating sound is available 942b.
  • a play/pause button/ icon 944 is provided.
  • the play/pause button944 provides a mechanism to pause or resume playback of content on the first screen display 510.
  • the pause/play button may also indicate the status of whether the playback can be paused 944a, or "or resumed 944b.
  • the user selects an additional content event on the second screen device 520 and what is displayed on the primary screen device 510 is synched to the selected event.
  • the events of additional content are synched to the primary content.
  • the user swipes the movie timeline or the events the events become out of synch with the movie being shown on the main screen.
  • the timeline or events are the synched back to what is being displayed on the main screen.
  • a user can select a trivia event or map event, touch the synch button, and the scene in the movie related to the selected trivia or map event will be played on the main screen. Examples of this can be seen in Figure 10A- D.
  • Figure 10A depicts how a user may interact with the chapter timeline 910 and event timeline 918 on the screen 900.
  • icons 1000 and 1002 represent how the user can touch the screen to scroll left or right in the chapter or event timelines 910, 918.
  • Figure 10B depicts one embodiment of the screen 900 when a user interacts with the chapter timeline 910.
  • the synch button/icon 908 indicates that the additional content on the second screen display 520 is out of synch with the primary content on the first screen display 510.
  • Icon 1000 represents the user scrolling through the chapter timeline 910. The current chapter remains highlighted 912 until the transition to the new chapter is completed.
  • a chapter position indicator 1004 is provided that indicates what chapter of the available chapters is selected.
  • the chapter indicator 916 also indicates the selected chapter and updates when the transition to the new chapter is complete.
  • the event timeline 918 is dimmed.
  • the user may jump directly to a particular chapter by selecting the chapter from the timeline 910.
  • Figure IOC depicts one embodiment of the screen 900 when a user interacts with the event timeline 918.
  • Icon 1002 represents the user scrolling through the event timeline 918.
  • the timeline 918 is being transitioned from current triggered event card 926 to the next event card 930.
  • an event position indicator 1004 is provided that indicates what event of the available events is selected.
  • Figure 10D depicts one embodiment of the screen 900 when a user interacting with the event timeline 918 causes a transition from one chapter to another.
  • Icon 1002 represents the user scrolling through the event timeline 910 causing a chapter change.
  • the timeline 918 is being transitioned a new event card 922 indicating a new set of events related to a new chapter.
  • the event position indicator 1004 is centered until the new series of events begins.
  • Figure 11 A-C and 12A-B indicate some of the other interactive activities that can be accessed via the event cards 922.
  • Figures 11 A-C depict the social media sharing feature.
  • Figures 12A-B depict the chapter selection as well as selection and playback of additional media files.
  • Figure 11 A-C shows various pop-up fields on the display 900 when the sharing feature is active via the share button/icon 937.
  • Figure 11A shows the field 1100 displayed when the user has logged into their social network (in this case Facebook).
  • Area 1102 indicates the event being shared and area 1104 indicates the comments the user is going to share about the event.
  • Button 1106 provides the mechanism to submit the event and comments to be shared.
  • Figure 1 IB shows the field 1100 displayed when the user has not yet signed in to the social network.
  • button 1108 is provided to sign into Facebook and button 1110 is provided to sign into twitter. Options to sign into other social networks may also be provided.
  • Figure 11C shows a onscreen Qwerty keyboard 1112 that may be used to enter comments into area 1104 for user's comments.
  • a onscreen Qwerty keyboard 1112 may be used to enter comments into area 1104 for user's comments.
  • this may be a default keyboard provided by the second screen device 520.
  • Figure 12A-B shows the selection of chapters as well media content for playback by the user.
  • the playback on the first screen device 510 is paused.
  • the user double taps 1202 the currently playing chapter shown in the chapter timeline playback of on the first screen device will jump to the beginning of the chapter and the events timeline 918 will be set to the first event of that chapter.
  • the event cards 922 may include media files 1204 such as video or audio clips. If the media file is an audio clip, then selection of the audio clip results in playback on the current screen 900.
  • the media file is a video clip
  • selection of the video clip results in the launching of a full-screen media player 1206 as seen in Figure 12B.
  • the media player includes on-screen controls 1208.
  • the user To return to the previous screen, the user only needs to tap the non- video surface 1210 of the media player.
  • Figure 13A-E depicts some other possible features regarding the additional content. These include a map view 1300, family tree 1310, and settings 1320.
  • Figure 13A depicts the menu bars for these options. In this example each of these menu bars are proved with first screen device controls 1330 including pause/resume and mute/un-mute.
  • Figure 13B depicts the map view display 1300.
  • the map view display 1300 includes a map 1302 including marked locations 1304 and information about the locations 1306. Icons are also provided to select other maps 1308.
  • Figure 13C depicts the family tree view 1310.
  • the family tree view shows the family tree with fields 1312 indication the relationship between the family members. In this example the button/icon 1314 at the bottom indicates what view is currently being shown (i.e. the family tree view).
  • a popup field 1316 is displayed, as shown in Figure 13D, providing information about the person in the field 1312.
  • Figure 13e depicts the settings view 1320.
  • the user is provided with controls for adjusting the preferences for the audio and video 1322, events 1324, and social network sharing 1326.
  • Figures 14A-L depict skinned examples of what may be displayed on the screen 900 of the second screen device to a user when using an application that provides additional content on the second screen device 520 that is synched with the primary content on the first screen device 510.
  • Figure 14A is a skinned version of the splash screen as shown and described in relation to Figure 9A.
  • Figures 14B-F depict skinned versions of the timeline view as seen and described in relation to figures 9C-F and 10A-D.
  • Figure 14G depicts a skinned version of a screen display wherein all the available video clips that are part of the additional content are displayed for the user.
  • Figure 14H depicts a skinned version of a screen display wherein all the available audio clips that are part of the additional content are displayed for the user.
  • Figure 141 depicts a skinned version of the maps view as shown and described in relation to Figures 13B.
  • Figures 14J and 14K depict skinned version of the family tree view as shown and described in relation to Figure 13C and 13D respectively.
  • Figure 14L depicts a skinned version of the settings view as shown and described in relation to Figure 13E.
  • a user may be able to configure or otherwise select what events they wish to be shown (e.g., don't show me purchase events).
  • the user may be able to select or bookmark events for viewing at a later time.
  • certain events may unavailable or locked out depending on the version of the program being viewed (i.e. purchased vs. rented or BD vs. VOD vs. Broadcast).
  • the events available can be personalized for a user based on previous viewing habits (i.e. in system such as TIVO where a user's viewing habits are tracked or using the personalization engine 118 of Figure 1).
  • a store front could be provided and accessible from the second screen to for purchasing movie merchandise.
  • points or awards could be provided to a user for watching, reviewing, or recommending a program or film. For example, the more movies watched or shared with friends, the more points awarded. The points can then be used for prizes or discounts on related goods.
  • achievements can also be awarded. These achievements could be pushed to a social networking site.
  • Example achievements could include:
  • a Wiki feature could be implemented.
  • a running Wiki could let a user and other users of a disc comment on certain scene.
  • tacking metadata could be created which is pushed to a web based wiki.
  • Such metadata could include:
  • This pushed information can be used to create a running Wiki which lets others comment on the movie. These comments could then be reintegrated into the second screen application as events which can be accessed.
  • processor or “controller” should not be construed to refer exclusively to hardware capable of executing software, and may implicitly include, without limitation, digital signal processor ("DSP") hardware, read only memory (“ROM”) for storing software, random access memory (“RAM”), and nonvolatile storage.
  • DSP digital signal processor
  • ROM read only memory
  • RAM random access memory
  • any switches shown in the figures are conceptual only. Their function may be carried out through the operation of program logic, through dedicated logic, through the interaction of program control and dedicated logic, or even manually, the particular technique being selectable by the implementer as more specifically understood from the context.
  • Computer program or application in the present context means any expression, in any language, code or notation, of a set of instructions intended to cause a system having an information processing capability to perform a particular function either directly or after either or both of the following a) conversion to another language, code or notation; b) reproduction in a different material form.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

La présente invention a pour objet un procédé et un système permettant de fournir un contenu lié à un programme affiché. Le procédé et le système selon la présente invention comprennent une seconde application d'écran pour un second dispositif d'affichage tel qu'une tablette (par l'exemple, l'iPad) qui offre de riches expériences de contenu conjointement avec un contenu principal affiché (par exemple, un film à partir d'un disque Blu-ray). Le second écran affiche des métadonnées de plongée profonde, des scènes alternatives, un autre matériel vidéo associé, ou d'autres informations apparentées qui sont synchronisées avec le programme principal affiché sans interrompre la visualisation d'un programme par l'utilisateur.
EP11852866.0A 2010-12-30 2011-12-27 Procédé et système permettant de fournir un contenu supplémentaire lié à un contenu affiché Withdrawn EP2659666A4 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201061460373P 2010-12-30 2010-12-30
US201161450328P 2011-03-08 2011-03-08
PCT/US2011/067350 WO2012092247A1 (fr) 2010-12-30 2011-12-27 Procédé et système permettant de fournir un contenu supplémentaire lié à un contenu affiché

Publications (2)

Publication Number Publication Date
EP2659666A1 true EP2659666A1 (fr) 2013-11-06
EP2659666A4 EP2659666A4 (fr) 2014-10-08

Family

ID=46383495

Family Applications (1)

Application Number Title Priority Date Filing Date
EP11852866.0A Withdrawn EP2659666A4 (fr) 2010-12-30 2011-12-27 Procédé et système permettant de fournir un contenu supplémentaire lié à un contenu affiché

Country Status (5)

Country Link
EP (1) EP2659666A4 (fr)
JP (1) JP2014510425A (fr)
KR (1) KR20130132886A (fr)
CN (1) CN103535028A (fr)
WO (1) WO2012092247A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2769300A4 (fr) * 2011-10-19 2015-05-20 Thomson Licensing Système et procédé de découverte automatique de programme de contenu

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104041058A (zh) 2012-01-06 2014-09-10 汤姆逊许可公司 基于社交消息在第二屏幕上提供动态广告的方法和系统
US8904304B2 (en) 2012-06-25 2014-12-02 Barnesandnoble.Com Llc Creation and exposure of embedded secondary content data relevant to a primary content page of an electronic book
FR2994625B1 (fr) * 2012-08-20 2014-08-08 Ifeelsmart Telecommande intelligente pour televiseur numerique
US8994827B2 (en) 2012-11-20 2015-03-31 Samsung Electronics Co., Ltd Wearable electronic device
US11237719B2 (en) 2012-11-20 2022-02-01 Samsung Electronics Company, Ltd. Controlling remote electronic device with wearable electronic device
US11157436B2 (en) 2012-11-20 2021-10-26 Samsung Electronics Company, Ltd. Services associated with wearable electronic device
US11372536B2 (en) 2012-11-20 2022-06-28 Samsung Electronics Company, Ltd. Transition and interaction model for wearable electronic device
EP2763431A1 (fr) * 2013-02-01 2014-08-06 Movym S.r.l. Procédé et système d'accès à des données concernant des produits associés à un objet multimédia
CN103974131A (zh) * 2013-02-04 2014-08-06 联想(北京)有限公司 一种信息处理方法及电子设备
WO2014178796A1 (fr) * 2013-05-03 2014-11-06 Telefun Transmedia Pte Ltd Système et procédé permettant d'identifier et de synchroniser un contenu
US9143565B2 (en) * 2013-05-30 2015-09-22 Opentv, Inc. Synchronizing an application on a companion device
KR102142067B1 (ko) * 2013-07-12 2020-08-06 삼성전자주식회사 휴대 단말 및 이의 정보 제공 방법
KR101538755B1 (ko) * 2013-09-23 2015-07-24 (주)파워보이스 외부 디바이스의 동작 제어 및 디바이스 간 컨텐츠 동기화를 위한 음파를 출력하는 디바이스 및 방법, 그리고 외부 디바이스
CN104866208B (zh) * 2014-02-21 2018-08-10 联想(北京)有限公司 信息处理方法和电子设备
WO2015130446A1 (fr) * 2014-02-28 2015-09-03 Technicolor Usa, Inc Annotation de contenu multimédia pour un second écran
WO2015168899A1 (fr) * 2014-05-08 2015-11-12 漆·亚历克斯 Système et procédé de lecture de vidéo
US10944707B2 (en) * 2014-09-26 2021-03-09 Line Corporation Method, system and recording medium for providing video contents in social platform and file distribution system
US9551161B2 (en) 2014-11-30 2017-01-24 Dolby Laboratories Licensing Corporation Theater entrance
DE202015009711U1 (de) 2014-11-30 2019-06-21 Dolby Laboratories Licensing Corporation Mit sozialen Medien verknüpftes großformatiges Kinosaaldesign
KR102296323B1 (ko) 2015-01-14 2021-09-01 삼성전자주식회사 전자 장치 및 전자 장치에서의 정보 처리 방법
FR3022725A1 (fr) * 2015-01-23 2015-12-25 Orange Procede de gestion de la restitution de contenus numeriques
CN113038208A (zh) * 2021-03-19 2021-06-25 深圳创维－Rgb电子有限公司 一种显示方法、计算机设备及计算机可读存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2028659A2 (fr) * 2007-08-23 2009-02-25 Sony Computer Entertainment America Inc. Système et procédé de fourniture de métadonnées à un moment donné
US20100119208A1 (en) * 2008-11-07 2010-05-13 Davis Bruce L Content interaction methods and systems employing portable devices
US20100280641A1 (en) * 2009-05-01 2010-11-04 David Henry Harkness Methods, apparatus and articles of manufacture to provide secondary content in association with primary broadcast media content

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
MXPA03002061A (es) * 2000-09-08 2004-09-10 Kargo Inc Interaccion de video.
BR0107352A (pt) * 2000-10-20 2002-09-17 Koninkl Philips Electronics Nv Método e arranjo para permitir não intermediação em um modelo de negócio, receptor para uso no arranjo, e, produto de programa de computador
EP1329045B1 (fr) * 2000-10-20 2004-12-08 Koninklijke Philips Electronics N.V. Dispositif et systeme de rendu
US20020162120A1 (en) * 2001-04-25 2002-10-31 Slade Mitchell Apparatus and method to provide supplemental content from an interactive television system to a remote device
US6741684B2 (en) * 2001-06-26 2004-05-25 Koninklijke Philips Electronics N.V. Interactive TV using remote control with built-in phone
JP4237480B2 (ja) * 2002-01-09 2009-03-11 パナソニック株式会社 アドレス提供機能を有する放送受信装置及びこれを用いた情報アクセスシステム
JP5059282B2 (ja) * 2003-10-14 2012-10-24 ソニー株式会社 情報提供システム，情報提供サーバ，ユーザ端末装置，コンテンツ表示装置，コンピュータプログラム，およびコンテンツ表示方法
JP3953497B2 (ja) * 2005-10-18 2007-08-08 ニフティ株式会社 携帯端末
KR20080029446A (ko) * 2006-09-29 2008-04-03 (주)이스트랩 오디오 워터마킹을 이용하여 정보를 제공하는 시스템 및 그제공 방법.
US20080098450A1 (en) * 2006-10-16 2008-04-24 Toptrend Global Technologies, Inc. Dual display apparatus and methodology for broadcast, cable television and IPTV
US8095646B2 (en) * 2007-08-16 2012-01-10 Sony Computer Entertainment Inc. Content ancillary to sensory work playback
JP5020135B2 (ja) * 2008-03-19 2012-09-05 ソニーモバイルコミュニケーションズ， エービー 携帯端末装置およびコンピュータプログラム
US8745502B2 (en) * 2008-05-28 2014-06-03 Snibbe Interactive, Inc. System and method for interfacing interactive systems with social networks and media playback devices

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2028659A2 (fr) * 2007-08-23 2009-02-25 Sony Computer Entertainment America Inc. Système et procédé de fourniture de métadonnées à un moment donné
US20100119208A1 (en) * 2008-11-07 2010-05-13 Davis Bruce L Content interaction methods and systems employing portable devices
US20100280641A1 (en) * 2009-05-01 2010-11-04 David Henry Harkness Methods, apparatus and articles of manufacture to provide secondary content in association with primary broadcast media content

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2012092247A1 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2769300A4 (fr) * 2011-10-19 2015-05-20 Thomson Licensing Système et procédé de découverte automatique de programme de contenu

Also Published As

Publication number Publication date
EP2659666A4 (fr) 2014-10-08
JP2014510425A (ja) 2014-04-24
CN103535028A (zh) 2014-01-22
KR20130132886A (ko) 2013-12-05
WO2012092247A1 (fr) 2012-07-05

Similar Documents

Publication Publication Date Title
EP2801208B1 (fr) Procédé et système pour synchroniser le contenu sur un second écran
WO2012092247A1 (fr) Procédé et système permettant de fournir un contenu supplémentaire lié à un contenu affiché
US20140150023A1 (en) Contextual user interface
US20130007793A1 (en) Primary screen view control through kinetic ui framework
WO2015105879A1 (fr) Interface utilisateur glisser-déposer pour acheter du contenu multimédia
EP2943907A1 (fr) Procédé et appareil pour attribuer des dispositifs à un service multimédia

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20130710

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

RIN1 Information on inventor provided before grant (corrected)

Inventor name: PICKERSGILL, JASON, DOUGLAS

Inventor name: PARK-EKECS, SYLVIA

Inventor name: PRICE III, EDWIN, CURMIE

Inventor name: TRENNUM, PETER

Inventor name: WITHSTANDLEY, ELIZABETH

Inventor name: GEKCHYAN, ROBERT

Inventor name: PARKER, CHARLES, B.

Inventor name: WALKER, MARK, LEROY

Inventor name: MCWHIRTER, CHARLES, BLAKE

Inventor name: SILL, SCOTT, LEE

Inventor name: MOHAN, GOKUL

DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20140904

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 21/4788 20110101ALI20140829BHEP

Ipc: H04N 21/41 20110101ALI20140829BHEP

Ipc: H04N 5/76 20060101ALI20140829BHEP

Ipc: H04N 5/783 20060101ALI20140829BHEP

Ipc: H04N 5/765 20060101ALI20140829BHEP

Ipc: H04N 21/488 20110101ALI20140829BHEP

Ipc: H04N 21/4722 20110101ALI20140829BHEP

Ipc: H04N 21/422 20110101ALI20140829BHEP

Ipc: G11B 27/34 20060101ALI20140829BHEP

Ipc: H04N 21/8358 20110101ALI20140829BHEP

Ipc: H04N 7/025 20060101AFI20140829BHEP

Ipc: H04N 21/81 20110101ALI20140829BHEP

Ipc: H04N 21/43 20110101ALI20140829BHEP

Ipc: H04N 21/472 20110101ALN20140829BHEP

Ipc: G11B 27/10 20060101ALI20140829BHEP

Ipc: H04N 9/82 20060101ALI20140829BHEP

Ipc: H04N 21/485 20110101ALI20140829BHEP

Ipc: H04N 21/439 20110101ALI20140829BHEP

17Q First examination report despatched

Effective date: 20170228

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20190702