CN103535028A - Method and system for providing additional content related to a displayed content - Google Patents

Method and system for providing additional content related to a displayed content Download PDF

Info

Publication number
CN103535028A
CN103535028A CN201180063729.8A CN201180063729A CN103535028A CN 103535028 A CN103535028 A CN 103535028A CN 201180063729 A CN201180063729 A CN 201180063729A CN 103535028 A CN103535028 A CN 103535028A
Authority
CN
China
Prior art keywords
screen
screen equipment
additional content
content
main contents
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201180063729.8A
Other languages
Chinese (zh)
Inventor
罗伯特·格克岩
查尔斯·B·帕克
戈库·莫汗
彼得·特伦努姆
伊丽莎白·维斯兰里
斯科特·李·西尔
詹森·道格拉斯·皮克斯吉尔
查尔斯·布莱克·麦克惠特
马克·勒罗伊·沃克
西尔维亚·派克-叶克斯
埃德温·柯米·普莱斯三世
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thomson Licensing SAS
Original Assignee
Thomson Licensing SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing SAS filed Critical Thomson Licensing SAS
Publication of CN103535028A publication Critical patent/CN103535028A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/79Processing of colour television signals in connection with recording
    • H04N9/80Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/82Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
    • H04N9/8205Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/025Systems for the transmission of digital non-picture data, e.g. of text during the active part of a television frame
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43079Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of additional data with content streams on multiple devices
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34Indicating arrangements 
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4122Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • H04N21/41265The peripheral being portable, e.g. PDAs or mobile phones having a remote control device for bidirectional communication between the remote control device and client device
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42208Display device provided on the remote control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/4222Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42222Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42224Touch pad or touch panel provided on the remote control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • H04N21/4394Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/485End-user interface for client configuration
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/488Data services, e.g. news ticker
    • H04N21/4882Data services, e.g. news ticker for displaying messages, e.g. warnings, reminders
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8126Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
    • H04N21/8133Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/835Generation of protective data, e.g. certificates
    • H04N21/8358Generation of protective data, e.g. certificates involving watermark
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/765Interface circuits between an apparatus for recording and another apparatus
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47214End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/78Television signal recording using magnetic recording
    • H04N5/782Television signal recording using magnetic recording on tape
    • H04N5/783Adaptations for reproducing at a rate different from the recording rate

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present disclosure is directed towards a method and system for providing content related to a displayed program. The method and system of the present disclosure includes a second screen application for a second screen device, such as a tablet (e.g., iPad) that provides rich content experiences in conjunction with displayed primary content (e.g., a movie from a Blu-Ray disc). The second screen displays deep dive metadata, alternate scenes, other companion video material, or other related information that is synched to the main displayed program without disrupting a user's program viewing experience.

Description

For the method and system of the additional content relevant to the content showing is provided
The cross reference of related application
The application requires the U.S. Provisional Patent Application No.61/460 submitting on December 30th, 2010, the U.S. Provisional Patent Application No.61/450 that on March 8th, 373 and 2011 submits to, and 328 priority, its full content is incorporated to herein by reference.
Technical field
Present invention relates in general to the additional content that provides relevant to the content showing.
Background technology
Traditionally, must watch separately and the film showing or the relevant additional content (for example, the supplementary material in DVD or Blu-ray disc) of program to main film or program.That is, user must stop or interrupting the playback of main film or program so that access supplements material.In many these type of situations, supplement between material and main film or program, do not exist associated.In other cases, with picture-in-picture form, show supplementary material, but this still can and watch and cause interference to the demonstration of main film or program.
Summary of the invention
The disclosure for a kind of for the method and system of the content relevant to the program showing is provided.Method and system of the present disclosure comprises for the second screen application such as the second screen equipments such as panel computers (as iPad), and it for example, provides abundant content to experience in conjunction with the shown main contents film of Blu-ray disc (, from).The second screen display deep diving metadata, alternately scene, other other relevant informations of following video material or synchronizeing with main display program, and the program viewing that can not destroy user is experienced.
According to an embodiment, a kind of method that shows the additional content relevant to the main contents of watching is disclosed.Described method comprises step: on the first screen equipment, show main contents; Be provided for explicitly synchronizeing the synchronization mechanism of described additional content with the demonstration of main contents on the first screen; And on the second screen equipment, show the additional content relevant to main contents on the first screen, described additional content is according to the content synchronization showing on described synchronization mechanism and the first screen.
According to another embodiment, a kind of system that shows the additional content relevant to the main contents of watching is disclosed.Described system comprises the first screen equipment and the second screen equipment.The first screen equipment is configured to show main contents.The second screen equipment is configured to show the additional content relevant to main contents on the first screen, and described additional content is according to the content synchronization showing on synchronization mechanism and the first screen.
Accompanying drawing explanation
Fig. 1 shows roughly according to an embodiment video and audio content to be sent to the system diagram of family.
Fig. 2 shows the system diagram of the more details of example set top box receiver.
Fig. 3 means according to the figure of the touch pad control appliance of an embodiment.
Fig. 4 shows according to an embodiment for the mutual figure of some example user of touch pad control appliance.
Fig. 5 shows the system diagram of an embodiment of realizing the system of the technology of the present invention according to an embodiment;
Fig. 6 shows according to the flow chart of the exemplary process of an embodiment.
Fig. 7 shows according to an embodiment and between equipment, carries out the figure of synchronous illustrative methods.
Fig. 8 shows according to an embodiment and between equipment, carries out the figure of synchronous illustrative methods.
Fig. 9 A-9F shows when using in Passive Mode according to the exemplary outline screen map of the feature of an embodiment.
Figure 10 A-10D shows when using in aggressive mode according to the exemplary outline screen map of the feature of an embodiment.
Figure 11 A-11C shows the exemplary outline figure according to the social media sharing feature of an embodiment.
Figure 12 A and 12B show the exemplary outline figure according to the content choice feature of an embodiment.
Figure 13 A-13E shows the exemplary outline figure according to the supplementary features of an embodiment.
Figure 14 A-14L shows some feature and how to manifest the exemplary reduced screen map to user.
Embodiment
Turn to now Fig. 1, show the block diagram for the embodiment of the system 100 to domestic consumer or terminal use's transferring content.Content source is from content source 102, for example, and film making Shi Huo studio.Can provide content with at least one form in two kinds of forms.A kind of form can be the forms of broadcasting of content.Broadcasted content is offered to broadcast affiliation manager 104, this broadcast affiliation manager 104 normally government broadcasting services, for example, American Broadcasting Company (ABC), National Broadcasting Service (NBC), Columbia Broadcasting System (CBS) etc.Broadcast affiliation manager can collect and store content, and can dispatch the content delivery on transmission network (being depicted as transmission network 1 (106)).Transmission network 1 (106) can comprise the satellite link transmission from national center to one or more regional center (RC)s or local center.Transmission network 1 (106) can also comprise use local transmission system, and the local content for example being undertaken by air broadcast, satellite broadcasting or wired broadcasting transmits.The content of local transmission is offered to the receiving equipment 108 in user family, in user's family, by user, then content is searched for.It is contemplated that, receiving equipment 108 can be taked various ways, and can specific implementation be Set Top Box/digital video recorder (DVR), gateway, modulator-demodulator etc.In addition, receiving equipment 108 can be as inlet point or the gateway of domestic network system, and this domestic network system comprises the client device that is configured in home network or the extras of peer device.
The content of the second form is known as special content or additional content.Special content or additional content can comprise as prepayment watch, pay-per-view and the content transmitted or to broadcast, do not co-sign other content that manager provides, for example, film, video-game or other video elementary.Under many circumstances, special content can be the content that user asks.Can be to content manager 110 transmission special contents.Content Management side 110 can be the service provider that is for example under the jurisdiction of content providers, broadcast service or transmission network service, for example, and internet site.Content Management side 110 can also merge to internet content in transmission system.Content Management side 110 can pass through independent transmission network (transmission network 2 (112)) to user's receiving equipment 108 transferring contents.Transmission network 2 (112) can comprise the communication system of high-speed broadband networks type.Be important to note that: all or part of that can also use transmission network 2 (112) transmits the content of co-signing manager 104 from broadcast, and can use transmission network 1 (106) all or part of transmit the content from Content Management side 110.In addition, user can also directly obtain content via transmission network 2 (112) from the Internet, and not necessarily will have the content of Content Management side's 110 management.
For utilizing the multiple adjustment of the additional content of individual transmission, be also possible.In a possible method, additional content is provided as the amplification to broadcasted content, thereby provide alternative demonstration, purchase and distribution option, strengthen material etc.In another embodiment, some programme content providing as broadcasted content can be provided additional content completely.Finally, additional content can be completely separated with broadcasted content, and can be only that user can select the media alternate item utilizing.For example, additional content can be not yet as the obtainable movie library of broadcasted content.
Receiving equipment 108 can receive dissimilar content from transmission network 1 and transmission network 2 one or both of.Receiving equipment 108 these contents are processed, and provide the separated of content based on user preference with order.Receiving equipment 108 can also comprise memory devices such as hard drive or disc drives, for record and plays back audio and video content.Below in conjunction with Fig. 2, the operation of receiving equipment 108 is described and the further details of the feature that is associated with the content of playback storage.Treated content is offered to display device 114.Display device 114 can be traditional 2-D escope or can be alternatively senior 3-D display.
Receiving equipment 108 can also be docked with the second screen, the second screen is for example touch-screen control appliance 116.Touch-screen control appliance 116 can be adapted for to provide the user of receiving equipment 108 and/or display device 114 is controlled.Touch panel device 116 can also display of video content.Video content can be figure input, for example, and user interface input, or can be a part that is transferred to the video content of display device 114.(for example can use any known signal transmission system, the communication of infrared (IR) or radio frequency (RF)) touch-screen control appliance 116 is docked with receiving equipment 108, and touch-screen control appliance 116 can comprise standard agreement (for example, Infrared Data Association (IRDA) standard, Wi-Fi, bluetooth etc.) or any other specialized protocol.In certain embodiments, touch-screen control appliance 116 can directly dock with transmission network 1 and 2.To the operation of touch-screen control appliance 116 be described in more detail below.
In the example of Fig. 1, system 100 also comprises back-end server 118 and usage data storehouse 120.Background server 118 comprises the use habit of analysis user and the personalized engine of recommending based on these use habits.Usage data storehouse 120 is places of storage user's use habit.In some cases, usage data storehouse 120 can be a part for background server 118.In this example, by transmission network 2 (112), background server 118 (and usage data storehouse 120) be connected to system 100 and by transmission network 2 (112), background server (and usage data storehouse 120) conducted interviews.
Turn to now Fig. 2, show the block diagram of the embodiment of receiving equipment 200.Receiving equipment 200 can be to work with the similar mode of the receiving equipment described in Fig. 1, and it is involved to can be used as the part of gateway device, modulator-demodulator, Set Top Box or other similar communication equipment.Shown equipment 200 also can be incorporated in other system that comprises audio frequency apparatus or display device.In either event, for simplicity, the necessary a plurality of assemblies of complete operation for system are not shown, this is because they are known to those skilled in the art.
In the equipment 200 shown in Fig. 2, receiver input signal 202 receives content.Receiver input signal 202 can be for to by a plurality of may networks one of (it comprises air network, cable network, satellite network, ethernet network, fiber optic network and telephone line network) signal of providing receive, one of a plurality of known receiver circuit of demodulation code.Can the user based on providing by control interface or touch pad interface 222 input to select and obtain the input signal of expectation by receiver input signal 202.Touch pad interface 222 can comprise the interface for touch panel device.Touch pad interface 222 can also be suitable for docking with cell phone, panel computer, mouse, high-end remote controller etc.
To inlet flow processor 204, provide decoded output signal.Inlet flow processor 204 is carried out final signal and is selected and process, and comprises for content flow separated by video content and audio content.To audio process 206, provide audio content, for example, to be converted to analog waveform signal from receiving form (, compression digital signal).To audio interface 208, provide analog waveform signal, and further to display device or audio frequency amplifier, provide analog waveform signal.Alternatively, audio interface 208 can be used high-definition media interface (HDMI) cable or alternative audio interface (for example,, via Sony/Philips digital interconnect form (SPDIF)) to provide digital signal to audio output apparatus or display device.Audio interface can also comprise for driving the amplifier of one or more groups loud speaker.Audio process 206 is also carried out any necessary conversion for stored audio signal.
To offer video processor 210 from the video of inlet flow processor 204 outputs.Vision signal can have a kind of form in multiple format.Video processor 210, based on input signal format, provides the conversion to video content as required.Video processor 210 is also carried out any necessary conversion for stored video signal.
Memory device 212 is stored in audio content and the video content that input end receives.Memory device 212 allows after a while under the control of controller 214 and based on obtaining and playing back content from the order (for example,, such as F.F. (FF) and the navigation instructions such as (Rew) that falls back) of user interface 216 and/or 222 receptions of touch pad interface.Memory device 212 can be hard drive, the integrated electronic memory of one or more large capacity (for example, static RAM (SRAM) (SRAM) or dynamic ram (DRAM)), or can be interchangeable optical disc storage system (for example, compact disk (CD) drives or digital video disk (DVD) drives).
The vision signal through conversion of inputting or be derived from memory device 212 from being derived from of video processor 210 is offered to display interface 218.Display interface 218 further offers display the display device of type mentioned above.Display interface 218 can be the analog signal interface such as R-G-B (RGB) etc., or can be the digital interface such as HDMI etc.Should be understood that, display interface 218 is by generating for present a plurality of screens of Search Results with the form of three-dimensional grid, as described in more detail below.
Via bus, controller 214 is interconnected to a plurality of assemblies in the assembly of equipment 200, comprises inlet flow processor 202, audio process 206, video processor 210, memory device 212 and user interface 216.Controller 214 management are for being converted to inlet flow signal the transfer process of the signal that will be stored on memory device or the signal that will show.Controller 214 is also managed obtaining and playback stored content.In addition, as will be described below, 214 pairs of contents of controller are searched for, and create and adjust and represent that the grid of content (as mentioned above, the content of storage or by the content via transmission network transmission) shows.
Controller 214 (is for example further coupled to control storage 20, volatile memory or nonvolatile memory, comprise RAM, SRAM, DRAM, ROM, programming ROM (PROM), flash memory, electronic programmable ROM (EPROM), electronics erasable programmable ROM (EEPROM) etc.), information and instruction code for storage for controller 214.Control storage 220 can be stored the instruction for controller 214.The database of all right storage element (for example, the graphic element of content) of control storage.Can the pattern using database as graphic element store.Alternatively, memory can be stored graphic element in memory location sign or grouping, and identifies the memory location for a plurality of parts of the information relevant with graphic element with access or position form.To the additional detail that have pass with storage map shaped element be described below.In addition, the realization of control storage 220 can comprise a plurality of may embodiment, for example, single memory device or alternatively, can connect communicatedly or be coupled to form and share or the more than one memory circuitry of common storage.In addition memory and other circuit (for example, a plurality of parts of bus communication circuit) can be included in larger circuit together.
User interface process of the present disclosure is used the input equipment that can be used in expressive function, such as F.F., fall back etc.In order can so to operate, can touch panel device 300 be docked via user interface 216 and/or the touch pad interface 222 of receiving equipment 200, as shown in Figure 3.Touch panel device 300 allows to move or gesture operation receiving equipment or Set Top Box based on hand, and by panel, action is interpreted as to the order for Set Top Box or other control appliances.In one embodiment, touch pad 300 can be used simply as navigational tool to grid is shown and navigated.In another embodiment, touch pad 300, also as display device, makes user be shown and more directly to be carried out alternately with navigation by the grid of content.Can comprise that touch panel device is as a part for remote control equipment, this remote control equipment for example comprises actuator or actuator button and so on more traditional control function.Touch pad 300 can also comprise at least one camera assembly.In certain embodiments, touch pad 300 can also comprise microphone.
Referring now to Fig. 4,, to gesture sensing controller or the routine use of touch-screen as shown, provide polytype user interactions.Come the input of self-controller for defining gesture, and gesture and then the order of definition specific context.The configuration of transducer can allow to define the motion of user's finger on touch-screen, or even can allow to define controller self moving along one dimension or two dimension.Any three-dimensional motion that for example two dimensional motion of diagonal and so on and the combination of waving, tilting and rolling can for example swing and so on for definition.Fig. 4 shows various gestures.In context, gesture is identified in decipher gesture the defined motion made by user.
By being drawn to define, two strokes of indicating along the sensing of a direction (upwards,, to the left or to the right) clash into 420 downwards.Clashing into gesture is associated with the particular command in context.For example, in time shift (TimeShifting) pattern, left shock gesture 420 has been indicated and has been fallen back, and right shock gesture has been indicated F.F..In other contexts, shock gesture 420 is interpreted as along the direction of clashing into appointment and increases progressively particular value.Picture is hooked to 440 and be defined as drafting hook number.This is similar to downward shock gesture 420.In context, identify picture and hook to specify reminder, user tag or option or element.To draw a circle and 440 be defined as along either direction and draw a circle.Can distinguish both direction.Yet, for fear of obscuring, no matter direction how, is identified as individual command by circle.By dragging 450, be defined as the angular movement of pressing the same Time Controller of the button of (virtual or physics) on panel computer 300 (change of tilting and/or waving) (that is, " triggering drags ").Drag gesture 450 can be for navigation, speed, distance, time shift, fall back and F.F..Dragging 450 can be for the change of the cursor on mobile display, virtual cursor or state, for example highlighted demonstration outlining or selection on display.Dragging 450 can be along any direction, and is generally used for two dimensional navigation.Yet in some interface, revising is preferred for the response that drags order.For example, in some interface, depend on the position of virtual cursor or the direction of motion, more preferential with respect to the operation of other dimension or other directions along the operation of one dimension or a direction.Dragged by twice rapid triggering move both vertically up and down to define teeters 460.Teeter and 460 be used to indicate "Yes" or " acceptance ".Draw fork 470 and be defined as drafting letter " X ".Drawing fork 470 orders for " deletion " or " prevention ".The quick front and back horizontal movement being dragged by twice triggering defines vacillates now to the left, now to the right 480.The gesture of vacillating now to the left, now to the right 480 is used to indicate "No" or " cancellation ".
The complexity that depends on sensing system, can only allow simple motion in one dimension or gesture.For example, the simple right side on transducer shown here or left movement can produce F.F. or rewind function.In addition, can comprise a plurality of transducers and be placed on the diverse location on touch-screen.For example, the horizon sensor for side-to-side movement can be placed in to the three unities and increase/reduce for volume, and the vertical reference for moving up and down can be placed in to place, different location, and increase/subtract for channel.In this manner, can use certain gestures mapping.
Depend on the hardware and the content that relate to, can realize system and method according to any various ways.The example of this deployment comprises DVD, Blu-ray disc (BD), stream video or video request program (VOD) and broadcast (satellite, wired, radio).These each in disposing can have different frameworks, but can for to what by by operate on the second screen should be used for queuing up in these events (additional content) that represented each carry out standardization trigger.For example, can in these sources with video, come trigger event A and event B by any synchronization mechanism being associated.When flat computer runs into " event A ", the program for example operating in, on the second screen equipment (flat computer) will make " event A " to occur.Similarly, if run into " event B ", the program of moving on the second screen equipment will make " event B " to occur.
Fig. 5 shows the general system 500 that can realize this method.Herein, system 500 comprises the first screen equipment 510, the second screen equipment 520, playback apparatus 530, network 540 and server 550.Each in these assemblies is hereinafter described in more detail.
The first screen equipment 510 is a kind of display devices, for example, above with reference to the display device 114 described in figure 1, for display case as the content of TV programme, film and website and so on.The example of this first screen display device is including, but not limited to TV, monitor, projecting apparatus etc.The first screen equipment 510 is connected with playback apparatus 530, and playback apparatus 530 provides main contents for showing to the first screen equipment 510.The example of this communication is including, but not limited to HDMI, VGA, display port, USB, component (Component), compound (Composite), radio frequency (RF) and infrared (IR) etc.In a particular embodiment, the first screen display device 510 can be connected with network 540 by wired or wireless (WiFi) mode, provides additional be connected to the second screen equipment 520 and server 550.In certain embodiments, the first display device 510 can comprise the functional of playback apparatus 530.In another embodiment, the first screen display device 510 can carry out non-connected network communication 560 with the second screen equipment 520.The example of this non-connected network communication 560 can be including, but not limited to: RF, IR, bluetooth and other voice communication technology and agreement.
The second screen equipment 520 is the equipment that can show additional content, and this additional content is relevant to the main contents just showing on the first screen equipment 510.The second screen equipment can be touch-screen control appliance 116 as above or touch panel device 300.The example of the second screen equipment can be including, but not limited to: smart phone, flat computer, laptop computer, personal media player (such as iPod) etc.The second screen equipment 520 is used network 540 and/or non-connected network communication 560 to communicate with playback apparatus 530.The second screen equipment 550 also communicates via network 540 and server 550, for asking and receiving the additional content relevant to the main contents just showing on the first screen equipment 510.In certain embodiments, the second screen equipment 520 can be networked or carry out non-connected network communication with the first screen equipment 510.The example of this non-connected network communication 560 can be including, but not limited to: RF, IR, bluetooth (BT), voice communication technology and agreement etc.
Playback apparatus 530 is that the equipment of main contents for showing on the first screen equipment 510 can be provided.The example of this playback display device is including, but not limited to DVD player, Blu-ray disc (BD) player, game console, receiver device (wired or satellite), digital video recorder (DVR), flow device, personal computer etc.Playback apparatus 530 is connected with the first screen equipment 510, to provide main contents for showing to the first screen equipment 510.The example of this connection is including, but not limited to HDMI, VGA, display port, USB, component (Component), compound (Composite), radio frequency (RF) and infrared (IR) etc.Playback apparatus 530 can also be connected with network 540 by wired or wireless (WiFi) mode, to the second screen equipment 520 and server 550, provides connection.In certain embodiments, the functional of playback apparatus 530 can be included in the first screen display device 510.In another embodiment, playback apparatus 530 can carry out non-connected network communication 560 with the second screen equipment 520.The example of this non-connected network communication 560 can be including, but not limited to: RF, IR, bluetooth (BT) and other voice communication technology and agreement.
Network 540 can be the wired or wireless communication network that uses Ethernet, MoCA and wireless protocols or its combination to realize.The example of this network is including, but not limited to above-mentioned transmission network 1 (106) and transmission network 2 (112).
Server 550 is the content servers that are configured to provide to the second screen equipment 520 additional content.In certain embodiments, server can also provide the main contents showing on the first screen equipment 510.Service is connected with network 540 and can communicates with any apparatus being also connected.The example of this server including, but not limited to: foregoing source 102, broadcast affiliation manager 104, Content Management side 110 and back-end server.
Fig. 6 shows the flow chart 600 of disclosed method, for showing the additional content relevant to the main contents of watching.The method comprises the following steps: on the first screen equipment 510, show main contents (step 610).What be associated with the demonstration of main contents on the first screen provides synchronization mechanism, with synchronous additional content (step 620).On the second screen equipment 520, show the additional content relevant with main contents on the first screen 510, described additional content is (step 630) with content synchronization in the first screen equipment demonstration according to synchronization mechanism.In certain embodiments, the method also comprises step: from the second screen equipment 520, receive order to control the demonstration (step 640) of main contents the first screen equipment 510; And the demonstration (step 650) of controlling main contents the first screen equipment 510 according to the order receiving from the second screen equipment 520.Below by describe in more detail in these steps each.
On the first screen equipment 510, carry out the step (step 610) that shows main contents (for example movie or television show).This relates to the first screen display 510 provides main contents.Can provide main contents by playback apparatus 530, or directly from content providers, receive main contents at the first screen display device 510 places.Then, on the first screen equipment 510, illustrate or show main contents.The demonstration of main contents also comprises the control of the content that aligns demonstration.This navigation that can comprise traditional playback command (play, stop, suspending, fall back, F.F.), on-screen menu is with chosen content and other playback options.In certain embodiments, the demonstration (step 620) on the first screen equipment 510 can also comprise the designator of the type of the additional content that demonstration is just just showing on the second screen equipment 520.
Can realize provided synchronization mechanism (step 620) according to various ways.In certain embodiments, can should be used for carrying out synchronization mechanism by what move in the second screen equipment 520, playback mechanism 530, the first screen equipment 510 or its combination in any.The most basically, the second screen equipment 520 (via application) is configured to detect the designator of synchronizing signal, prompting or other types, and it guides the demonstration of the second screen equipment 520 renewal additional contents so that consistent with the main contents being just presented on the first screen 510.A part that can be used as main contents provides the designator of synchronizing signal, prompting or other types, or can, according to the chapters and sections that showing, scene, timing code, theme or content, by the playback apparatus 530 (via application) of the first screen equipment 510, be produced the prompt of synchronizing signal, prompting or other types.Can use network according to wired or wireless (WiFi) mode, or use for example non-connected network communication 560 of audio signal and so on, the prompt of synchronizing signal, prompting or other types is sent to the second screen equipment 520.Hereinafter provided the example of some implementations.Other possible implementations obviously also can provide advantage of the present disclosure.
On the second screen equipment 520, carry out the additional content step display (step 630) of (such as supplementing material, video clipping, website etc.).Additional content can be stored on the second screen equipment 520 this locality, or is provided by server 550, playback apparatus 530 or the first screen equipment 510.According to synchronization mechanism, the demonstration of additional content is synchronizeed with the main contents just showing on the first screen equipment 510.For example, when the second screen equipment 520 detects the prompt of synchronizing signal, prompting or other types, the second screen equipment 520 correspondingly upgrades the demonstration of additional content.In certain embodiments, this also relates to contact server 550, playback apparatus 530 or the first screen equipment 510 and from its request additional content, downloads subsequently and show additional content.In certain embodiments, can select, revise or omit the additional content that will show according to the user by system.
In certain embodiments, the demonstration (step 630) on the second screen equipment 520 also comprises the show state that is presented at the main contents on the first screen equipment 510, for example, whether suspended the demonstration of main contents on the first screen equipment 510.In some other embodiment, the demonstration (step 630) on the second screen equipment 520 also comprises the additional content that shows on the second screen equipment 520 and the synchronous regime between the main contents on the first screen equipment 510.
In certain embodiments, the second screen equipment 520 can carry out sending and receiving.Optional step 640 and 650 is for this ability.In step 640, from the second screen equipment 520, receive order.Ideally, the equipment place that the playback of main contents is controlled on to the first screen equipment 510 receives these orders.In other embodiments, playback apparatus 530 is the equipment that receives order.Can send order via network 540 or non-connected network communication 560.Once receive order, these orders can be controlled the demonstration (step 650) of main contents.The example of these controls can be including, but not limited to: play, stop, suspending, fall back, F.F. and chapters and sections, scene and selection.These orders can also be for synchronizeing the main contents showing on the first screen equipment 510 with the additional content showing on the second screen equipment 520.
Fig. 7 provides the senior general view of an example of system 700, and system 700 has the synchronization mechanism that uses non-connected network communication 560 to realize.In this system 700, non-connected network communication synchronization mechanism is audio frequency watermark 710.In this example, audio frequency watermark 710 relates to high-frequency signal, prompting or other designators is just inserted in the audio signal of the main contents showing on the first screen equipment 510.Audio frequency watermark can not be heard for the mankind, but can detect by the microphone in the second screen equipment 520.When the second screen equipment 520 detects audio frequency watermark, according to the watermark detecting, upgrade the additional content showing, to synchronize with the main contents just showing on the first screen equipment 510.Can audio frequency watermark be merged in main contents at content source place, or be inserted in this locality by playback apparatus 520 or the first screen equipment 510.
Fig. 8 provides the senior outline figure of an example of system 800, and system 800 has the synchronization mechanism that uses network 540 to realize.In this system 800, synchronization mechanism is the radio communication (WiFi) 810 between playback apparatus 530 (blu-ray player) and the second screen equipment 520 (the iOS equipment of operation application).In the example of Fig. 7, use feature and the agreement of the live support equipment of BD.There are two chief components of this agreement: connect and communicate by letter.Below both will be described.In order to simplify, the second screen iOS application is called to " iPad ", the live support equipment of BD is called to " dish ".
When iOS support equipment 520 is initiated the second screen application first and attempt to be connected with the live support equipment 530 of BD on identical WiFi network 540, connect.
1. dish is inserted into BD player
2. dish enters UDP and " listens to " circulation
3.iPad initiates the second screen application
4.iPad carries out the udp broadcast of authentication token
5. dish receives authentication token and authenticates
6. examine and seize the IP (IP of iPad) fetching from token transmit leg
7. dish utilizes its IP and PORT (port) response authentication
8.iPad confirms IP and PORT
9.iPad closes UDP socket communication
10.iPad sets up and the direct TCP socket communication coiling according to the IP providing and PORT.
Set up communication between the second screen iOS application and the live support equipment of BD after, communicate by letter.
1.iPad knows IP each other and should occur that what PORT communicates by letter with dish
2. on the time period of application life cycles, keep TCO socket communication.
As shown in this example, an advantage of this radio communication is that it is two-way, allows the second screen equipment to send and receives order.This allows bi-directional synchronization and controls playback from the second screen equipment 520.
In certain embodiments, the application of the second screen equipment 520 can be exclusively used in for example, specific program or film on particular system (BD).In other embodiments, the second screen application can be common to make-up room, and make-up room has available plug-in card program to application is configured to for specific procedure or film.In other embodiments, the second screen application can be for system (BD, VOD, broadcast), interior perhaps the two is general.Given advantage of the present disclosure, other may implementation be apparent with configuration for those skilled in the art.
This system can be according to passive method or interactive approach operation.In passive method, the icon prompting user who shows on the first screen equipment 510 checks the relevant additional content event of the main contents to showing on the first screen equipment 510 just showing on the second screen equipment 520.This icon has preferably indicated the additional content event of what type on the second screen equipment 520 (for example to use, shopping cart icon has been indicated purchase events, " I " icon has been indicated message event, and bavin rod people (stickman) icon has been indicated Role Information event etc.).Fig. 9 A-F shows aspect some that can show to user in Passive Mode.
Fig. 9 A-F shows when using application in Passive Mode the outline example of the content showing on can the screen 900 at the second screen equipment, and the additional content of synchronizeing with the main contents on the first screen equipment 510 is wherein provided on the second screen equipment 520.
Fig. 9 A shows the splash-screen showing to user when initiating application.Comprise Product Identifying and the indication to main contents 902.Herein, as shown in arrow 904, according to the form of similar conveyer belt, from right side, change into new content screen.
Fig. 9 B shows the Pop-up message 906 showing to user when the second screen equipment 520 does not detect playback apparatus 530.
The screen 900 of Fig. 9 C shows lockage button/icon 908, chapters and sections timeline 910, now uses chapters and sections designator 912, chapters and sections event indicator 914, numbering of section designator 916, event time line 918, chapters and sections background 920, event card 922 and timeline view icon 924.Lockage button 908 provides the mechanism of synchronizing content between the first and second screen equipments 510,520.Lockage button 908 has also been indicated the synchronous regime between content on the first and second screen equipments 510,520.Chapters and sections timeline 910 has been indicated the chapters and sections of main contents.In the background of movie title guiding in chapters and sections timeline 910, and indicated main contents.Along with main contents is advanced, chapters and sections move along chapters and sections timeline with conveyer belt similar type, wherein now with chapters and sections designator 912 by highlighting the center of having indicated the current chapters and sections of main contents and having indicated chapters and sections timeline 912.It is the existing part with chapters and sections shown in chapters and sections timeline 910 that chapters and sections event indicator 914 has been indicated the event showing in event time line 918.Event time line 918 has shown event card 922, and event card 922 has been indicated the event corresponding with the content just occurring in the current chapters and sections of main contents.For each chapters and sections, the event card 922 first showing has been indicated the chapters and sections at the place of event generation subsequently.Along with main contents is advanced, event card 922 moves along event time line 918 with conveyer belt similar type, wherein the center of current event in event time line 918.Can provide the exclusive background 920 for the event of these concrete chapters and sections to each chapters and sections.Timeline view icon/button 924 has indicated beholder in showing the timeline view of chapters and sections timeline 910 and event time line 918, and the mechanism of access time line view is provided.
The screen 900 of Fig. 9 D and 9E shows event card 922 and how to advance and stride across event time line 918.Herein, synchronous (Synch) icon/button 908 has been indicated the timeline view of additional content and the main contents synchronised on the first screen equipment 510.In Fig. 9 D, at the center position of event time line 918, show the event card 926 of current triggering, the event card 926 of current triggering has represented the first event triggering.The left side of the event card 926 of current triggering in event time line 918 is previous event card 928, and this card has been indicated chapters and sections in this case.The right side of the event card 926 of current triggering in event time line 918 is next event card 930, and this card has been indicated the event of next scheduling in this case.Due to the event card 926 of current triggering in Fig. 9 D event for the first triggering, it is chapters and sections 1 that chapters and sections designator 916 has been indicated this.The event card 926 of current triggering comprises the additional content relevant to main contents 932.About showing the additional content of which kind of type, the event card 926 of current triggering also provides designator 934.In certain embodiments, the designator illustrating on this designator and the first screen display 510 matches.Current event card 926 also comprises the button/icon for synchronous (Synch) 936 and shared (Share) 938.The mechanism that lockage button/icon 936 provides a kind of main contents that makes on the first screen equipment 520 to show to synchronize with current event.Sharing button/icon 938 provides a kind of mechanism of additional content of and social networks shared events.Except when beyond the timeline event after a while of the event card 926 of front triggering for 916 indications of chapters and sections designator, the element of the screen 900 of Fig. 9 E and the element of Fig. 9 D are similar, it is chapters and sections 3 that chapters and sections designator 916 has been indicated current chapters and sections.
The functional example of other possibilities providing as the part showing on the second screen equipment 520 is provided Fig. 9 F.Herein, chapters and sections timeline 910 has folding (collapse) icon/button 940, and the mechanism of switching chapters and sections timeline between visible 940a and hiding 940b is provided.Equally, effectively whether synchronous (Synch) button/icon 908 can be switched between state 908a and indication has synchronously been lost and re-synchronization can be used state 908b when preamble in indication.In certain embodiments, provide volume button/icon 942.Volume button/icon 942 provides the mechanism of the sound of a kind of " closing " or " unlatching " first screen display.Volume button 942 has also been indicated following state: whether volume " unlatching " has indicated quiet available 942a, or whether " closing " has indicated sound can use 942b.In some other embodiment, provide broadcasting/pause button/icon 944.Broadcasting/pause button 944 provides a kind of mechanism of suspending or recovering the playback of content on the first screen display 510.Time-out/broadcast button can also be indicated the state that whether can suspend 944a or recover 944b playback.
In exchange method, user selects the additional content event on the second screen equipment 520, and by the content and the selected event synchronised that show on main screen equipment 510.As previously mentioned, by the event of attachment content and main contents synchronised.If user is switched (swipe) film timeline or event, event is no longer synchronizeed with the film just illustrating on main screen.For re-synchronization, touch the lockage button on flat computer.Timeline or event synchronization are returned the content just showing on main screen.Similarly, user can select film clips (trivia) event or map (map) event, touches lockage button, can on main screen, play the film scene relevant to selected film clips or map event.Figure 10 A-D shows the example of this situation.
Figure 10 A show user how with screen 900 on chapters and sections timeline 910 and event time line 918 carry out alternately.Herein, icon 1000 and 1002 represents users how touch screen rolls to the left or to the right in chapters and sections or event time line 910,918.
Figure 10 B shows an embodiment who carries out screen 900 when mutual when user and chapters and sections timeline 910.In this example, lockage button/icon 908 has indicated the additional content on the second screen display 520 not synchronize with the main contents on the first screen display 510.Icon 1000 represents users' chapters and sections timeline 910 that rolled.Current chapters and sections keep highlighting 912, until complete the conversion to new chapters and sections.When navigating by chapters and sections timeline 910, chapters and sections location pointer 1004 is provided, this designator has been indicated which chapters and sections of selecting in available chapters and sections.Chapters and sections designator 916 is also indicated selected chapters and sections, and when complete to new chapters and sections conversion time upgrade.In this example, when user navigates by chapters and sections timeline 910, event time line 918 is dimmed.In certain embodiments, user can be by selecting chapters and sections to leap to concrete chapters and sections from timeline 910.
Figure 10 C shows an embodiment who carries out screen 900 when mutual when user and event time line 918.Icon 1002 represents users' event time line 918 that rolled.Here, timeline 918 is transformed into next event card 930 from the event card 926 of current triggering.When navigating by event time line 918, event location designator 1004 is provided, indicated which event in available event of selecting.
Figure 10 D shows when carrying out with event time line 918 embodiment that mutual user causes screen 900 while being transformed into another chapter from a chapter.Icon 1002 represents that users' event time line 910 that rolled has caused chapters and sections change.Here, timeline 918 is just being transformed into the new events card 922 that new set is indicated to the event relevant to new chapters and sections.When the navigation by event time line 918 causes the conversion to new chapters and sections, centered by event location designator 1004, until new sequence of events starts.
Figure 11 A-C and 12A-B have indicated some in other interacting activities that can access via event card 922.Figure 11 A-C shows social media sharing feature.Figure 12 A-B shows selection and the playback of chapters and sections selection and additional media file.
Figure 11 A-C shows and when activating sharing feature via shared (Share) button/icon 937, shows the various Pop-up fields on 900.Figure 11 A shows the field 1100 showing when user signs in to its social networks (being Facebook in this example).The event being just shared has been indicated in region 1102, and the suggestion that user will be shared about this event has been indicated in region 1104.Button 1106 provide submit to will be shared event and the mechanism of suggestion.Figure 11 B shows the field 1100 showing when user not yet signs in on social networks.In this example, provide button 1108 for signing in to Facebook, and provide button 110 for signing in to twitter.Can also be provided for signing in to the option of other social networks.Figure 11 C show can for to region 1104 input suggestions with carry out user comment at screen Qwerty keyboard 1112.In certain embodiments, this can be the acquiescence keyboard being provided by the second screen equipment 520.
Figure 12 A-B shows user and selects chapters and sections and media content with playback.In the example of 12A, if the chapters and sections of the current broadcasting shown in user click 1200 chapters and sections timelines 912 suspend the playback on the first screen equipment 510.If user double-clicks the chapters and sections of the current broadcasting shown in 1202 chapters and sections timelines 912, the playback skip on the first screen equipment is to the beginning of these chapters and sections, and event time line 918 is set to the first event of these chapters and sections.In certain embodiments, event card 922 can comprise the media file 1204 of video for example or audio clips and so on.If media file is audio clips, select this audio clips can cause the playback on current screen 900.If media file is video clipping, select this video clipping can cause initiating full frame media player 1206 as shown in Figure 12 B.In this example, media player is included in screen control 1208.For the screen before returning, user only needs to touch the non-video plane 1210 of media player.
Figure 13 A-E shows some other possibility features about additional content.Comprise map view 1300, j-tree 1310 and arrange 1320.Figure 13 A shows the menu bar for these options.In this example, each in these menu bars is equipped with the first screen equipment control 1330, comprises suspending/resuming and quiet/non-quiet.Figure 13 B shows map view and shows 1300.Map view shows that 1300 comprise map 1302, and map 1302 comprises the position 1304 of mark and the information 1306 relevant with this position.Can also provide icon to select other maps 1308.Figure 13 C shows j-tree view 1310.J-tree view shows j-tree, and wherein field 1312 has been indicated the relation between family member.In this example, the button/icon 1314 of bottom has been indicated current which view (that is, j-tree view) that illustrating.If select field 1312, show and eject field 1316, as shown in Figure 13 D, provide the information relevant to people in field 1312.Figure 13 e shows view 1320 is set.In view 1320, to user, be provided for adjusting the control for the preference of Voice & Video 1322, event 1324 and social networks shared 1326.
Figure 14 A-L shows the simplification example of the content that can show to user on the screen 900 at the second screen equipment when using application, and wherein said being applied in provides the additional content of synchronizeing with the main contents on the first screen equipment 510 on the second screen equipment 520.Figure 14 A is as shown in Figure 9 A and with reference to the simple version of the splash-screen described in figure 9A.Figure 14 B-F shows as shown in Fig. 9 C-F and 10A-D and with reference to the simple version of the timeline view as described in figure 9C-F and 10A-D.Figure 14 G shows the simple version of screen display, wherein to user, shows all available video montages as a part for additional content.Figure 14 H shows the simple version of screen display, wherein to user, shows all audio available montages as a part for additional content.Figure 14 I shows as shown in Figure 13 B and with reference to the simple version of the map view described in figure 13B.Figure 14 J and 14K show respectively as shown in Figure 13 C and 13D and with reference to the simple version of the j-tree view as described in figure 13C and 13D.Figure 14 L shows as shown in Figure 13 E and with reference to the simple version that view is set as described in figure 13E.
Event shown in accompanying drawing and feature are only the examples of Possible event.In certain embodiments, user can configure or select to wish to illustrate which event (for example, to user, purchase events not being shown).In other embodiments, user can selection or flag event to watch after a while.In other embodiment, depend on the version of the program of watching, some event is unavailable or be locked in outer (that is, the vs. of purchase lease, or BD vs.VOD vs. broadcast).In other embodiments, can be according to the event (that is, in such as systems such as TIVO, follow the tracks of user's the custom of watching, or use the personalized engine of Fig. 1) of watching custom can use for user individual before.
Other possible configurations comprise shopping feature.For example, can provide paving and addressable from the second screen, to buy film commodity.In another embodiment, can to user provide count or reward for watching, review or programs recommended or film.For example, that watch or more with the shared film of friend, counting of rewarding is more.Then, this can be counted for the discount of prize or complementary goods.
Similarly, can also reward achievement.These achievements can be pushed to social network sites.Example achievement can comprise:
Watch some scene-achievement
Watch some the dish-achievement in a series of
Watch some dish-achievement of concrete make-up room or performer
In other implementations, can realize Wiki feature.The Wiki of operation can make the user of dish and other users express an opinion to a certain scene.For example, can create location (tacking) metadata that is pushed to the wiki based on web.This metadata can comprise:
Chapters and sections information
Timing code
The thumbnail of scene
Performer/director information
The information of this propelling movement can be for creating the Wiki of operation, and this operation Wiki makes other people to film, express an opinion.Then, these suggestions can be incorporated in the second screen application as the event that can access again.
This specification has been demonstrated principle of the present disclosure.Therefore, will be clear that, those skilled in the art can imagine various such layouts, although these are arranged, not describe clearly or will illustrate in this article, embody principle of the present disclosure and be included in spirit and scope of the present disclosure.
All examples described herein and conditional statement are intended to the object for information, with the design that helps reader understanding's principle of the present disclosure and inventor to contribute in order to go deep into this area, and all examples described herein and conditional statement should be interpreted as to example and the condition that is not limited to clearly record.
In addition, all statements of the disclosed principle of notebook, aspect and embodiment and concrete example thereof are intended to contain its equivalent structures and function equivalent herein.In addition, these equivalents are intended to comprise current known equivalent and at the equivalent of exploitation in the future, that is, any element of the function that the execution of developing is identical, no matter and structure how.
Therefore, for example, it will be apparent to one skilled in the art that the block representation presenting embodies the conceptual view of the exemplary circuit of principle of the present disclosure herein.Similarly, to be clear that, the expressions such as any flow chart, schematic flow sheet, state transition graph, false code are illustrated in fact in computer-readable medium and the various processes of therefore being carried out by computer or processor (no matter whether showing clearly this computer or processor).
Can be by specialized hardware and hardware that can executive software be combined to the function that makes to be used to provide each element shown in figure with applicable software.When processor provides function, these functions can be provided by single application specific processor, by single shared processing device, be provided or provided by a plurality of independent processors, wherein can share some in described a plurality of independent processor.In addition, the explicit use of term " processor " or " controller " not should be understood to exclusively to refer to hardware that can executive software, and can implicitly include, without being limited to digital signal processor (" DSP ") hardware, the read-only memory (" ROM ") for storing software, random access memory (" RAM ") and non-volatile memory device.
Can also comprise other hardware (traditional and/or customization).Similarly, any switching shown in figure is only notional.Operation that can be by programmed logic, by special logic, by program control and special logic realize alternately or even manually this function, wherein, specific technology can be selected by implementor, as more clearly understood by context.
Although be shown specifically in this article and described the embodiment that is incorporated to instruction of the present disclosure, those skilled in the art can easily be susceptible to the embodiment of a lot of other modification that are incorporated to equally these instructions.Although described for the preferred embodiment (it is intended to as illustrative rather than restrictive) of the method and system of media recommendation is provided, it should be noted in the discussion above that those skilled in the art can make and revise and change according to above-mentioned instruction.
Although above-mentioned example is paid close attention to electronic equipment, should be appreciated that the present invention can also be embedded in computer program, this computer program comprises all features of the implementation that makes it possible to carry out methods described herein, and when being loaded into computer system, can carry out these methods.Computer program in this context or application represent the instruction set representing with any language, code or annotation, be intended to make the system with information processing capability directly to carry out specific function, or after following functions one or both of, carry out specific function: a) be converted to another kind of language, code or annotation; B) with another kind of material form, reproduce.
In addition,, except described in claim subsequently, above-mentioned explanation only should not limit the present invention by any way as example.

Claims (23)

1. a method for the additional content that demonstration is relevant to the main contents of watching, described method comprises:
On the first screen equipment, show main contents;
Be provided for explicitly synchronizeing the synchronization mechanism of additional content with the demonstration of main contents on the first screen; And
On the second screen equipment, show the additional content relevant to main contents on the first screen, described additional content is according to the content synchronization showing on described synchronization mechanism and the first screen equipment.
2. method according to claim 1, wherein, provides the step of synchronization mechanism to comprise:
Provide audio frequency watermark, as a part for the demonstration of main contents on the first screen equipment.
3. method according to claim 2, wherein, shows that the step of additional content comprises:
Provided audio frequency watermark is provided on the second screen equipment; And
On the second screen equipment, according to the audio frequency watermark detecting, show described additional content.
4. method according to claim 1, also comprises step:
From the second screen equipment, receive order, to control the demonstration of main contents on the first screen equipment; And
According to the order receiving from the second screen equipment, control the demonstration of main contents the first screen equipment.
5. method according to claim 4, wherein, receives and controls step by provide the playback apparatus of main contents to carry out to the first display device.
6. method according to claim 4, wherein, receives described order via wireless communication protocol.
7. method according to claim 1, wherein, provides the step of synchronization mechanism to comprise:
Provide explicitly wireless communication signals with the demonstration of main contents on the first screen, with synchronous additional content.
8. method according to claim 7, wherein, shows that the step of additional content comprises:
Provided wireless communication signals is provided on the second screen equipment; And
On the second screen equipment, according to the wireless communication signals detecting, show additional content.
9. method according to claim 7, wherein, by provide the playback apparatus of main contents that the step of wireless communication signals is provided described in carrying out to the first display device.
10. method according to claim 1, also comprises:
On the first screen equipment, show to align and be presented at the icon that the type of the additional content on the second screen equipment is indicated.
11. methods according to claim 1, also comprise:
On the second screen equipment, show content on the first screen equipment and the synchronous regime between the additional content on the second screen.
12. methods according to claim 1, wherein, show that the step of additional content comprises:
Via synchronization mechanism, at the second screen equipment place, receive synch command;
According to the signal contact server receiving;
According to the signal receiving, from the server of contact, load additional content; And
On the second screen equipment, show additional content.
13. methods according to claim 1, also comprise:
On the second screen equipment, show the show state of main contents on the first screen equipment.
14. methods according to claim 1, also comprise:
The ability of sharing content on social networks is provided on the second screen equipment.
15. methods according to claim 1, wherein, the user of the additional content of demonstration based on the first and second screen equipments.
16. methods according to claim 1, wherein, show that the step of additional content comprises: with the main contents showing on the first screen equipment additional content that synchronously rolls on the second screen display.
17. methods according to claim 1, wherein, the type of shown additional content is at user option.
18. methods according to claim 1, wherein, the type of the type of shown additional content based on being just presented at the content on the first screen equipment.
The system of the additional content that 19. 1 kinds of demonstrations are relevant to the main contents of watching, described system comprises:
The first screen equipment, is configured to show main contents;
The second screen equipment, is configured to show the additional content relevant to main contents on the first screen, and described additional content is according to the content synchronization showing on synchronization mechanism and the first screen equipment.
20. systems according to claim 19, wherein, the first screen equipment comprises one of TV, monitor and video projector.
21. systems according to claim 19, wherein, the second screen equipment comprises one of smart phone, panel computer, personal media player and laptop computer.
22. systems according to claim 19, also comprise:
Playback apparatus, being configured to provides main contents to the first display device, and provides synchronization mechanism so that the additional content on the second screen is synchronizeed with the main contents on the first screen equipment.
23. systems according to claim 19, also comprise:
Server, is configured to be provided for the additional content showing on the second screen equipment.
CN201180063729.8A 2010-12-30 2011-12-27 Method and system for providing additional content related to a displayed content Pending CN103535028A (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201061460373P 2010-12-30 2010-12-30
US61/460,373 2010-12-30
US201161450328P 2011-03-08 2011-03-08
US61/450,328 2011-03-08
PCT/US2011/067350 WO2012092247A1 (en) 2010-12-30 2011-12-27 Method and system for providing additional content related to a displayed content

Publications (1)

Publication Number Publication Date
CN103535028A true CN103535028A (en) 2014-01-22

Family

ID=46383495

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201180063729.8A Pending CN103535028A (en) 2010-12-30 2011-12-27 Method and system for providing additional content related to a displayed content

Country Status (5)

Country Link
EP (1) EP2659666A4 (en)
JP (1) JP2014510425A (en)
KR (1) KR20130132886A (en)
CN (1) CN103535028A (en)
WO (1) WO2012092247A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104866208A (en) * 2014-02-21 2015-08-26 联想(北京)有限公司 Information processing method and electronic equipment
WO2015168899A1 (en) * 2014-05-08 2015-11-12 漆·亚历克斯 Video playback system and method
CN113038208A (en) * 2021-03-19 2021-06-25 深圳创维-Rgb电子有限公司 Display method, computer equipment and computer readable storage medium

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2769300A4 (en) * 2011-10-19 2015-05-20 Thomson Licensing System and method for automatic content program discovery
EP2801209A1 (en) 2012-01-06 2014-11-12 Thomson Licensing Method and system for synchronising social messages with a content timeline
US8904304B2 (en) 2012-06-25 2014-12-02 Barnesandnoble.Com Llc Creation and exposure of embedded secondary content data relevant to a primary content page of an electronic book
FR2994625B1 (en) * 2012-08-20 2014-08-08 Ifeelsmart INTELLIGENT REMOTE FOR DIGITAL TELEVISION
US11372536B2 (en) 2012-11-20 2022-06-28 Samsung Electronics Company, Ltd. Transition and interaction model for wearable electronic device
US8994827B2 (en) 2012-11-20 2015-03-31 Samsung Electronics Co., Ltd Wearable electronic device
US11157436B2 (en) 2012-11-20 2021-10-26 Samsung Electronics Company, Ltd. Services associated with wearable electronic device
US11237719B2 (en) 2012-11-20 2022-02-01 Samsung Electronics Company, Ltd. Controlling remote electronic device with wearable electronic device
EP2763431A1 (en) * 2013-02-01 2014-08-06 Movym S.r.l. Method and system of accessing data about products related to a multimedia object
CN103974131A (en) * 2013-02-04 2014-08-06 联想(北京)有限公司 Information processing method and electronic equipment
WO2014178796A1 (en) * 2013-05-03 2014-11-06 Telefun Transmedia Pte Ltd System and method for identifying and synchronizing content
US9143565B2 (en) 2013-05-30 2015-09-22 Opentv, Inc. Synchronizing an application on a companion device
KR102142067B1 (en) * 2013-07-12 2020-08-06 삼성전자주식회사 Portable terminal and Method for providing information
KR101538755B1 (en) * 2013-09-23 2015-07-24 (주)파워보이스 Device and method for outputting sound wave capable for controlling external device and contents syncronizing between the devices, and the external device
WO2015130446A1 (en) * 2014-02-28 2015-09-03 Technicolor Usa, Inc Media asset annotation for second-screen
US10944707B2 (en) * 2014-09-26 2021-03-09 Line Corporation Method, system and recording medium for providing video contents in social platform and file distribution system
US9551161B2 (en) 2014-11-30 2017-01-24 Dolby Laboratories Licensing Corporation Theater entrance
DE202015009711U1 (en) 2014-11-30 2019-06-21 Dolby Laboratories Licensing Corporation Large format cinema design linked to social media
KR102296323B1 (en) 2015-01-14 2021-09-01 삼성전자주식회사 Electronic device and method for processing information in the electronic device
FR3022725A1 (en) * 2015-01-23 2015-12-25 Orange METHOD FOR MANAGING THE RESTITUTION OF DIGITAL CONTENTS

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020162120A1 (en) * 2001-04-25 2002-10-31 Slade Mitchell Apparatus and method to provide supplemental content from an interactive television system to a remote device
CN1625252A (en) * 2003-10-14 2005-06-08 索尼株式会社 System and server for providing information, user terminal device, contents display device and method
EP2028659A2 (en) * 2007-08-23 2009-02-25 Sony Computer Entertainment America Inc. System and method for providing metadata at a selected time
CN101540800A (en) * 2008-03-19 2009-09-23 索尼爱立信移动通信日本株式会社 Mobile terminal device and computer program
US20090304182A1 (en) * 2006-09-29 2009-12-10 Mobilians Co., Ltd. System and method for providing information using audio watermarking
US20100119208A1 (en) * 2008-11-07 2010-05-13 Davis Bruce L Content interaction methods and systems employing portable devices
US20100122174A1 (en) * 2008-05-28 2010-05-13 Snibbe Interactive, Inc. System and method for interfacing interactive systems with social networks and media playback devices
US20100280641A1 (en) * 2009-05-01 2010-11-04 David Henry Harkness Methods, apparatus and articles of manufacture to provide secondary content in association with primary broadcast media content

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
BRPI0113763B8 (en) * 2000-09-08 2016-09-13 Ack Ventures Holdings Llc video interaction method
EP1400043A2 (en) * 2000-10-20 2004-03-24 Koninklijke Philips Electronics N.V. Method and arrangement for enabling disintermediation, and receiver for use thereby
EP1329045B1 (en) * 2000-10-20 2004-12-08 Koninklijke Philips Electronics N.V. Rendering device and arrangement
US6741684B2 (en) * 2001-06-26 2004-05-25 Koninklijke Philips Electronics N.V. Interactive TV using remote control with built-in phone
JP4237480B2 (en) * 2002-01-09 2009-03-11 パナソニック株式会社 Broadcast receiving apparatus having address providing function and information access system using the same
JP3953497B2 (en) * 2005-10-18 2007-08-08 ニフティ株式会社 Mobile device
US20080098450A1 (en) * 2006-10-16 2008-04-24 Toptrend Global Technologies, Inc. Dual display apparatus and methodology for broadcast, cable television and IPTV
US8095646B2 (en) * 2007-08-16 2012-01-10 Sony Computer Entertainment Inc. Content ancillary to sensory work playback

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020162120A1 (en) * 2001-04-25 2002-10-31 Slade Mitchell Apparatus and method to provide supplemental content from an interactive television system to a remote device
CN1625252A (en) * 2003-10-14 2005-06-08 索尼株式会社 System and server for providing information, user terminal device, contents display device and method
US20090304182A1 (en) * 2006-09-29 2009-12-10 Mobilians Co., Ltd. System and method for providing information using audio watermarking
EP2028659A2 (en) * 2007-08-23 2009-02-25 Sony Computer Entertainment America Inc. System and method for providing metadata at a selected time
CN101540800A (en) * 2008-03-19 2009-09-23 索尼爱立信移动通信日本株式会社 Mobile terminal device and computer program
US20100122174A1 (en) * 2008-05-28 2010-05-13 Snibbe Interactive, Inc. System and method for interfacing interactive systems with social networks and media playback devices
US20100119208A1 (en) * 2008-11-07 2010-05-13 Davis Bruce L Content interaction methods and systems employing portable devices
US20100280641A1 (en) * 2009-05-01 2010-11-04 David Henry Harkness Methods, apparatus and articles of manufacture to provide secondary content in association with primary broadcast media content

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
MATTHEW MA, ET AL.: "IDTV Broadcast Applications for a Handheld Device", 《2004IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS》 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104866208A (en) * 2014-02-21 2015-08-26 联想(北京)有限公司 Information processing method and electronic equipment
CN104866208B (en) * 2014-02-21 2018-08-10 联想(北京)有限公司 Information processing method and electronic equipment
WO2015168899A1 (en) * 2014-05-08 2015-11-12 漆·亚历克斯 Video playback system and method
CN113038208A (en) * 2021-03-19 2021-06-25 深圳创维-Rgb电子有限公司 Display method, computer equipment and computer readable storage medium

Also Published As

Publication number Publication date
EP2659666A4 (en) 2014-10-08
JP2014510425A (en) 2014-04-24
EP2659666A1 (en) 2013-11-06
KR20130132886A (en) 2013-12-05
WO2012092247A1 (en) 2012-07-05

Similar Documents

Publication Publication Date Title
CN103535028A (en) Method and system for providing additional content related to a displayed content
EP2801208B1 (en) Method and system for synchronising content on a second screen
KR101843592B1 (en) Primary screen view control through kinetic ui framework
JP2017508312A (en) Proximity-dependent media playback
JP2014510320A (en) Context user interface
CN103270482A (en) Method and apparatus for restricting user operations when applied to cards or windows
KR102330475B1 (en) Terminal and operating method thereof
US20160050212A1 (en) Method and apparatus for assigning devices to a media service

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20140122

WD01 Invention patent application deemed withdrawn after publication