KR20130132886A - Method and system for providing additional content related to a displayed content - Google Patents

Abstract

The present disclosure relates to a method and system for providing content related to a displayed program. The method and system of the present disclosure provide a method for a second screen device, such as a tablet (eg, an iPad), to provide rich content experiences associated with displayed primary content (eg, a movie from a Blu-ray disc). Includes two screen applications. The second screen displays deep dive metadata, alternative scenes, other companion video material, or other relevant information synchronized to the main displayed program without interrupting the user's viewing experience. Display.

Description

METHOD AND SYSTEM FOR PROVIDING ADDITIONAL CONTENT RELATED TO A DISPLAYED CONTENT}

This application claims the benefit of US Provisional Patent Application No. 61 / 460,373, filed December 30, 2010, and US Provisional Patent Application No. 61 / 450,328, filed March 8, 2011. Which is hereby incorporated by reference in its entirety.

The present invention generally relates to providing additional content related to displayed content.

Traditionally, additional content related to the displayed movie or program (such as supplemental material for a DVD or Blu-ray Disc) should be watched separately from the main movie or program. In other words, the user must stop or otherwise stop playback of the main movie or program in order to access supplemental materials. In many of these cases, there is no correlation between the supplementary materials and the main movie or program. In other examples, a picture in picture format is used to display supplemental materials, but this still interferes with the display and viewing of the main movie or program.

The present invention seeks to provide a method and system for providing additional content related to the displayed content while avoiding interference with viewing of the main movie or program.

The present disclosure relates to a method and system for providing content related to a displayed program. The method and system of the present disclosure provide a method for a second screen device, such as a tablet (eg, iPad), to provide rich content experiences in conjunction with the displayed primary content (eg, a movie from a Blu-ray disc). Includes two screen applications. The second screen displays deep dive metadata, alternative scenes, other companion video material, or other relevant information synchronized to the main displayed program without interrupting the user's viewing experience. Display.

According to one embodiment, a method of displaying additional content related to primary content being viewed is disclosed. The method includes displaying primary content on a first screen device; Providing a synching mechanism for synchronizing additional content with the display of the primary content on the first screen; And displaying, on the second screen device, additional content related to the primary content on the first screen, synchronized to the content displayed on the first screen device according to the synchronization mechanism.

According to another embodiment, a system for displaying additional content related to primary content being viewed is disclosed. The system includes a first screen device and a second screen device. The first screen device is configured to display primary content. The second screen device is configured to display additional content related to the primary content on the first screen, synchronized to the content displayed on the first screen device according to the synchronization mechanism.

Through the present invention, other related information synchronized to the main displayed program can be displayed without interrupting the user's program viewing experience.

1 is a system diagram that outlines delivery to home for video and audio content according to one embodiment.
2 is a schematic diagram illustrating additional details for an exemplary set top box receiver.
3 illustrates a touch panel control device according to one embodiment.
4 illustrates some example user interactions for using a touch panel control device in accordance with an embodiment.
5 is a system diagram illustrating one embodiment of a system for implementing the techniques of the present invention in accordance with one embodiment.
6 is a flow diagram illustrating an example process in accordance with an embodiment.
FIG. 7 illustrates an example methodology for synchronizing between devices in accordance with an embodiment. FIG.
8 illustrates an example methodology for synchronization between devices in accordance with an embodiment.
9A-9F are screen diagrams of an exemplary skeleton showing features according to one embodiment when used in the manual mode.
10A-10D are screen views of an exemplary skeleton showing features according to one embodiment when used in an active mode.
11A-11C are exemplary skeleton diagrams illustrating social media sharing features in accordance with one embodiment.
12A and 12B are exemplary skeleton diagrams illustrating content selection features according to one embodiment.
13A-13E are exemplary skeleton diagrams illustrating additional features in accordance with one embodiment.
14A-14L are exemplary skinned screen views illustrating how certain features may appear to a user.

Turning now to FIG. 1, shown is a block diagram of one embodiment of a system 100 for delivering content to a home or end user. The content comes from a content source 102, such as a movie studio or production house. The content may be supplied in at least one of two forms. One form may be a broadcast form of content. The broadcast content is typically provided to a broadcast affiliate manager 104, which is a national broadcast service such as the American Broadcasting Company (ABC), the National Broadcasting Company (NBC), the Columbia Broadcasting System (CBS) do. The broadcast member manager can collect and store content and schedule delivery of content over a delivery network shown as delivery network 1 106. [ Delivery network 1 106 may include satellite link transmission from a national center to one or more regional or local centers. Delivery network 1 106 may also include local content delivery using local delivery systems such as over the air broadcast, satellite broadcast, or cable broadcast. The locally delivered content is provided to a receiving device 108 within the user's home, where the content will be retrieved by the user later. It will be appreciated that the receiving device 108 can take many forms and can be implemented as a set top box / digital video recorder (DVR), a gateway, a modem, or the like. In addition, the receiving device 108 may serve as an entry point or gateway for a home network system that includes additional devices configured as client or peer devices in the home network.

The second form of content is referred to as specific or additional content. Certain or additional content may be premium viewing, pay-per-view, or otherwise as other content not provided to the broadcast member manager, such as, for example, movies, video games, or other video elements. It may include the delivered content. In many cases, the specific content may be the content requested by the user. The specific content may be communicated to the content manager 110. Content manager 110 may be, for example, a content provider, a broadcast service, or a service provider, such as an Internet web site affiliated with a delivery network service. The content manager 110 may also merge the Internet content into a delivery system. The content manager 110 may deliver the content to the user's receiving device 108 via the delivery network 2 112, which is a separate delivery network. Delivery network 2 112 may include high speed broadband internet type communication systems. It may be assumed that the content from the broadcast member manager 104 may be delivered using all or a portion of the delivery network 2 112 and that content from the content manager 110 may be delivered to all Lt; / RTI > may be transmitted using portions or portions thereof. In addition, the user may acquire the content directly from the Internet via the delivery network 2 (112) without necessarily allowing the content to be managed by the content manager 110. [

Several adaptations for using additional content delivered separately may be possible. In one possible approach, additional content is provided as an augmentation for broadcast content providing alternative displays, purchase and sales options, enhancement material, and the like. In other embodiments, additional content may completely replace some programming content provided as broadcast content. Finally, the additional content can be completely separated from the broadcast content, which can simply be a media alternative that the user can choose to use. For example, the additional content may be a library of movies that are not yet available as broadcast content.

Receiving device 108 may receive different types of content from one or both of delivery network 1 and delivery network 2. The receiving device 108 processes the content and provides separation of the content based on user preferences and commands. Receiving device 108 may also include a storage device, such as a hard drive or an optical disc drive, for recording and playing back audio and video content. Further details regarding the operation of the receiving device 108 and features associated with playing the stored content will be described below with respect to FIG. 2. The processed content is provided to the display device 114. The display device 114 may be a conventional 2-D type display, or alternatively it may be an advanced 3-D display.

Receiving device 108 may also be interfaced to a second screen, such as touch screen control device 116. The touch screen control device 116 can be adapted to provide user control for the receiving device 108 and / or the display device 114. The touch screen device 116 may also display video content. The video content may be graphical entries, such as user interface entries, or may be part of the video content delivered to the display device 114. The touch screen control device 116 may be interfaced to the receiving device 108 using any well known signal transmission system, such as infrared (IR) or radio frequency (RF) communication, and may include an infrared data communication (IRDA) standard, Standard protocols such as Wi-Fi, Bluetooth, and the like, or any other dedicated protocols. In some embodiments, the touch screen control device 116 can interface directly with delivery networks 1 and 2. The operation of the touch screen control device 116 will be described in more detail below.

In the example of FIG. 1, the system 100 also includes a back end server 118 and a usage database 120. The back-end server 118 includes a personalization engine that analyzes the user's usage habits and makes recommendations based on these usage habits. The usage database 120 is where the usage habits for the user are stored. In some cases, the usage database 120 may be part of the back-end server 118. In this example, the back-end server 118 (and the usage database 120) is connected to the system 100 and accessed through the forwarding network 2 112. [

Turning now to FIG. 2, shown is a block diagram of one embodiment of a receiving device 200. Receiving device 200 may operate similar to the receiving device described in FIG. 1 and may be included as part of a gateway device, modem, set-top box, or other similar communication device. The depicted device 200 may be merged with other systems, including audio devices or display devices. In any case, some components that are essential for the complete operation of the system are not shown for brevity, but are well known to those skilled in the art.

In the device 200 shown in FIG. 2, the content is received by the input signal receiver 202. The input signal receiver 202 is some known receiver circuit used to receive, demodulate, and decode signals provided over one of several possible networks, including over land, cable, satellite, Ethernet, fiber, and telephone line networks. It may be one of them. The desired input signal may be selected and retrieved by the input signal receiver 202 based on the user input provided through the control interface or touch panel interface 222. [ The touch panel interface 222 may include an interface for a touch screen device. The touch panel interface 222 may also be adapted to interface with a cellular phone, tablet, mouse, high-end remote, or the like.

The decoded output signal is provided to an input stream processor 204. The input stream processor 204 performs final signal selection and processing and includes separation of video content from audio content for the content stream. The audio content is provided to the audio processor 206 for conversion from a received format such as a compressed digital signal to an analog waveform signal. The analog waveform signal is provided to the audio interface 208 and is further provided to a display device or an audio amplifier. Alternatively, the audio interface 208 may be a display device using an alternative audio interface, such as through a high-definition multimedia interface (HDMI) cable or a Sony / Philips Digital Interconnect Format (SPDIF) Signal. The audio interface may also include amplifiers for driving one or more sets of speakers. The audio processor 206 also performs any necessary conversion for the storage of the audio signals.

The video output from the input stream processor 204 is provided to the video processor 210. The video signal may be one of several formats. The video processor 210 provides the necessary transformation of the video content based on the input signal format. Video processor 210 also performs any necessary conversion for the storage of video signals.

Storage device 212 stores audio and video content received as input. The storage device 212 is under the control of the controller 214 and also commands received from the user interface 216 and / or the touch panel interface 222, such as navigation such as fast forward (FF) and rewind (Rew). Allow for later retrieval and playback of content based on navigation instructions. Storage device 212 may be one or more large capacity integrated electronic memories, such as a hard disk drive, static RAM (SRAM), or dynamic RAM (DRAM), or a compact disk (CD) drive or digital video disk (DVD) It may be an interchangeable optical disc storage system such as a drive.

The converted video signal from the video processor 210, from the input or from the storage device 212, is provided to the display interface 218. The display interface 218 further provides a display signal to a display device of the type described above. Display interface 218 may be an analog signal interface, such as Red-Green-Blue (RGB), or it may be a digital interface, such as HDMI. It will be appreciated that the display interface 218 will generate various screens for displaying search results in a three dimensional grid, as described in more detail below.

The controller 214 busses various components of the device 200, including the input stream processor 202, the audio processor 206, the video processor 210, the storage device 212, and the user interface 216. Are interconnected through. The controller 214 manages the conversion process for converting the input stream signal into a signal for storage in a storage device or for display. The controller 214 also manages the retrieval and playback of stored content. In addition, as described below, the controller 214 performs the retrieval of content and the creation and adjustment of a grid display that represents the content to be delivered over the stored or previously described delivery networks.

Controller 214 stores control memory 220 (e.g., RAM, SRAM, DRAM, ROM, programmable ROM (PROM), flash memory, electronically programmed to store information and command codes for controller 214). And volatile or nonvolatile memory, including electronically erasable and electronically erasable and programmable ROM (EEPROM). The control memory 220 may store instructions for the controller 214. The control memory may also store a database of elements, such as graphical elements containing content. The database may be stored as a pattern of graphical elements. Alternatively, the memory may store graphical elements in identified or grouped memory locations and may use an access or location table to identify memory locations for various portions of information about graphical elements. Additional details regarding the storage of graphical elements will be described below. The implementation of control memory 220 may also include some possible embodiments, such as a single memory device, or alternatively, one or more memory circuits communicatively coupled or coupled together to form a shared or common memory . In addition, the memory may be included in other circuits, such as portions of the bus communication circuitry in larger circuits.

The user interface process of the present disclosure uses an input device that can be used to represent functions such as fast forward, rewind, and the like. To enable this, the touch panel device 300 may be interfaced via the touch panel interface 222 and / or the user interface 216 of the receiving device 200, as shown in FIG. 3. The touch panel device 300 enables operation of a receiving device or set top box based on hand movements or gestures, and actions translated into commands for a set top box or other control device via the panel. In one embodiment, the touch panel 300 may simply serve as a navigation tool for navigating the grid display. In other embodiments, the touch panel 300 may additionally serve as a display device that allows the user to interact more directly with the navigation through a grid display of the content. The touch panel device may be included as part of a remote control device that includes conventional control functions such as actuator or activator buttons. The touch panel 300 may also include at least one camera element. In some embodiments, touch panel 300 may also include a microphone.

Turning now to FIG. 4, the use of a gesture detection controller or touch screen provides many types of user interaction, as shown. Inputs from the controller are used to define gestures, and gestures also define commands in a particular context. The configuration of the sensors may allow defining the movement of the user's fingers on the touch screen, or may even allow the movement of the controller itself to be defined in one or two dimensions. The combination of yaw, pitch, and roll and two-dimensional motion, such as diagonal, can be used to define any three-dimensional motion, such as swing. Many gestures are shown in FIG. Gestures are interpreted in context and are identified by defined moves made by the user.

Bumping 420 is defined as a two-stroke drawing indicating one direction of up, down, left, or right. Bumping gestures are combined with specific instructions in context. For example, in time shifting mode, the left-bump gesture 420 represents rewinding and the right-bump gesture represents fast-forwarding. In other contexts, the bump gesture 420 is interpreted as increasing a particular value in a direction designated by the bump. Checking 440 is defined as drawing a check mark. This is similar to the downwardly directed bump gesture 420. The checking is identified in the context to specify a reminder, and a user tag, or to select an item or element. Circle ring 440 is defined as drawing a circle in both directions. It is possible that both directions can be distinguished. However, to avoid confusion, the circle is identified by a single instruction that is not related to direction. Dragging 450 is defined as the angular movement (pitch and / or yaw variation) of the controller while depressing the button (virtual or physical) on the tablet 300 (i.e., "trigger drag"). Dragging gesture 450 may be used for navigation, speed, distance, time-shifting, rewinding, and forwarding. Dragging 450 can be used to move changes in state, such as highlighting or selecting a border on a cursor, virtual cursor, or display. The dragging 450 can be in any direction and is generally used to navigate in two dimensions. However, in certain interfaces it is desirable to modify the response to the dragging command. For example, in some interfaces, operation in one dimension or direction is preferred over other dimensions or directions, depending on the location or direction of movement of the virtual cursor. Nodding 460 is defined as two fast trigger-drag up-and-down vertical movements. The manding 460 is used to indicate "yes" or "accept". X-ing (X-ing, 470) is defined as drawing the letter "X". X-Ying 470 is used for "delete" or "block" instructions. Wagging 480 is defined as the horizontal movement of two trigger-drag fast back-and-forth. The wedging gesture 480 is used to indicate "no" or "cancel".

Depending on the complexity of the sensor system, only simple one-dimensional motions or gestures can be tolerated. For example, a simple right or left motion on a sensor as shown herein may yield a fast forward or rewind function. Also, multiple sensors may be included and located at different locations on the touch screen. For example, horizontal sensors for left and right movements may be placed at one point and used for volume increase / decrease, while vertical sensors for up and down movements may be placed at different points and channel increase. Can be used for / reducing. In this manner, a specific gesture mapping can be used.

The system and methodology may be implemented in any number of ways, depending on the hardware and the content involved. Examples of such deployments include DVD, Blu-ray Disc (BD); Streaming video or video on demand (VOD), and broadcast (satellite, cable, terrestrial). Each of these deployments will have different schemes, but can standardize triggers for each of these events (additional content) indicating that they will be queued by the application running on the second screen. For example, event A and event B would be triggered by a synchronization mechanism coupled with their any sources for video. When the tablet faces "Event A", a program running on the second screen device (eg, tablet) will enact "Event A". Similarly, when faced with "Event B", a program running on the second screen device will enact "Event B".

5 shows a generic system 500 in which this methodology can be implemented. Here, the system 500 includes a first screen device 510, a second screen device 520, a playback device 530, a network 540, and a server 550. Each of these elements will be discussed in more detail below.

The first screen device 510 is a display device, such as the display device 114 described above with respect to FIG. 1, for displaying content such as television programs, movies, and websites. Examples of such first screen display devices include, but are not limited to, a television, a monitor, a projector, or the like. The first screen device 510 is connected to a playback device 530 that can provide primary content to the first screen device 510 for display. Examples of such communications include, but are not limited to, HDMI, VGA, DisplayPort, USB, Component, Composite, Radio Frequency (RF), Infrared (IR), and the like. In certain embodiments, the first screen display device 510 may be connected to the network 540 in a wired or wireless (Wi-Fi) manner, providing additional connectivity to the second screen device 520 and the server 550. . In some embodiments, the first display device 510 can include the functionality of the playback device 530. In other embodiments, the first screen display device 510 may be non-networked communication with the second screen device 520. Examples of such networkless communication 560 include, but are not limited to, RF, IR, Bluetooth, and other audio communication technologies and protocols.

 The second screen device 520 is a device capable of displaying additional content related to the primary content being displayed on the first screen device 510. The second screen device may be the touch screen control device 116 or touch screen device 300, as described above. Examples of second screen devices include, but are not limited to, a smartphone, tablet, laptop, personal media player (eg, iPod), and the like. The second screen device 520 communicates with the playback device 530 using the network 540 or communication 560 that is not networked, or both. The second screen device 550 also communicates with the server 550 via the network 540 to request and receive additional content related to the primary content being displayed on the first screen device 510. In some embodiments, the second screen device 520 may be communication 560 networked or unnetworked with the first screen device 510. Examples of such networkless communications 560 include, but are not limited to, RF, IR, Bluetooth (BT), or audio communication technologies and protocols, and the like.

The playback device 530 is a device capable of providing primary content for display on the first screen device 510. Examples of such playback display devices include, but are not limited to, DVD players, Blu-ray Disc (BD) players, game consoles, receiver devices (cable or satellite), digital video recorders (DVR), streaming devices, or personal computers. It is not limited. The playback device 530 is coupled to the first screen device 510 to provide primary content to the first screen device 510 for display. Examples of such connections include, but are not limited to, HDMI, VGA, DisplayPort, USB, Component, Composite, Radio Frequency (RF), Infrared (IR), and the like. The playback device 530 is also connected to the network 540 in a wired or wireless (Wi-Fi) manner and provides a connection to the second screen device 520 and the server 550. In some embodiments, the functionality of the playback device 530 can be included in the first screen display device 510. In yet other embodiments, the playback device 530 can be a communication 560 that is not networked with the second screen device 520. Examples of such networkless communications 560 include, but are not limited to, RF, IR, Bluetooth (BT), and other audio communication technologies and protocols.

The network 540 may be a wired or wireless communication network implemented using Ethernet, MoCA, and wireless protocols or a combination thereof. Examples of such networks include, but are not limited to, delivery network 1 106 and delivery network 2 112 discussed above.

The server 550 is a content server configured to provide additional content to the second screen device 520. In certain embodiments, the server may also provide primary content for display on the first screen device 510. The service is connected to the network 540 and can also communicate with any connected devices. Examples of such servers include, but are not limited to, content source 102, broadcast member manager 104, content manager 110, and the back end server described above.

6 is shown that shows a flowchart 600 for a methodology for displaying additional content related to primary content being viewed. The method comprises the following steps: displaying primary content on the first screen device 510 (step 610); In combination with the display of primary content on the first screen, providing a synchronization mechanism for synchronizing additional content (step 620); And displaying on the second screen device 520 additional content related to the primary content on the first screen 510, synchronized to the content displayed on the first screen device in accordance with a synchronization mechanism (step 630); It includes. In certain embodiments, the method also includes receiving instructions (step 640) from the second screen device 520 to control the display of the primary content on the first screen device 510, and the second Controlling the display of primary content on the first screen device 510 (step 650) based on the instructions received from the screen device 520. Each of these steps will be described in more detail below.

Displaying primary content such as a movie or television show (step 610) is performed at the first screen device 510. This includes primary content provided to the first screen display 510. The primary content may be provided by the playback device 530 or may be received directly from the content provider at the first screen display device 510. The primary content is then shown or otherwise displayed on the first screen device 510. Display of primary content also includes control of the content being displayed. This may include conventional playback commands of play, pause, pause, rewind, and fast forward, and navigation of on-screen menus to select content and other playback options. In certain embodiments, the display on the first screen device 510 (step 620) further includes displaying an indicator for the type of additional content being displayed on the second screen device 520.

The provided synchronization mechanism (step 620) may be implemented in many ways. In certain embodiments, the synchronization mechanism is performed by an application running on the second screen device 520, the playback mechanism 530, the first screen device 510, or any combination thereof. In the most basic step, the second screen device 520 synchronizes instructing the second screen device 520 to update the display of additional content to occur concurrently with the primary content being displayed on the first screen 510. Configured (via the application) to detect signals, cues, or other types of indicators. Synchronization signals, cues, or other types of indicators may be provided as part of the primary content, or depending on the chapter, scene, time-code, subject matter, or content being displayed (the application may be May be generated by the playback device 530 of the first screen device 510. Synchronization signals, cues, or other types of indicators may be connected to the second screen device 520 using a wired or wireless (Wi-Fi) type network, or using a networkless communication 560, such as audio signals. Can be sent. Examples of some implementations are given below. Other possible implementations will become apparent given the benefit of this disclosure.

Displaying additional content such as supplemental materials, video clips, websites, and the like (step 630) is performed at the second screen device 520. Additional content may be stored locally at the second screen device 520 or may be provided by the server 550, the playback device 530, or the first screen device 510. The display of additional content is synchronized to the primary content being displayed on the first screen device 510 in accordance with a synchronization mechanism. For example, when the second screen device 520 detects a synchronization signal, cue, or other type of indicator, the second screen device 520 updates the display of additional content accordingly. In some embodiments, this further comprises contacting and requesting additional content from the server 550, the playback device 530, or the first screen device 510, and subsequently downloading the additional content. And loading and displaying. In some embodiments, additional content to be displayed may be selected, modified, or omitted based on the user using the system.

In certain embodiments, the display on the second screen device 520 (step 630) is such that the display of the primary content on the first screen device 510 is stopped, such as whether the first screen device 510 is stopped. And displaying the status for display of the primary content on C). In other particular embodiments, the display on the second screen device 520 (step 630) is in a synchronized state between the additional content on the second screen device 520 and the primary content on the first screen device 510. It further includes the step of displaying.

In certain embodiments, the second screen device 520 may transmit, as well as receive. Optional steps 640 and 650 address this function. In step 640, the instructions are received from the second screen device 520. Ideally, these commands are received at the device that controls the playback of the primary content on the first screen device 510. In a particular embodiment, playback device 530 is a device that receives instructions. The instructions may be sent over the network 540 or over a non-networked communication 560. Once received, the instructions may control the display of the primary content (step 650). Examples of such controls include, but are not limited to, play, stop, pause, rewind, fast-forward, as well as chapters, scenes, and selections. These instructions may also be used to synchronize primary content being displayed on first screen device 510 with additional content being displayed on second screen device 520.

7 provides a high level overview of one example of a system 700 having a synchronization mechanism implemented using networkless communication 560. In the present system 700, the communication synchronization mechanism that is not networked is audio watermarking 710. In this example, audio watermarking 710 includes inserting a high frequency signal, cue, or other indicator into the audio signal of the primary content being displayed on the first screen device 510. The audio watermark is inaudible to people but may be detected at the second screen device 520 by the microphone. When the second screen device 520 detects the audio watermark, the displayed additional content is updated to synchronize with the primary content being displayed on the first screen device 510 based on the detected watermark. Audio watermarks may be merged into the primary content at the source of the content or may be locally inserted by the playback device 520 or the first screen device 510.

8 provides a high level overview of one example of a system 800 having a synchronization mechanism implemented using network 540. In the present system 800, the synchronization mechanism is wireless communication (Wi-Fi) 810 between the playback device 530 (Blu-ray Disc player) and the second screen device 520 (iOS device running the application). In the example of FIG. 7, the protocols and features of the BD-Live enabled device are used. There are two main components to this protocol: connection and communication. All of these are described below. For brevity, the second screen iOS application will be referred to as an "iPad" and the device enabled for BD-Live will be referred to as a "disc".

First, when the iOS enabled device 520 starts a second screen application and attempts to connect to the BD-live enabled device 530 in the same Wi-Fi network 540, a connection is made.

1.The disc is inserted in the BD player

2. Disk enters UDP 'listening' loop

3. iPad launches second screen application

4. iPad performs UDP broadcast of authentication token

5. The disk receives authentication tokens and authentications

6. Disk retrieves IP from token sender (iPad's IP)

7. Disk Responds to Authentication Through IP and Port

8. iPad checks IP and port

9. iPad closes UDP socket communication

10. iPad establishes direct TCP socket communication with disk based on provided port and IP

After the connection between the second screen iOS application and the BD-Live enabled device is established, the connection is made.

1. The iPad and the disk know each other's IPs and which port will be used to communicate.

2. TCP socket communication is maintained for the life of the applications.

As can be seen in this example, one advantage of such wireless communication is that the wireless communication is bidirectional allowing the second screen device to send and receive commands. This enables two methods: synchronization and control of playback from the second screen device 520.

In certain embodiments, the application of the second screen device 520 may be specified with a particular program or movie on a particular system (eg, BD). In other embodiments, the second screen application may be generic to a studio with plug-ins available for configuring the application for a particular program or movie. In still other embodiments, the second screen application may be universal to the system (BD, VOD, broadcast), content, or both. Other possible implementations and configurations will become apparent to those skilled in the art, given the benefit of this disclosure.

The system can be operated through a passive approach or an interactive approach. In a passive approach, icons displayed on the first screen device 510 may indicate that the user has a second screen device 520 associated with the primary content displayed on the first screen device 510 and for additional content events being displayed. Prompt to search for. The icon preferably indicates what type of additional content event is available on the second screen device 520 (eg, a shopping cart icon represents a purchase event, an "I" icon represents an information event, a stickman icon Is a property information event, and so on. 9A-9F illustrate some aspects that may be displayed to a user in a passive mode.

9A-9F illustrate a screen 900 of a second screen device when using an application in a passive mode that provides additional content on the second screen device 520 synchronized with the primary content on the first screen device 510. Examples of skeletons for what may be displayed to a user on the screen are shown.

9A shows a splash screen that can be displayed to the user when the application is started. This includes the product logo and representation 902 of the primary content. Here, new content screens are transitioned from the right in a conveyor-belt type manner indicated by arrow 904.

9B shows the pop-up message 906 displayed to the user when no playback device 530 is detected by the second screen device 520.

Screen 900 of FIG. 9C includes a sync button / icon 908, chapter timeline 910, active chapter indicator 912, chapter-event indicator 914, chapter number indicator 916, event timeline 918 ), Chapter background 920, event card 922, and timeline view icon 924. The sync button 908 provides a mechanism for synchronizing content between the first and second screen devices 510, 520. The sync button 908 can also indicate a synchronization state between content on the first and second screen devices 510, 520. The chapter timeline 910 displays chapters of the primary content. The movie title leader exists in the background of the chapter timeline 910 and displays primary content. As the primary content progresses, the chapters are conveyor-belt-like, via an active chapter indicator 912 that displays the current chapter within the primary content via the highlight and center position of the chapter timeline 912. Move along the chapter timeline in the The chapter-event indicator 914 indicates that the events displayed in the event timeline 918 are part of the active chapter shown in the chapter timeline 910. Event timeline 918 displays event cards 922 that display events corresponding to those occurring in the current chapter of the primary content. For each chapter, the first displayed event card 922 indicates the chapter in which the following events occur. As the primary content advances, the event cards 922 move along the event timeline 918 in a conveyor-belt fashion, with the current event at the central location of the event timeline 918. Each chapter may be provided with a unique background 920 for events of that particular chapter. Timeline view icon / button 924 indicates that the viewer is in a timeline view showing chapter timeline 910 and event timeline 918, and also provides a mechanism for accessing the timeline view. do.

The screens 900 of FIGS. 9D and 9E show which event card 922 advances across the event timeline 918. Here, the sync button / icon 908 indicates that the timeline view of the additional content is synchronized with the primary content on the first screen device 510. In FIG. 9D, the currently triggered event card 926 is shown at the center location of the event timeline 918 and represents the first triggered event. On the left of the event card 926 currently triggered in the event timeline 918 is a previous event card 928, in which case the card indicates a chapter. Next to the event card 926 currently triggered on the event timeline 918 is the next event card 930, in which case the card indicates the next scheduled event. In FIG. 9D, since the currently triggered event card 926 is for a first triggered event, the chapter indicator 916 indicates that it is chapter one. Currently triggered event card 926 includes additional content 932 related to the primary content. The currently triggered event card 926 also provides an indicator 934 of what type of additional content is displayed. In certain embodiments, this indicator is consistent with the indicator shown on the first screen display 510. Current event card 926 also includes buttons / icons for synchronization 936 and sharing 938. The sync button / icon 936 provides a mechanism by which the primary content displayed on the first screen device 520 is synchronized with the current event. The share button / icon 938 provides a mechanism for sharing additional content of the event via the social network. Elements of screen 900 of FIG. 9E except that the currently triggered event card 926 is for an event that occurs later in the timeline, as indicated by a chapter indicator 916 indicating that the current chapter is chapter 3. And similar to the elements of FIG. 9D.

9F shows examples of other possible functions that may be provided as part of a display on second screen device 920. Here, the chapter timeline 910 has a collapse icon / button 940 that provides a mechanism for toggling the chapter timeline between visible 940a and hidden 940b. ) Is provided. Similarly, the sync button / icon 908 may toggle between state 908a indicating whether synchronization is currently active and state 908b indicating that synchronization is lost and resynchronization is available. . In some embodiments, a volume button / icon 942 is provided. Volume button / icon 942 provides a mechanism for switching the sound of the first screen display to “off” or “on”. The volume button 942 can also display the status of whether the volume is "on" 942a indicating that muting is available or "off" 942b indicating that sound is available. Can be. In some other embodiments, a play / pause button / icon 944 is provided. The play / pause button 944 provides a mechanism for pausing or resuming playback of content on the first screen display 510. The pause / play button may also indicate the status of whether playback can be paused 944a or resumed 944b.

In the interactive approach, the user selects an additional content event at the second screen device 520, and what is displayed on the primary screen device 510 is synchronized to the selected event. As indicated previously, additional content events are synchronized to the primary content. When a user swipes a movie timeline or events, the events become out of sync with the movie shown on the home screen. To resync, touch the sync button on your tablet. The timeline or events are synchronized back to what is being displayed on the home screen. Similarly, the user can select a trivia event or a map event, touch the sync button, and the scene of the movie related to the selected trivia or map event will be played on the main screen. Examples of this can be found in FIGS. 10A-10D.

FIG. 10A shows how a user can interact with the chapter timeline 910 and the event timeline 918 on the screen 900. Here, icons 1000 and 1002 show how a user can touch the screen to scroll left or right in chapter or event timelines 910, 918.

10B shows one embodiment of a screen 900 for when a user interacts with the chapter timeline 910. In this example, the sync button / icon 908 indicates that additional content on the second screen display 520 is not synchronized with the primary content on the first screen display 510. Icon 1000 shows the user scrolling through the chapter timeline 910. The current chapter remains highlighted 912 until the transition to the new chapter is complete. When navigating through the chapter timeline 910, a chapter position indicator 1004 is provided that indicates which of the available chapters is selected. Chapter indicator 916 also displays and updates the selected chapter when the transition to the new chapter is complete. In this example, the event timeline 918 is blurred while the user navigates through the chapter timeline 910. In certain embodiments, the user can jump directly to a specific chapter by selecting a chapter from the timeline 910.

10C shows one embodiment of a screen 900 for when a user interacts with the event timeline 918. Icon 1002 shows the user scrolling across event timeline 918. Here, timeline 918 is transitioning from the currently triggered event card 926 to the next event card 930. When navigating across the event timeline 918, an event location indicator 1004 is provided that indicates which of the available events is selected.

FIG. 10D illustrates one embodiment of a screen 900 for when a user interacting with the event timeline 918 causes a transition from one chapter to another. Icon 1002 shows user scrolling through event timeline 910, which causes a change in chapter. Here, timeline 918 is being transitioned to a new event card 922 indicating a new set of events related to the new chapter. When navigation across the event timeline 918 causes a transition to a new chapter, the event location indicator 1004 is centered until a new series of events begins.

11A-11C, and 12A-B show some of the other interactive activities that can be accessed via event cards 922. 11A-11C illustrate social media sharing features. 12A and 12B show chapter selection, and selection and playback of additional media files.

11A-11C show various pop-up fields on the display 900 for when the sharing feature is activated via the share button / icon 937. FIG. 11A shows a field 1100 displayed when a user logs in to their social network (in this case, Facebook). Region 1102 indicates that the event is being shared, and region 1104 indicates comments that the user will share about the event. Button 1106 provides a mechanism for submitting an event and comments to be shared. 11B shows the field 1100 displayed when the user has not yet registered with the social network. In this example, button 1108 is provided to register with Facebook and button 1110 is provided to register with Twitter. Options for registering with other social networks may also be provided. 11C shows an on-screen Qwerty keyboard 1112 that can be used to enter comments into area 1104 for user comments. In certain embodiments, this may be the default keyboard provided by the second screen device 520.

12A and 12B illustrate selection of media content and chapters for playback by a user. In the example of FIG. 12A, if a user taps 1200 on the currently playing chapter shown in chapter timeline 912, playback on first screen device 510 is paused. If the user double taps 1202 the currently playing chapter shown in the chapter timeline, playback on the first screen device will skip to the beginning of the chapter, and the event timeline 918 returns to the first event of that chapter. Will be set. In some embodiments, event cards 922 may include media files 1204, such as video or audio clips. If the media file is an audio clip, the selection of the audio clip causes the current screen 900 to play. If the media file is a video clip, the selection of the video clip causes the full-screen media player 1206 to start, as can be seen in FIG. 12B. In this example, the media player includes on-screen controls 1208. To return to the previous screen, the user only needs to tap the non-video surface 1210 of the media player.

13A-13E illustrate some other possible features for additional content. These include a map view 1300, a family tree 1310, and settings 1320. 13A shows menu bars for these options. In this example, each of these menu bars is provided with first screen device controls 1330 that include pause / resume and mute / non-mute. 13B shows a map view display 1300. FIG. Map view display 1300 includes a map 1302 that includes marked locations 1304 and information 1306 about the locations. Also provided are icons for selecting other maps 1308. 13C shows a family tree view 1310. The family tree view shows a family tree that includes fields 1312 that indicate relationships between family members. In this example, the button / icon 1314 at the bottom indicates which view is currently shown (ie, a family tree view). If field 1312 is selected, as shown in FIG. 13D, pop-up field 1316 is displayed, which provides information about an individual within field 1312. 13E shows a set view 1320. [ In view 1320, the user is provided with controls for adjusting preferences for audio and video 1322, events 1324, and social network sharing 1326.

14A-14L show a user at screen 900 of a second screen device when using an application that provides additional content on second screen device 520 that is synchronized to primary content on first screen device 510. Show skinned examples of what can be displayed. 14A is a skinned version of the splash screen shown and described with respect to FIG. 9A. 14B-14F show skinned versions of timeline views identified and described with respect to FIGS. 9C-9F, and 10A-10D. 14G shows a skinned version of the screen display, where all available video clips that are part of the additional content are displayed for the user. 14H shows a skinned version of the screen display, where all available audio clips that are part of the additional content are displayed for the user. FIG. 14I shows a skinned version of the map view shown and described with respect to FIG. 13B. 14J and 14K show skinned versions of the family tree view shown and described with respect to FIGS. 13C and 13D, respectively. FIG. 14L shows a skinned version of the setup view shown and described with respect to FIG. 13E.

The events and features shown in the figures are only some examples of possible events. In certain embodiments, the user may configure or otherwise select which events he wants to be shown (eg, do not show me purchase events). In other embodiments, the user can select or bookmark events for later viewing. In still other embodiments, certain events may not be available or rejected depending on the version of the program being watched (ie, purchased vs. rented or BD vs. VOD vs. broadcast). In other embodiments, the available events are for the user based on previous viewing habits (ie, in a system such as TIVO where the user's viewing habits are tracked, or using the personalization engine 118 of FIG. 1). Can be personalized.

Other possible configurations include shopping features. For example, a store front may be provided and accessed from a second screen to purchase movie merchandise. In yet another embodiment, points or awards may be provided to the user for viewing, commenting on, or recommending a program or movie. For example, the more movies watched or shared with friends, the more points are awarded. Thereafter, points can be used for prizes or discounts on related products.

Similarly, achievements may be paid. These achievements can be pushed to social networking sites. Example achievements may include:

Watch specific scenes-Achievements

Watch specific discs in a series-Achievements

Watch specific discs by specific studios or actors-achievements

In still other implementations, the Wiki feature can be implemented. A running wiki can allow one user or other users to comment on a particular scene. For example, tacking of metadata pushed to a web-based wiki may be formed. Such metadata may include:

Chapter information

Time codes

Thumbnails of scenes

Actor / Performer Information

This pushed information can be used to form a running wiki that allows others to comment on the movie. These comments can be reintegrated into the second screen application as events that can be accessed later.

This description illustrates the principles of the present disclosure. Thus, it will be understood by those skilled in the art that, although not explicitly described or shown herein, various devices may be devised that implement the principles of the present disclosure and are included within its scope and spirit.

All examples and conditional language detailed herein are educated to assist the reader in understanding the principles and principles of the present disclosure that have been contributed by the inventor (s) in advancing the prior art. It is intended for the purpose of illustration and will be construed as not to impose any limitation on these specifically described examples and conditions.

Moreover, all statements herein reciting principles, aspects, and embodiments of the disclosure, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, such equivalents are intended to encompass all currently known equivalents, as well as equivalents developed in the future, including any developed elements that perform the same function regardless of structure.

Thus, it will be appreciated by those skilled in the art, for example, that the block diagrams presented herein will illustrate conceptual views of exemplary circuits embodying the principles of the present disclosure. Similarly, any flowcharts, flow diagrams, state variances, pseudocodes, and the like can be substantially represented in a computer readable medium, thereby whether or not a computer or processor is explicitly shown. Or it will be understood to represent various processes that may be executed by a processor.

The functions of the various elements shown in the figures may be provided through use of dedicated hardware, as well as hardware capable of executing the software in combination with appropriate software. When provided by a processor, the functions may be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which may be shared. In addition, the explicit use of the term "processor" or "controller" should not be construed as exclusively referring to hardware capable of executing software, and should not be construed as digital signal processor ("DSP") hardware, read-out for software storage. Dedicated memory (“ROM”), random access memory (“RAM”), and nonvolatile storage may be implicitly included, without limitation.

Other hardware, conventional and / or custom, may also be included. Similarly, any of the switches shown in the Figures are conceptual only. Their functions may be performed through computation of program logic, through dedicated logic, through program control and interaction of dedicated logic, or even manually, where a particular technique may be more specifically understood from the context and thus implemented. Can be chosen by the child.

Although embodiments that incorporate the teachings of the present disclosure have been shown and described in detail herein, those skilled in the art can readily devise many other various embodiments that still incorporate this teaching. Although the preferred embodiments of the method and system for providing media recommendations (which are intended to be illustrative and not restrictive) have been described, modifications are made by those skilled in the art in view of the foregoing teachings. It is noted that variations can be made.

While the examples enumerated above have been noted for electronic devices, the invention also includes all the features that enable implementation of the methods described herein, and a computer capable of performing these methods when loaded into a computer system. It will be appreciated that it can be inserted into a program product. A computer program or application in this context may include: a) conversion of a specific function, in any language, code or notation, directly or following into another language, code or symbol; b) any expression that is a collection of instructions intended to be the cause of a system having an information processing function for subsequent execution of one or both of the reproductions in different data formats.

In addition, the foregoing description is intended to be illustrative only and is not intended to limit the invention in any way, except as listed in the following claims.

102: Content source 104: Broadcast member manager
106: transmission network 1 108: receiving device
110: content manager 112: delivery network 2
114: Display device 116: Touch screen control device
118: personalization engine 120: usage database
202: input signal receiver 204: input stream processor
206: audio processor 208: audio interface
210: Video processor 212: Storage device
214: controller 216: user interface
218: display interface 220: control memory
222: touch panel interface 420: bumping gesture
430: Checking gesture 440: Circle ring gesture
450: Dragging Gesture 460: Nailing Gesture
470: X-Ying Gesture 480: Wagging Gesture

Claims (23)

A method of displaying additional content related to primary content being viewed,
Displaying primary content on a first screen device;
Providing a synching mechanism for synchronizing additional content with the display of the primary content on the first screen; And
Displaying additional content related to the primary content on the first screen on the second screen device, synchronized to the content displayed on the first screen device in accordance with the synchronization mechanism.
A method of displaying additional content related to primary content being viewed. The method of claim 1,
Providing a synchronization mechanism includes: providing audio watermarks to the first screen device as part of the display of the primary content,
A method of displaying additional content related to primary content being viewed. 3. The method of claim 2,
Displaying additional content includes:
Detecting, at the second screen device, the provided audio watermark; And
At the second screen device, displaying additional content based on the detected audio watermark;
A method of displaying additional content related to primary content being viewed. The method of claim 1,
Receiving instructions from a second screen device to control display of primary content on the first screen device; And
Controlling the display of the primary content on the first screen device based on instructions received from the second screen device;
A method of displaying additional content related to primary content being viewed. 5. The method of claim 4,
Receiving and controlling are performed by a playback device for providing primary content to the first display device,
A method of displaying additional content related to primary content being viewed. 5. The method of claim 4,
Commands are received via a wireless communication protocol,
A method of displaying additional content related to primary content being viewed. The method of claim 1,
Providing a synchronization mechanism includes: providing wireless communication signals in combination with display of primary content on a first screen to synchronize additional content;
A method of displaying additional content related to primary content being viewed. The method of claim 7, wherein
Displaying additional content includes:
At the second screen device, detecting provided wireless communication signals; And
At the second screen device, displaying additional content based on the detected wireless communication signals;
A method of displaying additional content related to primary content being viewed. The method of claim 7, wherein
Providing the wireless communication signals is performed by a playback device providing primary content to the first display device,
A method of displaying additional content related to primary content being viewed. The method of claim 1,
Displaying icons on the first screen device that indicate the type of additional content being displayed on the second screen device;
A method of displaying additional content related to primary content being viewed. The method of claim 1,
Displaying the synchronization status between the content on the first screen device and the additional content on the second screen device on the second screen device,
A method of displaying additional content related to primary content being viewed. The method of claim 1,
Displaying additional content includes:
At the second screen device, receiving a synch command via a synchronization mechanism;
Communicating with the server based on the received signal;
Loading additional content from the communicated server based on the received signal; And
Displaying additional content on the second screen device;
A method of displaying additional content related to primary content being viewed. The method of claim 1,
Displaying the state of the display for the primary content on the first screen device on the second screen device,
A method of displaying additional content related to primary content being viewed. The method of claim 1,
At the second screen device, further comprising providing a function for sharing content on the social network,
A method of displaying additional content related to primary content being viewed. The method of claim 1,
The additional content displayed is based on the user of the first and second screen devices,
A method of displaying additional content related to primary content being viewed. The method of claim 1,
Displaying additional content includes scrolling the additional content across the second screen display, synchronized with the primary content displayed on the first screen device,
A method of displaying additional content related to primary content being viewed. The method of claim 1,
The type of additional content displayed is user selectable,
A method of displaying additional content related to primary content being viewed. The method of claim 1,
The type of additional content displayed is based on the type of content being displayed on the first screen device,
A method of displaying additional content related to primary content being viewed. A system for displaying additional content related to primary content being viewed,
A first screen device configured to display primary content; And
A second screen device configured to display additional content related to the primary content on the first screen, synchronized to the content displayed on the first screen device according to the synchronization mechanism;
A system for displaying additional content related to primary content being viewed. 20. The method of claim 19,
The first screen device includes: one of a television, a monitor, and a video projector,
A system for displaying additional content related to primary content being viewed. 20. The method of claim 19,
The second screen device includes: one of a smartphone, a tablet, a personal media player, and a laptop,
A system for displaying additional content related to primary content being viewed. 20. The method of claim 19,
A playback device configured to provide primary content to the first display device, and a synchronization mechanism to synchronize additional content on the second screen with the primary content on the first screen device,
A system for displaying additional content related to primary content being viewed. 20. The method of claim 19,
Further comprising a server configured to provide additional content for display on the second screen device,
A system for displaying additional content related to primary content being viewed.

Images