WO2015034235A1

WO2015034235A1 - Point-to-point content navigation using an auxiliary device

Info

Publication number: WO2015034235A1
Application number: PCT/KR2014/008187
Authority: WO
Inventors: Martin Freeman; Paul Fahn
Original assignee: Samsung Electronics Co., Ltd.
Priority date: 2013-09-03
Filing date: 2014-09-02
Publication date: 2015-03-12

Abstract

One embodiment provides a system comprising a content navigation application module including a user interface unit, a synchronization unit, and a content navigation control unit. The user interface unit generates first metadata information associated with a content frame of a first piece of content. The synchronization unit synchronizes the display of the first metadata information with the display of the content frame during content playback of said first piece of content. The first metadata information and the content frame are displayed on different devices. The content navigation control unit enables content navigation based on user interaction with the first metadata information when the first metadata information is displayed.

Description

POINT-TO-POINT CONTENT NAVIGATION USING AN AUXILIARY DEVICE

The exemplary embodiments relate generally to a point to point content navigation using an auxiliary device.

Conventionally, a user may navigate through content playing on a device by manually pressing buttons representing navigation commands on the device or a remote control for the device.

An aspect of the exemplary embodiments is to provide a point to point content navigation using an auxiliary device.

One embodiment provides a system comprising a menu navigation application module comprising a request unit for requesting menu metadata information associated with a piece of content, a menu interface unit for generating one or more menu interfaces based on the menu metadata information, and a menu navigation control unit for enabling user interaction with menu interfaces during playback of the piece of content. The menu interfaces and the piece of content are displayed on different devices. The menu interfaces are displayed without interrupting the playback of the piece of content.

These and other aspects and advantages of one or more embodiments will become apparent from the following detailed description, which, when taken in conjunction with the drawings, illustrate by way of example the principles of one or more embodiments.

For a fuller understanding of the nature and advantages of one or more embodiments, as well as a preferred mode of use, reference should be made to the following detailed description read in conjunction with the accompanying drawings, in which:

FIG. 1 illustrates a block diagram of a system for point-to-point content navigation, in accordance with an first embodiment of the invention.

FIG. 2 illustrates a block diagram of a content control system, in accordance with an second embodiment of the invention.

FIG. 3 is a block diagram of an example point-to-point content navigation app, in accordance with an first embodiment of the invention.

FIG. 4 is a block diagram of an example control flow application module, in accordance with an first embodiment of the invention.

FIG. 5 illustrates an example page of metadata, in accordance with an first embodiment of the invention.

FIG. 6 is a timeline illustrating different pages of metadata displayed on the auxiliary device during content playback of content on the display device, in accordance with an first embodiment of the invention.

FIG. 7 illustrates example point-to-point content navigation using the auxiliary device 40, in accordance with an first embodiment of the invention.

FIG. 8 is a timeline illustrating an example point-to-point content navigation where the playback of content jumps to an earlier time or content frame of the content, in accordance with an first embodiment of the invention.

FIG. 9 is a timeline illustrating an example point-to-point content navigation where the playback of content jumps to a different piece of related content, in accordance with an first embodiment of the invention.

FIG. 10 is a block diagram of an example menu control app, in accordance with an second embodiment of the invention.

FIG. 11 is a block diagram of an example content control unit, in accordance with an second embodiment of the invention.

FIG. 12 illustrates an example authored menu, in accordance with an second embodiment of the invention.

FIG. 13 illustrates playback of content on the display device and controlling the playback of the content using an authored menu displayed on the auxiliary device, in accordance with an second embodiment of the invention.

FIG. 14 illustrates an example hierarchy of authored menus, in accordance with an second embodiment of the invention.

FIG. 15 is a high level block diagram showing an information processing system comprising a computer system useful for implementing an embodiment of the present invention.

The following description is made for the purpose of illustrating the general principles of one or more embodiments and is not meant to limit the inventive concepts claimed herein. Further, particular features described herein can be used in combination with other described features in each of the various possible combinations and permutations. Unless otherwise specifically defined herein, all terms are to be given their broadest possible interpretation including meanings implied from the specification as well as meanings understood by those skilled in the art and/or as defined in dictionaries, treatises, etc.

One embodiment provides a system comprising a content navigation application module including a user interface unit, a synchronization unit, and a content navigation control unit. The user interface unit generates first metadata information associated with a content frame of a first piece of content. The synchronization unit synchronizes the display of the first metadata information with the display of the content frame. The first metadata information and the content frame are displayed on different devices. The content navigation control unit enables content navigation based on user interaction with the first metadata information when the first metadata information is displayed.

FIG. 1 illustrates a block diagram of a system 10 for point-to-point content navigation, in accordance with an embodiment of the invention. The system 10 comprises an electronic display device 30. The display device 30 may be an appliance, a personal computer (PC), a television (TV) (e.g., a smart TV), or a mobile device (e.g., a laptop computer, a mobile phone such as a smart phone, etc.).

A user 20 may utilize the display device 30 for content playback. The display device 30 comprises a content playback unit 31 for enabling playback of content (e.g., audio content, video content, images, photos, documents, and/or audiovisual content such as movies, television shows, episodes of television programs, etc.), and a primary display unit 32 for displaying the content and/or visuals associated with the content.

The system 10 further comprises an auxiliary device 40 that provides the user 20 with metadata associated with content displayed on the display device 30. The auxiliary device 40 comprises a point-to-point content navigation application (“app”) 41 for providing metadata associated with the content, and a secondary display unit 42 for displaying the metadata. The metadata displayed on the auxiliary device 40 changes during playback of the content on the display device 30. Specifically, the metadata displayed on the auxiliary device 40 is synchronized with the content displayed on the display device 30. The auxiliary device 40 may further comprise a user interface unit (“UI”) 43 (e.g., keyboard, touch screen, keypad, pointing device) for allowing enabling user interaction with the metadata displayed on the auxiliary device 40. As described in detail later herein, the point-to-point content navigation app 41 generates, based on user interaction with the metadata displayed on the auxiliary device 40, control signals for controlling content displayed on the display device 30. The point-to-point content navigation app 41 allows a user 20 to jump from a current point (e.g., current content frame) of the content displayed to a different point (e.g., different content frame) of either the same content or different content.

The point-to-point content navigation app 41 is a software application configured to run on the auxiliary device 40. The user 20 may download one or more applications 41 from an application provider 60 (e.g., a content provider, a third party) to the auxiliary device 40 over a connection (e.g., a wireless connection, a wired connection, or a combination of the two). The auxiliary device 40 may also be pre-loaded with one or more applications 41. Each point-to-point content navigation app 41 is configured to provide metadata specific to particular content. For example, a user 20 may download a point-to-point content navigation app 41 that specifically provides metadata for episodes of the television program “Seinfeld”.

The system 10 further comprises a content source 50. The content source 50 comprises a content flow application module 51 for providing content to the display device 30 for display, and controlling, based on one or more control signals from a point-to-point content navigation app 41 running on the auxiliary device 40, the display of the content on the display device 30. The content flow application module 51 provides the content to the display device 30 over a connection (e.g., a wireless connection, a wired connection, or a combination of the two). The content provided may originate from a content provider 70, an optical disk or a memory unit of the content source 50. In one embodiment, the content source 50 is an Internet-based cloud service that streams content to the display device 30 for display. In another embodiment, the content source 50 is a local/in-home electronic device (e.g., a set-top box connected with the display device 30, a local media player such as a Blu-Ray player).

FIG. 2 illustrates a block diagram of a content control system 10, in accordance with an second embodiment of the invention.

The system 10 comprises an electronic display device 30. The display device 30 may be an appliance, a personal computer (PC), a television (TV) (e.g., a smart TV), or a mobile device (e.g., a laptop computer, a mobile phone such as a smart phone, etc.).

A user 20 may utilize the display device 30 for content playback. The display device 30 comprises a content control application module (“content control unit”) 300 that enables and controls playback of content (e.g., audio content, video content, images, photos, documents, and/or audiovisual content such as movies, television shows, episodes of television programs, etc.), and a primary display unit 32 for displaying the content and/or visuals associated with the content. As described in detail later herein, the content control unit 300 controls playback of content based on one or more user selections made by the user 20 via one or more menu interfaces.

Specifically, the system 10 further comprises an auxiliary device 40 that provides the user 20 with at least one authored menu interface (“authored menu”) 200 (FIG. 5) associated with content displayed on the display device 30. In this specification, let the term authored menu denote a particular menu interface for a particular piece of content from a content provider 70 that is generated based on menu metadata information associated with the particular piece of content. The menu metadata information may originate from the content provider 70. An authored menu 200 comprises one or more selectable content navigation commands and/or content setting commands. An authored menu 200 may further comprise additional elements that affect the formatting and/or aesthetic “look and feel” of the menu interface, such as font types, font sizes, font colors, screen positioning information, background images, etc. In one embodiment, an authored menu 200 is provided as a web page using HTML or another markup language.

The display device 30 and the auxiliary device 40 communicate with each other over a connection (e.g., a wireless connection, a wired connection, or a combination of the two). In one embodiment, the display device 30 and the auxiliary device 40 belong to the same Local Area Network (LAN).

The auxiliary device 40 comprises a menu control application module (“menu control app”) 400 for generating one or more authored menus 200 based on menu metadata information associated with the content displayed on the display device 30, and a secondary display unit 42 for displaying each authored menu 200 generated. The menu control app 400 is a software application configured to run on the auxiliary device 40. As described in detail later herein, the menu control app 400 requests menu metadata information associated with the content displayed on the display device 30 when the menu control app 400 discovers the content displayed on the display device 30.

The auxiliary device 40 further comprises a user interface unit 43 for enabling user interaction with an authored menu 200 displayed on the auxiliary device 40. In one embodiment, the user interface unit 43 comprises a touch user interface 44 that allows the user 20 to interact with an authored menu 200 and select one or more selectable content navigation commands and/or content setting commands using his or her finger. For example, the user 20 may interact with one or more authored menus 200 associated with the content to select content navigation commands, such as a particular audio track or video track of the content for playback. The user 20 may also interact with one or more authored menus 200 associated with the content to select content setting commands, such as audio and subtitle settings. The user interface unit 43 may also comprise one or more of the following: a keyboard, a keypad, a pointing device, etc.

The user 20 may interact with the authored menus 200 displayed on the auxiliary device 40 to select content navigation commands and/or content settings commands without interrupting the playback of content on the display device 30. Therefore, the user 20 can interact with authored menus 200 providing content navigation commands and/or content settings commands via the auxiliary device 40 without having to pause the content displayed on the display device 30.

As described in detail later herein, the menu control app 400 generates, based on user interaction with an authored menu 200 displayed on the auxiliary device 40, one or more action messages for controlling the playback of content displayed on the display device 30. Each action message includes one or more content navigation commands and/or content setting commands selected by the user 20 via an authored menu 200 displayed on the auxiliary device 40.

The system 10 further comprises a content source 50. The content source 50 provides content to the display device 30 for display. The content source 50 provides content to the display device 30 over a connection (e.g., a wireless connection, a wired connection, or a combination of the two). The content provided may originate from a - content provider 70, an optical disk or a memory unit of the content source 50. In one embodiment, the content source 50 is an Internet-based cloud service (e.g., Netflix, YouTube, Amazon, Hulu) that streams content to the display device 30 for display. In another embodiment, the content source 50 is a content playing device, such as a local/in-home electronic device (e.g., a set-top box connected with the display device 30, a local media player such as a DVD player or a Blu-Ray player).

In one embodiment, the menu control app 400 requests menu metadata information associated with the content displayed on the display device 30 from a content control unit 300 of the display device 30. Action messages generated by the menu control app 400 are sent to the content control unit 300 of the display device 30.

In another embodiment, the content source 50 comprises a content control unit 300 for controlling the playback of content displayed on the display device 30. The menu control app 400 requests menu metadata information associated with the content displayed on the display device 30 from a content control unit 300 of the content source 50. Action messages generated by the menu control app 400 are sent to the content control unit 300 of the content source 50.

In yet another embodiment, the menu control app 400 requests menu metadata information associated with the content displayed on the display device 30 from the display device 30. Action messages generated by the menu control app 400 are sent to the content control unit 300 of the content source 50.

In one embodiment, each content control unit 300 implements UPnP Content Control Service. The UPnP Content Control Service facilitates the conveyance of menu metadata information from a content control unit 300 to the menu control app 400, and user selections from the menu control app 400 to the content control unit 300.

In another embodiment, each content control unit 300 implements remote user interface (RUI) technology based on client-server architecture. RUI technology allows for a first device (e.g., the auxiliary device 40) to control a second device (e.g., the display device 30). Specifically, a RUI client operating on the first device may acquire a user interface from a RUI server operating on the second device such that a user of the RUI client may control the RUI server through the user interface on the RUI client.

FIG. 3 is a block diagram of an example point-to-point content navigation app 41, in accordance with an first embodiment of the invention. The point-to-point content navigation app 41 comprises a synchronization (“sync”) unit 410 for synchronizing the display of metadata on the auxiliary device 40 with the display of content on the display device 30, a graphical user interface (GUI) unit 420 for generating pages 200 of metadata associated with the content for display on the auxiliary device 40, a content navigation control unit 440 for enabling content navigation based on user interaction with the metadata displayed on the auxiliary device 40, and a memory unit 430 for maintaining the metadata associated with the content.

FIG. 4 is a block diagram of an example control flow application module 51, in accordance with an embodiment of the invention. The control flow application module 51 comprises a jump-style navigation module 510 for adjusting/changing content provided to the display device 30 by jumping to a time or content frame of a piece of content based on control signals received from a point-to-point content navigation app 41. The control flow application module 51 further comprises a synchronization (“sync”) module 540 that assists with synchronizing the display of metadata on the auxiliary device 40 with the display of content on the display device 30 by providing timing information for the content to the sync module 410. The timing information may identify a current content frame of the content and/or a time indicator indicating a current point within the content that is currently displayed. The control flow application module 51 further comprises a control module 530 for controlling the content provided to the display device 30.

FIG. 5 illustrates an example page 200 of metadata, in accordance with an first embodiment of the invention. In one embodiment, the GUI unit 420 of a point-to-point content navigation app 41 renders a hyperlink-style GUI interface including a page 200 of metadata in the form of HTML-based content. The page 200 includes one or more texts areas 540, one or more image areas 530, and one or more selectable navigation links/buttons 510. Each link/button 510 provides a user 20 with the option of jumping from a current point in a piece of content to another point within the same piece of content (e.g., an earlier content scene/frame referenced in the current dialogue) or a different piece of content (e.g., an earlier episode of a television program, another movie title within a movie franchise). When the user 20 selects the link/button 510 using the user interface 43 of the auxiliary device 40, the content displayed on the display device 30 will jump to the point in the content referenced by the selected link/button 510.

FIG. 6 is a timeline illustrating different pages 200 of metadata displayed on the auxiliary device 40 during content playback of content on the display device 30, in accordance with an first embodiment of the invention. A point-to-point content navigation app 41 running on the auxiliary device 40 generates one or more pages 200 of metadata for display on the auxiliary device 40. The display of metadata on the auxiliary device 40 is synchronized with the content displayed on the display device 30. During content playback of the content, the metadata displayed on the auxiliary device 40 changes based on the current frame/scene of the content displayed. Each page 200 of metadata includes metadata associated with dialogue, characters, actors, points of interest and/or other items occurring within a particular content frame.

As shown in FIG. 6, different pages 200 of metadata may be displayed on the auxiliary device 40 at different times during content playback of content. Each page 200 of metadata has a corresponding start time and a corresponding end time. A start time for a page 200 of metadata indicates when, during the content playback of the content, to begin displaying the page 200 on the auxiliary device 40. An end time for a page 200 of metadata indicates when, during the content playback of the content, to stop displaying the page 200 on the auxiliary device 40. For example, the point-to-point content navigation app 41 provides a first page 200A of metadata (“Page n-1 of Metadata”) for display on the auxiliary device 40 beginning at corresponding start time tn-1 and ending at corresponding end time t’n-1, wherein the first page 200A includes metadata specific to content frames/scenes within times tn-1 and t’n-1 of the content. The point-to-point content navigation app 41 provides a second page 200B of metadata (“Page n of Metadata”) for display on the auxiliary device 40 beginning at corresponding start time tn and ending at corresponding end time t’n, wherein the second page 200B includes metadata specific to content frames/scenes within times tn and t’n of the content. The point-to-point content navigation app 41 provides a third page 200C of metadata (“Page n+1 of Metadata”) for display on the auxiliary device 40 beginning at corresponding start time tn+1 and ending at corresponding end time t’n+1, wherein the third page 200C includes metadata specific to content frames/scenes within times tn+1 and t’n+1 of the content.

FIG. 7 illustrates example point-to-point content navigation using the auxiliary device 40, in accordance with an first embodiment of the invention. During content playback of a piece of content 300 representing an episode of the television program “Seinfeld”, the auxiliary device 40 displays pages 200 of metadata associated with the piece of content 300. For example, as shown in FIG. 5, for a current frame 310A, the auxiliary device 40 displays a first page 200A of metadata including multiple navigation links 210 related to characters referenced in the dialogue/scene of the current frame 310A. For example, the first page 200A includes a first navigation link 210A displaying and referencing a first “Seinfeld” character (“Jerry”), a second navigation link 210B displaying and referencing a second “Seinfeld” character (“Elaine”), a third navigation link 210C displaying and referencing a third “Seinfeld” character (“George”), and a fourth navigation link 210D displaying and referencing a fourth “Seinfeld” character (“Kramer”).

When the user 20 selects one of the navigation links 210, the content displayed on the display device 30 will jump to an earlier scene in the episode that includes the character referenced by the selected navigation link 210. Specifically, when the user 20 selects a selectable navigation link 210, the content navigation control unit 440 of the point-to-point content navigation app 41 generates controls signals including destination content information. The destination content information comprises an identifier of destination content for display on the display device 30, and a time or content frame indicator indicating a destination time or a destination content frame to commence/begin the display of the destination content from. The destination content is associated with the selected navigation link 210.

Based on the destination content information received, jump-style navigation unit 510 of the control flow application module 51 changes/adjusts the content provided to the display device 30. The control flow application module 51 will provide the destination content to the display device 30, wherein the playback of the destination content starts at the destination time or the destination content frame indicated in the destination content information. The auxiliary device 40 simultaneously displays a page 200 of metadata associated with the destination content at the destination time or the destination content frame. The page 200 may further include a selectable return link/button 220 referencing a point in the content before the jump. When the user selects the return link/button 220, the control flow application module 51 switches the content displayed on the display device 30 from the destination content back to the content frame displayed before the jump.

For example, as represented by action bubble 1 in FIG. 7, when the user 20 selects the fourth navigation link 210D displaying the character Kramer, the control flow application module 51 begins streaming destination content referenced by the fourth navigation link 210D to the display device 30. As represented by action bubble 2A in FIG. 7, the display device 300 displays a different content frame 300B associated with the character Kramer, and starts content playback from content frame 300B onwards. The different content frame 300B may be a different scene from the same episode (e.g., an earlier scene from the same episode), or from a different episode (e.g., an earlier episode) of the television program “Seinfeld”. As represented by action bubble 2B in FIG. 7, the auxiliary device 40 simultaneously displays a second page 200B of metadata associated with the different scene 300B. The different page 200B of metadata includes a selectable return link/button 220 for returning to the content frame 310A of the episode.

FIG. 8 is a timeline illustrating an example point-to-point content navigation where the playback of content jumps to an earlier time or content frame of the content, in accordance with an first embodiment of the invention. At time tn of the content, the auxiliary device 40 displays a page first 200A of metadata (“Page n of Metadata”) associated with a current content frame positioned at time tn of the content. The page 200A includes a selectable navigation link 210 that references an earlier content frame positioned at time tm of the content, wherein tm < tn (i.e., the earlier content frame precedes the current content frame). When the user selects the link 210, as represented by action bubble 1 in FIG. 8, the control flow application module 51 begins streaming, to the display device 30, content from the earlier content frame positioned at the time tm. The display device 30 begins content playback from the earlier content frame, as indicated by action bubble 2A in FIG. 8. As represented by action bubble 2B in FIG. 8, the auxiliary device 40 simultaneously displays a second page 200B of metadata associated with the earlier content frame.

FIG. 9 is a timeline illustrating an example point-to-point content navigation where the playback of content jumps to a different piece of related content, in accordance with an first embodiment of the invention. During content playback of a first piece of content on the display device 30, the auxiliary device 40 displays a first page 200A of metadata (“Page n of Metadata”) at time tn of the first piece of content, wherein the first page 200A includes metadata associated with a content frame within the first piece of content beginning at time tn. The first page 200A includes a selectable navigation link 210 that references a different content frame located at time tm within a second piece of content, wherein the second piece of content is related to the first piece of content. For example, if the first piece of content is an episode of a television program, the second piece of content may be a different episode of the television program (e.g., the second piece of content may be an earlier episode that precedes the first piece of content and which is referenced by dialogue included in the first piece of content).

When the user selects the link 210, as represented by action bubble 1 in FIG. 9, the control flow application module 51 changes the content streamed to the display device 30. Instead of continuing to stream the first piece of content to the display device 30, the control flow application module 51 begins streaming the second piece of content to the display device 30, wherein the streaming of the second piece of content begins at the content frame located at time tm of the second piece of content. Further, as represented by action bubble 2B in FIG. 9, the auxiliary device 40 simultaneously displays a second page 200B of metadata associated with the content frame located at time tm of the second piece of content.

FIG. 10 is a block diagram of an example menu control app 400, in accordance with an second embodiment of the invention. The menu control app 400 resides on an auxiliary device 40. The menu control app 400 comprises a discover unit 1010 configured to discover a content control unit 300 controlling playback of content on a display device 30 within proximity of the auxiliary device 40. In one embodiment, the content control unit 300 resides on the display device 30. In another embodiment, the content control unit 300 resides on a content source 50 providing the content to the display device 30.

The menu control app 400 further comprises a request unit 1040, a menu interface unit 1020, and a translation unit 1030. When the discover unit 1010 discovers content playing on the display device 30, the request unit 1040 requests menu metadata information associated with the content from the content control unit 300. Based on menu metadata information received from the content control unit 300, the menu interface unit 1020 generates one or more authored menus 200 for display on the auxiliary device 40.

In one embodiment, the authored menus 200 generated may be in a menu format that is incompatible with one or more device attributes of the auxiliary device 40. The translation unit 1030 is configured to translate an authored menu 200 from one menu format to another menu format that is suitable for display on the auxiliary device 40.

In another embodiment, the translation unit 1030 may reside where the menu control app 400 requests menu metadata information from, such as the display device 30 or the content source 50. Instead of having to generate authored menus 200, the menu control app 400 instead receives authored menus 200, from the display device 30 or the content source 50, in a menu format that is suitable for display on the auxiliary device 40.

The menu control app 400 further comprises a menu navigation control unit 1050. The menu navigation control unit 1050 enables user navigation of one or more authored menus 200 displayed on the auxiliary device 40, thereby facilitating user selection of one or more content navigation commands and/or content settings commands. When a content navigation command and/or a content setting command is selected, the menu navigation control unit 1050 generates an action message including the selected content navigation command and/or content setting command selected by the user 20, and sends the action message to the content control unit 300.

FIG. 11 is a block diagram of an example content control unit 300, in accordance with an second embodiment of the invention. The content control unit 300 controls playback of content on a display device 30 based on one or more action messages received from an auxiliary device 40 within proximity of the display device 30. In one embodiment, the content control unit 300 resides on the display device 30. In another embodiment, the content control unit 300 resides on a content source 50 providing the content to the display device 30.

The content control unit 300 comprises a memory unit 1110 maintaining content settings information for the content displayed on the display device 30. In one embodiment, the content settings information includes one or more content playback parameters, such as a parameter identifying whether subtitles are on or off, a parameter identifying a selected subtitle track number, etc.

The content control unit 300 further comprises another memory unit 1130 maintaining menu metadata information associated with the content displayed on the display device 30. The content control unit 300 provides the menu metadata information to the auxiliary device 40 when the content control unit 300 receives a request for menu metadata information from the auxiliary device 40.

The content control unit 300 further comprises a content settings control unit 1120 for receiving action messages from the auxiliary device 40, and controlling the playback of the content on the display device 30 based on the action messages received. The content settings control unit 1120 adjusts the content settings information maintained in the memory unit 1110 based on selected content navigation commands and/or content setting commands including in the action messages received. For example, if a user 20 selects a particular audio track or video track for playback via the auxiliary device 40, the content control unit 1120 adjusts the playback of the content on the display device 30 by jumping from a current audio track or video track to the selected audio track or video track.

FIG. 12 illustrates an example authored menu 200, in accordance with an second embodiment of the invention. In one embodiment, an authored menu 200 received/generated by the menu interface unit 1020 is a hyperlink-style menu interface. For example, the authored menu 200 may be a web page created using HTML. The authored menu 200 includes one or more texts areas 1201, one or more image areas 1202, and one or more selectable GUI components (e.g., links or buttons) 1203. Each selectable GUI component 1203 provides a user 20 with the option of viewing another authored menu 200 or selecting a particular content navigation command and/or content setting command.

FIG. 13 illustrates playback of content on a display device 30 and controlling the playback of the content using an authored menu 200 displayed on an auxiliary device 40, in accordance with an second embodiment of the invention. A menu control app 400 running on an auxiliary device 40 first discovers whether content is playing on a display device 30 within proximity of the auxiliary device 40. If there is content playing on the display device 30, the menu control app 400 then requests menu metadata information associated with the content from a content control unit 300 controlling the playback of the content.

Upon receiving the requested menu metadata information, the menu control app 400 generates and displays a notification page 280 on the auxiliary device 40. The page 280 includes a selectable GUI component 290 (e.g., a link or a button) that notifies a user 20 utilizing the auxiliary device 40 that one or more authored menus 200 associated with the content is available for viewing on the auxiliary device 40. When the user 20 selects the GUI component 290, the menu control app 400 generates an authored menu 200 based on the menu metadata information, and displays the authored menu 200 on the auxiliary device 40.

For example, as shown in FIG. 13, the notification page 280 may include a selectable MENU button 290. When the user 20 selects the MENU button 290, as represented by action bubble 1 in FIG. 13, the menu control app 400 generates an authored menu 200 based on the menu metadata information, and displays the authored menu 200 on the auxiliary device 40. For example, as represented by action bubble 2 in FIG. 13, the menu control app 400 receives and/or generates and displays an authored menu 200A on the auxiliary device 40. The authored menu 200A includes at least one selectable GUI component 1203 that is associated with a particular content setting command.

For example, as shown in FIG. 13, the authored menu 200A includes a first selectable link 1203 (“ENGLISH”) representing a content setting command for displaying English subtitles on the display device 30 during playback of the content, a second selectable link 1203 (“ESPANOL”) representing a content setting command for displaying Spanish subtitles on the display device 30 during playback of the content, a third selectable link 1203 (“FRANCAIS”) representing a content setting command for displaying French subtitles on the display device 30 during playback of the content, and a fourth selectable link 1203 (“POLSKI”) representing a content setting command for displaying Polish subtitles on the display device 30 during playback of the content. As shown in FIG. 13, the authored menu 200 may further include formatting information for the menu interface, such as background images, text attributes of the text displayed (such as font type, font size, font color, position), audio for playback during the display of the authored menu 200, etc.

When the user 20 selects the third selectable link 1203 (“FRANCAIS”), as represented by action bubble 3A in FIG. 13, the menu control app 400 generates and sends an action message including the selected content setting command (i.e., display French subtitles on the display device 30 during playback of the content) to the content control unit 300. Upon receiving the action message, the content control unit 1110 adjusts the playback of the content such that French subtitles 1310 are overlaid on top of the content displayed on the display device 30, as represented by action bubble 3B in FIG. 13.

FIG. 14 illustrates an example menu tree hierarchy 250 for a particular piece of content, in accordance with an second embodiment of the invention. In one embodiment, authored menus 200 associated with a particular piece of content may be organized into multiple levels of authored menus 200. For example, the menu tree hierarchy 250 in FIG. 14 comprises a top-level including a top-level (i.e., root) authored menu 210, and at least one sub-level including a sub-level authored menu 220. The menu control app 400 allows a user 20 to navigate through the authored menus 200 displayed on an auxiliary device 40 until an authored menu 200 providing a desired content navigation command and/or content setting command is displayed.

In one embodiment, when the menu control app 400 requests menu metadata information, the menu control app 400 receives menu metadata information associated with a top-level authored menu 210. For example, the menu metadata information received may comprise a URL location for retrieving menu metadata specific to the top-level authored menu 210. The URL location may reside on the display device 30, the content source 50, or elsewhere. The menu control app 400 retrieves menu metadata specific to the top-level authored menu 210 using the URL location, and generates the top-level authored menu 210 for display based on the menu metadata retrieved.

The top-level authored menu 210 may comprise one or more selectable references to one or more sub-level authored menus 220. For example, the top-level authored menu 210 may include one or more selectable components 230 that reference different sub-level authored menus 220. When a user 20 selects a component 230, the menu control app 400 retrieves menu metadata specific to a sub-level authored menu 220 referenced by the selected component 230, and generates the sub-level authored menu 220 for display based on the menu metadata retrieved. In one embodiment, the menu control app 400 retrieves menu metadata specific to the top-level authored menu 210 or a sub-level authored menu 220 using HTTP.

For example, the menu tree hierarchy 250 in FIG. 14 comprises a top-level authored menu 210A titled as “TRACK SELECTION MENU”, a first sub-level authored menu 220A titled as “AUDIO OPTIONS MENU”, and a second sub-level authored menu 220B titled as “SUBTITLE OPTIONS MENU”. The example top-level authored menu 210A comprises a first selectable component 230A (“AUDIO”) that references the first sub-level authored menu 220A, and a second selectable component 230B (“SUBTITLES”) that references the second sub-level authored menu 220B. The top-level authored menu 210A further includes a selectable component 270 (“CANCEL”) that triggers, when selected, the menu control app 400 to turn off the display of authored menus 200 on the auxiliary device 40.

If the user 20 selects the first selectable component 230A, the menu control app 400 generates and displays the first sub-level authored menu 220A on the auxiliary device 40. If the user 20 selects the second selectable component 230B instead, the menu control app 400 generates and displays the second sub-level authored menu 220B on the auxiliary device 40.

Each authored menu 200 may comprise one or more selectable components 240 associated with a particular content navigation command and/or a content setting command. For example, as shown in FIG. 14, the first sub-level authored menu 220Acomprises a first selectable component 240A (“ENGLISH (STEREO)”) representing a content setting command for setting audio playback to English in stereo mode, a second selectable component 240B (“ENGLISH (5.1)”) representing a content setting command for setting audio playback to English in 5.1 surround mode, and a third selectable component 240C (“FRENCH”) representing a content setting command for setting audio playback to French. The second sub-level authored menu 220B comprises a first selectable component 240D (“ENGLISH”) representing a content setting command for setting subtitles displayed to English, a second selectable component 240E (“FRENCH”) representing a content setting command for setting subtitles displayed to French, and a third selectable component 240F (“SUBTITLES OFF”) for turning off the display of subtitles.

Each sub-level authored menu 220 may further comprise a selectable component 260 for returning to an authored menu 200 preceding the sub-level authored menu 220 (e.g., the top-level menu 210A).

FIG. 15 is a high level block diagram showing an information processing system comprising a computer system 100 useful for implementing an embodiment of the present invention. The computer system 100 includes one or more processors 111, and can further include an electronic display device 112 (for displaying graphics, text, and other data), a main memory 113 (e.g., random access memory (RAM)), storage device 114 (e.g., hard disk drive), removable storage device 115 (e.g., removable storage drive, removable memory module, a magnetic tape drive, optical disk drive, computer readable medium having stored therein computer software and/or data), user interface device 116 (e.g., keyboard, touch screen, keypad, pointing device), and a communication interface 117 (e.g., modem, a network interface (such as an Ethernet card), a communications port, or a PCMCIA slot and card). The communication interface 117 allows software and data to be transferred between the computer system and external devices. The system 100 further includes a communications infrastructure 118 (e.g., a communications bus, network) to which the aforementioned devices/modules 111 through 117 are connected.

Information transferred via communications interface 117 may be in the form of signals such as electronic, electromagnetic, optical, or other signals capable of being received by communications interface 117, via a communication link that carries signals and may be implemented using wire or cable, fiber optics, a phone line, a cellular phone link, an radio frequency (RF) link, and/or other communication channels. Computer program instructions representing the block diagram and/or flowcharts herein may be loaded onto a computer, programmable data processing apparatus, or processing devices to cause a series of operations performed thereon to produce a computer implemented process.

Claims

A system, comprising:

a content navigation application module comprising:

a user interface unit for generating first metadata information associated with a content frame of a first piece of content;

a synchronization unit configured for synchronizing the display of said first metadata information with the display of said content frame during content playback of said first piece of content, wherein said first metadata information and said content frame are displayed on different devices; and

a content navigation control unit for

enabling content navigation based on user interaction with said first metadata information when said first metadata information is displayed.
The system of claim 1, comprising:

a display device for content playback, wherein

said display device includes a first display unit for displaying content;

a control flow application module for providing

content to said display device for content playback; and

an auxiliary device including said content

navigation application module and a second display unit for displaying metadata information generated by said content navigation application module;

wherein said synchronization unit synchronizes

the display of said first metadata information on said auxiliary device with the display of said content frame on said display device during content playback of said first piece of content on said display device.
The system of claim 2, wherein:

said first metadata information comprises a selectable navigation link associated with a different content frame.
The system of claim 3, wherein:

said different content frame is a content frame

of one of: said first piece of content, and a second piece of content related to said first piece of content.
The system of claim 3, wherein:

said content navigation control unit is further configured for:

generating a control signal when said navigation link is selected during said user interaction with said first metadata information, wherein said control signal comprises information identifying said different content frame; and

transmitting said control signal to said control flow application module, wherein, in response to said control signal, said control flow application module provides said different content frame to said display device for display, and wherein, upon receiving said different content frame, said display device begins content playback from said different content frame.
The system of claim 5, wherein:

said user interface unit is further configured for:

generating second metadata information associated with said different content frame;

wherein said synchronization unit synchronizes the display of said second metadata information on said auxiliary device with the display of said different content frame on said display device.
The system of claim 6, wherein:

said second metadata information comprises a

selectable return link associated with said content frame; and

said display device resumes content playback of said first piece of content from said content frame when said return link is selected during user interaction with said second metadata information.
A method, comprising:

generating first metadata information associated

with a content frame of a first piece of content;

synchronizing the display of said first metadata

information with the display of said content frame during content playback of said first piece of content, wherein said first metadata information and said content frame are displayed on different devices; and

enabling content navigation based on user interaction with said first metadata information when said first metadata information is displayed.
The method of claim 8, further comprising:

synchronizing the display of said first metadata

information on an auxiliary device with the display of said content frame on a display device during content playback of said first piece of content on said display device.
The method of claim 9, wherein:

said first metadata information comprises a selectable navigation link associated with a different content frame.
The method of claim 10, wherein:

said different content frame is a content frame

of one of: said first piece of content, and a second piece of content related to said first piece of content.
The method of claim 10, further comprising:

when said navigation link is selected during said

user interaction with said first metadata information:

pausing the display of said content frame on said display device; and

displaying said different content frame on said display device, wherein said display device begins content playback from said different content frame.
The method of claim 12, further comprising:

generating second metadata information associated with said different content frame; and

synchronizing the display of said second metadata

information on said auxiliary device with the display of said different content frame on said display device.
The method of claim 13, wherein:

said second metadata information comprises a

selectable return link associated with said content frame.
The method of claim 14, further comprising:

resuming content playback of said first piece of content on said display device from said content frame when said return link is selected during user interaction with said second metadata information.
A non-transitory computer-readable medium having

instructions which when executed on a computer perform a method comprising:

generating first metadata information associated with a content frame of a first piece of content;

synchronizing the display of said first metadata

information with the display of said content frame during content playback of said first piece of content, wherein said first metadata information and said content frame are displayed on different devices; and

enabling content navigation based on user interaction with said first metadata information when said first metadata information is displayed.
The medium of claim 16, the method further comprising:

synchronizing the display of said first metadata

information on an auxiliary device with the display of said content frame on a display device during content playback of said first piece of content on said display device.
The medium of claim 17, the method further comprising:

pausing the display of said content frame on said display device when a selectable navigation link associated with a different content frame is selected during said user interaction with said first metadata information; and

displaying said different content frame on said display device, wherein said display device begins content playback from said different content frame.
The medium of claim 18, the method further comprising:

generating second metadata information associated with said different content frame; and

synchronizing the display of said second metadata

information on said auxiliary device with the display of said different content frame on said display device.
The medium of claim 19, the method further comprising:

resuming content playback of said first piece of content on said display device from said content frame when a selectable return link associated with said content frame is selected during user interaction with said second metadata information.
A system, comprising:

a menu navigation application module comprising:

a request unit for requesting menu metadata information associated with a piece of content;

a menu interface unit for providing one or more menu interfaces based on the menu metadata information; and

a menu navigation control unit for enabling user interaction with

the one or more menu interfaces during playback of the piece of content;

wherein the one or more menu interfaces and the piece of content are displayed on different devices, and wherein the one or more menu interfaces are displayed without interrupting the playback of the piece of content.
The system of claim 21, comprising:

a content control application module for

controlling the playback of the piece of content based on user interaction with the one or more menu interfaces;

a display device including a first display unit

for displaying the first piece of content;

a content source for providing the piece of

content to the display device; and

an auxiliary device including the menu navigation

application module and a second display unit for displaying the one or more menu interfaces;

wherein the content control application module resides on one of the display device and the content source.
The system of claim 22, wherein:

each menu interface includes one or more selectable components; and

each selectable component of each menu interface is associated with one of the following: another menu interface, and a content playback setting.
The system of claim 23, wherein:

said menu navigation control unit is further configured for:

generating an action message when a selectable component associated with a content playback setting is selected during user interaction with the one or more menu interfaces, wherein the action message comprises information identifying the selected content playback setting; and

transmitting the action message to the content control application module, wherein the content control application module adjusts the playback of the piece of content based on the selected content playback setting.
The system of claim 24, wherein:

the content control application modules is

further configured for:

maintaining one or more content playback parameters for the piece of content, wherein each content playback parameter is associated with a content playback setting; and

upon receiving an action message identifying a selected content playback setting, updating an associated content playback parameter.
The system of claim 24, wherein:

the selected content playback setting represents

one of the following: an audio track selection, a video track selection, an audio selection, and a subtitle selection.
The system of claim 23, wherein:

the one or more menu interfaces include a top-level menu interface.
The system of claim 27, wherein:

the top-level menu interface comprises at least

one reference to another menu interface of the one or more menu interfaces.
A method, comprising:

requesting menu metadata information associated

with a piece of content;

generating one or more menu interfaces based on

the menu metadata information; and

enabling user interaction with the one or more menu interfaces during playback of the piece of content;

wherein the one or more menu interfaces and the piece of content are displayed on different devices, and wherein the one or more menu interfaces are displayed without interrupting the playback of the piece of content.
The method of claim 29, further comprising:

controlling the playback of the piece of content

based on user interaction with the one or more menu interfaces.
The method of claim 30, wherein:

each menu interface includes one or more selectable components; and

each selectable component of each menu interface is associated with one of the following: another menu interface, and a content playback setting.
The method of claim 31, further comprising:

generating an action message when a selectable

component associated with a content playback setting is selected during user interaction with the one or more menu interfaces, wherein the action message comprises information identifying the selected content playback setting; and

transmitting the action message to a content

control application module controlling the playback of the piece of content, wherein the content control application module adjusts the playback of the piece of content based on the selected content playback setting.
The method of claim 32, wherein:

the selected content playback setting represents

one of the following: an audio track selection, a video track selection, an audio selection, and a subtitle selection.
The method of claim 31, wherein:

the one or more menu interfaces include a top-level menu interface.
The method of claim 34, wherein:

the top-level menu interface comprises at least

one reference to another menu interface of the one or more menu interfaces.
A non-transitory computer-readable medium having

instructions which when executed on a computer perform

a method comprising:

requesting menu metadata information associated

with a piece of content;

generating one or more menu interfaces based on

the menu metadata information; and

enabling user interaction with the one or more menu interfaces during playback of the piece of content;

wherein the one or more menu interfaces and the piece of content are displayed on different devices, and wherein the one or more menu interfaces are displayed without interrupting the playback of the piece of content.
The medium of claim 36, the method further comprising:

controlling the playback of the piece of content

based on user interaction with the one or more menu interfaces.
The medium of claim 37, wherein:

each menu interface includes one or more selectable components; and

each selectable component of each menu interface is associated with one of the following: another menu interface, and a content playback setting.
The medium of claim 38, the method further comprising:

generating an action message when a selectable

component associated with a content playback setting is selected during user interaction with the one or more menu interfaces, wherein the action message comprises information identifying the selected content playback setting; and

transmitting the action message to a content

control application module controlling the playback of the piece of content, wherein the content control application module adjusts the playback of the piece of content based on the selected content playback setting.
The medium of claim 39, wherein:

the selected content playback setting represents

one of the following: an audio track selection, a video track selection, an audio selection, and a subtitle selection.