US20180152743A1 - Enhanced trick mode to enable presentation of information related to content being streamed - Google Patents
Enhanced trick mode to enable presentation of information related to content being streamed Download PDFInfo
- Publication number
- US20180152743A1 US20180152743A1 US15/363,263 US201615363263A US2018152743A1 US 20180152743 A1 US20180152743 A1 US 20180152743A1 US 201615363263 A US201615363263 A US 201615363263A US 2018152743 A1 US2018152743 A1 US 2018152743A1
- Authority
- US
- United States
- Prior art keywords
- content
- trick mode
- segment
- display device
- displayed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
- H04N21/2387—Stream processing in response to a playback request from an end-user, e.g. for trick-play
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/251—Learning process for intelligent management, e.g. learning user preferences for recommending movies
- H04N21/252—Processing of multiple end-users' preferences to derive collaborative data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25866—Management of end-user data
- H04N21/25891—Management of end-user data being end-user preferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
- H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8455—Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/437—Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server
Definitions
- This disclosure is generally directed to pre-indexing content to provide enhanced media streaming functionality.
- An embodiment is directed to system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for skipping a portion of content during streaming of the content to a display device, where the portion is of little or no interest to the user.
- the apparatus may be a media streaming device, and the content may be a movie or a TV program, to name just two examples.
- the apparatus includes a memory having a database stored therein.
- the database stores metadata relating to the content.
- the metadata includes an index, where the index stores pointers to portions of the content.
- the apparatus includes a processor that is communicatively coupled to the memory. In operation, in some embodiments, the processor streams the content for display on the display device.
- the processor determines an end of a teaser portion has been reached in the stream of the content to the display device, it enables a skip command. Responsive to enabling the skip command, the processor receives command input from the user to skip a title sequence/opening credits portion of the content. Then, the processor determines an end to the title sequence/opening credits portion of the content using the metadata, and advances streaming of the content to the determined end of the title sequence/opening credits portion of the content. In this way, the user is able to skip portions of content that have little or no interest.
- Another embodiment is directed to system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for displaying information associated with content while streaming the content to a display device.
- the apparatus may be a media streaming device, and the content may be a movie or a TV program, to name just two examples.
- the apparatus includes a memory having a database stored therein.
- the database stores metadata relating to the content.
- the metadata includes a trick mode index, trick mode images and a database of information associated with segments of the content.
- the apparatus also includes a processor communicatively coupled to the memory. In operation, in some embodiments, the processor streams the content for display on the display device.
- the processor implements a trick mode operation upon receiving an appropriate user request.
- the processor receives command input requesting information associated with the content. Then, responsive to such command input, the processor retrieves information from the database of information associated with a segment of the content being featured on the display device when the command input was received, and displays the retrieved information on the display device.
- FIG. 1 illustrates a block diagram of a multimedia environment that includes media system(s), crowd source server(s) and content server(s), according to some embodiments.
- FIG. 2 illustrates a block diagram of a media device, according to some embodiments.
- FIGS. 3 and 4 illustrate example databases of a media device, according to some embodiments.
- FIG. 5 illustrates a method for enabling a user to skip over uninteresting portion(s) of content when streaming such content, according to some embodiments.
- FIG. 6 illustrates a method for crowd sourced identification of particular portion(s) of content, according to some embodiments.
- FIG. 7 illustrates a method for enabling users to select and view ancillary or associated information when streaming content using an enhanced trick mode, according to some embodiments.
- FIG. 8 illustrates an example screen shot displayed on a display device, according to some embodiments
- FIG. 9 illustrates an example computer system useful for implementing various embodiments.
- FIG. 1 illustrates a block diagram of a multimedia environment 102 , according to some embodiments.
- multimedia environment 102 is directed to streaming media.
- the multimedia environment 102 may include one or more media systems 104 , one or more content servers 122 , and one or more crowd source servers 114 , communicatively coupled via a network 120 .
- the network 118 can include, without limitation, wired and/or wireless intranet, extranet, Internet, cellular, Bluetooth and/or any other short range, long range, local, regional, global communications network, as well as any combination thereof.
- Media system 104 may include a display device 106 , media device 108 and remote control 110 .
- Display device 106 may be a monitor, television, computer, smart phone, tablet, and/or projector, to name just a few examples.
- Media device 108 may be a streaming media device, DVD device, audio/video playback device, cable box, and/or digital video recording device, to name just a few examples.
- the media device 108 can be a part of, integrated with, operatively coupled to, and/or connected to display device 106 .
- the media device 108 may be configured to communicate with network 120 .
- Remote control 110 can be any component, part, apparatus or method for controlling media device 108 and/or display device 106 , such as a remote control, a tablet, laptop computer, smartphone, on-screen controls, integrated control buttons, or any combination thereof, to name just a few examples.
- Content servers 120 may each include databases to store content 124 and metadata 126 .
- Content 124 may include any combination of music, videos, movies, TV programs, multimedia, images, still pictures, text, graphics, gaming applications, advertisements, software, and/or any other content or data objects in electronic form.
- metadata 126 comprises data about content 124 .
- metadata 126 may include associated or ancillary information indicating or related to writer, director, producer, composer, artist, actor, summary, chapters, production, history, year, trailers, alternate versions, related content, applications, and/or any other information pertaining or relating to the content 124 .
- Metadata 126 may also or alternatively include links to any such information pertaining or relating to the content 124 .
- Metadata 126 may also or alternatively include one or more indexes of content 124 (examples of such indexes are further described below with respect to FIGS. 3-4 ).
- Crowd source servers 114 may each include a boundary processing module 116 and a database 118 .
- boundary processing module 116 receives and processes information identifying portions in content 124 having little or no interest to users.
- boundary processing module 116 receives such information from users 112 via their media systems 104 .
- Boundary processing module 116 may store such received information, as well as processing and analysis of such received information, in database 118 .
- FIG. 2 illustrates an example block diagram of the media device 108 , according to some embodiments.
- Media device 108 may include a streaming module 202 , processing module 204 , user interface module 206 and database 208 .
- user 112 may use remote control 110 to interact with media device 108 to select content, such as a movie, TV show, music, book, application, game, etc.
- Media device 108 may request the selected content from content server(s) 122 over the network 120 .
- Content server(s) 122 may transmit the requested content to media device 108 .
- Media device 108 may transmit the received content to display device 106 for presentation to user 112 .
- media device 108 may transmit the content to display device 106 in real time or near real time as it receives such content from content server(s) 122 .
- media device 108 may buffer or store the content received from content server(s) 122 in database 208 for later playback on display device 106 .
- content 124 A shown in FIG. 3
- content 124 A may be stored in database 208 of media device 108 , as shown in the example of FIG. 3 , or streamed from content server(s) 122 via network 120 ).
- content 124 A is a television show 124 A.
- television show 124 A has three parts: a teaser 302 (also sometimes called a cold open), a title sequence and/or opening credits 304 , and a feature 306 which is the remainder of the television show 124 A (sometimes referred to herein as the show proper).
- the user 112 may wish to skip over the title sequence/opening credits 304 . This may be particularly true after the user 112 has already viewed the title sequence/opening credits 304 when watching the first episode of the associated TV series.
- a conventional solution to skipping over the title sequence/opening credits 304 is using the fast forward function. But this approach is often bulky and inefficient, as the user 112 may fast forward past the end of the title sequence/opening credits 304 , and then must rewind back to the beginning of the feature 306 . This problem is particularly acute in digital playback systems (such as streaming media players, DVRs, etc.) where the trick mode index may not line up with the end of the title sequence/opening credits 304 (or, equivalently, the beginning of the feature 306 ).
- the feature 306 may overlap with the title sequence/opening credits 304 . This may be especially true in streaming applications, for example, where there may not be a commercial or other hard break between the title sequence/opening credits 304 and the feature 306 . Thus, trying to use the fast forward function on the remote control 110 to skip over the title sequence/opening credits 304 and go directly to the feature 306 may be a frustrating experience for the user 112 .
- metadata 126 A is associated with the content 124 A.
- the metadata 126 A may store information pertaining or relating to the content 124 A, and may include index 308 .
- index 308 may include pointers 310 to content 124 A.
- index 308 may include pointer 310 A that points to the beginning 316 of the teaser 302 , pointer 310 B that points to the beginning 318 of the title sequence/opening credits 304 , and pointer 310 C that points to the end 320 of the title sequence/opening credits 304 .
- Index 308 may have other pointers 310 pointing to other points in content 124 A.
- content 124 A and metadata 126 A may be transferred from content server(s) 122 to the user 112 's media device 108 over network 120 at the same time (or substantially the same time). In other embodiments, content 124 A and metadata 126 A may be transferred from content server(s) 122 to the user 112 's media device 108 at different times. For example, metadata 126 A may be preloaded and stored in database 208 of media device 108 , or may be transferred to media device 108 from content server(s) 122 during pauses in the display of content 124 A on the display device 106 .
- Some embodiments may use the pointers 310 in the index 308 to enable a user 112 to easily and effectively skip over the title sequence/opening credits 304 .
- This skip functionality is graphically depicted in FIG. 3 as skip option 324 , that when selected by user 112 skips over a portion 326 of content 124 A from the beginning 318 of the title sequence/opening credits 304 to the end 320 of the title sequence/opening credits 304 .
- FIG. 5 shows a method 502 for enabling a user to skip over uninteresting portion(s) of content when streaming such content, according to some embodiments.
- Method 502 can be performed by processing logic that can comprise hardware (e.g., circuitry, dedicated logic, programmable logic, microcode, etc.), software (e.g., instructions executing on a processing device), or a combination thereof. It is to be appreciated that not all steps may be needed to perform the disclosure provided herein. Further, some of the steps may be performed simultaneously, or in a different order than shown in FIG. 5 , as will be understood by a person of ordinary skill in the art.
- FIG. 5 is described with reference to FIGS. 1-3 , but the method 502 is not limited to these example embodiments.
- media device 108 in the user 112 's media system 104 may determine the end of the teaser 302 (or, equivalently, the beginning of the title sequence/opening credits 304 ) in content 124 A.
- the processing module 204 of media device 108 may access the index 308 in the metadata 126 A stored in database 208 , and retrieve pointer 310 B that points to the end 318 of the teaser 302 .
- media device 108 may determine the end of the title sequence/opening credits 304 in content 124 A.
- the processing module 204 may access the index 308 in the metadata 126 A, and retrieve pointer 310 C that points to the end 320 of the title sequence/opening credits 304 .
- media device 108 may begin streaming the content 124 A for playback on the display device 106 .
- the streaming module 202 of media device 108 may begin streaming the content 124 A to the display device 106 , either as the content 124 is received from content servers 122 over network 120 , or by retrieving content 124 from database 208 .
- operation 508 may begin prior to operation 504 , or at any time in parallel with operations 504 and 506 .
- processing module 204 and/or streaming module 202 may determine when the end 318 of the teaser 302 has been reached in the stream of the content 124 A to the display device 106 .
- the user interface module 206 in the media device 108 may display a “skip” icon (such as the example skip icon 324 in FIG. 3 ) on the display device 106 .
- the skip icon 324 may be displayed in a location on display device 106 outside the window wherein the content 124 A is being displayed.
- the skip icon 324 may be displayed on the display device 106 during the entire period when the title sequence/opening credits 304 are being streamed to and played back on display device 106 .
- the streaming module 202 may use pointer 310 C in index 308 to access the end 320 of the title sequence/opening credits 304 . Then, the streaming module 202 may advance the streaming of content 124 A to display device 106 to that end 320 of the title sequence/opening credits 304 . In this manner, the user 112 is able to skip playback of the title sequence/opening credits 304 at any point during its presentation on display device 106 .
- flowchart 502 is performed only if the content 124 A is not the first episode in a series (such as a TV series or a series of movies). In this manner, the title sequence/opening credits 304 are presented to the user 112 during playback of the first episode in a series (although the user 112 can still use conventional fast forward functionality to skip the title sequence/opening credits 304 ). In other embodiments, flowchart 502 is performed for all episodes in a series.
- the index 308 may be populated by manually linking the pointers 310 to particular points in the content 124 A.
- the beginning 316 and end 318 of the teaser 302 may be manually located in the content 124 A.
- the values of pointers 310 A and 310 B in the index 308 may be manually set to respectively point to these locations in content 124 A.
- the end 320 of the title sequence/opening credits 304 may be manually located in the content 124 A, and then the value of pointer 310 C may be set to point to this location.
- the index 308 may be populated using a crowd sourced approach wherein users 112 at media systems 104 collectively identify points of interest in content 124 , such as but not limited to the beginning 316 and end 318 of the teaser 302 and the end 320 of the title sequence/opening credits 304 .
- An example embodiment of such an approach is shown as flowchart 602 in FIG. 6 .
- Method 602 can be performed by processing logic that can comprise hardware (e.g., circuitry, dedicated logic, programmable logic, microcode, etc.), software (e.g., instructions executing on a processing device), or a combination thereof. It is to be appreciated that not all steps may be needed to perform the disclosure provided herein.
- method 602 is described with reference to FIGS. 1-3 although it is not limited to these example embodiments.
- media device 108 may detect a fast forward command issued by the user 112 while content 124 A is being streamed to display device 106 .
- the media device 108 may record the point in content 124 A that was being displayed on display device 106 when the fast forward command was received.
- the point may be denoted as position 1 , or P 1 .
- operation 604 is performed only for the first fast forward detected while streaming the content 124 A to the display device 106 .
- media device 108 may determine if P 1 occurs within a monitoring window 350 of content 124 A.
- the monitoring window 350 is a portion of the content 124 A where the title sequence/opening credits 304 normally occurs.
- the monitoring window 350 may be set to the first 5-10 minutes of the content 124 A.
- the media device 108 may monitor and detect when the user 112 discontinues the fast forward operation.
- the media device 108 may record the point in content 124 A that was being displayed on display device 106 when the fast forward command was discontinued. The point may be denoted as position 2 , or P 2 .
- the media device 108 may store P 1 and P 2 in database 208 .
- media device 108 may upload P 1 and P 2 to crowd source server(s) 114 via network 120 .
- operations 604 - 612 may be performed by media device 108 whenever the content 124 A is played from the beginning 316 on the display device 106 . Additionally or alternatively, operations 604 - 612 may be performed by media device 108 for every fast forward command detected within the monitoring window 350 . Accordingly, multiple P 1 /P 2 sets may be stored in database 208 when operation 614 is performed. In such cases, the media device 108 in 614 may upload to the crowd source server(s) 114 all of the P 1 /P 2 sets stored in database 208 at the time operation 614 is performed.
- operations 604 - 614 are performed by any combination of media systems 104 in the multimedia environment 102 .
- boundary processing module 116 in crowd source server 114 may use the P 1 /P 2 timing information associated with the content 124 A, received from media systems 104 as well as stored in database 208 , to generate a crowd sourced determination of the beginning 318 and the end 320 of the title sequence/opening credits 304 of the content 124 A.
- the boundary processing module 116 in 616 may average the P 1 s to generate a crowd sourced determination of the beginning 318 of the title sequence/opening credits 304 , and may average the P 2 s to generate a crowd sourced determination of the end 320 of the title sequence/opening credits 304 , or may process the P 1 s and P 2 s using any other system defined statistical or mathematical function or process to generate crowd sourced values of the beginning 318 and the end 320 of the title sequence/opening credits 304 of the content 124 A.
- the P 1 s, P 2 s and crowd sourced values of the beginning 318 and the end 320 of the title sequence/opening credits 304 of the content 124 A may be stored in database 118 .
- the crowd source server 114 may transmit the crowd sourced values of the beginning 318 and the end 320 of the title sequence/opening credits 304 of the content 124 A to the content servers 122 and/or media devices 108 for storage in the index 308 of metadata 126 A.
- Embodiments of this disclosure are not limited to skipping the title sequence/opening credits 304 of content 124 A. Rather, embodiments are applicable to skipping any portion or portions of any given content of little interest to users 112 , where the boundaries of such portion(s) may be manually determined, or determined in a crowd sourced manner as shown in FIG. 6 , and then skipped per user command as shown in FIG. 5 .
- trick mode is an ability in digital media devices to fast forward, rewind, pause, or otherwise manipulate content 124 (at one or more speeds) during display on a display device 106 .
- An example data structure embodiment of trick mode is illustrated in FIG. 4 , wherein content 124 B is stored in database 208 of media device 108 (or may be streamed from content server(s) 122 to media device 108 via network 120 ).
- Content 124 B has a plurality of segments 414 . Some segments 414 may be the same size and some may be different. Or, the segments 414 may all be the same size or different sizes.
- Metadata 126 B may be associated with content 124 B and may store information pertaining or relating to content 124 B. Metadata 126 B may be stored in database 208 . Metadata 126 B may include a trick mode index 402 and trick mode images 406 .
- Trick mode index 402 may include a pointer 404 to each segment 414 of content 124 B.
- trick mode images 406 may include an image 408 for each segment 414 of content 124 B.
- pointer 404 A in trick mode index 402 and image 408 A in trick mode images 406 correspond to segment 414 A of content 124 B.
- content server(s) 122 may transmit the requested content 124 B as well as the associated metadata 126 B (at the same time or at different times) to media device 108 .
- media device 108 may access the metadata 126 B and use the trick mode index 402 and the trick mode images 406 to perform the requested trick mode operation on the display device 106 .
- the media device 108 may display the trick mode images 408 corresponding to content segments 414 (as identified by the pointers 404 ) as the content 124 is fast forwarded on the display device 106 .
- the media device 108 may display trick mode image 408 E on the display device 106 when the fast forward operation reaches content segment 414 E, wherein this trick mode image 408 E may be identified and accessed using pointer 404 E.
- the metadata 126 B may also include associated information 410 .
- the associated information 410 may include information 412 pertaining or relating to each content segment 414 .
- Such information 412 may identify, indicate and/or relate to writer, director, producer, composer, artist, actor, summary, chapters, production, history, year, trailers, alternate versions, related content, applications, and/or any other information pertaining or relating to the content 124 .
- Information 412 may also or alternatively include links to any such information pertaining or relating to the content 124 .
- FIG. 7 illustrates a method 702 for enabling users to select and view information relating to content when streaming and displaying such content using enhanced trick mode functionality, according to some embodiments.
- Method 702 can be performed by processing logic that can comprise hardware (e.g., circuitry, dedicated logic, programmable logic, microcode, etc.), software (e.g., instructions executing on a processing device), or a combination thereof. It is to be appreciated that not all steps may be needed to perform the disclosure provided herein. Further, some of the steps may be performed simultaneously, or in a different order than shown in FIG. 7 , as will be understood by a person of ordinary skill in the art. For illustrative purposes, method 702 is described with reference to FIGS. 1, 2, 4 and 8 although it is not limited to these example embodiments ( FIG. 8 illustrates an example screen shot 801 displayed on display device 106 , according to some embodiments).
- content 124 B may be streamed to display device 106 in the user 112 's media system 104 .
- content server(s) 122 in 706 may stream content 124 B to media device 108 .
- Content server(s) 122 may also stream metadata 126 B relating to content 124 B to media device 108 (at the same time as the streaming of content 124 B, or different times).
- the media device 108 may transfer the received content 124 B to display device 106 for playback to user 112 .
- the content 124 B may be displayed in a content window 802 on the display device 106 .
- user interface module 206 in the media device 108 may receive a request for a trick mode operation from user 112 (via, for example, remote control 110 ).
- the requested trick mode operation may be fast forward, rewind, pause, of any other manipulation of the display of content 124 B on display device 106 .
- Streaming module 202 (working with processing module 204 , for example) in 708 may implement the requested trick mode operation on the display device 106 using the trick mode index 402 and trick mode images 406 in the metadata 126 B.
- the streaming module 202 may display trick mode images 408 in the content window 802 on the display device 106 when the fast forward operation reaches content segments 414 corresponding to those trick mode images 408 , wherein the trick mode images 408 may be identified and accessed using associated pointers 404 .
- the streaming module 202 may enable an “associated information” option.
- the streaming module 202 may display an “Info” button 804 at a location on display device 106 outside the content window 802 where the content 124 B is being displayed.
- the streaming module 202 may retrieve associated information 412 corresponding to the content segment 414 currently being displayed (that is, featured) via trick mode on the display device 106 , and may display such retrieved associated information 412 in an associated information window 806 on the display device 106 .
- the associated information window 806 may partially or fully overlap with the content window 802 , or may not overlap at all (this latter case is shown in the example of FIG. 8 ).
- trick mode image 4081 corresponding to content segment 4141 is being displayed in the content window 802 on the display device 106 .
- the streaming module 202 may use the associated pointer 4041 to retrieve the associated information 4121 corresponding to content segment 4141 , and may display the retrieved associated information 4121 in the associated information window 806 .
- the trick mode operation is suspended when the user 112 selects the Info button 804 and the retrieved associated information 4121 is displayed in the associated information window 806 . This is done to allow the user 112 to view the information in the associated information window 806 .
- the trick mode operation is resumed when the user 112 selects the Info button 804 a second time.
- operations 708 and 710 may be available only for non-fast forward and non-fast rewind trick mode operations. In other embodiments, operations 708 and 710 may be available for all trick mode operations.
- Computer system 900 can be any computer or computing device capable of performing the functions described herein.
- one or more computer systems 900 can be used to implement the devices and operations of FIGS. 1-8 .
- Computer system 900 includes one or more processors (also called central processing units, or CPUs), such as a processor 904 .
- processors also called central processing units, or CPUs
- Processor 904 is connected to a communication infrastructure or bus 906 .
- One or more processors 904 can each be a graphics processing unit (GPU).
- a GPU is a processor that is a specialized electronic circuit designed to process mathematically intensive applications.
- the GPU can have a parallel structure that is efficient for parallel processing of large blocks of data, such as mathematically intensive data common to computer graphics applications, images, videos, etc.
- Computer system 900 also includes user input/output device(s) 903 , such as monitors, keyboards, pointing devices, etc., that communicate with communication infrastructure 906 through user input/output interface(s) 902 .
- user input/output device(s) 903 such as monitors, keyboards, pointing devices, etc.
- Computer system 900 also includes a main or primary memory 908 , such as random access memory (RAM).
- Main memory 908 can include one or more levels of cache.
- Main memory 908 has stored therein control logic (i.e., computer software) and/or data.
- Computer system 900 can also include one or more secondary storage devices or memory 910 .
- Secondary memory 910 can include, for example, a hard disk drive 912 and/or a removable storage device or drive 914 .
- Removable storage drive 914 can be a floppy disk drive, a magnetic tape drive, a compact disk drive, an optical storage device, tape backup device, and/or any other storage device/drive.
- Removable storage drive 914 can interact with a removable storage unit 918 .
- Removable storage unit 918 includes a computer usable or readable storage device having stored thereon computer software (control logic) and/or data.
- Removable storage unit 918 can be a floppy disk, magnetic tape, compact disk, DVD, optical storage disk, and/any other computer data storage device.
- Removable storage drive 914 reads from and/or writes to removable storage unit 918 in a well-known manner.
- secondary memory 910 can include other means, instrumentalities or other approaches for allowing computer programs and/or other instructions and/or data to be accessed by computer system 900 .
- Such means, instrumentalities or other approaches can include, for example, a removable storage unit 922 and an interface 920 .
- the removable storage unit 922 and the interface 920 can include a program cartridge and cartridge interface (such as that found in video game devices), a removable memory chip (such as an EPROM or PROM) and associated socket, a memory stick and USB port, a memory card and associated memory card slot, and/or any other removable storage unit and associated interface.
- Computer system 900 can further include a communication or network interface 924 .
- Communication interface 924 enables computer system 900 to communicate and interact with any combination of remote devices, remote networks, remote entities, etc. (individually and collectively referenced by reference number 928 ).
- communication interface 924 can allow computer system 900 to communicate with remote devices 928 over communications path 926 , which can be wired and/or wireless, and which can include any combination of LANs, WANs, the Internet, etc.
- Control logic and/or data can be transmitted to and from computer system 900 via communication path 926 .
- a tangible apparatus or article of manufacture comprising a tangible computer useable or readable medium having control logic (software) stored thereon is also referred to herein as a computer program product or program storage device.
- control logic software stored thereon
- control logic when executed by one or more data processing devices (such as computer system 900 ), causes such data processing devices to operate as described herein.
- references herein to “one embodiment,” “an embodiment,” “an example embodiment,” or similar phrases indicate that the embodiment described can include a particular feature, structure, or characteristic, but every embodiment can not necessarily include the particular feature, structure, or characteristic. Moreover, such phrases are not necessarily referring to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with an embodiment, it would be within the knowledge of persons skilled in the relevant art(s) to incorporate such feature, structure, or characteristic into other embodiments whether or not explicitly mentioned or described herein. Additionally, some embodiments can be described using the expression “coupled” and “connected” along with their derivatives. These terms are not necessarily intended as synonyms for each other.
- Coupled can also mean that two or more elements are not in direct contact with each other, but yet still co-operate or interact with each other.
Abstract
Description
- This application is related to U.S. patent application Ser. No. ______ entitled “Skipping Content of Lesser Interest When Streaming Media” by Anthony Wood and Joseph Hollinger, filed Nov. 29, 2016, which is hereby incorporated herein by reference in its entirety.
- This disclosure is generally directed to pre-indexing content to provide enhanced media streaming functionality.
- In today's world, on-demand availability of content—such as movies, TV shows and music, to name just a few examples—is commonplace. But the electronic and computerized storage and delivery of content offers the potential for far more than just the availability and vanilla playback of content. For example, through innovative use of technology, it is possible to generate content recommendations that are tailored for individual users, as well as to customize the viewing experience to each user's personal preferences.
- But, existing media systems and services still fall short in many areas. For example, many media systems and services require users to experience content in a linear manner, requiring them to view portions of content having little or no interest. Also, too often, media systems and services fail to leverage the immense knowledge base of the Internet and other sources when presenting content to users; thus, while streaming content may be available on an on-demand basis, related information is not, at least not in an easily accessible manner.
- Provided herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for using technology in innovative ways to provide enhanced media streaming functionality.
- An embodiment is directed to system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for skipping a portion of content during streaming of the content to a display device, where the portion is of little or no interest to the user. In a non-limiting embodiment, the apparatus may be a media streaming device, and the content may be a movie or a TV program, to name just two examples. The apparatus includes a memory having a database stored therein. The database stores metadata relating to the content. The metadata includes an index, where the index stores pointers to portions of the content. The apparatus includes a processor that is communicatively coupled to the memory. In operation, in some embodiments, the processor streams the content for display on the display device. When the processor determines an end of a teaser portion has been reached in the stream of the content to the display device, it enables a skip command. Responsive to enabling the skip command, the processor receives command input from the user to skip a title sequence/opening credits portion of the content. Then, the processor determines an end to the title sequence/opening credits portion of the content using the metadata, and advances streaming of the content to the determined end of the title sequence/opening credits portion of the content. In this way, the user is able to skip portions of content that have little or no interest.
- Another embodiment is directed to system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for displaying information associated with content while streaming the content to a display device. Again, in a non-limiting embodiment, the apparatus may be a media streaming device, and the content may be a movie or a TV program, to name just two examples. The apparatus includes a memory having a database stored therein. The database stores metadata relating to the content. The metadata includes a trick mode index, trick mode images and a database of information associated with segments of the content. The apparatus also includes a processor communicatively coupled to the memory. In operation, in some embodiments, the processor streams the content for display on the display device. The processor implements a trick mode operation upon receiving an appropriate user request. During implementation of the trick mode operation, the processor receives command input requesting information associated with the content. Then, responsive to such command input, the processor retrieves information from the database of information associated with a segment of the content being featured on the display device when the command input was received, and displays the retrieved information on the display device.
- The accompanying drawings are incorporated herein and form a part of the specification.
-
FIG. 1 illustrates a block diagram of a multimedia environment that includes media system(s), crowd source server(s) and content server(s), according to some embodiments. -
FIG. 2 illustrates a block diagram of a media device, according to some embodiments. -
FIGS. 3 and 4 illustrate example databases of a media device, according to some embodiments. -
FIG. 5 illustrates a method for enabling a user to skip over uninteresting portion(s) of content when streaming such content, according to some embodiments. -
FIG. 6 illustrates a method for crowd sourced identification of particular portion(s) of content, according to some embodiments. -
FIG. 7 illustrates a method for enabling users to select and view ancillary or associated information when streaming content using an enhanced trick mode, according to some embodiments. -
FIG. 8 illustrates an example screen shot displayed on a display device, according to some embodiments -
FIG. 9 illustrates an example computer system useful for implementing various embodiments. - In the drawings, like reference numbers generally indicate identical or similar elements. Additionally, generally, the left-most digit(s) of a reference number identifies the drawing in which the reference number first appears.
-
FIG. 1 illustrates a block diagram of amultimedia environment 102, according to some embodiments. In a non-limiting example,multimedia environment 102 is directed to streaming media. - The
multimedia environment 102 may include one ormore media systems 104, one or more content servers 122, and one or morecrowd source servers 114, communicatively coupled via anetwork 120. In various embodiments, thenetwork 118 can include, without limitation, wired and/or wireless intranet, extranet, Internet, cellular, Bluetooth and/or any other short range, long range, local, regional, global communications network, as well as any combination thereof. -
Media system 104 may include adisplay device 106,media device 108 andremote control 110.Display device 106 may be a monitor, television, computer, smart phone, tablet, and/or projector, to name just a few examples.Media device 108 may be a streaming media device, DVD device, audio/video playback device, cable box, and/or digital video recording device, to name just a few examples. In some embodiments, themedia device 108 can be a part of, integrated with, operatively coupled to, and/or connected todisplay device 106. Themedia device 108 may be configured to communicate withnetwork 120. - A
user 112 may interact withmedia system 104 viaremote control 110.Remote control 110 can be any component, part, apparatus or method for controllingmedia device 108 and/ordisplay device 106, such as a remote control, a tablet, laptop computer, smartphone, on-screen controls, integrated control buttons, or any combination thereof, to name just a few examples. - Content servers 120 (also called content sources 120) may each include databases to store
content 124 andmetadata 126.Content 124 may include any combination of music, videos, movies, TV programs, multimedia, images, still pictures, text, graphics, gaming applications, advertisements, software, and/or any other content or data objects in electronic form. In some embodiments,metadata 126 comprises data aboutcontent 124. For example,metadata 126 may include associated or ancillary information indicating or related to writer, director, producer, composer, artist, actor, summary, chapters, production, history, year, trailers, alternate versions, related content, applications, and/or any other information pertaining or relating to thecontent 124.Metadata 126 may also or alternatively include links to any such information pertaining or relating to thecontent 124.Metadata 126 may also or alternatively include one or more indexes of content 124 (examples of such indexes are further described below with respect toFIGS. 3-4 ). -
Crowd source servers 114 may each include aboundary processing module 116 and adatabase 118. In some embodiments,boundary processing module 116 receives and processes information identifying portions incontent 124 having little or no interest to users. In some crowd sourced embodiments,boundary processing module 116 receives such information fromusers 112 via theirmedia systems 104.Boundary processing module 116 may store such received information, as well as processing and analysis of such received information, indatabase 118. -
FIG. 2 illustrates an example block diagram of themedia device 108, according to some embodiments.Media device 108 may include astreaming module 202,processing module 204,user interface module 206 anddatabase 208. - Now referring to
FIGS. 1 and 2 , in some embodiments,user 112 may useremote control 110 to interact withmedia device 108 to select content, such as a movie, TV show, music, book, application, game, etc.Media device 108 may request the selected content from content server(s) 122 over thenetwork 120. Content server(s) 122 may transmit the requested content tomedia device 108.Media device 108 may transmit the received content to displaydevice 106 for presentation touser 112. In streaming embodiments,media device 108 may transmit the content to displaydevice 106 in real time or near real time as it receives such content from content server(s) 122. In non-streaming embodiments,media device 108 may buffer or store the content received from content server(s) 122 indatabase 208 for later playback ondisplay device 106. - Skipping Content of Lesser User Interest when Streaming Media
- Too often, streaming media systems and services require users to experience streaming content in a linear manner, requiring them to view portions of content having little or no interest. Consider, for example,
content 124A shown inFIG. 3 (content 124A may be stored indatabase 208 ofmedia device 108, as shown in the example ofFIG. 3 , or streamed from content server(s) 122 via network 120). For non-limiting illustrative purposes, assumecontent 124A is atelevision show 124A. Generally,television show 124A has three parts: a teaser 302 (also sometimes called a cold open), a title sequence and/or openingcredits 304, and afeature 306 which is the remainder of thetelevision show 124A (sometimes referred to herein as the show proper). - Often when streaming
content 124A to herdisplay device 106, theuser 112 may wish to skip over the title sequence/opening credits 304. This may be particularly true after theuser 112 has already viewed the title sequence/openingcredits 304 when watching the first episode of the associated TV series. A conventional solution to skipping over the title sequence/openingcredits 304 is using the fast forward function. But this approach is often bulky and inefficient, as theuser 112 may fast forward past the end of the title sequence/openingcredits 304, and then must rewind back to the beginning of thefeature 306. This problem is particularly acute in digital playback systems (such as streaming media players, DVRs, etc.) where the trick mode index may not line up with the end of the title sequence/opening credits 304 (or, equivalently, the beginning of the feature 306). - Also, there is often a blurry line between the end of the title sequence/opening
credits 304 and the beginning of thefeature 306. Sometimes thefeature 306 may overlap with the title sequence/opening credits 304. This may be especially true in streaming applications, for example, where there may not be a commercial or other hard break between the title sequence/openingcredits 304 and thefeature 306. Thus, trying to use the fast forward function on theremote control 110 to skip over the title sequence/openingcredits 304 and go directly to thefeature 306 may be a frustrating experience for theuser 112. - In some embodiments, to address this problem,
metadata 126A is associated with thecontent 124A. As noted above, themetadata 126A may store information pertaining or relating to thecontent 124A, and may includeindex 308. In some embodiments,index 308 may include pointers 310 tocontent 124A. In particular,index 308 may includepointer 310A that points to the beginning 316 of theteaser 302,pointer 310B that points to the beginning 318 of the title sequence/openingcredits 304, andpointer 310C that points to theend 320 of the title sequence/opening credits 304.Index 308 may have other pointers 310 pointing to other points incontent 124A. - In some embodiments,
content 124A andmetadata 126A may be transferred from content server(s) 122 to theuser 112'smedia device 108 overnetwork 120 at the same time (or substantially the same time). In other embodiments,content 124A andmetadata 126A may be transferred from content server(s) 122 to theuser 112'smedia device 108 at different times. For example,metadata 126A may be preloaded and stored indatabase 208 ofmedia device 108, or may be transferred tomedia device 108 from content server(s) 122 during pauses in the display ofcontent 124A on thedisplay device 106. - Some embodiments may use the pointers 310 in the
index 308 to enable auser 112 to easily and effectively skip over the title sequence/opening credits 304. This skip functionality is graphically depicted inFIG. 3 asskip option 324, that when selected byuser 112 skips over aportion 326 ofcontent 124A from the beginning 318 of the title sequence/openingcredits 304 to theend 320 of the title sequence/opening credits 304. - An example of such operation is depicted in
FIG. 5 , that shows amethod 502 for enabling a user to skip over uninteresting portion(s) of content when streaming such content, according to some embodiments.Method 502 can be performed by processing logic that can comprise hardware (e.g., circuitry, dedicated logic, programmable logic, microcode, etc.), software (e.g., instructions executing on a processing device), or a combination thereof. It is to be appreciated that not all steps may be needed to perform the disclosure provided herein. Further, some of the steps may be performed simultaneously, or in a different order than shown inFIG. 5 , as will be understood by a person of ordinary skill in the art. - For illustrative purposes,
FIG. 5 is described with reference toFIGS. 1-3 , but themethod 502 is not limited to these example embodiments. - In 504,
media device 108 in theuser 112'smedia system 104 may determine the end of the teaser 302 (or, equivalently, the beginning of the title sequence/opening credits 304) incontent 124A. For example, in 504, theprocessing module 204 ofmedia device 108 may access theindex 308 in themetadata 126A stored indatabase 208, and retrievepointer 310B that points to theend 318 of theteaser 302. - In 506,
media device 108 may determine the end of the title sequence/openingcredits 304 incontent 124A. For example, in 506, theprocessing module 204 may access theindex 308 in themetadata 126A, and retrievepointer 310C that points to theend 320 of the title sequence/opening credits 304. - In 508,
media device 108 may begin streaming thecontent 124A for playback on thedisplay device 106. For example, in 508, thestreaming module 202 ofmedia device 108 may begin streaming thecontent 124A to thedisplay device 106, either as thecontent 124 is received from content servers 122 overnetwork 120, or by retrievingcontent 124 fromdatabase 208. It is noted thatoperation 508 may begin prior tooperation 504, or at any time in parallel withoperations - In 510,
processing module 204 and/orstreaming module 202 may determine when theend 318 of theteaser 302 has been reached in the stream of thecontent 124A to thedisplay device 106. When theend 318 of theteaser 302 has been reached, and while continuing to stream the content for playback on thedisplay device 106, theuser interface module 206 in themedia device 108 may display a “skip” icon (such as theexample skip icon 324 inFIG. 3 ) on thedisplay device 106. For example, theskip icon 324 may be displayed in a location ondisplay device 106 outside the window wherein thecontent 124A is being displayed. In some embodiments, theskip icon 324 may be displayed on thedisplay device 106 during the entire period when the title sequence/openingcredits 304 are being streamed to and played back ondisplay device 106. - In 512, if the
user 112 selects the skip icon 324 (usingremote control 110, for example), then thestreaming module 202 may usepointer 310C inindex 308 to access theend 320 of the title sequence/opening credits 304. Then, thestreaming module 202 may advance the streaming ofcontent 124A to displaydevice 106 to thatend 320 of the title sequence/opening credits 304. In this manner, theuser 112 is able to skip playback of the title sequence/openingcredits 304 at any point during its presentation ondisplay device 106. - In some embodiments,
flowchart 502 is performed only if thecontent 124A is not the first episode in a series (such as a TV series or a series of movies). In this manner, the title sequence/openingcredits 304 are presented to theuser 112 during playback of the first episode in a series (although theuser 112 can still use conventional fast forward functionality to skip the title sequence/opening credits 304). In other embodiments,flowchart 502 is performed for all episodes in a series. - In some embodiments, the
index 308 may be populated by manually linking the pointers 310 to particular points in thecontent 124A. For example, the beginning 316 and end 318 of theteaser 302 may be manually located in thecontent 124A. Then, the values ofpointers index 308 may be manually set to respectively point to these locations incontent 124A. Similarly, theend 320 of the title sequence/openingcredits 304 may be manually located in thecontent 124A, and then the value ofpointer 310C may be set to point to this location. - In other embodiments, the
index 308 may be populated using a crowd sourced approach whereinusers 112 atmedia systems 104 collectively identify points of interest incontent 124, such as but not limited to the beginning 316 and end 318 of theteaser 302 and theend 320 of the title sequence/opening credits 304. An example embodiment of such an approach is shown asflowchart 602 inFIG. 6 .Method 602 can be performed by processing logic that can comprise hardware (e.g., circuitry, dedicated logic, programmable logic, microcode, etc.), software (e.g., instructions executing on a processing device), or a combination thereof. It is to be appreciated that not all steps may be needed to perform the disclosure provided herein. Further, some of the steps may be performed simultaneously, or in a different order than shown inFIG. 6 , as will be understood by a person of ordinary skill in the art. For illustrative purposes,method 602 is described with reference toFIGS. 1-3 although it is not limited to these example embodiments. - In 604, media device 108 (such as
streaming module 202 and/or user interface module 206) may detect a fast forward command issued by theuser 112 whilecontent 124A is being streamed to displaydevice 106. Themedia device 108 may record the point incontent 124A that was being displayed ondisplay device 106 when the fast forward command was received. The point may be denoted as position 1, or P1. In some embodiments,operation 604 is performed only for the first fast forward detected while streaming thecontent 124A to thedisplay device 106. - In 606, media device 108 (such as
streaming module 202 and/or processing module 204) may determine if P1 occurs within amonitoring window 350 ofcontent 124A. In some embodiments, themonitoring window 350 is a portion of thecontent 124A where the title sequence/openingcredits 304 normally occurs. For example, themonitoring window 350 may be set to the first 5-10 minutes of thecontent 124A. - If P1 is outside the
monitoring window 350, then it is likely theuser 112's fast forward command is not related to skipping the title sequence/opening credits 304. Thus, the flowchart ends at 608. - If P1 is within the
monitoring window 350, then it is possible theuser 112's fast forward command is for the purpose of skipping the title sequence/opening credits 304. Accordingly, the media device 108 (such asstreaming module 202 and/or user interface module 206) may monitor and detect when theuser 112 discontinues the fast forward operation. Themedia device 108 may record the point incontent 124A that was being displayed ondisplay device 106 when the fast forward command was discontinued. The point may be denoted as position 2, or P2. - In 612, the
media device 108 may store P1 and P2 indatabase 208. - In 614, periodically or at predefined times,
media device 108 may upload P1 and P2 to crowd source server(s) 114 vianetwork 120. - In some embodiments, operations 604-612 may be performed by
media device 108 whenever thecontent 124A is played from the beginning 316 on thedisplay device 106. Additionally or alternatively, operations 604-612 may be performed bymedia device 108 for every fast forward command detected within themonitoring window 350. Accordingly, multiple P1/P2 sets may be stored indatabase 208 whenoperation 614 is performed. In such cases, themedia device 108 in 614 may upload to the crowd source server(s) 114 all of the P1/P2 sets stored indatabase 208 at thetime operation 614 is performed. - In some embodiments, operations 604-614 are performed by any combination of
media systems 104 in themultimedia environment 102. - In 616,
boundary processing module 116 incrowd source server 114 may use the P1/P2 timing information associated with thecontent 124A, received frommedia systems 104 as well as stored indatabase 208, to generate a crowd sourced determination of the beginning 318 and theend 320 of the title sequence/openingcredits 304 of thecontent 124A. In some embodiments, theboundary processing module 116 in 616 may average the P1s to generate a crowd sourced determination of the beginning 318 of the title sequence/openingcredits 304, and may average the P2s to generate a crowd sourced determination of theend 320 of the title sequence/openingcredits 304, or may process the P1s and P2s using any other system defined statistical or mathematical function or process to generate crowd sourced values of the beginning 318 and theend 320 of the title sequence/openingcredits 304 of thecontent 124A. The P1s, P2s and crowd sourced values of the beginning 318 and theend 320 of the title sequence/openingcredits 304 of thecontent 124A may be stored indatabase 118. - In 618, the
crowd source server 114 may transmit the crowd sourced values of the beginning 318 and theend 320 of the title sequence/openingcredits 304 of thecontent 124A to the content servers 122 and/ormedia devices 108 for storage in theindex 308 ofmetadata 126A. - Embodiments of this disclosure are not limited to skipping the title sequence/opening
credits 304 ofcontent 124A. Rather, embodiments are applicable to skipping any portion or portions of any given content of little interest tousers 112, where the boundaries of such portion(s) may be manually determined, or determined in a crowd sourced manner as shown inFIG. 6 , and then skipped per user command as shown inFIG. 5 . - Enhanced Trick Mode to Enable Presentation of Information Related to Content being Streamed
- According to some embodiments, trick mode is an ability in digital media devices to fast forward, rewind, pause, or otherwise manipulate content 124 (at one or more speeds) during display on a
display device 106. An example data structure embodiment of trick mode is illustrated inFIG. 4 , whereincontent 124B is stored indatabase 208 of media device 108 (or may be streamed from content server(s) 122 tomedia device 108 via network 120).Content 124B has a plurality of segments 414. Some segments 414 may be the same size and some may be different. Or, the segments 414 may all be the same size or different sizes. -
Metadata 126B may be associated withcontent 124B and may store information pertaining or relating tocontent 124B.Metadata 126B may be stored indatabase 208.Metadata 126B may include atrick mode index 402 andtrick mode images 406.Trick mode index 402 may include a pointer 404 to each segment 414 ofcontent 124B. Similarly,trick mode images 406 may include an image 408 for each segment 414 ofcontent 124B. Thus, for example,pointer 404A intrick mode index 402 andimage 408A intrick mode images 406 correspond tosegment 414A ofcontent 124B. - In some embodiments, when
media device 108 requests content 124B from content server(s) 122, content server(s) 122 may transmit the requestedcontent 124B as well as the associatedmetadata 126B (at the same time or at different times) tomedia device 108. Whenmedia device 108 receives a trick mode request from the user 112 (such as a request to rewind or fast forward the display ofcontent 124B),media device 108 may access themetadata 126B and use thetrick mode index 402 and thetrick mode images 406 to perform the requested trick mode operation on thedisplay device 106. In particular, themedia device 108 may display the trick mode images 408 corresponding to content segments 414 (as identified by the pointers 404) as thecontent 124 is fast forwarded on thedisplay device 106. For example, during a fast forward operation, themedia device 108 may displaytrick mode image 408E on thedisplay device 106 when the fast forward operation reachescontent segment 414E, wherein thistrick mode image 408E may be identified and accessed usingpointer 404E. - In some embodiments, the
metadata 126B may also include associatedinformation 410. The associatedinformation 410 may include information 412 pertaining or relating to each content segment 414. Such information 412 may identify, indicate and/or relate to writer, director, producer, composer, artist, actor, summary, chapters, production, history, year, trailers, alternate versions, related content, applications, and/or any other information pertaining or relating to thecontent 124. Information 412 may also or alternatively include links to any such information pertaining or relating to thecontent 124. -
FIG. 7 illustrates amethod 702 for enabling users to select and view information relating to content when streaming and displaying such content using enhanced trick mode functionality, according to some embodiments.Method 702 can be performed by processing logic that can comprise hardware (e.g., circuitry, dedicated logic, programmable logic, microcode, etc.), software (e.g., instructions executing on a processing device), or a combination thereof. It is to be appreciated that not all steps may be needed to perform the disclosure provided herein. Further, some of the steps may be performed simultaneously, or in a different order than shown inFIG. 7 , as will be understood by a person of ordinary skill in the art. For illustrative purposes,method 702 is described with reference toFIGS. 1, 2, 4 and 8 although it is not limited to these example embodiments (FIG. 8 illustrates an example screen shot 801 displayed ondisplay device 106, according to some embodiments). - In 706,
content 124B may be streamed to displaydevice 106 in theuser 112'smedia system 104. For example, content server(s) 122 in 706 may stream content 124B tomedia device 108. Content server(s) 122 may also streammetadata 126B relating tocontent 124B to media device 108 (at the same time as the streaming ofcontent 124B, or different times). Themedia device 108 may transfer the receivedcontent 124B to displaydevice 106 for playback touser 112. In some embodiments, thecontent 124B may be displayed in acontent window 802 on thedisplay device 106. - In 708,
user interface module 206 in themedia device 108 may receive a request for a trick mode operation from user 112 (via, for example, remote control 110). The requested trick mode operation may be fast forward, rewind, pause, of any other manipulation of the display ofcontent 124B ondisplay device 106. Streaming module 202 (working withprocessing module 204, for example) in 708 may implement the requested trick mode operation on thedisplay device 106 using thetrick mode index 402 andtrick mode images 406 in themetadata 126B. For example, during a trick mode fast forward operation, thestreaming module 202 may display trick mode images 408 in thecontent window 802 on thedisplay device 106 when the fast forward operation reaches content segments 414 corresponding to those trick mode images 408, wherein the trick mode images 408 may be identified and accessed using associated pointers 404. - Also in 708, while implementing the requested trick mode operation, the streaming module 202 (working with
processing module 204, for example) may enable an “associated information” option. For example, thestreaming module 202 may display an “Info”button 804 at a location ondisplay device 106 outside thecontent window 802 where thecontent 124B is being displayed. - In 710, if the
user 112 selects theInfo button 804 or otherwise selects the “associated information” option (using, for example, the remote control 110), the streaming module 202 (working with theprocessing module 204, for example) may retrieve associated information 412 corresponding to the content segment 414 currently being displayed (that is, featured) via trick mode on thedisplay device 106, and may display such retrieved associated information 412 in an associatedinformation window 806 on thedisplay device 106. The associatedinformation window 806 may partially or fully overlap with thecontent window 802, or may not overlap at all (this latter case is shown in the example ofFIG. 8 ). - For example, assume during a trick mode fast forward operation,
trick mode image 4081 corresponding tocontent segment 4141 is being displayed in thecontent window 802 on thedisplay device 106. If, at this time, theuser 112 presses theInfo button 804, then thestreaming module 202 may use the associatedpointer 4041 to retrieve the associatedinformation 4121 corresponding tocontent segment 4141, and may display the retrieved associatedinformation 4121 in the associatedinformation window 806. - In some embodiments, in 710, the trick mode operation is suspended when the
user 112 selects theInfo button 804 and the retrieved associatedinformation 4121 is displayed in the associatedinformation window 806. This is done to allow theuser 112 to view the information in the associatedinformation window 806. The trick mode operation is resumed when theuser 112 selects the Info button 804 a second time. - In some embodiments,
operations operations - Various embodiments and/or components therein can be implemented, for example, using one or more computer systems, such as
computer system 900 shown inFIG. 9 .Computer system 900 can be any computer or computing device capable of performing the functions described herein. For example, one ormore computer systems 900 can be used to implement the devices and operations ofFIGS. 1-8 . -
Computer system 900 includes one or more processors (also called central processing units, or CPUs), such as aprocessor 904.Processor 904 is connected to a communication infrastructure orbus 906. - One or
more processors 904 can each be a graphics processing unit (GPU). In some embodiments, a GPU is a processor that is a specialized electronic circuit designed to process mathematically intensive applications. The GPU can have a parallel structure that is efficient for parallel processing of large blocks of data, such as mathematically intensive data common to computer graphics applications, images, videos, etc. -
Computer system 900 also includes user input/output device(s) 903, such as monitors, keyboards, pointing devices, etc., that communicate withcommunication infrastructure 906 through user input/output interface(s) 902. -
Computer system 900 also includes a main orprimary memory 908, such as random access memory (RAM).Main memory 908 can include one or more levels of cache.Main memory 908 has stored therein control logic (i.e., computer software) and/or data. -
Computer system 900 can also include one or more secondary storage devices ormemory 910.Secondary memory 910 can include, for example, ahard disk drive 912 and/or a removable storage device or drive 914.Removable storage drive 914 can be a floppy disk drive, a magnetic tape drive, a compact disk drive, an optical storage device, tape backup device, and/or any other storage device/drive. -
Removable storage drive 914 can interact with aremovable storage unit 918.Removable storage unit 918 includes a computer usable or readable storage device having stored thereon computer software (control logic) and/or data.Removable storage unit 918 can be a floppy disk, magnetic tape, compact disk, DVD, optical storage disk, and/any other computer data storage device.Removable storage drive 914 reads from and/or writes toremovable storage unit 918 in a well-known manner. - According to an exemplary embodiment,
secondary memory 910 can include other means, instrumentalities or other approaches for allowing computer programs and/or other instructions and/or data to be accessed bycomputer system 900. Such means, instrumentalities or other approaches can include, for example, aremovable storage unit 922 and aninterface 920. Examples of theremovable storage unit 922 and theinterface 920 can include a program cartridge and cartridge interface (such as that found in video game devices), a removable memory chip (such as an EPROM or PROM) and associated socket, a memory stick and USB port, a memory card and associated memory card slot, and/or any other removable storage unit and associated interface. -
Computer system 900 can further include a communication ornetwork interface 924. -
Communication interface 924 enablescomputer system 900 to communicate and interact with any combination of remote devices, remote networks, remote entities, etc. (individually and collectively referenced by reference number 928). For example,communication interface 924 can allowcomputer system 900 to communicate with remote devices 928 overcommunications path 926, which can be wired and/or wireless, and which can include any combination of LANs, WANs, the Internet, etc. Control logic and/or data can be transmitted to and fromcomputer system 900 viacommunication path 926. - In some embodiments, a tangible apparatus or article of manufacture comprising a tangible computer useable or readable medium having control logic (software) stored thereon is also referred to herein as a computer program product or program storage device. This includes, but is not limited to,
computer system 900,main memory 908,secondary memory 910, andremovable storage units - Based on the teachings contained in this disclosure, it will be apparent to persons skilled in the relevant art(s) how to make and use embodiments of this disclosure using data processing devices, computer systems and/or computer architectures other than that shown in
FIG. 9 . In particular, embodiments can operate with software, hardware, and/or operating system implementations other than those described herein. - It is to be appreciated that the Detailed Description section, and not the Summary and Abstract sections, is intended to be used to interpret the claims. The Summary and Abstract sections can set forth one or more but not all exemplary embodiments as contemplated by the inventors, and thus, are not intended to limit this disclosure or the appended claims in any way.
- While this disclosure describes exemplary embodiments for exemplary fields and applications, it should be understood that the disclosure is not limited thereto. Other embodiments and modifications thereto are possible, and are within the scope and spirit of this disclosure. For example, and without limiting the generality of this paragraph, embodiments are not limited to the software, hardware, firmware, and/or entities illustrated in the figures and/or described herein. Further, embodiments (whether or not explicitly described herein) have significant utility to fields and applications beyond the examples described herein.
- Embodiments have been described herein with the aid of functional building blocks illustrating the implementation of specified functions and relationships thereof. The boundaries of these functional building blocks have been arbitrarily defined herein for the convenience of the description. Alternate boundaries can be defined as long as the specified functions and relationships (or equivalents thereof) are appropriately performed. Also, alternative embodiments can perform functional blocks, steps, operations, methods, etc. using orderings different than those described herein.
- References herein to “one embodiment,” “an embodiment,” “an example embodiment,” or similar phrases, indicate that the embodiment described can include a particular feature, structure, or characteristic, but every embodiment can not necessarily include the particular feature, structure, or characteristic. Moreover, such phrases are not necessarily referring to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with an embodiment, it would be within the knowledge of persons skilled in the relevant art(s) to incorporate such feature, structure, or characteristic into other embodiments whether or not explicitly mentioned or described herein. Additionally, some embodiments can be described using the expression “coupled” and “connected” along with their derivatives. These terms are not necessarily intended as synonyms for each other. For example, some embodiments can be described using the terms “connected” and/or “coupled” to indicate that two or more elements are in direct physical or electrical contact with each other. The term “coupled,” however, can also mean that two or more elements are not in direct contact with each other, but yet still co-operate or interact with each other.
- The breadth and scope of this disclosure should not be limited by any of the above-described exemplary embodiments, but should be defined only in accordance with the following claims and their equivalents.
Claims (20)
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/363,263 US10003834B1 (en) | 2016-11-29 | 2016-11-29 | Enhanced trick mode to enable presentation of information related to content being streamed |
PCT/US2017/060339 WO2018102084A1 (en) | 2016-11-29 | 2017-11-07 | Enhanced trick mode to enable presentation of information related to content being streamed |
EP17875470.1A EP3549338A4 (en) | 2016-11-29 | 2017-11-07 | Enhanced trick mode to enable presentation of information related to content being streamed |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/363,263 US10003834B1 (en) | 2016-11-29 | 2016-11-29 | Enhanced trick mode to enable presentation of information related to content being streamed |
Publications (2)
Publication Number | Publication Date |
---|---|
US20180152743A1 true US20180152743A1 (en) | 2018-05-31 |
US10003834B1 US10003834B1 (en) | 2018-06-19 |
Family
ID=62192951
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/363,263 Active US10003834B1 (en) | 2016-11-29 | 2016-11-29 | Enhanced trick mode to enable presentation of information related to content being streamed |
Country Status (3)
Country | Link |
---|---|
US (1) | US10003834B1 (en) |
EP (1) | EP3549338A4 (en) |
WO (1) | WO2018102084A1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20200029131A1 (en) * | 2018-07-19 | 2020-01-23 | Netflix, Inc. | Shot-based view files for trick play mode in a network-based video delivery system |
WO2020183080A1 (en) * | 2019-03-12 | 2020-09-17 | Orange | Method for managing the download of images associated with image jumps capable of being carried out during accelerated reading of multimedia content which is continuously broadcast |
US11611803B2 (en) * | 2018-12-31 | 2023-03-21 | Dish Network L.L.C. | Automated content identification for binge watching of digital media |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150245101A1 (en) * | 2014-02-26 | 2015-08-27 | United Video Properties, Inc. | Methods and systems for supplementing media assets during fast-access playback operations |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090049186A1 (en) | 2007-08-16 | 2009-02-19 | Sony Corporation, A Japanese Corporation | Method to facilitate trick-modes for streaming video |
US8554046B2 (en) | 2008-06-23 | 2013-10-08 | Verizon Patent And Licensing Inc. | Providing interactive content during trick mode |
US20100077435A1 (en) | 2008-09-24 | 2010-03-25 | Concert Technology | System and method for smart trick mode display |
US8463108B2 (en) | 2009-01-06 | 2013-06-11 | Microsoft Corporation | Client-side ad insertion during trick mode playback |
US8307390B2 (en) | 2009-02-26 | 2012-11-06 | Comcast Cable Communications, Llc | Re-addressable alternate content |
US20110123173A1 (en) | 2009-11-24 | 2011-05-26 | Verizon Patent And Licensing Inc. | Trick play advertising systems and methods |
US8625974B1 (en) | 2010-05-22 | 2014-01-07 | Arris Enterprises, Inc. | Obscuring advertisements during trick mode operation |
CN103765871A (en) | 2011-07-25 | 2014-04-30 | 汤姆逊许可公司 | Metadata assisted trick mode intervention method and system |
US9319753B2 (en) | 2013-05-09 | 2016-04-19 | Broadcom Corporation | Seamless trick-mode with decreased latency for live transcode streaming |
US9247317B2 (en) | 2013-05-30 | 2016-01-26 | Sonic Ip, Inc. | Content streaming with client device trick play index |
US20140359678A1 (en) | 2013-05-30 | 2014-12-04 | Sonic Ip, Inc. | Device video streaming with trick play based on separate trick play files |
-
2016
- 2016-11-29 US US15/363,263 patent/US10003834B1/en active Active
-
2017
- 2017-11-07 WO PCT/US2017/060339 patent/WO2018102084A1/en unknown
- 2017-11-07 EP EP17875470.1A patent/EP3549338A4/en active Pending
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150245101A1 (en) * | 2014-02-26 | 2015-08-27 | United Video Properties, Inc. | Methods and systems for supplementing media assets during fast-access playback operations |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20200029131A1 (en) * | 2018-07-19 | 2020-01-23 | Netflix, Inc. | Shot-based view files for trick play mode in a network-based video delivery system |
US11082752B2 (en) * | 2018-07-19 | 2021-08-03 | Netflix, Inc. | Shot-based view files for trick play mode in a network-based video delivery system |
US11611803B2 (en) * | 2018-12-31 | 2023-03-21 | Dish Network L.L.C. | Automated content identification for binge watching of digital media |
US20230217073A1 (en) * | 2018-12-31 | 2023-07-06 | Dish Network L.L.C. | Automated content identification for binge watching of digital media |
US11917246B2 (en) * | 2018-12-31 | 2024-02-27 | Dish Network L.L.C. | Automated content identification for binge watching of digital media |
WO2020183080A1 (en) * | 2019-03-12 | 2020-09-17 | Orange | Method for managing the download of images associated with image jumps capable of being carried out during accelerated reading of multimedia content which is continuously broadcast |
Also Published As
Publication number | Publication date |
---|---|
EP3549338A4 (en) | 2020-05-20 |
WO2018102084A1 (en) | 2018-06-07 |
EP3549338A1 (en) | 2019-10-09 |
US10003834B1 (en) | 2018-06-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11431772B2 (en) | Skipping content of lesser interest when streaming media | |
US9113193B1 (en) | Video content item timeline | |
US20120185905A1 (en) | Content Overlay System | |
US11838604B2 (en) | Generating crowdsourced trailers based on forward or rewind commands | |
US10091549B1 (en) | Methods and systems for recommending media assets based on the geographic location at which the media assets are frequently consumed | |
US10003834B1 (en) | Enhanced trick mode to enable presentation of information related to content being streamed | |
US20230217049A1 (en) | Intelligent download of content | |
EP3707914B1 (en) | Enhanced playback bar | |
US9749700B1 (en) | Automatic display of closed captioning information | |
US10531138B2 (en) | Automatically and programmatically generating scene change markers | |
US10194209B2 (en) | Automatic display of closed captioning information | |
US20090328102A1 (en) | Representative Scene Images | |
US9363575B2 (en) | Method and apparatus for viewing instant replay | |
US11930226B2 (en) | Emotion evaluation of contents | |
US11616997B2 (en) | Methods and systems for trick play using partial video file chunks |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: ROKU, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:WOOD, ANTHONY;REEL/FRAME:041443/0785 Effective date: 20170215 |
|
AS | Assignment |
Owner name: SILICON VALLEY BANK, CALIFORNIA Free format text: AMENDED AND RESTATED INTELLECTUAL PROPERTY SECURITY AGREEMENT;ASSIGNOR:ROKU, INC.;REEL/FRAME:042768/0268 Effective date: 20170609 |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: MORGAN STANLEY SENIOR FUNDING, INC., MARYLAND Free format text: PATENT SECURITY AGREEMENT;ASSIGNOR:ROKU, INC.;REEL/FRAME:048385/0375 Effective date: 20190219 |
|
AS | Assignment |
Owner name: ROKU, INC., CALIFORNIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:SILICON VALLEY BANK, AS BANK;REEL/FRAME:048420/0841 Effective date: 20190222 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |
|
AS | Assignment |
Owner name: ROKU, INC., CALIFORNIA Free format text: TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 048385/0375);ASSIGNOR:MORGAN STANLEY SENIOR FUNDING, INC.;REEL/FRAME:062826/0001 Effective date: 20230221 |