EP2522133A1 - Echtzeit-benutzerschnittstelle auf flash-basis für medienwiedergabevorrichtung - Google Patents

Echtzeit-benutzerschnittstelle auf flash-basis für medienwiedergabevorrichtung

Info

Publication number
EP2522133A1
EP2522133A1 EP11732233A EP11732233A EP2522133A1 EP 2522133 A1 EP2522133 A1 EP 2522133A1 EP 11732233 A EP11732233 A EP 11732233A EP 11732233 A EP11732233 A EP 11732233A EP 2522133 A1 EP2522133 A1 EP 2522133A1
Authority
EP
European Patent Office
Prior art keywords
playback device
content
natively
application
user interface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP11732233A
Other languages
English (en)
French (fr)
Other versions
EP2522133A4 (de
Inventor
Bill Wagner
Brian Oberholtzer
Ramon Davila
Frederick F. Hermanson
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sonic IP LLC
Original Assignee
Divx LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Divx LLC filed Critical Divx LLC
Publication of EP2522133A1 publication Critical patent/EP2522133A1/de
Publication of EP2522133A4 publication Critical patent/EP2522133A4/de
Withdrawn legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/414Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/16Analogue secrecy systems; Analogue subscription systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00Digital computers in general; Data processing equipment in general
    • G06F15/16Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H04N21/4437Implementing a Virtual Machine [VM]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47202End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/482End-user interface for program selection
    • H04N21/4828End-user interface for program selection for searching program descriptors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6581Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application

Definitions

  • the present invention generally relates to consumer electronics devices and more specifically to consumer electronics devices configured to playback content accessed via the Internet.
  • One embodiment of the invention includes audio and video decoders, a natively implemented host process, a natively implemented virtual machine, a common client including natively implemented processes configured to coordinate playback of audio and video using the playback device ' s audio and video decoders, a VM framework configured to execute within the virtual machine and to enable scripts executing within the virtual machine to initiate playback of audio and video using the natively implemented processes, and a user interface implemented as a script configured to be executed within the virtual machine.
  • the natively implemented processes are also configured to locally cache URI objects
  • the VM framework is configured to intercept URI requests made by scripts executing within the virtual machine and to provide the URI requests to the natively implemented processes
  • the natively implemented processes are configured to verify that a requested URI object is not located within the local cache before requesting a URI object from a remote server.
  • the common client provides a runtime environment for applications deployed as a combination of a script configured to execute within the virtual machine and natively compiled code
  • the VM framework is configured to enable the application script to utilize the common client ' s natively implemented processes and the application ' s natively compiled code during execution of the application script within the virtual machine.
  • the user interface includes an Internet Content Guide identifying content on remote servers that can be played back by the playback device.
  • the Internet Content Guide also includes information concerning video player applications associated with content identified within the Internet Content Guide
  • the VM framework is configured to request at least one video player application in response to a user selecting a piece of content within the Internet Content Guide user interface for playback, where the Internet Content Guide indicates that the at least one video player application is utilized during the playback of the selected content
  • the natively implemented processes are configured to provide requested video player applications to the VM framework
  • the VM framework is configured to instantiate video player applications provided by the natively implemented processes and provide the Internet Content Guide with interface information
  • the Internet Content Guide user interface is configured to utilize video player interface information to coordinate content playback in conjunction with the video player application.
  • a content player application is requested.
  • an ad player application is requested.
  • the VM framework also instantiates a proxy player application.
  • the natively implemented processes include a Device Application process configured to retrieve information from remote servers and a Platform Services process configured to handle playback of audio and video using the playback device ' s audio and video decoders
  • the virtual machine is a Flash virtual machine implemented within a natively implemented Flash player
  • the VM framework is an ActionScript framework comprising a set of ActionScript classes
  • the Device Application process is configured to communicate with the ActionScript framework via the Flash player ' s XMLSocket capability.
  • applications are deployed on the common client as a SWF and a natively compiled plug-in to the Device Application process.
  • the Device Application process and application natively compiled plug-ins to the Device Application process are implemented as shared libraries.
  • the common client further includes an installer, and the common client is configured to provide a software platform and components of the common client can be dynamically loaded using the installer.
  • the virtual machine is a Flash virtual machine implemented within a natively compiled Flash player
  • the natively implemented processes includes a device application container configured to provide a set of services and APIs, and a platform runtime process configured to provide an abstraction layer between the playback device and the device application container
  • the VM framework includes a Ul application container configured to expose a set of APIs enabling a Flash application executing within the Flash virtual machine to communicate with an associated natively implemented module
  • the user interface is implemented as an application bundle including a SWF, and a natively compiled code module.
  • the user interface SWF is configured to communicate with the natively compiled code module via the Ul application container APIs, and the natively compiled code module is configured to implement the functionality of the user interface that is not provided by the Flash virtual machine using services and APIs provided by the device application container.
  • the application bundle further includes a manifest.
  • the installer is configured to dynamically load applications from a remote server, where the applications include a SWF, a natively compiled code module, and a manifest.
  • the installer is implemented in playback device ROM and the installer is configured to dynamically load the software platform into device memory.
  • the user interface includes an Internet Content Guide generated using a navigation hierarchy obtained by the user interface from a remote server.
  • the user interface is configured to enable navigation within the hierarchical ICG using arrow buttons on a controller.
  • the user interface is configured to enable navigation within the navigation hierarchy using a joystick on a controller.
  • An embodiment of the method of the invention includes obtaining a navigation hierarchy for an Internet Content Guide using the common client, displaying a user interface generated by a user interface application script executing within the virtual machine using the navigation hierarchy, receiving a user selection of a piece of content identified within the Internet Content Guide via the user interface, where the Internet Content Guide includes a unique identifier associated with the content, passing the unique identifier associated with the requested content to the common client ' s natively implemented processes using the VM framework, obtaining media identified by the unique identifier using the common client ' s natively compiled processes, and decoding the obtained media using the playback device ' s media decoder.
  • FIG. 1 illustrates a common client in accordance with an embodiment of the invention.
  • FIG. 2 illustrates deployment of an application implemented as a combination of a SWF and a natively compiled shared library to a common client in accordance with an embodiment of the invention.
  • FIG. 3 illustrates a common client configured to dynamically load a software platform and application bundles in accordance with an embodiment of the invention.
  • FIG. conceptually illustrates a natively compiled module of an application running within a software platform runtime environment provided by a common client and utilizing services and APIs provided by a natively compiled device application bundle in accordance with an embodiment of the invention.
  • FIG. 5 illustrates a process for requesting object URIs on a common client that locally caches content in accordance with an embodiment of the invention.
  • FIG. 6 illustrates communication between a Flash player, a natively implemented Platform Services process, and a Multimedia Framework in accordance with an embodiment of the invention.
  • FIG. 7 illustrates a system for loading applications onto a common client that includes an Internet Content Guide user interface in accordance with an embodiment of the invention.
  • FIG. 8 conceptually illustrates the loading of a video player application to playback content selected by a user within an Internet Content Guide user interface in accordance with an embodiment of the invention.
  • FIG. 9 conceptually illustrates the loading of a third party video player application to playback content selected by a user within an I nternet Content Guide user interface in accordance with an embodiment of the invention.
  • FIG. 10 conceptually illustrates the loading of content player proxy application in response to a user selecting content for playback using an Internet Content Guide user interface in accordance with an embodiment of the invention.
  • FIG. 1 1 conceptually illustrates a process for downloading a content player application to a common client from a remote server in accordance with an embodiment of the invention.
  • Virtual machines are software implementations of a programmable machine, where the software implementation is constrained within another processor at a higher level of symbolic abstraction.
  • a Flash VM is capable of playing back Small Web Format (SWF) files, which is a file format specified by Adobe Systems I ncorporated of San Jose, California for multimedia, vector graphics, and ActionScripts, and is also capable of decoding Flash Video, which is a container file format that can be used to deliver video over the Internet.
  • SWF Small Web Format
  • the Flash VM provides the capability of generating customized user interfaces.
  • playback devices in accordance with embodiments of the invention include natively compiled code that implements specific functionality including but not limited to communicating with external servers and playback of content.
  • the natively compiled code implements a local resource cache to improve the speed with which Flash applications load frequently utilized resources.
  • applications can be installed on the playback devices that are deployed as a combination of a SWF file and an associated plug-in or dynamically loaded module of native code.
  • content player applications can be installed on the playback device to enable playback of content and advertising associated with content, and the collection of metrics.
  • Flash players Flash VMs and SWF files.
  • any virtual machine capable of implementation on a consumer electronics device can be used in place of a Flash player/Flash VM. Therefore, the Flash player, Flash VM, SWF files, and ActionScript can be readily substituted with equivalent components associated with another virtual machine in accordance with embodiments of the invention.
  • Playback devices in accordance with embodiments of the invention typically take the form of televisions, set-top boxes, DVD/Blu-ray Disk players, mobile phone handsets or game consoles that combine Internet access capability with media playback hardware and/or software.
  • a common client is utilized by playback devices to generate a user interface, retrieve content for playback using the media playback hardware and/or software, and provide a runtime environment for applications. Provision of a common client reduces the amount of development effort involved in developing software for different playback devices, however, manufacturers typically desire that the user interfaces of their products have a different look and feel to the products of other manufacturers.
  • the common client includes the ability to create a customized user interface.
  • the common client includes a native implementation of a Flash VM and a user interface can be authored in Flash.
  • the common client can also include natively compiled code that enables the client to interact in real time with networked servers and handles playback of content using the media playback capabilities of the hardware and/or software of the playback device.
  • the natively compiled code creates a software platform runtime on which applications can be deployed as a combination of a SWF file and an associated plug-in or dynamically loaded module of native code.
  • any of a variety of techniques can be utilized to enable the creation of customized user interfaces in accordance with embodiments of the invention.
  • a playback device including a common client configured to display a custom user interface and to playback Internet content in accordance with an embodiment of the invention is illustrated in FIG. 1.
  • the playback device 10 includes hardware and an operating system, which handle content playback and communication via the Internet.
  • the operating system can be any operating system suitable for use on a consumer electronics device such as a Linux derivative.
  • the playback device also includes a Flash Player 62, which provides a natively compiled Flash VM that is capable of executing SWF files and playing back Flash Movies. Examples of suitable Flash players include MachBlue from Bluestreak Technology, Inc. of Montreal, Canada and Stagecraft (Flash Lite) from Adobe Systems Incorporated of San Jose, California.
  • the Flash VM can be utilized to create a user interface, including but not limited to an ICG that can be used to access Internet content, and to execute applications on the playback device.
  • a significant aspect of the common client illustrated in FIG. 1. is that the operation of the Flash VM is enhanced by natively compiled applications/processes.
  • the operation of the Flash VM is enhanced using the natively compiled Device Application 14 and Platform Services 16, which are compiled as binaries and implement functionality that would be too slow or technology constrained if run through the Flash VM and/or implemented in ActionScript.
  • the functionality of the Device Application and Platform Services are discussed further below as examples of the manner in which natively compiled code can be utilized to implement functionality outside of the Flash VM that can be utilized by SWF files executing within the Flash VM.
  • the natively compiled Device Application 14 efficiently implements processes for retrieving information from remote servers used in the construction of a user interface, including but not limited to obtaining a navigation hierarchy used to generate an ICG including hierarchical paths that a user can traverse to select content for playback using a unique identifier associated with the content by the ICG (such as but not limited to a URI).
  • the Device Application 14 implements functionality such as the ability to write to a file-system and to asynchronously communicate with a Flash application user interface using the Flash XMLSocket capability built into a Flash VM.
  • the primary functions of the natively compiled Platform Services 16 is to provide support for handling media playback functionality using the media playback capabilities of the hardware and/or software of the playback device.
  • the Platform Services includes a Mulimedia Framework subsystem that handles streaming, demultiplexing, decoding and playback control of content in a variety of formats including the DivX® and DivX Plus® formats specified by DivX, Inc. of San Diego, CA.
  • the Platform Services can also include a Local Content Caching subsystem that reduces latency in loading user interface components of the device user interface, or application user interfaces.
  • the Local Content Caching subsystem can also be used to pre-load content and advertising to decrease playback latency.
  • the Platform Services can handle a variety of other functions including managing applications and device security, and coordinating playback of DRM protected content.
  • Flash applications can execute within the Flash VM that can utilize the functionality provided by the Device Application 14, and Platform Services 16.
  • Flash applications including the device user interface 20 tie into the Device Application 14, and the Platform Services 16 through an ActionScript Framework, which is a set of ActionScript classes.
  • the ActionScript Framework is implemented as a SWF file and applications, widgets, players, and app extensions are also deployed as SWFs and are loaded into the ActionScript Framework SWF.
  • applications for playback devices in accordance with embodiments of the invention are deployed as a combination of Flash applications and Device Application plug-ins.
  • Applications deployed as Flash applications with associated shared libraries to a common client similar to the common client described above in accordance with an embodiment of the invention are illustrated in FIG. 2.
  • the plug-ins 23 associated with an application 24 also can be deployed as shared libraries.
  • user interface components 24 for such applications are dependent on the Device Application-deployed plug-ins 23 for the same application, not the other way around.
  • alternative techniques can be utilized to load native code into the common client to provide a Flash application with additional functionality beyond the capabilities of the Flash VM.
  • FI G. 1 utilizes a specific configuration involving a Flash VM , ActionScript Frameworks, Device Applications, and Platform Services to implement a User Interface and support applications
  • the functions performed by these components can be performed in a variety of ways.
  • Common clients that support applications deployed as a combination of a SWF file and associated natively compiled code to perform functionality beyond the capabilities of the Flash VM can be implemented in any of a variety configurations in accordance with embodiments of the invention.
  • a common client where the playback device dynamically loads a natively compiled software platform to provide an application runtime environment in which similar functions to the functions performed by the Device Application and Platform Services are performed by the Software Platform Runtime and a Device Application Container, in accordance with an embodiment of the invention is discussed further below.
  • FIG. 3 A consumer electronics device on which a common client is installed that dynamically loads a software platform and applications in accordance with an embodiment of the invention is illustrated in FIG. 3.
  • the common client 10 ' includes a natively implemented Flash player and a natively compiled software platform that implements functions that would be too slow or technology constrained if run through the Flash VM and/or implemented in ActionScript.
  • the software platform of the common client 10 ' shown in FIG. 3 and the applications supported by the software platform can be dynamically loaded and updated. Enabling the software platform to be dynamically loaded reduces the amount of native code stored in the playback device ' s ROM and enables the dynamic addition of applications and user interface components when adding additional device services and features.
  • the dynamic loading of software platforms and application is discussed in U.S. Provisional Application No. 61/430,135 the disclosure of which is incorporated by reference above.
  • the common client 10 ' includes the installer 26 and the host application 25.
  • the components of the dynamically loaded software platform include the components of the natively compiled device application process 30, which include a device application container 32 and a platform runtime process 34.
  • a Ul application container 37 is loaded into the Flash VM 36 of the consumer electronic device. Flash applications including the device user interface are loaded onto the playback device as application bundles 40 that can include a Flash application module 41 , a natively implemented device module 42 that implements functionality complementing the Flash VM and an application manifest file 43 describing the content of the bundle and its configuration details.
  • the common client also natively implements a Webkit web browser 38 and the application bundles can include HTML 5 applications.
  • the device application container 32 provides a set of services and APIs that can be reused by various device user interface implementations and that allow developers to write native device modules that can be loaded and executed as part of the application bundles.
  • the manner in which a device module 42 can utilize APIs and services in the device application 32 to perform functions outside of the Flash VM in accordance with embodiments of the invention is illustrated in FIG. 4.
  • the Ul application container 37 is configured to run inside the Flash VM to allow application bundles to run a user interface that is integrated into the main user interface loaded as part of the software platform.
  • the Ul application container can also expose a set of services and APIs that allow an application bundle to leverage the capabilities of the device application container 32.
  • the platform runtime process 26 presents an abstraction layer for specific device functionality to applications running on the software platform.
  • the abstraction layer presented by the platform runtime process 26 and the services and APIs provided by the device application container 32 enable the natively encoded device modules utilized in each application bundle to be written using only a very small amount of native code. Therefore, the effort required to port and maintain applications can be significantly reduced.
  • the ability to dynamically load application bundles means that the natively encoded portion of a bundle and/or the natively encoded portions of the underlying software platform can be readily updated by simply fetching the latest version of the application and/or software platform component from an update server.
  • common clients can be implemented in a variety of ways in which a natively implemented Flash player/Flash VM is enhanced by natively compiled applications/processes.
  • Applications that are loaded onto a common client implemented in this manner are not limited to the functionality provided by the Flash VM and/or the functionality that can be implemented using ActionScript. Instead, applications can implement additional functionality natively and access the additional communication and media playback functionality provided natively by the common client.
  • the implementation of various applications, including device user interfaces, and the manner in which common clients in accordance with embodiments of the invention utilize natively implemented applications/processes to handle requests by the applications to download and playback media are discussed further below.
  • the common clients described above include natively implemented processes that efficiently implement functionality that either cannot be performed or cannot be performed efficiently on the natively implemented Flash VM using ActionScript.
  • Functions that are commonly performed using local processes include the playback of media and communication with remote servers. These functions are discussed below in the context of various applications including an Internet Content Guide (ICG) user interface.
  • ICG Internet Content Guide
  • Common clients in accordance with embodiments of the invention can utilize the Flash VM and natively implemented code to create customized user interfaces.
  • the playback device ' s Internet connection provides access to metadata, often in the form of a navigation hierarchy that can be utilized to generate an Internet Content Guide (ICG) user interface, which can be used to access content on remote sites.
  • ICG Internet Content Guide
  • the user interface is hierarchical and only contains listings for content capable of being played back by the playback device. Due to the hierarchical nature of the user interface, the user can navigate the ICG using arrow buttons or a joystick on a remote control or game controller.
  • the information contained in the user interface can be utilized to retrieve content via the Internet from the appropriate content site for playback using the media playback hardware and/or software of the playback device.
  • the generation of ICGs is described in U.S. Patent Application No. 12/985,222, entitled " Systems and Methods for Accessing Content Using
  • Caching Internet content on the playback device can improve the performance of Flash applications. Therefore, many playback devices in accordance with embodiments of the invention utilize Local Content Caching.
  • the playback device can then use the cached content to reduce access time and optimize network traffic.
  • local content caching is implemented using a custom URI handler within the Flash VM that intercepts and redirects URI requests to a natively implemented Cache Manager process.
  • the URI interception and redirection can be implemented using a modified HTTP client.
  • the Cache Manager can set up access to cached data by loading cached data (if any) from persistent storage into a memory pool used to maintain a runtime cache.
  • the Cache Manager can then handle URI request redirected from Flash applications by searching the Local Cache for the corresponding URI object. In the event that the URI object is not locally cached, the Cache Manager can initiate a HTTP request to obtain the URI object. The Cache Manager can also manage the refreshing of expired items within the cache (i.e. cached objects with timestamps that indicate they are unreliable).
  • FIG. 5 A process for managing a local content cache on a playback device, which retrieves content via HTTP Get requests, in accordance with an embodiment of the invention is illustrated in FIG. 5.
  • the process 60 commences when a URI request is received and the cache is queried (62). When the URI object is not found , a HTTP GET Request is made (64) to obtain the U RI object. The HTTP response is then stored (66) in the cache and the process returns (68) the URI object for use by the Flash application that made the original URI request. When the requested URI object is found within the cache, the freshness of the URI object is checked (70) to determine whether the cached URI object is reliable. In the event that the URI object is fresh, the cached URI object is returned (68).
  • a validation step is performed wherein the server is queried (72) via HTTP to check if the cache entry is sill valid or not. If the data has been modified since the URI object was cached, then a HTTP GET request is made (64). Otherwise, the cached URI object is returned (68).
  • Any of a variety of techniques can be utilized to select content to store in the cache.
  • requested content is added to the cache.
  • the state of the user interface is used to pre-fetch content that is likely to be required based upon the navigation options presented by the user interface.
  • cached content has an associated age and/or priority that can be used in selecting content to overwrite when adding new content to the cache.
  • restrictions are placed upon the content that can be stored in the cache including but not limited to restrictions based upon the type of the content, the size of the content, and/or the age of the content.
  • User interfaces implemented on common clients in accordance with many embodiments of the invention enable a user to select content for playback, which is typically achieved using natively implemented processes that coordinate the demuxing, decryption , decoding and rendering of multimedia content.
  • the natively implemented processes that handle these functions can be referred to as the common client ' s Multimedia Framework.
  • the Multimedia Framework receives a URI or URL for playback from an application running within the Flash VM.
  • the Multimedia Framework utilizes the playback device ' s media playback resources to achieve media playback.
  • communication between the Flash VM and the Multimedia Framework is mediated by the Platform Services, which handles communication between the Flash VM and a variety of playback device resources.
  • FIG. 6 A sequence diagram showing communication between a Flash VM, Platform Services, and a Multimedia Framework during playback of content in accordance with an embodiment of the invention are illustrated in FIG. 6.
  • the Flash Player provides a URI to the Platform Services process and the Platform Services module provides an instruction to the Multimedia Framework to open the URI.
  • a similar sequence of communications instructs the Multimedia Framework to play the media identified by the URI.
  • the Media Framework Upon the completion of the playback of the media indicated by the URI, the Media Framework provides notification to the Platform Services that playback is complete and the Platform Services provides an XML message to the Flash application that playback is complete.
  • FIG. 6 Although a specific sequence of communications and processes is illustrated in FIG. 6, other communication techniques appropriate to a specific playback device and specific natively implemented processes can also be implemented in accordance with embodiments of the invention.
  • a playback device configured to obtain ICG metadata from a remote server, playback content from content servers, and retrieve Flash applications from remote servers in accordance with an embodiment of the invention is illustrated in FIG. 7.
  • the system 100 includes at least one playback device 102, which includes a common client similar to the common clients described above and is configured to playback content that is accessible locally or at content sites 104 via the Internet 106.
  • Each playback device 102 retrieves navigation hierarchy information from a content metadata database that is part of a metacenter 108 via the Internet and uses the retrieved information to generate an I CG that is navigable with the playback device ' s controller.
  • the metacenter is one or more servers that are configured to manage the collection of content metadata within the content metadata database and the communication of navigation hierarchies to playback devices.
  • the metacenter 108 constructs the content metadata database by obtaining metadata concerning content available from a number of content sites 104.
  • the collection of metadata by metacenters is more fully described in U.S. Patent No. 12/985,222, entitled “ Systems and Methods for Accessing Content Using an Internet Content Guide " , filed January 5, 201 1 , the disclosure of which is incorporated by reference above.
  • the playback device can also obtain Flash applications from the Appcenter 1 70, which can be provided in the cloud.
  • the applications can provide any functionality capable of execution on the playback device and may be provided by 3 rd parties ( 1 72).
  • a variety of architectures can be utilized to enable playback devices to download applications in accordance with embodiments of the invention.
  • applications that require capabilities beyond those offered by the Flash VM can be deployed as a combination of a SWF and native code (including but not limited to a plug-in or a dynamically downloaded module).
  • SWF Secure Digital
  • native code including but not limited to a plug-in or a dynamically downloaded module.
  • a variety of applications can be implemented in the manner outlined above.
  • content players and ad players are discussed further below.
  • Playback devices include applications that enable the playback of content and associated advertising.
  • An ICG can be built in accordance with the processes described in U.S. Patent No. 12/985,222.
  • the ICG can include information concerning content located on a content site and advertising associated with the content.
  • the playback device can retrieve the information concerning the content and the advertising and present both the content and the advertising to the viewer.
  • advertising player applications can be used to present additional advertising specific to the playback device and/or operator of the ICG. Applications can also collect metrics concerning the advertising presented on the playback device and/or other aspects of the operation of the playback device.
  • the a variety of videos player applications can be loaded by a common client in accordance with embodiments of the invention including but not limited to ad players, content players, and metric players.
  • the terms video player or video player application are generic terms describing one or more player applications of different types that are used to integrate a content provider ' s video content for playback on a common client in accordance with embodiments of the invention.
  • the term can also be used to describe a set of players working together (ad, cont and/or metric players).
  • video player is used, a video player can play any type of content.
  • ad player can be used to describe a video player that interacts with an ad service on the back end to associate advertising to videos being viewed.
  • a content player is a video player that is focused on the rendering of actual video content.
  • a site may require a specific content player (e.g. video, music or photo), ad player, and metric player.
  • a given content, ad, or metric player can be used by more than one site and there may be more than one of each type of player associated with a specific content site.
  • the players are typically loaded by the portion of the common client resident within the flash VM (e.g. an ActionScript Framework or Ul container).
  • the interaction between the playback device ' s default content player and the additional players loaded into the Flash VM can be specified as business rules.
  • Functional components of a video player infrastructure, where a generic content player is utilized on a playback device in accordance with an embodiment of the invention are illustrated in FIG. 8.
  • the device ' s ICG user interface (IVN) 204 is loaded by an application loader process 204 that forms part of the Flash framework of the common client.
  • the ICG application can launch a generic content player application 206 and pass information to the generic content player needed to load additional content player applications (208, 210).
  • Additional components are typically described with a unique ID, a URL to the module that contains the component, and the type of player application in the package.
  • the ad player 208 implements an ad player interface and the metric player 210 implements a metric player interface.
  • the content players expose an Ad Callback interface that is used by ad players to inform the content player 206 when ads of various types should be displayed.
  • the common client ' s user interface can expose a player callback interface that is used by the content player application 206 to send events to the user interface application such as ad display messages (banner, pre-roll, mid-roll, and post-roll) and content status messages and metadata found inside content.
  • the common client Flash framework also allows use of content-specific content player applications.
  • the functional components of a the video players called when an ICG user interface receives a user instruction to playback content with which a custom content player application is associated, in accordance with an embodiment of the invention is illustrated in FIG. 9.
  • the custom content player application 212 includes an ad player 208 and a metric player 210.
  • advertising that is not associated with the content can also be displayed by the playback device and metrics can be collected by the playback device. Additional advertising and metric player applications can be utilized by the playback device for this purpose and the device ' s user interface can make calls to the required players directly.
  • the ICG user interface 206 calls a content player proxy application 214, which calls the common client ' s metric player application 21 6, and a content player application 216.
  • the proxy 214 can call either the common client ' s content player application or a 3 rd party content player application.
  • Third party ad and metric player applications (208, 210) can also be called.
  • the players (video, ad, and metric) to be activated for particular content are determined by information associated with that content.
  • the ICG data for particular content is obtained by the ICG user interface.
  • the ICG user interface application loads the needed content player using the common client Flash framework.
  • FIG. 1 1 A process for launching players in accordance with embodiments of the invention is illustrated in FIG. 1 1 .
  • the ICG user interface application 206 is launched and receives ICG information from a remote server, including information identifying player applications for playing back particular content.
  • the ICG user interface application 206 utilizes the application loader 204 within the common client Flash framework 202 to request the appropriate player application(s).
  • a content player application 208 is requested.
  • the application loader 204 responds to the request by issuing a request to load the content player 208 using a URL received as part of the request from the ICG user interface application 206.
  • the local resource cache 230 is checked to determine whether the content player 208 is cached. In the event that the content player 208 is not cached, the content player is loaded from an application server 1 70 and cached.
  • the application loader 204 instantiates the requested content player 208 and returns an interface to it back to the ICG user interface application 206, which can then interact with the instantiated content player.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • Computer Hardware Design (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)
EP11732233.9A 2010-01-07 2011-01-07 Echtzeit-benutzerschnittstelle auf flash-basis für medienwiedergabevorrichtung Withdrawn EP2522133A4 (de)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US29318010P 2010-01-07 2010-01-07
US33559210P 2010-01-07 2010-01-07
US201161430135P 2011-01-05 2011-01-05
PCT/US2011/020580 WO2011085249A1 (en) 2010-01-07 2011-01-07 Real time flash based user interface for media playback device

Publications (2)

Publication Number Publication Date
EP2522133A1 true EP2522133A1 (de) 2012-11-14
EP2522133A4 EP2522133A4 (de) 2013-05-22

Family

ID=44352265

Family Applications (1)

Application Number Title Priority Date Filing Date
EP11732233.9A Withdrawn EP2522133A4 (de) 2010-01-07 2011-01-07 Echtzeit-benutzerschnittstelle auf flash-basis für medienwiedergabevorrichtung

Country Status (9)

Country Link
US (1) US8631407B2 (de)
EP (1) EP2522133A4 (de)
JP (1) JP2013516923A (de)
KR (1) KR20120123405A (de)
CN (1) CN102907110A (de)
AU (1) AU2011203963A1 (de)
CA (1) CA2786609A1 (de)
MX (1) MX2012008023A (de)
WO (1) WO2011085249A1 (de)

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102907110A (zh) 2010-01-07 2013-01-30 迪维克斯公司 用于媒体回放装置的基于实时Flash的用户界面
JP5730914B2 (ja) * 2010-03-05 2015-06-10 ブラス・モンキー・インコーポレイテッドBrass Monkey,Inc. Webブラウザにおける双方向通信および内容制御のシステムおよび方法
US8799647B2 (en) 2011-08-31 2014-08-05 Sonic Ip, Inc. Systems and methods for application identification
US20130055255A1 (en) * 2011-08-31 2013-02-28 Rovi Technologies Corporation Systems and methods for common application platforms utilizing shared services
JP5821631B2 (ja) * 2011-12-28 2015-11-24 富士通株式会社 再生装置、再生方法、及び再生プログラム
US9507748B2 (en) * 2012-04-26 2016-11-29 Hewlett Packard Enterprise Development Lp Platform runtime abstraction
US9489471B2 (en) * 2012-06-29 2016-11-08 Dell Products L.P. Flash redirection with caching
US9354764B2 (en) 2012-06-29 2016-05-31 Dell Products L.P. Playback of flash content at a client by redirecting execution of a script by a flash redirection plugin at a server to a flash redirection browser at the client
US9626450B2 (en) * 2012-06-29 2017-04-18 Dell Products L.P. Flash redirection with browser calls caching
US9491222B2 (en) * 2013-03-13 2016-11-08 Nice-Systems Ltd. System and method for interoperability between flex applications and .NET applications
CN103200462B (zh) * 2013-03-23 2015-12-02 四三九九网络股份有限公司 一种swf文件的视频播放方法
KR101499327B1 (ko) * 2013-05-31 2015-03-18 주식회사 유비온 플래쉬 기반 스마트 러닝 컨텐츠의 재생장치
US8788703B1 (en) 2013-08-05 2014-07-22 Iboss, Inc. Content caching
US8972513B2 (en) * 2013-08-05 2015-03-03 Iboss, Inc. Content caching
US10028002B2 (en) 2013-12-16 2018-07-17 Samsung Electronics Co., Ltd. Server device for sharing contents, client device, and method for sharing contents
US9965783B2 (en) * 2014-02-07 2018-05-08 Uber Technologies, Inc. User controlled media for use with on-demand transport services
CA2942339C (en) 2014-03-13 2022-06-07 Uber Technologies, Inc. Configurable push notifications for a transport service
US10198245B1 (en) * 2014-05-09 2019-02-05 Audible, Inc. Determining hierarchical user interface controls during content playback
US9536271B2 (en) 2014-05-16 2017-01-03 Uber Technologies, Inc. User-configurable indication device for use with an on-demand transport service
US9892637B2 (en) 2014-05-29 2018-02-13 Rideshare Displays, Inc. Vehicle identification system
US10467896B2 (en) 2014-05-29 2019-11-05 Rideshare Displays, Inc. Vehicle identification system and method
US10325442B2 (en) 2016-10-12 2019-06-18 Uber Technologies, Inc. Facilitating direct rider driver pairing for mass egress areas
US10355788B2 (en) 2017-01-06 2019-07-16 Uber Technologies, Inc. Method and system for ultrasonic proximity service
CN110147512B (zh) * 2019-05-16 2022-12-20 腾讯科技(深圳)有限公司 播放器预加载、运行方法、装置、设备及介质

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030084120A1 (en) * 2001-06-15 2003-05-01 Paul Egli Software framework for web-based applications

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7200357B2 (en) 2000-10-20 2007-04-03 Universal Electronics Inc. Automotive storage and playback device and method for using the same
US20020156909A1 (en) * 2001-02-15 2002-10-24 Harrington Jeffrey M. System and method for server side control of a flash presentation
EP1361759A1 (de) * 2002-05-10 2003-11-12 Canal+ Technologies Société Anonyme System und Verfahren zur Bereitstellung von Medieninhalt
US20070192818A1 (en) * 2004-10-12 2007-08-16 Mikael Bourges-Sevenier System and method for creating, distributing, and executing rich multimedia applications
US20070074258A1 (en) * 2005-09-20 2007-03-29 Sbc Knowledge Ventures L.P. Data collection and analysis for internet protocol television subscriber activity
JP2008197928A (ja) * 2007-02-13 2008-08-28 Good House:Kk 動画内蔵プログラム
CN102907110A (zh) 2010-01-07 2013-01-30 迪维克斯公司 用于媒体回放装置的基于实时Flash的用户界面

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030084120A1 (en) * 2001-06-15 2003-05-01 Paul Egli Software framework for web-based applications

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
"Creating an XML Slideshow in Flash", , 22 April 2009 (2009-04-22), pages 1-5, XP055059514, Retrieved from the Internet: URL:http://republicofcode.com/tutorials/flash/as3xmlvideoplayer/ [retrieved on 2013-04-12] *
"The HAVi Specification: Specification of the Home Audio/Video Interoperabilty (HAVi) Architecture", HAVI SPECIFICATION, XX, XX, 19 November 1998 (1998-11-19), pages 1-384, XP002116332, *
See also references of WO2011085249A1 *

Also Published As

Publication number Publication date
KR20120123405A (ko) 2012-11-08
CN102907110A (zh) 2013-01-30
WO2011085249A1 (en) 2011-07-14
MX2012008023A (es) 2013-01-28
CA2786609A1 (en) 2011-07-14
EP2522133A4 (de) 2013-05-22
AU2011203963A1 (en) 2012-08-02
JP2013516923A (ja) 2013-05-13
US20110258623A1 (en) 2011-10-20
US8631407B2 (en) 2014-01-14

Similar Documents

Publication Publication Date Title
US8631407B2 (en) Real time flash based user interface for media playback device
JP5781497B2 (ja) 拡張可能なメディア形式を持つホスト型アプリケーションプラットフォーム
KR101420943B1 (ko) 웹 미디어 자산 식별 시스템 및 방법
US9485305B2 (en) API platform that includes server-executed client-based code
US8151004B1 (en) File processing to accelerate image viewer initialization
US8938674B2 (en) Managing media player sound output
US20070192818A1 (en) System and method for creating, distributing, and executing rich multimedia applications
US8161275B1 (en) Configuring media player
KR20160021235A (ko) 콘텐츠를 프리 렌더링 및 프리 페치하기 위한 방법 및 시스템들
WO2012163123A1 (zh) 一种应用的管理方法和一种应用平台
WO2012109568A1 (en) System and method for using an application on a mobile device to transfer internet media content
JP2005513621A (ja) マルチメディア用パブリッシングシステム、ワイヤレス装置用メディアプレーヤー、およびパブリッシングシステム
JP2012506077A (ja) 電子配信のためのコンテンツ・パッケージ
US9417851B2 (en) Location-based application development for runtime environments
US20180011991A1 (en) Secure connected digital media platform
CN101978674A (zh) 用于显示由客户端生成的信息的方法
US20130055255A1 (en) Systems and methods for common application platforms utilizing shared services
KR101078603B1 (ko) 멀티미디어 서비스를 위한 플랫폼, 스마트 카드 및 방법
KR101709145B1 (ko) 문맥 관련 광고 전달 및 디스플레이용 플랫폼 독립 시스템
US11700435B2 (en) Systems and methods of universal video embedding
WO2009102522A1 (en) Efficient compression of applications
CN117615215A (zh) 一种插件应用运行方法以及装置
CN117407027A (zh) 一种电视应用更新方法以及装置
CN117412129A (zh) 一种电视应用运行方法以及装置
Michéle et al. Media Playback System

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20120712

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20130423

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SONIC IP, INC.

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SONIC IP, INC.

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20150801