JP2008544412A - Apparatus, system, method, and product for automatic media conversion and generation based on context - Google Patents

Abstract

Embodiments provide automatic media generation or other conversion of media input (including value enhancement) for delivery to user devices in a device-independent manner. The conversion process is further automatically enhanced in value based on the context information. Context information provides customized content value enhancement to media delivered to user devices. Contextual information is automatically integrated with the converted and generated media, providing highly customized high quality media content delivery in a device-independent manner.

Description

(Citation of related application)
This application is assigned to the same assignee as the present application and is incorporated herein by reference in its entirety. The benefit of US Provisional Patent Application No. 60 / 693,381 entitled “BASED MEDIA TRANSFORMATION AND GENERATION” is S. C. Claim under section 119 (e).

(Technical field)
The present application relates generally to media distribution over a communication network, and more particularly, but not exclusively, to media generation and transformation for distribution to client devices over a communication network.

  Various forms of media format conversion are currently available on the market. For example, many companies routinely use speech recognition systems for telephones to enter data into customer service server-side applications that process In order to do this, the voice data is converted into text data. Media conversion techniques include, but are not limited to, text to audio conversion, image to 3D rendering, and image to video conversion. Various techniques for customizing data according to device capabilities for distribution to various user devices are also known in the prior art. For example, based on some information typically provided by the requesting device, the data is modified in the server-side application for various display and audio capabilities before delivery to the client device. It is known. Examples include modifying web content for a mobile phone or PDA size display versus a full size PC display.

  However, such basic media, particularly in the current environment, where user demands are increasing for a variety of different types of media content that can be easily delivered to a variety of different types of client devices. Much remains to be desired in format conversion and media conversion techniques. Such media format conversion and media conversion techniques are too basic to meet the needs of users with technical knowledge to maximize the benefits of various user devices and Too rudimentary.

  In accordance with one aspect, a method obtains first data, analyzes the first data to obtain context information therefrom, and obtains a context to determine second data. Using the information, supplementing the first data with the determined second data to obtain the transformed data, and delivering the transformed data to at least one client device And including.

  Embodiments that are not intended to be limiting and are not exhaustive will be described with reference to the following drawings. The same reference numbers refer to the same parts throughout the various figures unless otherwise specified.

  Embodiments for automatic media conversion and generation based on context are described herein. In the following description, numerous specific details are given to provide a thorough understanding of the embodiments. However, one of ordinary skill in the art appreciates that the embodiments may be practiced without one or more of the specific details, or with other methods, components, materials, and the like. In other instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring aspects of the embodiments.

  Reference to “one embodiment” or “an embodiment” throughout this specification includes that the particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment. Means that. Thus, the appearances of the phrases “in one embodiment” or “in an embodiment” in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

  As previously mentioned above, there are some prior art approaches to media format conversion and media conversion. However, in the prior art, there are no systems or methods introduced to provide automated media generation or conversion for simultaneous multiple media inputs and device outputs. In particular, there are no systems and methods available to provide media conversion and media value enhancement based on context parameters.

  Overall, the embodiments are for automatic media generation or other conversion (including value enhancement) of multiple media input formats for delivery to user devices in a device-independent manner. Provide a system. In one embodiment, the conversion process is further automatically valued based on the context information. The context information provides customized media value enhancement to all media delivered to the user device. The contextual information is automatically integrated with the converted and generated media, providing a highly customized delivery of high quality media content in a device-independent manner.

  FIG. 1 illustrates a first system 10 for implementing embodiments. FIG. 1 has multiple media inputs (101, 102, 103, etc.) and customized media outputs (111, 121, 131, etc.) to feed one or more user devices (110, 120, 130, etc.) 1 shows an automated media customization system 100. Input media (101, 102, 103, etc.) can be, for example, audio, video, 3D rendering, graphics, Internet / web content, live audio or video, files, stock trading values, videos such as news and weather forecasts Or it can take any shape like text programs, satellite images, and sports programs.

  Various media inputs (101, 102, 103, etc.) to the media customization system 100 may include content such as media created by end users such as text messages, voice messages, images, and audio clips. Media input may include preset list information such as certain text messages, avatars or other image representations, images, and themes. Media input is provided by third party information services such as news programs, weather forecasts, sports headlines, and stock trading values, for example. It will be appreciated that media types / formats other than those specifically described herein may be included in the media input (101, 102, 103).

  Embodiments of the automated media customization system 100 can provide on-the-fly format conversion for various media inputs (101, 102, 103, etc.) and can generate media based on contextual parameters, In combination with input media, each user device forms a respective customized media output (111, 121, 131, etc.) and / or one or more devices (110, 120, 130, etc.) More than one media output may be received.

  In accordance with an embodiment, a client device user may select media delivery preferences for more than one destination client device (110, 120, 130, etc.). System 100 may be deployed as a stand-alone client technology or a combination of server-client technologies. In one embodiment, customized media is generated on a server (eg, media customization system 100 is located on the server) and distributed to devices (110, 120, 130, etc.). It is also possible to generate some or all media at the device (110, 120, 130, etc.) based on instructions and data from the media customization system 100. Media generation is optimized to use the resources available to individual user accounts and the components available in the media customization system.

  The context component 107 of one embodiment determines context information and / or integrates context elements into a quality enhanced media format for delivery to client devices. For example, contextual information may be preset or derived based on a number of factors including application type, media type, client device location, end user input, and end user demographics. The resulting context-enhanced media and / or other quality-enhanced media can be generated by the media generation component 106 to match the capabilities of the client device or the factors listed above. . In one embodiment, media generation component 106 and context component 107 may comprise the same component.

  In one embodiment, the context component 107 includes input for a context, such as user input preferences sent from the client device or context data, which includes service request history, location data, charges Derived from user account data such as billing data, applied demographic data, user geography / location data, etc., the user account data is stored in the customer information database 109 or other storage unit. , The customer information database 109 or other storage unit may be separated from or integrated into the media customization system 100. In one embodiment, other contextual elements can be determined by decomposing the media input by contextual component 107 and parsing the content, and then represent emotions in text and speech, such as voice inflection and emoticons. Use any determined contextual elements, such as elements, and location-based contexts, such as rain sound for rainy weather forecasts, to generate a new customized media.

  In an embodiment, the media customization system 100 includes a transcoding component 105 and is optimized for the status of these devices and / or channels for delivery to devices (110, 120, 130, etc.). Then convert the media. For example, the transcoding component 105 may be configured to optimize the media based on characteristics of the client device that receives the media and / or based on the channel conditions of the client device, The encoding format, color format, or other parameters related to the media being delivered can be changed dynamically, and they can be changed throughout the communication session. Examples of techniques and modules that can be used by the transcoding component 105 are assigned to the same assignee as the present application and are incorporated herein by reference in their entirety as “COMPUTER PROGRAM PRODUCT FOR” filed on Feb. 10, 2000. No. 09 / 502,390 entitled “TRANSFORMING STREAMING VIDEO DATA”.

  The system 100 obtains various media inputs and then converts based on the contextual information or generates customized media of different or the same media type. The customized data can then be delivered to client devices having video display and / or audio capabilities. Delivery mechanisms include, but are not limited to, streaming, email, MMS, WAP, PUSH, and download links. Distribution channels include, but are not limited to, wireless and wired networks, and cable assisted upload channels.

  2 and 3 illustrate another embodiment for the system 100 of FIG. For example, FIG. 2 shows a media transcoding system (or other conversion system) 200 in which the context component 107 includes a media generation component 106. Further, in embodiments, the user information database 109 may include information regarding device capabilities, and alternatively or additionally, may include information regarding user information or other information. As shown by way of example in FIG. 2, various client devices may include a cellular phone 210, a wireless device 220 (such as a PDA or BlackBerry), a laptop 230, and the like.

  The user information database 109 in one embodiment may include preferences and user history. The user can select an avatar or customize the avatar or other image display, and that information can be stored either in the client device or in the user information database 109. For example, a user may want a predetermined avatar, such as a “Maria Bartiromo” avatar or a “Larry Kudlow” avatar, to deliver stock price news on those client devices. Users can also provide digital photos for use as the basis for new custom avatars. As mentioned above, the user information database 109 may also include a device capability database that associates media performance with specific user accounts. If the user has more than one device, the MIN, SID or other device identification code may be cross-referenced and determined on the fly based on the request for service from the device.

In accordance with various embodiments, one or more processes are included:
The first process analyzes the input media by applying the media generation component 106 and the context component 107 to derive various contextual characteristics, eg, other information and contextual information that can be input from the database 109. Combine. The media customization system of FIGS. 1-3 is configured to provide audio analysis, text analysis, video analysis, image analysis, location-based information analysis, user demographic analysis, and user behavior history analysis. Yes.

  The second process uses the characteristics determined by the analysis and other information such as user preferences and device capabilities to deliver this information to the client device in a way that appeals and stimulates the new and Or generating a modified media type. The resulting customized output media may include images, 3D animations, 2D animations, video and audio, video only, and audio only outputs, as well as various other media output types. As new features become available, the customized media content can be adapted and updated. Embodiments feature customized media from raw media input based on intelligent automatic decomposition, analysis and generation (if appropriate) of media customized to the user / device based on contextual parameters It is a reconstruction.

  One feature of the system is an “intelligent” media generation and conversion or other intelligent conversion application. The intelligent generation and transformation elements of the system provide services such as acquiring raw media data sources and automatically converting raw media data sources into 3D avatar video or other image display To do. Each application in the system shares a certain amount of common functionality. For example, underlying implementation technology components such as text-to-speech conversion, audio-to-video conversion, 3D server-side rendering, 3D client-side rendering, and 3D-to-video encoding.

  In order to assemble a customized media output, several contextual components, eg templates, are applied by the embodiment (see, eg, contextual component 307 in media customization system 300 of FIG. 3). Context-specific media placement template 337 may be used to define the placement of media in the avatar's video clip; for example, template 337 places the weather map in the background and the avatar on the left side toward the screen. Can do.

  A context-specific media animation template 347 may also be used to define a time-course animation flow, such as a voice-to-video transition, and an application screen general flow, for example. The template 347 shows, for example, a splash screen, a weather map in the middle of the screen of the device that communicates the weather, moving the weather forecaster to the left, and associating the weather map with a 24-hour forecast audio feed. It may be configured to guide the composition of the moving image according to the order of: A context-specific database 317 referenced to a user information database can also be used for media objects and text-to-speech conversions to match events to media objects in the scene.

  The context component 307 may include, for example, a context media generation engine 327 that has the role of scene generation and video generation. In one embodiment, the “intelligent” context media generation engine 327 first obtains input media and optionally obtains user preferences and uses information stored in the user database 109. , Determine which media assets are to be changed in the scene and further use the placement template 337 to place those media assets at the correct position in the scene at the correct time in the media clip. For example, for a weather forecast, the input may be the text string “60 degrees Fahrenheit, 80% precipitation probability”. The text can be parsed by the context component 307 to determine key contextual parameters such as “Precipitation Probability” to derive a media object that represents a rainy appearance with a high probability of rain—for example, a woman telling the weather Can be transformed into a look in waterproof clothing and can be compared with contextual information from the contextual database 317 in order to be outside with the 3D of the animation showing the location of the forecast to rain.

  The video is similarly generated by the media generation engine component 306 of FIG. 3 using the video template and context information stored in the customer information database 109. Text weather forecasts can be converted to audio forecasts, which can be scripted based on animated templates. In one embodiment, the animation engine 346 may be used to provide animation for media objects. The video is then rendered by the rendering engine 336 into video for distribution, delivered to the client device as 3D data, or delivered in some other media format. It is. An example of a rendering engine 336 is a 3D batch processor that renders frames of a 3D video using a hardware accelerated opengl engine that can be used to render video content.

  The frame can then be passed to a dedicated video encoding component (VeeCoder) or other video engine 316. The VeeCoder component or other video engine 316 may encode the video into a number of different video formats that the client device can support. Audio engine 326 may also be used to generate or provide appropriate audio for the video. If the clip is delivered as 3D, the underlying avatar model and texture (such as from avatar template 356) and all video data are packed and sent to the device where the data is client-side Played using the rendering engine.

  The client-side rendering engine is typically part of an application, such as a weather forecast application. Media generation component 306 can include an image recognition component that can be used for various image fine-tuning and character generation. The image input is analyzed and then the output of the video with alternative images or modifications based on templates, user input, text-to-speech conversion, or other pre-specified image value enhancement effects. Can be used to generate.

  In the embodiment of media customization system 300 of FIG. 3, device capability information may be stored in database 350. Further, as preferred or selected by the user, the customer information database 109 may store a personal avatar 309 that is used with the distributed media.

  Here, numerous examples of media customization systems and non-limiting applications are described to further illustrate the utility of one or more embodiments.

  One exemplary use for a customized media system includes videos that are automatically generated and distributed based on text input. In this application, various text inputs such as weather forecasts, stock quotes, and news are converted into much higher quality media types such as 3D or video weather forecasts. Visual scenes can be constructed and enhanced based on the physical location of the client device using a location-based template or visual cue.

  For example, if the client device is associated with San Francisco, a background showing a picture of Golden Gate Bridge may appear after other content such as text, 3D rendering, video, or video. In another example, user preferences may be applied to customize media for the user. For example, the user may select audio, video avatars, or the user may also provide images to generate personal avatars or other image displays. User demographics can also be applied to customize the media. For example, based on a particular age / gender / income group, preferences for content oriented towards flashy, cutting-edge, or more conservative occupation type content may be derived. Device capabilities can also be used to customize media for client devices. For example, scenes can be created to specifically match the capabilities of the device, including supported video, 3D and audio formats.

  One exemplary embodiment includes intelligent text input recognition. In this version, customized media is generated based on the data contained in the text input. Using weather information as an example, the GPS location of the client device may be used as a basis for querying the weather database. The returned weather description can be analyzed and then used to create audio for the virtual character, while the probability of precipitation can be drawn by the rain clouds appearing on the map, The temperature below can be drawn by a shaking avatar. In this way, a series of media inputs are customized for a particular client device based on contextual parameters such as location. In another related example, a message such as an instant message may be converted by a media customization system to convert the text message to a video with an audio track. In particular, text birthday celebrations in instant messages can be transformed to provide media birthday enhancements to provide birthday songs or birthday celebrations for videos with audio tracks that play the original message text. .

  Another related exemplary application for embodiments includes the generation of intelligent traffic reports or intelligent travel information. Location information can be obtained by using a GPS system. For example, by obtaining two GPS measurements a few seconds apart, the current road and direction can be determined, information about further traffic on the road can be obtained and customized for the client device. In general, a client device capable of GPS sends GPS data to a media customization system or connected server several times during a normal commute. Thus, the system can determine whether the user has one or more normal paths. Next, in response to the query, based on the derived route information, the system may report traffic conditions along the remaining routes that the user is likely to take. The time data can also be used to determine whether it is a morning commute or an evening commute. If a real-time traffic event (accident) is available to the server, the media customization system can send an alert to the client device if the traffic accident occurs further along the normal route . Once the user's route information is derived, the user's route information can be generated to generate roadmaps, traffic data photos, or other customized parameters based on 3D avatars that convey reports or other contextual information. Route information can be used.

  Travel-related services can be provided in much the same customized way, but again the client device location, previous user preferences and demographics, and available input media channels such as restaurant guides (Zagat), And provide specific local information on restaurants, hotels, clubs, and entertainment options based on paid partner agreements with hotels and entertainment promotion services.

  Other applications for media customization that use various embodiments of the methods and systems of the present invention include, for example, Friendster, Tribe, MySpace, Dodgeball, Match. com conversion and generation to send messages between users in a community such as com. Messages can be sent in the format of the minimum common denominator (text only: instant message, SMS, email). However, other inputs such as audio and video are also supported. Input media can be transcoded according to the capabilities of the destination device, and additional context parameters such as avatars selected or created by the user, playback audio, location-based scenes, etc. are used during the conversion and generation process. obtain. The message originates from one user and is sent to another user, but passes through the community's central “profile” engine, which performs end-to-end routing, Hide the end points (phone numbers, email addresses, etc.) of the two users. Only the identification of the profiles of the two users is revealed to each other, but the identity of the “real world” is not revealed. This allows text or SMS messages to be used in higher performance formats for users with devices / players where the use of “textimation” (text to video) conversion can handle higher performance formats. Allows you to "upgrade". Examples include SMS-to-avatar conversion and generation using text-to-speech conversion, using sender's avatar (extracted from sender profile), and compressed and shortened SMS Includes the use of SMS-specific context engines to explode shorthand expressions into more complete conversational sentences with emotional nuances extracted from emoticon cues, punctuation.

  In one embodiment, the various media elements need not be “disassembled”. For example, if the element supplied to the system is an audio track, the audio track need not be disassembled before the audio track is incorporated and / or converted into other media elements.

  In various embodiments, more than just a contextual transformation can occur. For example, combining various artistic elements (eg, adding audio to a graphical 3D rendering) creates a “wow”-this creates a derivative work or other resulting work Conversion process. More than just acquiring different inputs in different formats and converting them all to the same format (eg, 3GPP), such embodiments include situations where the total exceeds the sum of the parts. Further, in embodiments, one element characterizes or influences another element—for example, an audio track “moves” a moving image (motion) such as lips, eyes, and the like.

  According to one embodiment, at least some of the features described herein may be implemented in software or other machine readable instructions stored on one or more machine readable media. Machine readable instructions may be executed by one or more processors to provide the features and other functionality described herein. For example, the various engines, templates, components, etc. shown in FIGS. 1-3 can be implemented as software modules that can be executed by one or more processors.

  Another embodiment is shown in FIG. The embodiment provides a context-based media generation component (blocks 106 and 107) that has the ability to generate supplemental information that can improve the speed and quality of video encoding. The supplemental information is used by the transcoding component 105 (or some other transform component) to generate a video (eg, a 3GPP file from a 3D frame). Video compression used by the transcoding component 105 involves evaluating motion between frames and encoding prediction errors. The 3D media generator 106 may provide motion information between frames. Having accurate motion information reduces the time required to encode the video (eg, motion evaluation is required), as it can be seen that the motion that has occurred has changed between one frame and another. Not) reduce forecast errors.

  This motion information or other supplemental information is passed to the transcoding component 105 as a hint track 151 for encoding. The reduction in forecast errors increases the quality of compression and allows for higher video quality for a constant bit rate or reduced file size for a constant quality video file. It will be appreciated that motion data is just one possible example of supplemental information that may be provided by 3D media generator 106 to increase the quality and speed of video encoding. Media generator 106 may also provide information regarding changes in luminance or other lighting between frames, texture changes between frames, as additional non-limiting examples. Embodiments of 3D media generator 106 may also send information about the composition of the frame if there is a text overlay, or which part of the scene will be the focus of more bits, as a further additional example. Information about what to do can be sent.

  In embodiments, the media may be delivered to the end user's device as a 3GPP video file or a 3D video file (for example) based on device capabilities. This information is derived using the device capability detection engine 109. Furthermore, video or 3D media can be custom created to match the capabilities of the device. With respect to rendering a 3D file, different devices may have different capabilities and thus may require 3D content optimized for that device. A context-based media generation engine can generate files that match the capabilities of the device. In a similar manner, transcoding component 105 can generate a video file with attributes suitable for the end user's device. If the media is pre-encoded into multiple 3D files and multiple 3GPP files, all with different characteristics, the delivery engine uses device information and file properties to optimize for end-user devices You can select the correct file.

  The distribution engine of one embodiment uses device capabilities rather than network state or device state to select a file. Once the session is initiated, the delivery engine capabilities can be combined with dynamic bandwidth adaptation techniques. It is disclosed, for example, in US patent application Ser. No. 10 / 452,035 entitled “METHOD AND APPARATUS FOR DYNAMIC BANDWIDTH ADAPTATION” filed on May 30, 2003, which is assigned to the same assignee as the present application. And is hereby incorporated by reference in its entirety. The transcoding component (105) of one embodiment may also utilize adaptation techniques disclosed in this sharing application.

  All of the above U.S. patents, U.S. patent application publications, U.S. patent applications, foreign patents, foreign patent applications, and non-patent publications mentioned in this specification and / or listed in the application data sheet are incorporated in their entirety. Incorporated herein by reference.

  The above description of illustrated embodiments, including those described in the abstract, is not intended to be exhaustive or to limit the invention to the precise form disclosed. While particular embodiments and examples have been described herein for purposes of illustration, various equivalent modifications are possible within the scope of the invention and without departing from the spirit and scope of the invention. Can be done.

  These and other modifications can be made to the invention in light of the above detailed description. The terms used in the following claims should not be construed to limit the invention to the specific embodiments disclosed in the specification and the claims. Rather, the scope of the present invention should be determined entirely by the claims, which should be construed in accordance with established principles with respect to claim interpretation.

FIG. 1 is a block diagram of a system according to one embodiment. FIG. 2 is a block diagram of a system according to another embodiment. FIG. 3 is a block diagram of a system according to yet another embodiment. FIG. 4 is a block diagram of a system according to yet another embodiment.

Claims (22)

Obtaining the first data;
Analyzing the first data and obtaining context information therefrom;
Using the obtained contextual information to determine second data;
Supplementing the first data with the determined second data to obtain transformed data;
Delivering the transformed data to at least one client device.   Obtaining the first data includes obtaining text data, and analyzing the first data comprises parsing the text data and obtaining the context information therefrom. Including and supplementing the first data with the determined data comprises supplementing the text data with audio, video, image display, one or more images, or other quality media elements associated with the text data. The method of claim 1, comprising supplementing or replacing the text data with these.   Obtaining the first data includes obtaining a plurality of first data, and determining the second data is based on context information of the plurality of first data. Using at least a portion of a plurality of first data as the second data, and supplementing the first data with the determined second data comprises the plurality of first data The method of claim 1, comprising combining at least some second data corresponding to some of the data to obtain the transformed data.   The method of claim 1, wherein obtaining the context information includes determining emotional nuances from the first data. The converted data, the second data, or another format from the first format based on characteristics of the client device or based on the status of a communication channel for delivering the converted data Transcoding the transformed data into:
The method of claim 1, further comprising: dynamically updating the transcoded data in response to changes in device characteristics or channel conditions of the client during a communication session. .   Complementing the first data with the determined second data uses a template to add the quality of the high quality media to the first data according to the order in time at the selected location. The method of claim 1, comprising providing an improvement. Deriving hint track information based on the determined second data or based on the context information;
Using the hint track information to optimize transcoding of the transformed data to a format that is optimal for the client device or for a communication channel to the client device; The method of claim 1, further comprising: Means for obtaining first data;
Means for analyzing the first data and obtaining context information therefrom;
Means for determining second data using the obtained context information;
Means for supplementing the first data with the determined second data to generate transformed data;
Means for delivering the converted data to at least one client device. Means for converting the first, second or converted data;
9. The system of claim 8, further comprising means for storing client device data, customer information, or image information that can be used to generate the transformed data.   9. The system of claim 8, wherein the means for analyzing the first data includes at least one of a context database, a context engine, a placement template, and an animation template.   9. The supplemental means of claim 8, comprising at least one of a video engine, an audio engine, a rendering engine, a video engine, and an image template that can be used to generate media for the converted data. System.   9. The system of claim 8, further comprising means for increasing the value of video encoding based on supplemental information derived from the contextual information or from the second data.   8. The system of claim 7, further comprising means for distributing the converted data as a video file derived based on device capabilities. For analyzing the obtained first data and obtaining context information therefrom;
Using the obtained context information to determine second data;
At least one for supplementing the first data with the determined second data to obtain transformed data and for delivering the transformed data to at least one client device; A product comprising machine-readable media having instructions stored on the product that are executable by the processor. The machine-readable medium is
For deriving hint track information based on the determined second data or based on the contextual information, and using the hint track information for the client device or for the client For optimizing the transcoding of the transformed data into a format that is optimal for the communication channel to the device;
15. The product of claim 14, further comprising instructions stored on the product.   15. The product of claim 14, wherein the instructions for analyzing the obtained first data to obtain contextual information include instructions for deriving emotional nuances from the first data.   Using the obtained contextual information, the instructions for determining second data are at least one or more of user preferences, device characteristics, or media content that may be associated with the first data. 15. The product of claim 14, comprising instructions for identifying second data associated with the first data based on the first data. An input terminal that receives media input;
The terminal for analyzing the media input, obtaining context information therefrom, and using the obtained context information to determine a media supplement to the media input associated with the media input; A combined context component;
A media generation component combined with the context component to supplement the media input with the determined media supplement to obtain transformed media;
An apparatus comprising: an output terminal coupled with the media generation component for delivering the converted media to at least one client device. For converting the converted media into a format that is optimal for a communication channel to the client device or to a communication channel to the client device used to deliver the converted media; A transcoding component combined with a media generation component;
19. The apparatus of claim 18, further comprising: at least one storage unit for storing information related to the client device, including device capability information, user information, preference information, or avatar templates. The device described.   For converting the converted media into a format that is optimal for a communication channel to the client device or to a communication channel to the client device used to deliver the converted media; The apparatus of claim 18, further comprising a transcoding component combined with a media generation component, wherein the transcoding component is used to optimize conversion of the media generation component or the converted media. An apparatus further coupled to receive hint track information from the contextual component that is possible.   The apparatus of claim 18, wherein the context component includes a context database, a context engine, a placement template, and an animation template.   The apparatus of claim 18, wherein the media generation component includes a video engine, an audio engine, a rendering engine, a video engine, and an image template that can be used to generate objects for the converted media.

Images