KR100987862B1 - Method and system for recording edits to media content - Google Patents

Abstract

Systems and methods have been developed for manipulating media assets in a networked computing environment where processing power, bandwidth and / or storage capacity may be limited. More specifically, low resolution media assets can be created that are optimized for transmission over low bandwidth networks and for editing and manipulation in environments with low processing power and low storage capacity, and high resolution media assets created for playback. Systems and methods have been developed to enable this.

Media Assets, Master Assets, Keyframes

Description

METHOD AND SYSTEM FOR RECORDING EDITS TO MEDIA CONTENT}

[Copyright notice]

Portions of this patent document contain copyrighted material. The copyright owner has no objection to facsimile reproduction of this patent document or patent specification, as indicated in the US Patent and Trademark Office patent files or records, but otherwise reserves all copyright rights.

[Related Application]

This application claims the priority of US Provisional Application 60 / 758,664, filed January 13, 2006 and US Provisional Application 60 / 790,569, filed April 10, 2006. The provisional applications are incorporated herein by reference.

In the current Internet, there are a number of different types of media assets in the form of digital files. Digital files may include data representing one or more types of content, including but not limited to audio, images, and video. For example, media assets include MPEG-1 Audio Layer 3 (MP3) for audio, Joint Photographic Experts Group (JPEG) for images, MPEG-2 and Motion Picture Experts Group (MPEG-4) for video, animation File formats such as Adobe Flash, and executable files.

Such media assets are currently created and edited using applications running locally on a dedicated computer. For example, in the case of digital video, popular applications for creating and editing media assets include Apple's iMovie and FinalCut Pro and Microsoft's MovieMaker. After creating and editing a media asset, one or more files may be sent to a computer (eg, a server) located on a distributed network, such as the Internet. The server can host files for different users to see. Examples of companies that run such servers are YouTube (http://youbube.com) and Google Video (http://video.google.com).

Currently, users must create and / or edit their media assets on their client computers before sending them to the server. Therefore, many users cannot edit media assets from other clients, for example, if the user's client computer does not contain the appropriate application or media asset for editing. Moreover, editorial applications are typically designed for professional or high-end consumer markets. Such applications do not address the needs of average consumers without dedicated computers with significant processing power and / or storage capacity.

In addition, the average consumer typically does not have the transmission bandwidth required to transmit, share or access media assets that can be widespread across the network. Many media assets are stored on computers connected to the Internet. For example, services such as Getty Images sell media assets (eg, images) stored on a computer connected to the Internet. Thus, when a user requests a media asset for manipulation or editing, the asset is typically transmitted over the network intact. Especially in the case of digital video, such transmissions can consume enormous processing and transmission resources.

[summary]

In response to this background, systems and methods have been developed for manipulating media assets in a networked computing environment where processing power, bandwidth and / or storage capacity may be limited. More specifically, low resolution media assets can be created that are optimized for transmission over low bandwidth networks and for editing and manipulation in environments with low processing power and low storage capacity, and high resolution media assets created for playback. Systems and methods have been developed to enable this.

In one example (this example is for illustration and not limitation), the present invention may be considered a method of editing a low resolution media asset to create a high resolution edited media asset. The method includes receiving a request from a requestor to edit a first high resolution media asset. The method further includes sending a low resolution media asset based on the first high resolution media asset to the requestor. The method includes receiving an editing command associated with the low resolution media asset from the requester. The method further includes generating a second high resolution media asset based on the editing instructions associated with the first high resolution media asset and the low resolution media asset.

In one example (this example is for purposes of illustration and not limitation), the invention encodes or comprises computer executable instructions for performing a method of editing a low resolution media asset to produce a high resolution edited media asset. It can be considered as a possible medium. The computer readable medium includes instructions for receiving a request to edit a first high resolution media asset from the requester. The computer readable medium further includes instructions for sending to the requestor a low resolution media asset based on the first high resolution media asset. The computer readable medium includes instructions for receiving an editing command associated with the low resolution media asset from the requestor. The computer readable medium further includes instructions for generating a second high resolution media asset based on the editing instructions associated with the first high resolution media asset and the low resolution media asset.

In one example (the example is for the purpose of illustration and not of limitation), the invention may be considered a system. The system includes a high resolution media asset library. The system further includes a low resolution media asset generator that generates low resolution media assets from the high resolution media assets included in the high resolution media asset library. The system includes a high resolution media asset editor that applies the edits to the high resolution media asset based on the edits made to the associated low resolution media asset.

In one example (the example is for the purpose of illustration and not of limitation), the invention may be regarded as a method. The method includes receiving a request to create a video asset that identifies a start frame and an end frame within a keyframe master asset. The method further comprises generating a first portion of the video asset, the first portion including one or more keyframes associated with the start frame, the keyframes obtained from the keyframe master asset. Include. The method includes a second portion of the video asset, the second portion including the keyframes and sets of optimized frames, wherein the optimized frames are obtained from an optimized master asset associated with the keyframe master asset. Generating a step.

In one example (the example is for the purpose of illustration and not of limitation), the invention may be regarded as a method. The method includes receiving a request to create a video asset identifying a start frame and an end frame within a master asset. The method includes a first portion of the video asset, the first portion including one or more keyframes associated with the start frame, the keyframes obtained from a keyframe master asset corresponding to the master asset. It further comprises the step of generating. The method includes a second portion of the video asset, the second portion including the keyframes and sets of optimized frames, wherein the optimized frames are obtained from an optimized master asset corresponding to the master asset. Generating steps.

In one example (the example is for the purpose of illustration and not of limitation), the invention may be regarded as a method. The method includes receiving a request to create a video asset identifying a start frame and an end frame within the optimized master asset. The method further includes generating a keyframe master asset based on the optimized master asset, the keyframe master asset including one or more keyframes corresponding to the start frame. The method includes generating a first portion of the video asset, the first portion including at least the start frame identified in the optimized master asset. The method further comprises generating a second portion of the video asset, the second portion including the keyframes and sets of optimized frames, wherein the optimized frames are obtained from the optimized master asset. Include.

In one example (this example is for illustration and not limitation), the invention may be considered a computer readable medium that encodes or includes computer executable instructions for performing a method. The computer readable medium includes instructions for receiving a request to generate a video asset identifying a start frame and an end frame within a keyframe master asset. The computer readable medium generating a first portion of the video asset, the first portion including one or more keyframes associated with the start frame, the keyframes obtained from the keyframe master asset It further includes instructions for. The computer readable medium comprises a second portion of the video asset, the second portion including the keyframes and sets of optimized frames, wherein the optimized frames are optimized master assets associated with the keyframe master asset. Obtained from-instructions for generating the.

In one example (this example is for illustration and not limitation), the invention may be considered a computer readable medium that encodes or includes computer executable instructions for performing a method. The computer readable medium includes instructions for receiving a request to create a video asset that identifies a start frame and an end frame within a master asset. The computer readable medium comprises a first portion of the video asset, the first portion including one or more keyframes associated with the start frame, the keyframes obtained from a keyframe master asset corresponding to the master asset. -Further includes instructions for generating. The computer readable medium comprises a second portion of the video asset, the second portion including the keyframes and sets of optimized frames, wherein the optimized frames are obtained from an optimized master asset corresponding to the master asset. -Contains instructions for creating.

In one example (this example is for illustration and not limitation), the invention may be considered a computer readable medium that encodes or includes computer executable instructions for performing a method. The computer readable medium includes instructions for receiving a request to generate a video asset that identifies a start frame and an end frame within an optimized master asset. The computer readable medium further includes instructions for generating a keyframe master asset comprising one or more keyframes corresponding to the start frame based on the optimized master asset. The computer readable medium includes instructions for generating a first portion of the video asset, the first portion including at least the start frame identified in the optimized master asset. The computer readable medium generates a second portion of the video asset, the second portion including the keyframes and sets of optimized frames, wherein the optimized frames are obtained from the optimized master asset. It further includes instructions for.

In one example (the example is for the purpose of illustration and not of limitation), the invention may be considered a system. The system includes a master asset library that stores at least one high resolution master asset. The system further includes a specification applicator that stores at least one edit specification for applying edits to the at least one high resolution master asset. The system includes a master asset editor that applies the at least one editing specification to the at least one high resolution master asset. The system further includes an edit asset generator for generating a low resolution asset corresponding to the high resolution master asset.

In one example (the example is for the purpose of illustration and not of limitation), the invention may be regarded as a method. The method includes editing a low resolution media asset corresponding to the master high resolution media asset. The method further includes generating an editing specification based on the editing of the low resolution media asset. The method includes applying the edit specification to the master high resolution media asset to create an edited high resolution master asset.

In one example (the example is for the purpose of illustration and not of limitation), the invention may be considered a computer readable medium having a data structure stored thereon. The computer readable medium includes a first data field that contains data identifying a high resolution media asset. The computer readable medium includes a second data field containing data describing one or more edits made to a low resolution media asset associated with the high resolution media asset.

In one example (this example is for illustration only, not limitation), the present invention may be regarded as a method of identifying edit information of a media asset. The method includes editing a low resolution media asset comprising at least a first portion corresponding to the first high resolution master media asset and a second portion corresponding to the second high resolution master media asset. The method further includes receiving a request to create a high resolution edited media asset, the request identifying the first high resolution master media asset and the second high resolution master media asset. The method includes generating the high resolution edited media asset. The method further includes associating edit information identifying the first high resolution master media asset and the second high resolution master media asset with the high resolution edited media asset.

In one example (this example is for illustration and not for purposes of limitation), the invention may be considered a computer readable medium comprising or encoding computer executable instructions for performing a method of identifying edit information of a media asset. have. The method includes editing a low resolution media asset comprising at least a first portion corresponding to the first high resolution master media asset and a second portion corresponding to the second high resolution master media asset. The method further includes receiving a request to create a high resolution edited media asset, the request identifying the first high resolution master media asset and the second high resolution master media asset. The method includes generating the high resolution edited media asset. The method further includes associating edit information identifying the first high resolution master media asset and the second high resolution master media asset with the high resolution edited media asset.

In one example (this example is for illustration, not limitation), the present invention can be considered a method of rendering a media asset. The method includes receiving a command to render an aggregate media asset defined by an edit specification that at least identifies a first media asset associated with the at least one edit command. The method further includes retrieving the edit specification. The method includes retrieving the first media asset. The method further comprises rendering, on a media asset rendering device, the first media asset of the aggregate media asset in accordance with the at least one editing instruction.

In one example (the example is for the purpose of illustration and not limitation), the invention may be considered a computer readable medium that encodes or includes computer executable instructions for performing a method of rendering a media asset. The method includes receiving a command to render an aggregate media asset defined by an edit specification that at least identifies a first media asset associated with at least one edit command. The method further includes retrieving the edit specification. The method includes retrieving the first media asset. The method further comprises rendering, on a media asset rendering device, the first media asset of the aggregate media asset in accordance with the at least one editing instruction.

In one example (this example is for illustration only, not limitation), the present invention may be regarded as a method of editing an aggregate media asset. The method includes receiving, in a playback session, a stream corresponding to an aggregate media asset that includes at least one component media asset from a remote computing device. The method further includes rendering the aggregate media asset on an image rendering device. The method includes receiving a user command to edit an edit specification associated with the aggregate media asset. The method further includes initiating an editing session for editing the editing specification associated with the aggregate media asset.

In one example (this example is for illustration and not limitation), the invention may be considered a computer readable medium that includes or encodes computer executable instructions for performing a method of editing an aggregate media asset. The method includes receiving, in a playback session, a stream corresponding to the aggregate media asset including at least one component media asset from the remote computing device. The method further includes rendering the aggregate media asset on an image rendering device. The method includes receiving a user command to edit an edit specification associated with the aggregate media asset. The method further includes initiating an editing session for editing the editing specification associated with the aggregate media asset.

In one example (this example is for illustration only, not limitation), the present invention may be regarded as a method of storing an aggregate media asset. The method includes storing a plurality of component media assets. The method further includes storing a first aggregate edit specification that includes at least one command to render the plurality of component media assets to create a first aggregate media asset.

These and other various features as well as advantages will be apparent by reading the following detailed description and reviewing the associated drawings. In the following description further features are set forth, some of which will be apparent from the description, or may be learned by practice of the embodiments to be described. Benefits and features will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the claimed invention.

The following drawings, which form part of this application, illustrate the embodiment systems and methods described below and are not intended to limit the scope of the invention in any way. The scope of the invention will be based on the claims appended hereto.

1 illustrates one embodiment of a system for manipulating a media asset in a networked computing environment.

2 illustrates one embodiment of a system for manipulating a media asset in a networked computing environment.

3 illustrates one embodiment of a method for editing a low resolution media asset to create a high resolution edited media asset.

4 illustrates one embodiment of a method for creating a media asset.

5 illustrates one embodiment of a method for creating a media asset.

6 illustrates one embodiment of a method for creating a media asset.

7 illustrates one embodiment of a method of recording edits in media content.

8 illustrates one embodiment of a method of identifying edit information of a media asset.

9 illustrates one embodiment of a method of rendering a media asset.

10 illustrates one embodiment of a method of storing an aggregate media asset.

11 illustrates one embodiment of a method for editing an aggregate media asset.

1 illustrates one embodiment of a system 100 for creating a media asset. In one embodiment, the system 100 includes a master asset library 102. In one embodiment, master asset library 102 may be a logical grouping of data including, but not limited to, high resolution and low resolution media assets. In another embodiment, master asset library 102 may be a physical grouping of data, including but not limited to high resolution and low resolution media assets. In one embodiment, master asset library 102 may include one or more databases and reside on one or more servers. In one embodiment, master asset library 102 may include a plurality of libraries including public, private, and shared libraries. In one embodiment, master asset library 102 may be organized into a searchable library. In another embodiment, the one or more servers comprising master asset library 102 may include connections to one or more storage devices for storing digital files.

For the purposes of this specification, the drawings associated with this specification, and the appended claims, the term "files" is generally stored as a unit and, among other things, search, modification, storage, deletion or Represents a collection of information that can be transmitted. Storage devices may include, but are not limited to, devices such as volatile memory (eg, RAM, ROM), nonvolatile memory (eg, ROM, EPROM, flash memory), and hard disk drives and optical drives. Storage devices may store information in duplicate. Storage devices can also be connected in parallel, in series, or in any other connection configuration. As shown in this embodiment, one or more assets may exist within the master asset library 102.

For the purposes of this specification, the drawings associated with this specification, and the appended claims, an "asset" represents a logical collection of content that may be included in one or more files. For example, an asset may include a single file (eg, an MPEG video file) that contains an image (eg, a still frame of video), audio, and video information. As another example, an asset can also include a collection of files (eg, JPEG image files) that can be used to collectively render animation or video. As another example, the asset may also include an executable file (eg, an executable video graphics file such as a SWF file or a FLA file). The master asset library 102 may include many types of assets including but not limited to video, images, animations, text, executable files, and audio. In one embodiment, master asset library 102 may include one or more high resolution master assets. In the remainder of this specification, a "master asset" will be disclosed as a digital file containing video content. However, those of ordinary skill in the art are not limited to that the master asset includes video information, and as described above, the master asset includes but is not limited to images, audio, text, executable files, and / or animations. It will be appreciated that it can contain many types of information.

In one embodiment, the media asset may be stored in the master asset library 102 to preserve the quality of the media asset. For example, for media assets containing video information, two important aspects of video quality are spatial resolution and temporal resolution. Spatial resolution generally describes the clarity of lack of blurring in the displayed image, while temporal resolution generally describes the smoothness of motion. Motion video, such as film, consists of a certain number of frames per second to represent motion in a scene. Typically, the first step in digitizing video is to divide each frame into a number of pixels, or pixels or, in short, pels. The more the number of pixels, the higher the spatial resolution. Likewise, the more frames per second, the higher the temporal resolution.

In one embodiment, the media asset may be stored in the Meyer asset library 102 as a master asset that is not directly manipulated. For example, a media asset can be preserved in its original form in the master asset library 102-although it can still be used to create copies or derivative media assets (eg, low resolution assets). In one embodiment, media assets may also be stored in master asset library 102 along with corresponding or related assets. In one embodiment, the media asset stored in the master asset library 102 may be stored as multiple versions of the same media asset. For example, a plurality of versions of a media asset stored in the master asset library 102 may be an all-keyframe version that does not use intra-frame similarities for compression, and It may include an optimized version that uses intra-frame similarities. In one embodiment, the original media asset may represent an all-keyframe version. In another embodiment, the original media asset may be in the form of an original optimized version or stored as an optimized version. Those skilled in the art will appreciate that media assets may take many forms within the scope of this specification within the master asset library 102.

In one embodiment, the system 100 also includes an edit asset generator 104. In one embodiment, editorial asset generator 104 may include transcoding hardware and / or software capable of converting media assets from one format to another, among others. For example, a transcoder may be used to convert an MPEG file into a Quicktime file. As another example, a transcoder may be used to convert a JPEG file into a bitmap (eg, * .BMP) file. As another example, the transcoder may standardize media asset formats into a Flash video file (* .FLV) format. In one embodiment, the transcoder may create two or more versions of the original media asset. For example, upon receiving the original media asset, the transcoder may convert the original media asset into a high resolution version and a low resolution version. As another example, the transcoder may convert the original media asset into one or more files. In one embodiment, the transcoder may be on a remote computing device. In other embodiments, the transcoder may reside on one or more connected computers. In one embodiment, editorial asset generator 104 may also include hardware and / or software for transferring and / or uploading media assets to one or more computers. In another embodiment, editorial asset generator 104 may include or be connected to hardware and / or software used to capture media assets from external sources such as a digital camera.

In one embodiment, editorial asset generator 104 may generate a low resolution version of a high resolution media asset stored in master asset library 102. In another embodiment, editorial asset generator 104 converts a media asset stored in master asset library 102 in real time and sends the media asset as a stream to a remote computing device to generate a low resolution version of that media asset. I can send it. In another embodiment, edit asset generator 104 may generate a low quality version of another media asset (eg, a master asset), and the low quality version is sufficient to allow a user to apply edits to the low quality version. You can provide data while preserving it.

In one embodiment, the system 100 may also include a specification applicator 106. In one embodiment, specification applicator 106 may include one or more files or editing specifications that include instructions for editing and modifying a media asset (eg, a high resolution media asset). In one embodiment, the specification applicator 106 may include one or more editing specifications including modification instructions for a high resolution media asset based on edits made to the corresponding or related low resolution media asset. In one embodiment, the specification applicator 106 may store a plurality of editing specifications in one or more libraries.

In one embodiment, system 100 also includes a master asset editor 108 that can apply one or more editing features to a media asset. For example, the master asset editor 108 may apply an edit specification stored in the specification applicator 106 library to the first high resolution media asset and thereby create another high resolution media asset, such as a second high resolution media asset. In one embodiment, the master asset editor 108 may apply the editing specification to the media asset in real time. For example, the master asset editor 108 may modify the media asset when it is sent to another location. In another embodiment, master asset editor 108 may apply the editing specification to a media asset in non-real-time. For example, the master asset editor 108 may apply editing specifications to the media asset as part of the scheduled process. In one embodiment, the master asset editor 108 may be used to minimize the need to transfer large media assets over the network. For example, by storing the edits in the edit specification, the master asset editor 108 may be able to store operations performed on a remote computing device on one or more local computers (eg, computers containing a master asset library). You can transfer small data files over the network to implement your assets.

In another embodiment, the master asset editor 108 may respond to commands from the remote computing device (eg, clicking on the “remix” button on the remote computing device may cause the master asset editor 108 to edit). Command to apply the specification to high quality media assets). For example, the master asset editor 108 may apply editing specifications to media assets dynamically and / or interactively at the same time user commands are issued from the remote computing device. In one embodiment, master asset editor 108 may dynamically apply edit specifications to high resolution to create an edited high resolution media asset for playback. In another embodiment, master asset editor 108 may apply an editing specification to a media asset on a remote computing device and one or more computers connected by a network (eg, the Internet 114). For example, bifurcating the application of an edit specification can minimize the size of the edited high resolution asset before sending the edited high resolution asset to a remote computing device for playback. In another embodiment, the master asset editor 108 may apply the editing specification on the remote computing device to take advantage of vector-based processing, which may be executed efficiently on the remote computing device, for example, at playback time. .

In one embodiment, system 100 also includes an editor 110 that can reside on a remote computing device 112 that is connected to one or more networked computers, such as the Internet 114. do. In one embodiment, the editor 110 may include software. For example, the editor 110 may be a stand-alone program. As another example, the editor 110 may include one or more instructions that may be executed via another program, such as the Internet 114 browser (eg, Microsoft Internet Explorer). In one embodiment, the editor 110 may be designed with a user interface similar to other media-editing programs. In one embodiment, the editor 110 may include connections to the master asset library 102, the edit asset generator 104, the specification applicator 106, and / or the master asset editor 108. In one embodiment, the editor 110 may include pre-constructed or "default" editing features that may be applied to the media asset by the remote computing device. In one embodiment, editor 110 may include a player program for displaying media assets and / or applying one or more instructions from an editing specification upon playback of the media asset. In other embodiments, the editor 110 may be connected to a player program (eg, a standalone editor may be connected to a browser).

2 illustrates an embodiment of a system 200 for creating a media asset. In one embodiment, system 200 includes a high resolution media asset library 202. In one embodiment, the high resolution media asset library 202 may be a shared library, a public library, and / or a personal library. In one embodiment, the high resolution media asset library 202 may include at least one video file. In another embodiment, high resolution media asset library 202 may include at least one audio file. In yet another embodiment, the high resolution media asset library 202 may include at least one reference to a media asset residing on the remote computing device 212. In one embodiment, the high resolution media asset library 202 may reside on a plurality of computing devices.

In one embodiment, the system 200 further includes a low resolution media asset generator 204 that generates a low resolution media asset from the high resolution media assets included in the high resolution media asset library. For example, as discussed above, the low resolution media asset generator 204 may convert high resolution media assets into low resolution media assets.

In one embodiment, the system 200 further includes a low resolution media asset editor 208 that sends edits made to the associated low resolution media asset to one or more computers via a network such as the Internet 214. In other embodiments, the low resolution media asset editor 208 may reside on a computing device, such as a remote computing device 212, remote from the high resolution media asset editor. In another embodiment, the low resolution media asset editor 208 may use a browser. For example, the low resolution media asset editor 208 may store the low resolution media assets in the browser's cache.

In one embodiment, the system 200 may also include an image rendering device 210 that displays the associated low resolution media assets. In one embodiment, image rendering device 210 resides on computing device 212 remote from high resolution media asset editor 206. In another embodiment, the image rendering device 210 may use a browser.

In one embodiment, the system 200 further includes a high resolution media asset editor 206 that applies the edits to the high resolution media asset based on the edits made to the associated low resolution media asset.

3 illustrates an embodiment of a method 300 of editing a low resolution media asset to produce a high resolution edited media asset. In method 300, a request to edit a first high resolution media asset is received from a requestor in a request operation 302. In one embodiment, the first high resolution media asset may comprise a plurality of files and receiving a request to edit the first high resolution media asset in a request operation 302 may include at least one of the plurality of files. The method may further include receiving a request for editing. In another embodiment, the request operation 302 may further include receiving a request to edit at least one high resolution audio or video file.

In method 300, a low resolution media asset based on the first high resolution media asset is transmitted to the requestor in a transmit operation 304. In one embodiment, the transmitting operation 304 can include transmitting at least one low resolution audio or video file. In another embodiment, the transmitting operation 304 converts each of the at least one high resolution audio or video file associated with the first high resolution media asset from the first file format to at least one low resolution audio or video file having a second file format, respectively. It may further comprise a step. For example, high resolution uncompressed audio files (eg WAV files) may be converted to compressed audio files (eg MP3 files). As another example, a compressed file with a smaller compression ratio may be converted to a file formatted in the same format but with a larger compression ratio.

The method 300 then includes receiving an editing command from the requestor relating to the low resolution media asset in the receive operation 306. In one embodiment, the receiving operation 306 may further include receiving a command to modify a video presentation property of the at least one high resolution video file. For example, modifying the video presentation attribute includes receiving a command to modify an image aspect ratio, a spatial resolution value, a temporal resolution value, a bit rate value, or a compression value. can do. In another embodiment, the receiving operation 306 may further include receiving a command to modify a timeline (frame sequence) of the at least one high resolution video file.

The method 300 further includes generating a second high resolution media asset based on an editing instruction associated with the first high resolution media asset and the low resolution media asset in a create operation 308. In one embodiment of the create operation 308, an editing specification is applied to at least one high resolution audio or video file that includes the first high resolution media asset. In a further embodiment, the create operation 308 generates at least one high resolution audio or video file. In yet another embodiment, the generating operation 308 comprises generating a copy of at least one high resolution audio or video file associated with the first high resolution media asset; Applying the editing commands to the at least one high resolution audio or video file respectively; And storing the copy as a second high resolution media asset.

In another embodiment of the method 300, at least a portion of the second high resolution media asset may be transmitted to a remote computing device. In yet another embodiment of the method 300, at least a portion of the second high resolution media asset may be displayed by the image rendering device. For example, the image rendering device can take the form of a browser residing on a remote computing device.

4 illustrates an embodiment of a method 400 of generating a media asset. In method 400, a request is received at receive operation 402 to generate a video asset identifying a start frame and an end frame within a keyframe master asset. For example, the request of receive operation 402 can identify a first portion and / or a second portion of a video asset.

Then, in a first portion generation operation 404, the method 400 includes generating a first portion of the video asset, wherein the first portion is configured to generate one or more keyframes associated with the start frame. And the keyframes are obtained from the keyframe master asset. For example, if the keyframe master asset includes an uncompressed video file, one or more frames of the uncompressed video file may include keyframes associated with a start frame of the media asset.

In a second portion generation operation 406, the method 400 further includes generating a second portion of the video asset, wherein the second portion includes the keyframes and sets of optimized frames; The optimized frames are obtained from an optimized master asset associated with the keyframe master asset. For example, if the optimized master asset comprises a compressed video file, the set of frames that are compressed may be combined with one or more uncompressed frames from the uncompressed video file within the video asset.

In another embodiment of the method 400, a library of master assets may be maintained, such that keyframe master assets and optimized master assets may be generated corresponding to at least one of the library master assets. In yet another embodiment of the method 400, the request may identify a start keyframe or end keyframe in a keyframe master asset that respectively corresponds to a start frame or end frame.

5 illustrates an embodiment of a method 500 of generating a media asset. In method 500, a request is received at receive operation 502 to generate a video asset that identifies a start frame and an end frame within a master asset. For example, the request of receive operation 502 can identify a first portion and / or a second portion of a video asset.

Then, in a first portion generation operation 504, the method 500 includes generating a first portion of the video asset, wherein the first portion is configured to generate one or more keyframes associated with the start frame. And the keyframes are obtained from a keyframe master corresponding to the master asset. For example,

In a second portion generation operation 506, the method 500 further includes generating a second portion of the video asset, wherein the second portion includes the keyframes and sets of optimized frames; The optimized frames are obtained from an optimized master asset corresponding to the master asset. For example, if the optimized master asset comprises a compressed video file, the set of frames that are compressed may be combined with one or more uncompressed keyframes from the keyframe master asset within the video asset.

In another embodiment of the method 500, a library of master assets may be maintained, such that keyframe master assets and optimized master assets may be generated corresponding to at least one of the library master assets. In yet another embodiment of the method 500, the request may identify a start keyframe or end keyframe in a keyframe master asset that respectively corresponds to a start frame or end frame.

6 illustrates an embodiment of a method 600 of generating a media asset. In method 600, a request is received to generate a video asset that identifies a start frame and an end frame within the optimized master asset in a receive operation 602. For example, the request of receive operation 602 can identify a first portion and / or a second portion of a video asset.

The method 600 then includes generating a keyframe master asset including one or more keyframes corresponding to the start frame based on the optimized master asset in a keyframe generation operation 604. . In a first portion generation operation 606, the method 600 further comprises generating a first portion of the video asset, wherein the first portion is at least one start frame identified in the optimized master asset. Include. Then, in a second portion generation operation 608, the method 600 further includes generating a second portion of the video asset, the second portion including keyframes and sets of optimized frames. And the optimized frames are obtained from the optimized master asset.

In another embodiment of the method 600, a library of master assets may be maintained, such that keyframe master assets and optimized master assets may be generated corresponding to at least one of the library master assets. In another embodiment of the method 600, the request may identify a start keyframe or end keyframe in the keyframe master asset that corresponds to the start frame or end frame, respectively.

7 illustrates an embodiment of a method 700 of recording edits in media content. In method 700, in editing operation 702, a low resolution media asset corresponding to the master high resolution media asset is edited. In one embodiment, the editing includes modifying the image of the low resolution media asset corresponding to the master high resolution media asset. For example, if an image contains pixel data, the pixels can be manipulated to appear in different colors or at different brightnesses. In another embodiment, the editing includes modifying the duration of the low resolution media asset corresponding to the duration of the master high resolution media asset. For example, the modification may include shortening the low resolution media asset and the high resolution media asset corresponding to the low resolution media asset.

In another embodiment, where the master high resolution media asset and the low resolution media asset include at least one or more frames of video information, the editing is a low resolution media asset corresponding to the master high resolution media asset. Modifying a transition property of the at least one or more video information frames of. For example, a transition, such as a fade-in or fade-out transition, can replace an image of one frame with an image of another frame. In another embodiment, the editing includes modifying the volume value of the audio component of the low resolution media asset corresponding to the master high resolution media asset. For example, a media asset containing video information may include an audio track that may be played louder or quieter depending on whether a larger volume value or a smaller volume value is selected.

In another embodiment, where the master high resolution media asset and the low resolution media asset comprise at least two or more frames of sequential video information, the editing is a low resolution media asset corresponding to the master high resolution media asset. Modifying the sequence of the at least two or more sequential video information frames of a. For example, the second frame may be sequenced prior to the first frame of the media asset containing the video information.

In yet another embodiment, the editing includes modifying one or more uniform resource locators (URLs) associated with the low resolution media assets corresponding to the master high resolution media assets. In another embodiment, editing includes modifying a playback rate (eg, 30 frames per second) of the low resolution media asset corresponding to the master high resolution media asset. In another embodiment, the editing includes modifying the resolution (eg, temporal or spatial resolution) of the low resolution media asset corresponding to the master high resolution media asset. In one embodiment, the editing can occur on the remote computing device. For example, the edit specification itself can be written on a remote computing device. Likewise, for example, the edited high resolution media asset may be sent to a remote computing device for rendering on an image rendering device such as a browser.

The method 700 then includes generating an edit specification based on the editing of the low resolution media asset in a create operation 704. The method 700 further includes applying the edit specification to the master high resolution media asset in the apply operation 706 to create an edited high resolution media asset. In one embodiment, the method 700 further comprises rendering the edited high resolution media asset on an image rendering device. For example, rendering the edited high resolution media asset may itself include applying a media asset filter to the edited high resolution media asset. As another example, applying the media asset filter may include overlaying an animation on the edited high resolution media asset. As another example, applying the media asset filter may further comprise changing display properties of the edited high resolution media asset. Changing the display property may include, but is not limited to, changing the video presentation property. In this example, applying the media asset filter includes video effects, titles, frame rates, tricky-play effects (e.g., media asset filters are fast-forward, pause, Slow-motion and / or rewind behavior may be altered, and / or composite displays (eg, picture-in-picture and / or green- As in the case of green-screen synthesis, displaying two different media assets simultaneously). In another embodiment, the method 700 may further comprise storing the edit specification. For example, the editorial specification may be stored on a remote computing device or one or more computers connected via a network such as the Internet.

8 illustrates an embodiment of a method 800 for identifying edit information of a media asset. In method 800, a low resolution media asset is edited in an editing operation 802, wherein the low resolution media asset comprises a first portion corresponding to a first high resolution master media asset and a second portion corresponding to a second high resolution master media asset. Include at least. In one embodiment, editing operation 802 further includes storing at least a portion of the editing information as metadata along with the high resolution edited media asset. In other embodiments, editing operation 802 may occur on a remote computing device.

In receive operation 804, the method 800 includes receiving a request to create a high resolution edited media asset, the request identifying the first high resolution master media asset and the second high resolution master media asset. do. The method 800 then includes generating a high resolution edited media asset at a creation operation 806. The method 800 further includes associating edit information identifying the first high resolution master media asset and the second high resolution master media asset with a high resolution edited media asset in an associating operation 808.

In one embodiment, the method 800 further includes retrieving the first high resolution master media asset or the second high resolution master media asset. In yet another embodiment, the method 800 further includes assembling the retrieved first high resolution media asset and the retrieved second high resolution media asset into a high resolution edited media asset.

9 illustrates an embodiment of a method 900 for rendering a media asset. In method 900, a command is received in a receive operation 902 to render an aggregate media asset defined by an edit specification, the edit specification identifying at least a first media asset associated with at least one edit command. In one embodiment, receive operation 902 includes an end-user command. In another embodiment, receive operation 902 may include a command issued by a computing device, such as a remote computing device. In yet another embodiment, receive operation 902 may include a series of commands that together represent a command to render an aggregate media asset defined by an editing specification.

In the edit specification search operation 904, an edit specification is searched for. In one embodiment, the search operation 904 may include retrieving an edit specification from memory or some other storage device. In another embodiment, the search operation 904 may include retrieving an edit specification from a remote computing device. In another embodiment, retrieving the edit specification in search operation 900 may include retrieving several edit specifications collectively comprising only one related edit specification. For example, several editing features may include different media assets (eg, the play's content) that together contain only one relevant editing feature (eg, for the entire play including each act of play). Acts can each be associated with a media asset). In one embodiment, the editing specification may identify a second media asset associated with a second editing command that may be retrieved and rendered on the media asset rendering device.

At media asset retrieval operation 906, the first media asset is retrieved. In one embodiment, the retrieval operation 906 may include retrieving the first media asset from the remote computing device. In other embodiments, retrieval operation 906 may include retrieving the first media asset from memory or some other storage device. In yet another embodiment, the retrieval operation 906 may include retrieving a particular portion of the first media asset (eg, a header or first portion of the file). In another embodiment of the search operation 906, the first media asset may include a plurality of sub-parts. According to the example presented in search operation 906, the first media asset in video form (eg, play with multiple acts) includes media asset parts (eg, multiple acts represented as separate media assets). can do. In this example, the editing specification can include information linking or associating the plurality of different media assets together into only one related media asset.

In rendering operation 908, the first media asset of the aggregate media asset is rendered on a media asset rendering device in accordance with at least one editing command. In one embodiment, the editing command may identify or point to a second media asset. In one embodiment, the media asset rendering device may include a display for video information and a speaker for audio information. In embodiments where a second media asset exists, the second media asset may include information similar to the first media asset (eg, both the first and second media assets may include audio or video information). ) May include information other than the first media asset (eg, the second media asset may include audio information, such as a commentary on the movie, while the first media asset may include images, audio, etc., for the movie). May include video information). In another embodiment, rendering operation 908 may modify the transition attribute for transitioning from the first media asset to the second media asset, overlay effects and / or titles on the asset, or combine the two assets ( Combinations resulting from editing commands relating to picture-in-picture and / or green-screen, for example), the frame rate and / or presentation rate of at least a portion of the media asset, or the duration of the first media asset. May further include an editing command to modify the display property, modify the display property of the second media asset, or modify the audio property of the first media asset.

10 illustrates an embodiment of a method 1000 of storing aggregate media assets. In method 1000, a plurality of component media assets are stored in a storage operation 1002. For example, and by way of example and not limitation, storage operation 1002 may include caching at least one of the plurality of component media assets in a memory. As another example, one or more component media assets may be cached in a memory cache reserved for a program such as an internet browser.

In a save operation 1004, a first collective edit specification is stored, the first aggregate edit specification comprising at least one command to render the plurality of component media assets to generate a first aggregate media asset. For example, an aggregate media asset may include one or more component media assets that include video information. In this example, the component videos can be ordered to be rendered in a particular order as an aggregate video (eg, video montage). In one embodiment, the save operation 1004 includes storing at least one command to display a first portion of the plurality of component media assets in a sequence. For example, the displaying command may modify the playback duration of the component media asset including the video information. In another embodiment of the save operation 1004, at least one command may be stored that renders an effect corresponding to at least one of the plurality of component media assets. As one example, the storage operation 1004 can include one or more effects instructing transitions between component media assets. In another embodiment of the save operation 1004, a second aggregated editing specification can be stored, the second aggregated editing specification being at least one for rendering the plurality of component media assets to generate a second aggregated media asset. Command.

11 illustrates an embodiment of a method of editing an aggregate media asset. In method 1100, a stream corresponding to an aggregate media asset comprising at least one component media asset from a remote computing device is received in a playback session in a receive operation 1102. For example, a playback session can include a user environment that allows for playback of media assets. As another example, a playback session can include one or more programs that can display one or more files. According to this example, the playback session may include an internet browser capable of receiving streaming aggregate media assets. In this example, the aggregate media asset can include one or more component media assets residing on the remote computing device. These one or more component media assets may be streamed to achieve bandwidth and processing efficiency on the local computing device.

In rendering operation 1104, the aggregate media asset is rendered on an image rendering device. For example, the aggregate media asset may be displayed such that pixel information from the aggregate media asset, including video information, is shown. In a receive operation 1106, a user command to edit an edit specification associated with the aggregate media asset is received. As noted above, the editorial specifications can take many forms, including but not limited to, one or more files containing metadata and other information related to component media assets that may be associated with an aggregate media asset.

In launch operation 1108, an editing session is initiated for editing an editing specification associated with the aggregate media asset. In one embodiment, initiating operation 1108 includes displaying information corresponding to an editing specification associated with the aggregate media asset. For example, an editing session can allow a user to adjust the duration of a particular component media asset. In another example, the method 1100 further includes modifying the edit specification associated with the aggregate media asset, thereby changing the aggregate media asset. According to the previous example, once a component media asset is edited in the editing session, edits to that component media asset can be made to the aggregate media asset.

Those skilled in the art will appreciate that the methods and systems herein may be implemented in a number of ways and therefore should not be limited by the above-described exemplary embodiments and examples. In other words, functional elements performed in various combinations of hardware and software or firmware, and individual functions by a single or multiple components, can be distributed between software applications at the client or server level or both. . In this regard, any number of features of the different embodiments described herein may be combined in a single or multiple embodiments, with alternatives having fewer or more features than all of the features described herein. Embodiments are possible. The functionality, in whole or in part, may be distributed among the plurality of components in ways that are now known or will be known. Thus, countless software / hardware / firmware combinations are possible in achieving the functions, features, interfaces and preferences described herein. Moreover, the scope of the present disclosure may be made in the known manner for performing the described features and functions and interfaces, and in the hardware or software or firmware components described herein that will be understood by those skilled in the art now or in the future. Changes and modifications included.

While various embodiments have been described for the purposes of this specification, various changes and modifications may be made within the scope of the present invention. For example, the editing specification may further include instructions for layering a plurality of audio tracks together or splicing different audio samples together. As another example, an online reconstruction (eg, editing of a 3D game environment) of a two dimensional game environment may be achieved using the methods and systems described for generating low resolution media assets corresponding to high resolution media assets. As another example, the methods and systems described herein can allow for interactive reconstruction of Internet web pages.

Numerous other modifications can be readily made by those skilled in the art and are defined in the appended claims and included within the spirit of the disclosed invention.

Claims (53)

A method of recording edits in media content, Editing a low resolution media asset corresponding to the master high resolution media asset; Generating an edit specification based on the editing of the low resolution media asset; And Applying the editing specification to the master high resolution media asset to create an edited high resolution media asset, Wherein the editing specification identifies at least one keyframe of the master high resolution media asset. The method of claim 1, wherein the editing step comprises: Modifying an image of the low resolution media asset corresponding to the master high resolution media asset. The method of claim 1, wherein the editing step comprises: Modifying the duration of the low resolution media asset corresponding to the duration of the master high resolution media asset. The method of claim 1, wherein the master high resolution media asset and the low resolution media asset comprise at least one or more frames of video information, and the editing step comprises: Modifying a transition property of the at least one or more video information frames of the low resolution media asset corresponding to the master high resolution media asset. The method of claim 1, wherein the editing step comprises: Modifying a volume value of an audio component of the low resolution media asset corresponding to the master high resolution media asset. The method of claim 1, wherein the master high resolution media asset and the low resolution media asset comprise at least two or more frames of sequential video information, and the editing comprises: Modifying the sequence of at least two or more sequential video information frames of the low resolution media asset corresponding to the master high resolution media asset. The method of claim 1, wherein the editing step comprises: Modifying one or more uniform resource locators (URLs) associated with the low resolution media asset corresponding to the master high resolution media asset. The method of claim 1, wherein the editing step comprises: Modifying a playback rate of the low resolution media asset corresponding to the master high resolution media asset. The method of claim 1, wherein the editing step comprises: Modifying the resolution of the low resolution media asset corresponding to the master high resolution media asset. The method of claim 1, Rendering the edited high resolution media asset on an image rendering device The method of recording an edit in the media content further comprising. The method of claim 10, wherein the rendering comprises: And applying a media asset filter to the edited high resolution media asset. The method of claim 11, wherein applying the media asset filter comprises: Overlaying an animation on the edited high resolution media asset. The method of claim 11, wherein applying the media asset filter comprises: Changing the display attribute of the edited high resolution media asset. The method of claim 1, wherein the editing step occurs on media content on a remote computing device. 15. The method of claim 14, wherein the edit specification writes edits to media content created on a remote computing device. The method of claim 14, Sending the edited high resolution media asset to the remote computing device. The method of recording an edit in the media content further comprising. The method of claim 16, Rendering the edited high resolution media asset on an image rendering device associated with the remote computing device. The method of recording an edit in the media content further comprising. The method of claim 1, Storing the edit specification The method of recording an edit in the media content further comprising. A computer readable medium having a data structure stored thereon, A first data field containing data identifying a high resolution media asset; And A second data field containing data describing one or more edits made to a low resolution media asset associated with the high resolution media asset, And the data describing the edits identify at least one keyframe of the high resolution media asset. 20. The computer readable medium of claim 19, wherein the data in the second data field includes data for modifying an image associated with the high resolution media asset associated with the low resolution media asset. 20. The computer readable medium of claim 19, wherein the data in the second data field includes data for modifying the duration of the high resolution media asset associated with the low resolution media asset. 20. The method of claim 19, wherein the high resolution media asset associated with the low resolution media asset comprises one or more video information frames, and wherein data in the second data field is adapted to modify the transition attribute of the one or more video information frames. Computer-readable media containing data for the computer. 20. The computer readable medium of claim 19, wherein the data in the second data field includes data for modifying a volume value of an audio component of the high resolution media asset associated with the low resolution media asset. 20. The computer readable medium of claim 19, wherein the data in the second data field includes data for modifying the playback order of video information or audio information of the high resolution media asset associated with the low resolution media asset. 20. The computer readable medium of claim 19, wherein the data in the second data field includes data for modifying one or more uniform resource locators (URLs) associated with the high resolution media asset associated with the low resolution media asset. 20. The computer readable medium of claim 19, wherein the data in the second data field includes data for modifying a playback rate of video information or audio information of the high resolution media asset associated with the low resolution media asset. 20. The computer readable medium of claim 19, wherein the data in the second data field includes data for modifying the resolution of the high resolution media asset associated with the low resolution media asset. A method of rendering a media asset, Receiving a command to render an aggregate media asset defined by an editing specification that at least identifies at least one first media asset associated with the at least one editing command; Retrieving the edit specification; Retrieving the first media asset; And Rendering, on a media asset rendering device, the first media asset of the aggregate media asset according to the at least one editing instruction A method of rendering a media asset comprising a. The method of claim 28, wherein retrieving the first media asset comprises: Retrieving the first media asset from a remote computing device. 29. The method of claim 28, wherein the edit specification identifies a second media asset associated with a second edit command. 31. The method of claim 30, Retrieving the second media asset; And Rendering, on a media asset rendering device, the second media asset of the aggregate media asset according to the second editing command A method of rendering a media asset further comprising. 31. The method of claim 30, wherein the first media asset includes at least one or more video information frames and the second media asset includes audio information. 31. The method of claim 30, wherein the first media asset includes at least one or more video information frames and the second media asset includes at least one or more video information frames. 31. The method of claim 30, wherein the at least one editing instruction modifies a transition attribute for the transition from the first media asset to the second media asset. 29. The method of claim 28, wherein the editing instruction modifies the duration of the first media asset. 29. The method of claim 28, wherein the editing command modifies the display attributes of the first media asset. 29. The method of claim 28, wherein the editing command modifies an audio attribute of the first media asset. A computer readable medium comprising or encoding computer executable instructions for performing a method of rendering a media asset, the method comprising: Receiving a command to render an aggregate media asset defined by an edit specification that identifies at least one first media asset associated with the at least one edit command; Retrieving the edit specification; Retrieving the first media asset; And Rendering, on a media asset rendering device, the first media asset of the aggregate media asset according to the at least one editing instruction And a computer readable medium. The method of claim 38, wherein retrieving the first media asset comprises: And instructions for retrieving the first media asset from a remote computing device. 39. The computer readable medium of claim 38, wherein the editing specification identifies a second media asset associated with a second editing command. The method of claim 40, Instructions for retrieving the second media asset; And On a media asset rendering device, instructions for rendering the second media asset of the aggregate media asset according to the second editing instruction The computer readable medium further comprising. 41. The computer readable medium of claim 40, wherein the first media asset includes at least one or more video information frames and the second media asset includes audio information. 41. The computer readable medium of claim 40, wherein the first media asset comprises at least one or more video information frames and the second media asset comprises at least one or more video information frames. 41. The computer readable medium of claim 40, wherein said at least one editing instruction modifies a transition attribute for transitioning from said first media asset to said second media asset. 39. The computer readable medium of claim 38, wherein the editing instructions modify the duration of the first media asset. 39. The computer readable medium of claim 38, wherein the editing instructions modify the display attribute of the first media asset. 39. The computer readable medium of claim 38, wherein the editing instruction modifies an audio attribute of the first media asset. As a method of editing an aggregate media asset, In a playback session, receiving a stream corresponding to an aggregate media asset comprising at least one component media asset from a remote computing device; Rendering the aggregate media asset on an image rendering device; Receiving a user command to edit an edit specification associated with the aggregate media asset; And Initiating an editing session for editing the editing specification associated with the aggregate media asset. A method of editing an aggregate media asset comprising a. The method of claim 48, wherein initiating the editing session comprises: Displaying information corresponding to the editing specification associated with the aggregate media asset. The method of claim 48, Modifying the editing specification associated with the aggregate media asset and thereby changing the aggregate media asset The method of editing an aggregate media asset further comprising. delete delete delete

Images