WO2008019210A2

WO2008019210A2 - Graphical motion composition files and methods for formatting and organization thereof

Info

Publication number: WO2008019210A2
Application number: PCT/US2007/073335
Authority: WO
Inventors: Pierre-Olivier Latour
Original assignee: Apple Inc.
Priority date: 2006-08-04
Filing date: 2007-07-12
Publication date: 2008-02-14
Also published as: EP2062173A2; US20080028918A1; US8650541B2; WO2008019210A3

Abstract

A method and data structure for improving the utility of graphics compositions is disclosed. In one embodiment, composition files are created through the connection of patches in a composition editor. Automatically included with the created composition file is protocol information. Preferably such protocol information is included as metadata in the header of the composition file, and can be constructed in any suitable fashion. So constructed, composition files can be grouped together in a physical or virtual repository accessible to other application programs. Another user can then pick an appropriate composition for a new project based on review and filtering of the protocols as contained in the header information of the repositoried composition files. Such review and filtering can be accomplished using a composition picker user interface in the user's application program. The repository can then be queried for composition files matching or otherwise compatible with the specified protocol.

Description

GRAPHICAL MOTION COMPOSITION FILES AND METHODS FOR FORMATTING AND ORGANIZATION THEREOF

FIELD OF THE INVENTION

[oooi] Embodiments of the invention relate to graphical motion composition files and methods for the formatting and the organization of such files to promote easier sharing and screening of such files.

BACKGROUND

[ooo2] It is known in the art of computer graphics to create motion graphics programs called "compositions." Compositions are a relatively simple way in which a user can intuitively create motion graphical effects (such as a moving background, flashing text, etc.) without extensive knowledge of how to program a computer. An exemplary program that allows for the creation of composition files is known as the Quartz Composer™, manufactured by Apple Computer, Inc. Further information concerning the Quartz Composer can be found in the following documents, copies of which are filed with the Information Disclosure Statement filed with this disclosure, and which are incorporated by reference herein. "Working With Quartz Composer" (published Feb. 13, 2006 at http://developer.apple.com/graphicsimaging/quartz/quartzcomposer.html); "Quartz Composer Programming Guide" (published July 24, 2006).

[ooo3] Quartz Composer is based on and brings together several graphical and non-graphical technologies, such as Quartz 2D, Core Image, Core Video, OpenGL, QuickTime, MIDI System Services, and Real Simple Syndication. As a result, once created, compositions can be incorporated into any number of applications, such as iPhoto, iMove, iChat, PhotoBooth, Final Cut Pro, screen savers, etc.

[ooo4] When creating a composition file 20, and as shown in Figure 1, the editor portion 10 of the Quartz Composer program contains a grid 12 for assembling and connecting "patches" 14, which are selected from a library 16. Patches 14 are like functions, and may take input parameters (the left side of the patches) and provide output results (the right side of the patches). Within the editor 10, patches 14 can be visually connected together by links 18 to create a composition (Compl.qtz) which essentially defines the data flow or the manner in which graphical motion data is processed by the composition.

[ooo5] Consider the exemplary composition illustrated in Figure 1. As shown, four patches 14 have been selected from the library. Each of these patches 14 performs a function, and together the overall effect of the composition provides a "glow effect" applied to an input image. Thus, patch "Image Importer" generates a bitmap image from a source file (such as a JPEG or BMP file); patch "Gaussian Blur" blurs an image by an amount specified by a definable radius; patch "Addition" adds the blurred image to the original bitmap image to superimpose the two; and patch "Billboard" renders the final image on the user's screen. Of course, composition files can also be used to manipulate video (i.e., motion graphics), which constitutes a series of images.

[ooo6] The composition file 20, shown in further detail in Figure 2, is typically constructed of metadata 30 having the header information for the file (such as copyright information, author name, creation date, etc.); the topology of the composition 32 as defined by the patches 14 and links 18; and any assets 34 (data) necessary to the composition (such as a corporate logo or other data structures).

[ooo7] So constructed, a composition file 20, like the patches 14 from which it is created, may have various inputs and outputs as well. This is illustrated in Figure 3, which shows a simplification of the exemplary "glow effect" composition file 20 of Figure 1. As shown, the composition file 20 ultimately receives an input image and produces an output image. However, because the various patches 14 specify other various inputs, other inputs can be present as well. For example, patch "Gaussian Blur" allows the user to specify a radius; patch "Billboard" allow a user to specify color, etc., of the resulting output image. A user can enter values for such other inputs during the creation or editing of the composition, such as by mousing over the input in question (e.g., radius) and typing in an appropriate number. Otherwise, default values can be automatically populated for those inputs. (Note that other patch inputs such as "X and Y Position" and "Rotation" are not shown as inputs to the composition file 20 because of their minor significance in the mind of the designer of the composition file. In other words, the designer in this example has configured the composition file such that X and Y position and Rotation are not modifiable by the end user.).

[0008] A benefit of the Quartz Composer format is the ease with which a user can quickly create a relatively complicate graphical composition. However, that same complexity makes it rather difficult for one user to use the compositions of another. This is because, as just noted with respect to Figure 3, different compositions will have different input and output characteristics depending on which patches 14 have been used to create the composition. Suppose a user is considering several composition files 20 (*.qtz) present on his company's server, and is considering whether or not they would be of use to his current graphical project. Such a user cannot know absent trial and error which composition files 20 might be suitable for his graphical project. For example, a user might be trying to manipulate an image, and accordingly any compositions missing image inputs would be inapplicable to that user. But such an inconsistency would not be known to the user until he tried to use this file and realized that the selected composition file was unsuitable for his project.

[ooo9] A solution to this problem is therefore desirable, and is provided in this disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

[ooio] Embodiments of the inventive aspects of this disclosure will be best understood with reference to the following detailed description, when read in conjunction with the accompanying drawings, in which:

[ooii] Figure 1 shows the creation of a composition file in accordance with the prior art.

[ooi2] Figure 2 shows the basic data structure of a composition file in accordance with the prior art. [ooi3] Figure 3 shows the inputs and outputs of a composition file in accordance with the prior art.

[ooi4] Figure 4 shows the basic data structure of a composition file in accordance with an embodiment of the invention, which includes protocol information in the file's metadata reflective of the format of the file.

[ooi5] Figure 5 shows several of the composition files of Figure 4 in a repository, and the ability of user to query those files from different applications.

[ooi6] Figure 6 shows a user's application program and shows a composition picker user interface for selecting a compatible composition file from the repository of Figure 5.

DETAILED DESCRIPTION

[ooi7] A method and data structure for improving the utility of graphics compositions is disclosed. In one embodiment, composition files are created through the connection of patches in a composition editor. Included with the created composition file is protocol information. Preferably such protocol information is included as metadata in the header of the composition file, and can be constructed in any suitable fashion. So constructed, composition files can be grouped together in a physical or virtual repository accessible to other application programs. Another user can then pick an appropriate composition for a new project based on review and filtering of the protocols as contained in the header information of the repositoried composition files. Such review and filtering can be accomplished using a composition picker user interface in the user's application program. The repository can then be queried for composition files matching or otherwise compatible with the specified protocol.

[ooi8] Figure 4 shows the basic format of a composition file 20 in accordance with one embodiment of the invention. As shown, the format is largely the same as shown in Figure 2, but includes protocol information 50 as part of the metadata 30 header. Such protocol information 50 reflects a convention which ultimately reflects the number and formats of input and output characteristics of the composition file 20 as explained below. For example, shown in Figure 4 is the protocol "Image Filter," which, as will be explained below, ultimately specifies that the composition file applies an effect to a source image in order to produce a modified or new image.

[ooi9] The protocols 50 provide a standardized way of making a call to a protocol registry 62, which actually contains the records concerning the number, name, and format of the inputs and outputs. Thus, as shown, registry entry 62b, corresponding to protocol "Image Filter," specifies a single input and a single output, each taking the format of an image. Registry entry 62a, corresponding to protocol "Music Visualizer," is more complex, and involves a visual way to represent music on a user's screen. It receives as inputs an instantaneous peak volume (in the format of a number); a quantified amount of low and high frequency energy (a number); and artist name and album name (in the format of text). As further specified, that protocol outputs an single image which essentially pulsates to the beat of the music, and which displays the artist and album particulars. In short, the protocol registry entries, at a minimum, specify the primary information necessary to composition file compatibility, namely name, format, and number of inputs and outputs.

[0020] However, the protocol 50 does not restrain the composition files 20 that conform to it to have only those primary inputs and outputs; other secondary inputs are permissible. In the example of Figure 3, such secondary inputs might include the radius used in the Gaussian filter and the color of the output image. Such inputs and outputs are secondary in that they could be of benefit to a user to review and consider when picking a composition file, and may have to be edited by the user if the composition file is picked, but is not critical to compatibility with the user's graphical project. In short, while such secondary inputs and outputs can be of help to the composition file designer in creating a more powerful, flexible, parametrizable, and configurable composition file, they are merely secondary and not critical to compatibility with end users graphical projects. [002i] The entries in the protocol registry 62 can additionally specify other additional information not significant to the issue of compatibility, for example, a textual description of the protocol suitable for displaying in a user interface.

[0022] One skilled in the art of computer programming will appreciate that the protocol information 50 and protocol registry 62 can be coded in any number of suitable manners, such as by using forms of extensible markup language, etc. The manner in which such coding occurs is therefore not of particular importance to embodiments of the invention. The protocol information 50 is typically populated by the file editor concurrent with the creation of the composition file 20.

[0023] In any event, the protocol 50 of the composition file 20 allows various users' composition files to be queried, reviewed, and (if suitable) used by other users. Such querying by other users can be conveniently accomplished when the composition files 20 are centrally located in a repository 70, as is shown in Figure 5. Such a repository 70 can be physical or virtual. In one example, all composition files 20 can be stored in a particular directory in on a particular system (e.g., in directory "Library/Quartz Composition Files"). However, in other applications, accessible composition files 20 need not be commonly located, but instead can be marshaled for review by a suitable search engine (e.g., one that searches for all *.qtz files on a system).

[0024] As shown in Figure 5, the repository 70 of composition files 20 is accessible by any of a plurality of users on the system. As shown, each user runs an application ("App x") which is capable of rendering and/or editing the composition files. As discussed earlier, the number of different application able to access the composition files 20 can be numerous, especially when a flexible format like Quartz Composer is used.

[0025] Once added to the repository 70, the composition file 20 is assigned a unique identifier in the form of a unique text string. This allows the composition file 20 to be reliably and persistently identified independent of the client application or of the computer. The identifier remains identical even if the composition file is moved to a new location within the repository, or installed in a repository on a different computer. A unique identifier also allows a client application program to refer directly to the composition file in the repository, and further provides to the client application a simple mechanism for remembering a previously-selected composition file 20 (e.g., for use as a default) without having to keep a copy of the actual composition file.

[0026] Figure 6 illustrates one user's application program 80, and shows the manner in which the protocol information 50 in the composition files 20 can be used to quickly sort out composition files of interest in the repository 70. Shown in the application 80 is a particular graphical project 85, in this case an image. Suppose the user wishes to manipulate that image to produce a different-looking output image, for example, by applying some sort of filter to the image. To so manipulate the file, the user can access the menu structure of the application 80 (not shown) to ultimately access or incorporate 82 composition files 20 present in the repository 70 (or elsewhere on the system if a search engine is used).

[0027] However, realizing that composition files 20 can be varied in nature, with different usage models and inputs and outputs, the composition files 20 in the repository 70 are queried for those that are compatible with the graphical project 85. In this regard, the user can be presented with composition picker user interface 83 for choosing a suitable composition file 20. As shown, the user can select the criteria ("image filter," "music visualizers," etc.) for the composition files he wishes to review, which is used to query the repository 70 for suitable compositions files 20. In this regard, note that the composition criteria as specified in the applications program corresponds with the protocol information 50 discussed earlier during the creation of the composition files 20. This allows the composition criteria to be compared against the protocol information 50 to select suitable composition files 20 for the user's consideration.

[0028] Assuming the composition criteria as shown, and referring again to the composition files 20 of Figure 5, it is seen that a comparison of the composition criteria and the protocol information 50 for each of the files 20 has yielded a match (file "comp2.qtz"), which is displayed in a results window 87 in Figure 6. Because this selected composition file 20 is necessarily compatible with the user's graphical project 85, a preview window 88 can be used to briefly display the effect the composition file will have on the project 85. Of course, if more than one composition file 20 is determined to be suitable, they too will be listed in the results window 87 for potential user selection.

[0029] To the extent a selected composition file 20 has other secondary inputs not critical to compatibility, default values can be used, or the user can be prompted to enter or edit such inputs either before or after application of the selected composition file 20 to his graphical project 85. Additionally, the composition picker 83 can also be used to filter the composition files returned (to results window 87) in other ways using the metadata 30 already typically present in a composition file. For example, the composition picker 83 as shown might provide an option or options for various attributes, such as author name (not shown), and thus return from the query only those composition files 20 authored by a particular person or organization. The application 80 can use a standard user interface picker program which is provided as a service along with the repository 70, or the application program can implement its own user interface picker. Indeed, if the process is automated, no picker may be needed at all.

[0030] While preferred embodiments of the invention have been disclosed, it should be understood that the embodiments as disclosed herein can be modified while still achieving the various advantages discussed herein. In short, it should be understood that the inventive concepts disclosed herein are capable of many modifications. To the extent such modifications fall within the scope of the appended claims and their equivalents, they are intended to be covered by this patent.

Claims

WHAT IS CLAIMED IS:

1. A method for formatting a graphical composition file, comprising: creating a composition, wherein the composition is formed by linking patches, wherein each patch has at least one input and/or at least one output, and wherein each input and/or output has a format; storing protocol information with the composition indicative of the format of at least one input and/or the format of at least one output for the composition.

2. The method of claim 1, wherein the protocol information comprises a name, and wherein the protocol information is indicative of the format of the at least one input and/or the format of the at least one output for the composition via a protocol registry.

3. The method of claim 2, wherein the protocol registry comprises the name of the protocol and the format of the at least one input and/or the format of the at least one output for the composition.

4. The method of claim 1 , further comprising storing the composition file in a composition file repository.

5. The method of claim 1, wherein the patches are graphically represented by their at least one input and/or their at least one output in the editor program.

6. The method of claim 1, wherein the protocol information calls to a protocol registry.

7. The method of claim 1, wherein the format comprises one image or a series of images.

8. A method for formatting a graphical composition file, comprising: creating within an editor program a composition, wherein the composition is formed by linking patches, wherein each patch has at least one input and/or at least one output, and wherein each input and/or output has a format; storing protocol information with the composition, wherein the protocol information points to a protocol registry entry which indicates of the format of at least one input and/or the format of at least one output for the composition.

9. The method of claim 8, wherein the protocol information comprises a name.

10. The method of claim 8, further comprising storing the composition file in a composition file repository.

11. The method of claim 8, wherein the patches are graphically represented by their at least one input and/or their at least one output in the editor program.

12. A data structure for a graphical composition file, comprising: a composition topology for a graphical motion file, wherein the composition topology is formed by linked patches each having at least one input and/or at least one output, and wherein each input and/or output has a format; and metadata, wherein the metadata comprises protocol information, wherein the protocol information is indicative of the format of at least one input and/or the format of at least one output for the composition.

13. The data structure of claim 12, wherein the protocol information comprises a name, and wherein the protocol information is indicative of the format of the at least one input and/or the format of the at least one output for the composition via a protocol registry.

14. The data structure of claim 13, wherein the protocol registry comprises the name of the protocol and the format of the at least one input and/or the format of the at least one output for the composition.

15. The data structure of claim 12, wherein the protocol information calls to a protocol registry.

16. The data structure of claim 12, wherein the format comprises one image or a series of images.

17. A data structure for a graphical composition file, comprising: a composition topology for a graphical motion file, wherein the composition topology is formed by linked patches each having at least one input and/or at least one output, and wherein each input and/or output has a format; and protocol information pointing to a protocol registry entry which indicates of the format of at least one input and/or the format of at least one output for the composition.

18. The data structure of claim 17, wherein the protocol information comprises a name.

19. The data structure of claim 18, wherein the protocol registry comprises the name of the protocol and the format of the at least one input and/or the format of the at least one output for the composition.

20. The data structure of claim 17, wherein the format comprises one image or a series of images.

21. A method for choosing a graphical composition file to process a graphical project in an application program, comprising: specifying composition criteria for the graphical project; querying at least one composition file using the composition criteria, wherein the at least one composition file comprise protocol information indicative of the format of at least one input and/or the format of at least one output for the composition; comparing the composition criteria with the protocol information to determine which of the at least one composition files are compatible with the graphical project; and permitting the compatible composition files to modify the graphical project.

22. The method of claim 21, wherein the protocol information comprises a name, and wherein the protocol information is indicative of the format of the at least one input and/or the format of the at least one output via a protocol registry.

23. The method of claim 22, wherein the protocol registry comprises the name of the protocol and the format of the at least one input and/or the format of the at least one output.

24. The method of claim 21, wherein the at least one composition file is stored in a composition file repository.

25. The method of claim 21, wherein the protocol information calls to a protocol registry.

26. The method of claim 21, wherein the format comprises one image or a series of images.

27. A method for choosing a graphical composition file to process a graphical project in an application program, comprising: specifying protocol information for the graphical project, where the protocol information is indicative of the format of at least one input and/or the format of at least one output for the composition; querying at least one composition file in a repository using the protocol information; determining from the protocol information which of the at least one composition files are compatible with the graphical project; and permitting the compatible composition files to modify the graphical project.

28. The method of claim 27, wherein the protocol information comprises a name, and wherein the protocol information is indicative of the format of the at least one input and/or the format of the at least one output via a protocol registry.

29. The method of claim 28, wherein the protocol registry comprises the name of the protocol and the format of the at least one input and/or the format of the at least one output.

30. The method of claim 27, wherein the protocol information calls to a protocol registry.

31. The method of claim 27, wherein the format comprises one image or a series of images.