JP2003531441A - System and method for digital document processing - Google Patents

Abstract

  (57) [Summary] A display technology that separates the basic functions of an application program from the graphical display process, thereby eliminating or reducing the need for an application that controls the display device and provides tools and controls for a graphical user interface for display. Accordingly, such a system reduces or eliminates the need for an application program to be present in the processing system when displaying data, such as documents or video streams, created by or for the application program. Thus, in one aspect, the systems and methods described herein can display content, including documents, video streams, or other content, without the need for the underlying application to be in a system for displaying content. It is understood that it is possible and provides graphical user functions, such as zoom, pan, or other such functions, to view the displayed document. Advantages of the systems and methods described herein over the prior art include those that allow different types of content from different application programs to be shown on the same display, within the same workspace.

Description

Detailed Description of the Invention

Related Application This application is a previously filed UK patent application 000, filed April 14, 2000.
No. 9129.8 and U.S. patent application 09/703, filed October 31, 2000.
No. 502 claims priority, both have Majid Anwar as inventor, the contents of which are incorporated herein by reference.

FIELD OF THE INVENTION The present invention relates to data processing systems, and more particularly to processing digital documents to produce an output representation of a source document, as an image representation, hard copy, or in some other representation format. Method and system for doing so.

BACKGROUND The term “digital document” as used herein
"), typically in whole or in part, by being visually displayed or reproduced (e.g., by an image display device or printer), or by text-to-speech conversion. Used to indicate a digital representation of any type of data processed by a data processing system intended to be some form of output to a user of the. A digital document may include any displayable feature including, but not limited to, text, graphic images, animated graphic images, full motion video images, interactive icons, buttons, menus, or Contains hyperlinks. Digital documents may include non-visual elements such as auditory (sound) elements.

Data processing systems, such as personal computer systems, come from any one of several local or remote sources and exist in any one of a wide variety of data formats (“file formats”). It is typically required to process possible "digital documents". To produce an output of this document, whether as an image display or as a printed copy, for example, a computer system translates the original data file and outputs it to an associated output device (e.g., monitor, or It is necessary to generate output compatible with other image display devices or printers. Typically, this process involves application programs adapted to translate data files, computer operating systems, software "drivers" specific to the desired output device, and in some cases (especially monitors, or other image display devices). Due to), it will include additional hardware in the form of expansion cards.

This conventional approach to processing digital documents to produce output is deficient in terms of hardware resources, software overhead, as well as processing time, and low power portable data including wireless telecommunication systems. It is not completely suitable for processing systems or low-cost data processing systems such as network terminals. Traditional digital document processing systems require the configuration of multiple system components (including both hardware and software components) to interact in any desired manner, as well as different systems (eg, formatting, color reproduction). Etc.) and other problems, including inconsistencies in processing the same source material. In addition, this conventional approach to digital document processing fails to take advantage of the commonality and / or reusability of file format components.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a method and system for processing digital documents that avoids or reduces the aforementioned disadvantages of conventional methods and systems, as well as apparatus incorporated into such methods and systems.

The systems and methods described herein decouple the underlying functionality of the application program from the graphical display process, thereby controlling the display of the device and providing graphical user interface tools and controls for the display. To provide display technology that eliminates or reduces the need for active applications. Moreover, such systems reduce or eliminate the need for application programs to be present in the processing system when displaying data, such as documents or video streams, created by or for application programs. Thus, in one aspect, the systems and methods described herein include
Content, including documents, video streams, or other content, can be displayed without the need for an underlying application to be present in the system for displaying the content, and zoom, pan to view the displayed document. It is understood to provide graphical user functionality, such as, or other such functionality. Advantages of the systems and methods described herein over the prior art include the advantage of allowing different types of content from different application programs to be presented on the same display within the same workspace. Many additional advantages will be apparent to those skilled in the art, and they will also find many ways to use the technology underlying the present invention to create additional systems, devices, and applications. be able to. It is understood that these modified systems, as well as alternative systems and implementations, are within the scope of the invention.

More particularly, the systems and methods described herein receive an input byte stream representing source data in one of a plurality of predetermined data formats, and the input byte stream is in a predetermined data format. Includes a digital content processing system including an application dispatcher for connecting to one. The system also translates the input byte stream as a function of the associated predetermined data format, and the input byte stream is
A document agent for parsing into a stream of document objects that provides an internal representation of the basic structure within the input byte stream may be included.
The system also includes a core document engine for converting the document object into the internal representation data format and for mapping the internal representation data to locations on the display.
ne) is also included. A shape processor in the system processes the internal representation data and operates an output device to display the content as represented by the internal representation.

Aspects of the invention are described below, by way of example only, with reference to the accompanying drawings.

The above and other objects and advantages of the present invention will be more fully understood from the further description thereof below, with reference to the accompanying drawings.

Detailed Description of Some Illustrated Aspects The systems and methods described herein provide an output stream or output file produced by an application program for the purpose of displaying output on an output device such as a video display. It includes a computer program that operates to process. An application according to the invention can process these streams to create an internal representation of its output, and further process this internal representation for display on the output device as output produced by the application according to the invention. Can create a new output stream. Thus, the system of the present invention decouples the application program from the display process, thus freeing the application program from having to display the output on a particular display device, and further displaying the application program to the output. Eliminates the need to exist when processing application output for the purpose.

To illustrate this operation, FIG. 1 illustrates a plurality of application programs collectively shown as element 13 that are created by an output stream for processing and displaying on device 26. A high level functional block diagram of a system 10 is provided that allows an output stream to be passed to a computer process 8 that produces a representation of various outputs. This collective output of application programs 13 is depicted in FIG. 1 by an output printer device 26 that displays the output content produced by the various application programs 13. Output device 2
It will be appreciated by those skilled in the art that 6 represents the output produced by the computer process 8 and that this output collectively delivers the content of the plurality of application programs 13. In the illustration provided by FIG. 1, the displayed content consists of multiple images and the output device 26 is a display. However, one of ordinary skill in the art will appreciate that other implementations may be delivered in formats other than images, such as auditory, tactile, or any other format, or any combination of formats suitable for communicating information to a user. it is obvious. Further, those of ordinary skill in the art will appreciate that the type of output device 26 will vary with the application and include devices for displaying audio content, video content, print content, plot content, or any other type of content. It is understood that it is good. For purposes of explanation, the systems and methods described herein are generally shown as displaying an image on a display device, these exemplary systems are for illustrative purposes only, and It is understood that it should not be understood as limiting. Thus, the output produced by the application programs 13 is processed and aggregated by the computer process 8 to create a single display containing all the content produced by each application program 13.

In the depicted embodiment, the output of each representation that appears on the display 26 is called a document, and each depicted document can be associated with one of the application programs 13. It is understood that the term document, as used herein, includes documents, stream video, stream audio, web pages, and any other form of data that can be processed and displayed by the computer process 8. To be done. The computer process 8 produces a single output representation containing one or more documents produced by the application program 13 during its output representation. This collection of displayed documents represents content generated by the application program 13, which content is displayed within the program window generated by the computer process 8. The program window for the computer process 8 is equipped with a graphical user interface and yet has a series of icons representing tools which allow the user to control the behavior of the document, in this case the screen display, which appears in the program window. May be included.

On the contrary, the conventional approach, in which each application program is to form its own display, is for a display device 26 that includes multiple program windows, typically one for each application program 13. The resulting display. In addition, each different type of program window contains a different set of tools for manipulating the content displayed in that window. Therefore, the system 10 of the present invention has the advantage of providing a consistent user interface and only requiring knowledge of a set of tools to display and control different documents. In addition, the computer process 8 operates on the output of the application program 13, and therefore only needs that output to create the document that appears in the program window. Therefore, it is not necessary for the application program 13 to reside on the same machine as the processing 8 or the application program 13 to operate in accordance with the computer processing 8. The computer process 8 only needs the output from these application programs 13, which can be delivered early from the stored data file created by the application program 13. However, the systems and methods described herein allow an application program to display its own content, control at least a portion of display 26, and display that content within a program window associated with the application program. May be used as part of. In these aspects, the system and method of the present invention may operate as a separate application appearing on a portion of the display provided for use.

More specifically, FIG. 1 depicts a plurality of application programs 13. These application programs may include word processing programs such as, for example, Word, Word Perfect, or any other similar word processing program.
For example, Netscape Composer that generates an HTML file, Adobe Acrobat that processes a PDF file, a web server that delivers XML or HTML, and streaming that generates a stream of audiovisual data. A server, an email client or server, a database, a spreadsheet, or any other that delivers output either as a file, a data stream, or in some other format suitable for use by a computer process. Contains programs such as application types. In the aspect of FIG. 1, each application program 13 presents its output content to the computer process 8. In operation, this can occur by having the application process 13 direct its output stream as an input byte stream to the computer process 8. The use of data streams is well known to those skilled in the art,
For example, Stephen G.M. Kochan, Programming i
n C, Hayden Publishing (1983). Additionally, application program 13 can create a data file, eg, a word document, that is streamed to computer processing 8, either by another application or by computer processing 8.

Computer process 8 is capable of processing various input streams to create the aggregated display shown on display device 26. To this end, and as shown in more detail below, the computer process 8 processes the input streams to produce an internal representation of each of these input streams. In one implementation, this internal representation is intended to be as close as possible to the output stream of the respective application program 13. However, in other aspects, the internal representation is created to selectively, briefly, or partially resemble the output streams generated by the respective application programs 13. Additionally or additionally, the systems and methods described herein may apply a filter to the translated content, thereby removing some of that content from the displayed or presented content. To be able to be done. Further, the systems and methods described herein may allow the structure of the source document to be altered, repositioning the content within the document, reordering the structure of the document, or selecting only certain types of data. To enable. Similarly, in one ancillary aspect, content including active content, such as links to websites, can be added during the translation process. In any event, the internal representation created by computer processing 8 can be further processed by computer processing 8 to operate display device 26 to create the aggregated image depicted in FIG.

Referring to FIG. 2, a more detailed representation of the system of FIG. 1 is presented. In particular, FIG. 2 illustrates that computer processing 8, source document 11, and display device 26.
Drawing system 10 including. The computer process 8 includes a plurality of document agents 12, an internal representation format file and process 14, a buffer store 15,
Generic object library 16 and, in this aspect, analysis module 1
8 includes a core document engine consisting of 8 and a rendering module, an internal view 20, a shape processor 22 and a final output 24. FIG. 2 further illustrates an additional input device 3 for communicating user input 40 to computer process 8.
Draw 0. The depicted aspect includes a process 8 that includes a shape processor 22. But,
It will be apparent to those skilled in the art that the depicted process 8 is merely exemplary and may be implemented with alternative processes and architectures. For example, the shape processor 22 may optionally be implemented as a hardware component such as a semiconductor device that supports the operation of other elements of the process 8. Further, while FIG. 2 shows process 8 as a functional block diagram containing a single system, process 8 can be distributed across several different platforms and, incidentally, its elements It will be appreciated that operating at various times, the output from one element of process 8 can be delivered as an input to the next element of process 8 at a later time.

As discussed above, each source document 11 is bound to a document agent 12 that can translate the input document into an internal representation of the content of that source document 11. Source document 11
In order to identify a suitable document agent 12 for processing the, the system 10 of FIG. 1 includes an application dispatcher (not shown) that controls the interface between the application program and the system 10. In one implementation, the use of an external application programming interface (API)
It is handled by the application dispatcher, which either passes the data, calls the appropriate document agent 12, or executes the request made by the application program. The application dispatcher
It informs all loaded document agents 12 of the source document 11 in order to select the appropriate document agent 12 for a particular source document 11. These document agents 12 will then respond with information regarding the particular suitability for translating the content of the source document 11 informed. When the document agent 12 responds, the application dispatcher selects the document agent 12 and sends the URI of the source document 11 to the selected document agent 12.
Pass a pointer like.

In one implementation, the computer process 8 is executed as a service in which multiple threads are created, which can support multi-processing of multiple document sources 11. In another aspect, the process 8 does not support multi-threaded processing, and the document agent 12 selected by the application dispatcher is called on the current thread.

It will be appreciated that the exemplary aspect of FIG. 2 provides a flexible and extensible front for processing input data streams of different file formats. For example, incidentally, if the application dispatcher determines that the system lacks a suitable document agent 12 to translate the source document 11, the application dispatcher will notify each application program 13 of the source document. It can be signaled that 11 is in an unrecognized format. Additionally, the application program 13 reformats the source document 11 by, for example, converting the source document 11 created by the application program 13 from the current format to another format supported by the application program 13. You may choose to make it possible. For example, the application program 13 may determine that the source document 11 needs to be saved in a different format, such as an earlier version of that file format. To the extent that the application program 13 supports the format, the application program 13 can resave the source document 11 in this supported format so that the document agent 12 provided by the system 10 can translate the source document 11. . Additionally, the application dispatcher indicates to the user that when the system 10 lacks a suitable document agent 12, a new document agent of a particular type may be needed to translate the current source document 11. be able to. To this end, the computer process 8 may indicate to the user that a new document agent needs to be loaded into the system 10, and may direct the user to a location such as a website where the new document agent 12 can be downloaded. . Optionally, the system can automatically include the document agent without asking the user, or, for example,
A generic agent such as a generic text agent capable of extracting a part of the source document 11 representing text
agent) 12 can be identified. Further, an agent may be provided to prompt the user for input and instructions during the translation process.

In a further ancillary aspect, the application dispatcher associated with the document agent 12 may be explicit in the document, for example, from a filename that includes a filename extension, or from known characteristics of content of a particular file type. It acts as an input module to identify the file format of the source document 11 based on any one of various criteria, such as identifying the file type of. The byte stream is the input to the document agent 12 that is specific to the file format of the source document 11.

Although the above discussion has discussed input data provided by streams or computer files, the system 10 can stream its output from an input device, such as a digital camera or scanner, and directly to the process 8. It should be understood by those skilled in the art that it may be applied to the input received from the application program that causes the output to be flowed to the process 8 by the operating system. In this case, the input byte stream may come directly from the input device, rather than from the source document 11. However, the input byte stream is also a data format suitable for processing by the system 10, and for the purposes of the present invention, the input received from such an input device may be considered the source document 11.

As shown in FIG. 2, the document agent 12 includes parameters that define the characteristics of particular instances of various document objects within a document, and general types such as those defined in the library 16. A library of standard objects 16 is used to generate an internal representation 14 that describes the content of a source document with a set of document objects. Thus, library 16 provides a set of types of objects that document agent 12, parser 18, and system 10 recognize. For example,
The document objects used in the internal representation 14 are text, bitmap and vector graphics document objects, which may or may not be animated, or may be two-dimensional, three-dimensional, video, and audio. , And various types of interactive objects such as buttons and icons. Vector graphics document objects can be Postscript-like paths with specific fills and transparency. The bitmap graphics document object is, for example, JPEG or GIF.
, And PNG object types. A text document object may declare a stylized range of text. This range may include paragraphs of text,
It is typically understood as a series of characters found between two delimiters, such as a pair of carriage returns. Each text object may include a group of characters and style information for that group of characters, including one or more associated typefaces, points, and other such style information.

Typically, the parameters that determine a particular instance of a document object are related to the dimensional coordinates that determine the physical shape, size, and position of the document object, and any to define a document object whose properties change over time. Temporal data, which enables the system to handle dynamic document structure and / or display capabilities. For example, a stream of video input may be processed by system 10 as a series of images changing at a rate of, for example, 30 frames per second. In this case, it means that the temporal characteristics of this image object should be updated 30 times per second. As discussed above, the parameters also include the font and size that should normally be applied to the string for the text object. The parameters of the object may define other properties such as transparency. It is understood that the internal representation may be stored / stored in a file format specific to that system, and the range of source documents 11 that can be input to the system 10 may include documents in a file format native to the system. . The internal representation 14 can be converted to any other range of file formats, if desired, using a suitable conversion agent.

FIG. 3 depicts a flow chart diagram of an exemplary process performed by the document agent 12. In particular, FIG. 3 illustrates an example of a document agent 12, a process 5 representing the operation of the document agent 12 suitable for translating the content of a Microsoft Word document into an internal representation format.
Draw 0. In particular, process 50 includes an initialization step 52 that initializes data structures, memory space, and other resources that process 50 uses while translating source document 11. After step 52, the process 50 proceeds to a series of steps 54, 58, 60 where the source document 11 is parsed and divided into subsections. In the process 50 depicted in FIG. 3, step 54
, 58, 60 subdivides the source document 11 into sections first when it is streamed to the document agent 12, then subdivides this section into paragraphs, and then this paragraphs into the individual characters that make up the paragraph. Subdivide. The sections, paragraphs, and letters identified in the source document 11 may be identified in a piece table containing certain pointers to different subsections identified in the source document 11. It will be appreciated by those skilled in the art that the piece table depicted in FIG. 3 represents a construct used by MS words to provide pointers to different subsections of a document. Furthermore, it will be appreciated that the use of piece tables or constructs such as piece tables is ancillary and immediately dependent on the application and on the type of document being processed.

Once the process 50 begins identifying different characters found within a particular paragraph in step 60, the process 60 proceeds to step 62 where a style is applied to the character or set of characters identified in step 60. You can proceed. Applying a style is understood to associate the identified characters with the style representations used with those characters. The style indication may include characteristics associated with the character, including font type, font size, and whether the character is bold, italic, or of another style. In addition, in step 62, the process
It can be determined whether the character rotates or is arranged to follow a curved path or other shape. Additionally, in step 62, the style associated with the paragraph in which the character occurs may be identified and associated with that character. Such characteristics may include line spacing associated with paragraphs, margins associated with paragraphs, spacing between characters, and other such characteristics.

After step 62, process 50 proceeds to step 70 where an internal representation is formed. An object that describes the structure of the document is created in step 64 as an object in the internal representation, and the bound style of this object, along with the characters it contains, is created separately in the internal representation in step 68. . Figures 6, 7, and 8, described in more detail below, are characterized in that the structure of a document is captured by a group of document objects, and the data associated with this document object is stored in another data structure. , Graphically draw the file structure created by process 50. After step 70, process 50 proceeds to decision block 72, where process 50 determines if the paragraph associated with the last processed character is complete. If the paragraph is not complete, the process 50 returns to step 60 where the next character from the paragraph is read. Alternatively, if the paragraph is complete, the process 50 proceeds to decision block 74 where the process 50 determines if the section is complete. If the section is complete, the process returns to step 58 and the next paragraph is read from the piece table. Alternatively, if the section is complete, then the next section, if any, is read from the piece table to step 54 and processing continues. Once the document has been processed, the system 8 can send, save, export, or otherwise store the translated document for subsequent use. This system can store the translated files in a format compatible with the internal representation, and incidentally, (an "export document agent", not shown, capable of receiving the internal representation data and creating the source document data). Other formats as well, including formats that are compatible with the file format of the source document 11 as well as binary, textual document description structure, markup text, etc. Can be stored in an appropriate format of, and then Unicode and shift mapping (Shiftmappi
ng), big-5 (big-5), and a luminance / chrominance model, a universal text encoding model may be used.

As can be seen from the above, the format of the internal representation 14 is the “structure” (or “or structure” of the document as described by the type of object and its parameters.
Layout ") is separated from the" content "of various objects, for example, the character string (content) of a text object is separated from the dimension parameter of an object, and the image data (content) of a graphic object is separated from the parameter of that dimension. Separated from. This allows the document structure to be defined with compression means and provides the option for content data to be stored remotely and to be retrieved by the system only when needed. Internal representation 14 is a "high level" description that describes the document and its constituent objects.

The document agent 12 described above with reference to FIG. 3 is capable of processing a data file created by an MS word word processing application, which data file is an object selected from the library 16. It can be translated into an internal representation formed from a set of types, which represents the content of the processed document. Therefore, the document agent 12 parses the document in words and translates the structure and content of the document into an internal representation understood by the computer process 8. An example of a type of word document that can be processed by the document agent 12 is depicted in FIG. In particular, FIG. 4 depicts a word document 32 of the type created by the MS Word application program. The depicted document 32 includes a page of information that includes two columns of text 34 and one figure 36. FIG. 4 further illustrates that one column of text runs from the top of page 38 to the bottom of page 38, and a second column of text runs from about the center of the page to the bottom of the page, and FIG. A column of text 34 and FIG. 36 are placed on page 38 so that they are placed above the second column.

As discussed above with reference to FIG. 3, the document agent 12 begins processing the document 32 by determining that the document 32 contains a page and contains multiple different objects. For a single page found by the document agent 12, the document agent 12
Identifies the style of the page, and for example it is 8.5x in portrait format.
It becomes the page style of 11 pages. The page styles identified by the document agent 12 are represented in an internal representation for later use by the parser 18 in formatting and streaming the text into the document created by operation 8.

For the document 32 depicted in FIG. 4, there is only one page. However, it will be appreciated that the document 12 may process word documents containing multiple pages. In such a case, the document agent 12
Process each page separately by creating a page and then filling it with objects of the type found in the library. As such, the page style information may include that the document includes a plurality of pages and that the pages have a predetermined size. Other page style information may be identified by the document agent 12, and the identified page style information may vary with the application. Accordingly, different page style information may be identified by a document agent capable of processing Microsoft Excel document or real-media data streams.

Once the document agent 12 has identified the page style, as further described with reference to FIG.
2 can be mapped into document objects that are recognized by the system, and can typically begin to be decomposed into objects that can be stored in library 16.
For example, the document agent 12 processes the document 32 to find text objects, bitmap objects, and vector graphic objects. Other types of object types may optionally be provided, including video types, animation types, button types, and script types. In this implementation, the document agent 12 identifies a text object 34 whose bound style has two columns. The paragraphs of text that occur within the text object 34 may be parsed to identify each character in a separate paragraph. Process 50 may apply style characteristics to each identified character group, and each identified character group in document 32 may be mapped to a text object of the type listed in library 16. . By the document agent 12, as each character group and applied style has been found in the document 32 and translated into a document object, in this case a text object of the type listed in the library 16. It can be understood as the identified object. This internal representation object may be streamed from document agent 12 to internal representation 14. The document agent 12 continues to translate the objects found in the document 32 into document objects recognized by the system 10 until the respective objects are translated. The object type is appropriate for the application, and can be digital documents, audio / visual displays, music files, interactive scripts, user interface files, image files, and any other type of file. It may include an object type suitable for translating source data representing and.

Referring to FIG. 5, the process 80 depicted in FIG. 5 finds that it is possible to compress similar objects that appear within the internal representation of the source document 11 in order to reduce the size of the internal representation. To be For example, FIG. 5 depicts a process 80 in which step 82 has a basic library object A to be processed, and step 84 inserts the basic object into a document that will be an internal representation of source document 11. At step 88, another object B provided by the document agent 12 is passed to the internal representation file processing 14.
The process 80 then performs a series of depicted steps 92-98 in which the properties of object A are compared to the properties of object B to determine if the two objects are the same property. For example, if the object A and the object B represent two characteristics such as a character P and a character N, if both characteristics P and N have the same color, the same font, the same size, and the bold type or If it is the same style, such as in italics, then the process 80 at step 94 combines the two objects into a single object classification stored in the internal representation. If these properties do not match, process 80 adds them to the internal representation as two separate objects.

FIG. 5 depicts a process 80 in which the internal representation file 14 compresses an object as a similar function of physically close objects. Those skilled in the art will appreciate that this is just one process for compressing objects and that other techniques may be used. For example, in an ancillary implementation, the compression process may include a process for compressing visually close objects.

FIGS. 6, 7 and 8 depict the structure of the internal representation of a document processed by the system depicted in FIGS. The internal representation of the document may be represented as a computer file or as data stored in core memory. However, one of ordinary skill in the art will appreciate that the data structure selected to capture or transport the internal representation will vary with the application, and any suitable data structure will fall outside the scope of the invention in conjunction with the systems and methods described herein. It is clear that it may be used without.

As described in more detail below, the structure of the internal representation of the processed document decouples that document's structure from the document's content. In particular, the structure of a document is captured by a data structure that describes the different document objects that make up the document, as well as how these document objects are arranged in relation to each other. The separation of structure from this content is shown in FIG. 6, where a data structure 110 captures the structure of the document being processed and that structure is independent of the actual content associated with that document. Store in the format. In particular, the data structure 110 includes a resource table 112 and a document structure 114. The resource table 112 provides a list of resources for building the internal representation of the document. For example, the resource table 112 may include one or more tables of common structure, such as a list of typefaces, links, and colors that occur within a document. These common structures may be numerically referenced in the resource table 112. Resources in resource table 112 relate to document objects located in document structure 114. As shown in FIG. 6, the document structure 114 includes a plurality of containers 118 represented by a set of nested parentheses. The plurality of document objects 120 are within the container 118. As shown in FIG. 6, container 118 represents the collection of document objects found within the document being processed. As further illustrated by FIG. 6, the container 118 can also have sub-containers. For example, the document structure 114 includes one top-level container identified by the set of outer brackets labeled 1, and has three nested containers 2, 3, 4. In addition, the container 4 is doubly nested within the container 1 and the container 3.

Each container 118 represents a feature within a document, and the feature may be a collection of individual document objects, such as the depicted document object 120. Thus, for example, a document such as the document 32 depicted in FIG. 4 may include a container that represents a group of characters, and the group of characters includes the text found in the column 34. The different document objects 120 that occur within a character group may represent, for example, different paragraphs that occur within that character group. The container for this group of characters has a style associated with it. For example, the character group depicted in FIG. 4 includes the font type of the character, the font size, the style, eg, bold or italic style, and the width and length of which the character group or at least a portion of the character group occurs. Style information representing the size of the field can be included. This style information is later used by the parser 18 to reformat and reflow the text within the context specific view 20. Another example container may be, for example, a table found within text field 34 of document 32. This table may be a container with objects. Other types and uses of containers will soon vary from application to application, and the system and method of the present invention is not limited to any particular set of object types or containers.

Thus, when the document agent 12 translates the source document 11, it encounters an object that is of a known object type, and the document agent 16 tells the library 16 to create an object of the appropriate object type. Request. The document agent 12 sends the created document object to the document structure 11
Save the entire structure of the source document 11 by placing it in the appropriate position within 4. For example, when the document agent 12 encounters an image 36 in the source document 11, the document agent 12 recognizes the image 36, such as a JPEG image, as an object of type bitmap, or incidentally a subtype of JPEG. To do. As shown in steps 64 and 68 of FIG. 3, the document agent 12 can create the appropriate document object 120 and place the created document object 120 in the structure 114. In addition, the data for the JPEG image document object 120, or in another example, for the characters and their associated styles for the character groups, is data structure 1 depicted in FIG.
It may be stored in 50.

When the source document 11 is being processed, the document agent 1
2 may identify other containers that represent subordinate features found in existing containers, such as letters. For example, these sub-features may include links to referenced material, or clipped video regions or features that are found in the document and that include a collection of individual document objects 120. . The document agent 12 sends these document objects 120 to
Can be placed inside another container nested within an existing container. An array of these document objects 120 and containers 118 is shown in FIG. 7A as a tree structure 130 in which the respective containers 1, 2, 3, 4 are shown as container objects 132, 134, 138, 140, respectively. The containers 118 and document objects 120 are arranged in a tree structure that shows the nested container structure of the document structure 114 and the various document objects 120 that occur within the container 118. The tree structure of FIG. 7A illustrates that structure 114 records and stores the structure of source document 11, which represents the source document as a hierarchy of document objects 120, and that document object 120 is found by, for example, character groups. It includes style information such as the size of the columns to be rendered, or temporal information such as the frame rate for the streamed content. Therefore, the graphic structure of each document is described by a series of parameter elements. An example of this is shown below in Table 1.

[0040]

[Table 1]

As shown, Table 1 represents examples of parameters used to describe the graphic structure of a document. Table 1 is an example of a parameter, eg an object type, which in this case is a bitmap object type. Bounding box parameters provided, source document 1
Gives the position of the document object within 1. In addition, Table 1 provides the fill used and an alpha element representing the degree of transparency of the object. The shape parameter gives a handle to the shape of the object, which in this case can be the path defining the outline of the object containing the irregularly shaped object. Table 1 also presents a time parameter that describes the time evolution of the object. In this example, the image is fixed and does not change over time.
However, if the image object represents streamed media, this parameter may include a temporal characteristic that indicates the rate at which the object is changing, eg, the rate corresponding to the desired frame rate for the content. it can.

Thus, an element of this structure is a container with flowable data content, which is held separately and referenced by a handle from this container. In this way, some or all of the data content is kept separate from the document structure. This allows a document to be rendered in a way that mixes on-premises and remotely held data content. In addition, this data is used to render the internal representation of the source document 11 in a fast way so that the wider and higher level objects can be displayed first, followed by the finer features. to enable. Thus, the separate structure and data allows the video document to be displayed with the data flowing to "fill" the content. In addition, the separate content and structure allows the content of the document to be quickly edited and changed. Since the document structure is independent of the content, different content can be replaced by the document structure. This is done on a container-by-container basis or for the entire document. This structure of a document can be passed separately from its content and subsequently provided content, or it can reside on the platform to which the structure is passed.

In addition, FIG. 7A shows that the structure of the source document 11 can be represented as a tree structure 130. In one implementation, this tree structure may be modified and edited to change the appearance of the source document 11. For example, the tree structure may be modified to add additional structure and content to the tree 130. This is depicted in FIG. 7 (B) which shows the original tree structure of FIG. 7 (A) duplicated and given below the higher level container. Therefore, FIG.
(B) shows that a new document structure, and thus a new representation, is created by processing the tree structure 130 created by the document agent 12. This allows the relative position of different objects 120 to remain the same, but the visual position of the objects within the document to change. By adjusting the tree structure 130, the systems described herein can edit and modify content. For example, in these applications, if the content in the tree structure 130 represents visual content, the system described herein edits the tree structure to duplicate the video of the document,
The video of the document can then be displayed side by side. Alternatively, the tree structure 130 can be edited and supplemented to add additional visual information, for example by adding a video of a new document or part of the document. In addition, by controlling the rate at which the tree structure is changed, the system described herein allows the document to slowly slide across a display, such as display device 26, or to become a new document. It can create the illusion of slowly changing. The effects of creating thumbnail views and other similar results are obtained and are of ordinary skill in the art by making modifications to the systems and methods described herein, as well as systems and methods modified in this manner. Falls within the range of.

The data of the source document 11 is stored separately from the structure 114. To this end, each document object 120 includes a pointer to the data associated with that object, and this information may be arranged in an indirect list, such as indirect list 160 depicted in FIG. In this implementation, as shown in FIG. 8, an indirect list 152 is created in which each document object 120 is numbered and each object document number 154 is associated with an offset value 158. For example, document object number 1 identified by reference numeral 160 may be associated with offset 700 identified by reference numeral 162. Therefore, the indirect list associates offset 700 with object number 1. Offset 700 may represent an offset in file or file in core memory where the data associated with object 1 resides. As further shown in FIG. 8, the data structure 150 is
It may reside where data representing content associated with each document object 120 is stored. Therefore, for example, jump position 7
The drawn object 1 of 00 may include Unicode characters that represent the characters that occur within the characters of the container depicted in FIG. Similarly, the data for object 2 bound at location 810 in core memory, which is depicted in FIG. 8 by reference numeral 172 and identified by reference numeral 170, is stored in the bitmap referenced in document structure 114 of FIG. It may represent a JPEG bitmap associated with the document object 120.

It will be noted by those skilled in the art that the content of the source document is kept in a centralized repository once the data is separated from the structure. Thus, the system described herein allows compression over various types of data objects. Such processing provides the flexibility of storing more in a limited resource system.

Referring to FIG. 2, the process for compressing the content of the internal representation file is as follows.
It will be appreciated that once the various objects have been compressed, they are passed to parser 18. The parser 18 parses the object identified in the structure section of the internal representation and refers to the content of the data associated with this object, which reapplies location and style information to each object. The renderer 19 produces a context-specific representation or “view” 20 of the document represented by the internal representation 14.
The required views are: multiple documents, a single document,
Alternatively, it may be part of one or more documents. Renderer 19
A view control input 40 is received that defines the display context of the particular document view to be generated and any associated temporal parameters. For example,
The system 10 may be required to generate a zoomed view of a portion of a document and then pan or scroll the zoomed view to display adjacent portions of the document. This view control input 40 is the renderer 1
Interpreted by 9 to determine which part of the internal representation requires a particular view, and how, when, and how much the view should be displayed.

The context-specific representation / view 20 is represented by basic shapes and parameters.

The renderer 19 may perform additional pre-processing functions on relevant parts of the internal representation 14 when generating the requested view 20 of the source document 11. This view representation 20 is an input to a shape processor 22 for processing to produce output in a format suitable for operating an output device 26, such as a display device or printer.

The pre-processing functions of renderer 19 may include color correction, resolution adjustment / enhancement, and antialiasing. The resolution enhancement may include a scaling function that keeps the readability of the object's content as it is displayed or played by the target output device. Resolution adjustments are context sensitive, for example, the display resolution of a particular object may be reduced while the view of the displayed document is panned or scrolled, and may be increased when the document view is static. .

Incidentally, for example, in the case where the source document 11 represented by the internal representation includes a multi-frame moving image, the parser 18 and the internal representation 14 can be updated in order to trigger the update of the content of the internal representation 14. There may be a feedback path 42 in between.

The output from the renderer 19 represents a document with basic objects. For each document object, the representation from the renderer 19 is at least a physically rectangular bounding box, the actual outline path of the object bounded by the bounding box, the data content of the object, and the transparency. The object is defined by sex and.

The shape processor 22 interprets the underlying object and outputs it to a target output device 26, for example a dot map for a printer, a set of vector instructions for a plotter, or a bitmap for a display device. Convert to a frame format suitable for output. Output control inputs 44 to the shape processor 22 provide information to the shape processor 22 to produce the appropriate output for the particular output device 26.

The shape processor 22 defines an object defined by the view display 20 as “shape” (ie, the shape of the outline of the object), “fill” (data content of the object), and “alpha” (transparency of the object). , And the appropriate scaling and clipping for the specified view and output device, suitable for the output device (typically for almost all types of display devices or printers, scan conversion, etc. Represents an object (in pixels). Incidentally,
The shape processor 22 includes an edge buffer that determines the shape of the object in scan converted pixels and preferably applies de-aliasing to the outline shape. Antialiasing is accomplished by applying a grayscale ramp across the boundaries of the object, a means determined by the characteristics of the output device 26. This approach allows effective memory for shape clipping and shape intersection processing and is an effective memory as well as an effective processor. Look-up tables, or other techniques, are used to determine the multitone response curve, allowing non-linear rendering control. Shape processor 2
The individual elementary objects processed by 2 are combined in a composite output frame. One shape processor design suitable for use with the system described herein is set forth in greater detail in an application filed on the same date as and entitled Shape Processor, the contents of which are incorporated by reference. To be However, any suitable shape processor system or process may be used without departing from the scope of the present invention.

As described above, the process 8 depicted in FIG. 1 is a handheld computer, a mobile phone, a set top box, a facsimile machine, a copier or other office equipment, an embedded computer system, Software running on a data processing system such as Windows® or a Unix workstation, or any other type of computer / processing platform capable of supporting all or part of the document processing system described above. It can be realized as a component. In these aspects, the system
C language computer program, or C ++, Fortran (Fortra)
n), Java, or Basic can be executed as a computer program written in a high level language including Basic. In addition, in embodiments where a microcontroller or DSP is used, the system can be implemented as a computer program written in microcode or written in a high level language and compiled into microcode that can be executed on the platform used. . The development of such systems is known to those of ordinary skill in the art, and such techniques are well known in the Intel.RTM.
Long Arm Processor (StrongARM Processor) SA-
1110 Microprocessors Shown in Advanced Developer Manual . In addition, common techniques for high level programming are known, for example Ste
phen G. Kochan, Programming in C, Ha
in Yon Publishing (1983). In particular, it is noted that the DSP is suitable for performing signal processing functions including processing functions such as image enhancement by adjusting contrast, edge resolution, and brightness, for example. DSP
And developing code for a microcontroller system can be done from principles well known in the art.

Accordingly, although FIGS. 1 and 2 graphically depict computer process 8 to include a plurality of functional block elements, these elements may be implemented on a data processing platform, thereby providing a system according to the present invention. It will be apparent to those skilled in the art that the data processing platform can be implemented as a computer program or a part of a computer program. Further, although FIG. 1 depicts system 10 as an integrated unit of document processing process 8 and display device 26, this is merely one aspect, and the system described herein may implement the document processing function of process 8, It will be apparent to those skilled in the art that other architectures and arrangements can be implemented, including system architectures that decouple the display of documents performed by display 26. Moreover, the system of the present invention is not limited to those systems that include a display or output device, although the system of the present invention processes those digital documents to produce output that is displayed on the output device. It is understood to include a processing system. However, whether the output is for the next display on the display device, for long-term storage, or for network distribution,
Alternatively it may be stored in a data file for other purposes than immediate display.
Thus, the systems and methods described herein can support many different document and content processing applications, and the structure of the system or process used for a particular application will vary with the choice of application and designer. Is obvious.

From the foregoing, the system of the present invention may be implemented, for example, in ROM (ROM),
And / or may be "hardwired," such as integrated into an AISI C or other single-chip system, or firmware (
It is understood that it may be implemented as software that is stored as a programmable ROM, such as Flash EEPROM (ePROM), or stored locally or remotely and retrieved and executed when required by a particular device. . Such improvements and modifications may be incorporated without departing from the scope of the invention.

Those of ordinary skill in the art will be able to know or ascertain using no more than mere experimentation of mechanical work, many equivalents of this aspect, and the practice described herein. For example, the systems and methods described herein may make the system for processing the source document 11 stand-alone, but incidentally, these systems may process various types of data in many different ways. It may be incorporated into systems and devices and into peripheral devices. In a general purpose data processing system (“host system”),
The system of the present invention may be incorporated with the operating system and host system applications, or may be wholly or partially incorporated into the host operating system. For example, the system described herein does not require the use of a browser or application program
It enables the instant display of various types of data files in a portable data processing device with a D display. Examples of portable data processing devices that may be used with the system include "palmtop" computers, portable digital assistants (PDAs, tablet-types whose primary user interface includes a graphical display for direct user interaction with a stylus device). PDA), Internet-enabled cell phones, and other communication devices. This type of data processing device requires a small size and low power processor for portability. Typically, these devices are ASIC (
ASIC (application specific integrated circuit (application specification)
A new type RISC type core processor designed for c integrated circuit) is used. Also, this type of device has limited random access memory and typically does not have non-volatile data storage (eg, hard disk). Traditional operating system models, such as those used in standard desktop computer systems (PCs), require high power central processing units and large amounts of memory to process digital documents and produce useful output. It is not suitable for any type of data processing device. In particular, conventional systems do not provide processing of multiple file formats in an integrated manner. On the contrary, the system described here uses a common processing and pipeline for all file formats, which makes it a highly integrated document that is highly effective in terms of power consumption and system resource usage. Provide a processing system.

The system of the present invention provides a portable data processing device bios () to enable document processing and output with less overhead than conventional system models.
It may be integrated at the BIOS level. Alternatively, these systems may be run at the lowest system level directly above the transport protocol stack. For example, the system may be incorporated into a network device (card) or system to provide in-line processing of network traffic (eg, working at the packet level of TCP / IP systems).

The system herein may be configured to operate with a predetermined set of data file formats and a predetermined output device such as, for example, a video display of the device and / or at least one type of printer.

The system described herein interacts with low cost data processing terminals, such as extended telephones and “thin” network client terminals (eg, network terminals with limited premises processing and storage resources), interactive / It may be incorporated into a "set top box" for use in an internet-enabled cable TV system. The system is, for example, a hard copy device (printer and plotter), a display device (eg digital projector), a networking device, an input device (camera, scanner, etc.), and a multi-function peripheral device (MFP). It may be incorporated in various peripheral devices. When the system is installed in a printer, the printer receives the raw data file from the host data processing system and requires the exact content of the original data file without the need for a specific application or driver provided by the host system. It is possible to reproduce in. This avoids or reduces the need to configure a computer system to operate a particular type of printer. The system directly produces a dotmap image of the source document suitable for output by the printer (this depends on whether the system is built into the printer itself or the host system). Similar considerations apply to other hardcopy devices such as plotters.

The system, when incorporated into a display device such as a projector, allows the device to utilize the host system's applications or drivers and without the need for specific configurations of the host system and / or display device. It also allows you to view the contents of the original data file exactly. When these types of peripheral devices are equipped with the system, they are capable of receiving and outputting data files from any source via any type of data communication network.

In addition, the systems and methods described herein provide a driver information or entertainment system to facilitate the distribution of information within a vehicle to facilitate distribution of information within the vehicle or to networks that communicate beyond the vehicle. It may be incorporated into the system. Further, it is understood that the system described herein can operate a device with multiple output sources to utilize a modification to only control parameters to maintain a consistent display. Examples include, but are not limited to, an STB or in-vehicle system that incorporates an image display and a printhead, which allows documents to be viewed or printed without the need for source applications and drivers. Become.

From the foregoing, the system of the present invention may be implemented, for example, in ROM (ROM),
And / or may be "hardwired" such as integrated into an ASIC (AISC) or other single-chip system, or firmware (programmable ROM (ROM) such as Flash EPROM (ePROM)).
), Or stored on-site or remotely, and may be implemented as software that is retrieved and executed as required by the particular device.

Therefore, while it is understood that the present invention is not limited to the embodiments described herein, it is understood from the following claims that they should be construed broadly as permitted by law. Should be.

[Brief description of drawings]

FIG. 1 is a block diagram illustrating one aspect of a digital document processing system according to the present invention.

[Fig. 2]   2 is a block diagram illustrating the system depicted in FIG. 1 in more detail. FIG.

[Figure 3]   It is a flowchart figure of a certain document agent.

FIG. 4 schematically depicts an exemplary document of the type that can be processed by the system of FIG.

FIG. 5 depicts a flow chart diagram of two exemplary processes used to reduce redundancy within an internal representation of a document.

FIG. 6 depicts an exemplary data structure for storing an internal representation of a processed source document.

FIG. 7 depicts an exemplary data structure for storing an internal representation of a processed source document.

FIG. 8 depicts an exemplary data structure for storing an internal representation of a processed source document.

[Explanation of symbols]

8 ... Computer processing, 10 ... System, 11 ... Source document,
12 ... Document Agent, 13 ... Application Program,
14 ... Internal representation, 15 ... Buffer storage, 16 ... Library, 18 ... Parser, 19 ... Renderer, 20 ... Internal view, 22 ... Shape processor, 24
... final output, 26 ... output device, 30 ... input device, 32 ... document,
34 ... Text object, 36 ... Diagram, 38 ... Page, 40 ... Input,
42 ... Feedback path, 50, 80 ... Processing, 52, 54, 58, 60,
62, 64, 68, 70, 82, 84, 88, 92, 94, 98 ... Steps,
72, 74 ... Decision block, 110 ... Data structure, 112 ... Resource table, 114 ... Document structure, 118 ... Container, 120 ... Document object.

─────────────────────────────────────────────────── ─── Continued front page    (81) Designated countries EP (AT, BE, CH, CY, DE, DK, ES, FI, FR, GB, GR, IE, I T, LU, MC, NL, PT, SE, TR), OA (BF , BJ, CF, CG, CI, CM, GA, GN, GW, ML, MR, NE, SN, TD, TG), AP (GH, G M, KE, LS, MW, MZ, SD, SL, SZ, TZ , UG, ZW), EA (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), AE, AG, AL, AM, AT, AU, AZ, BA, BB, BG, BR, BY, B Z, CA, CH, CN, CO, CR, CU, CZ, DE , DK, DM, DZ, EE, ES, FI, GB, GD, GE, GH, GM, HR, HU, ID, IL, IN, I S, JP, KE, KG, KP, KR, KZ, LC, LK , LR, LS, LT, LU, LV, MA, MD, MG, MK, MN, MW, MX, MZ, NO, NZ, PL, P T, RO, RU, SD, SE, SG, SI, SK, SL , TJ, TM, TR, TT, TZ, UA, UG, US, UZ, VN, YU, ZA, ZW F-term (reference) 5B009 NC07                 5B021 AA01 CC06 CC07                 5B050 BA20 CA06 EA09 EA10 FA02                       FA03 FA05

Claims (39)

[Claims] 1. A method for representing digital content, the method comprising receiving a source of data representative of digital content, processing the source of data to identify objects that occur within the source, To create a document object that represents the internal representation of the encountered object and separates the structure of the object from the data content of the object, makes that document object a document structure that represents the structure of the digital content, and , Digital content, including providing a set of pointers to the data content structure and linking the document objects within the document structure to the data content stored in the data content structure. Way to the current. 2. The method of claim 1, further comprising creating an indirect list storing the set of pointers that associate a document object with data content. 3. The method of claim 1 or claim 2, wherein receiving a source of data comprises receiving a stream of data generated from an application program. 4. A method as claimed in claim 1 or claim 2, wherein receiving a source of data comprises receiving a stream of data generated from streaming data from an application program. 5. The method of claim 1 or claim 2, wherein receiving a source of data comprises receiving a stream of data from a peripheral device. 6. The method of claim 1 or 2, wherein receiving a source of data comprises receiving a stream of data from multiple sources of data. 7. The method of claim 6, further comprising combining the document objects found in the first source of data and the second source of data to create a composite document structure. 8. The document structure representing the structure of digital content comprises filtering the document objects to select a subset of the document objects for the document structure. Method according to any of the preceding claims. 9. The method of claim 1, wherein making the document object a document structure representing a structure of digital content includes arranging the document object in a different array than a structure of a source of data. The method described in the section. 10. The method of claim 1, wherein making the document object a document structure representing a structure of digital content includes adding document objects to change the structure of digital content. The method described in. 11. The method of claim 1, wherein structuring the data content of the object to structure the data content includes filtering the content and selecting the content for internal representation. The method described in. 12. The method of claim 1, wherein structuring the data content of the object to structure the data content includes adding content and selecting the content for internal representation. 10. The method according to 10. 13. The method further comprising processing pointers to remodify the association of data content with document objects, thereby replacing data content from one source with data content from another source. Method according to any of the claims. 14. A method as claimed in any one of the preceding claims, further comprising the step of compressing the document objects stored in the internal representation by combining document objects having similar properties. 15. Further, to provide storage identified within the source of the data,
A method according to any of the preceding claims including creating a resource table. 16. The method of claim 15, wherein the resources include resources selected from the group consisting of fonts, color lists, styles, and links. 17. The method of any of the preceding claims, wherein the data content includes a data passing process in which the data content is stored and passed independent of the document structure. 18. A method according to any one of the preceding claims including a compression process for compressing the data content. 19. A method as claimed in any one of the preceding claims including a coding process for coding the data content. 20. A method as claimed in any one of the preceding claims including a compression process for compressing the document structure. 21. A method as claimed in any one of the preceding claims including an encoding process for encoding the document structure. 22. A method according to any preceding claim, wherein the document object contains location information representative of the location of the content within the document. 23. The method of claim 22, wherein the location information is relative or fixed location information. 24. A method according to any preceding claim, wherein the document structure defines location information representative of the location of the object relative to other objects within the document structure. 25. The method of any preceding claim, wherein the document structure comprises a document object having a predetermined set of parameters including dimensional, temporal, and physical. 26. The method according to claim 22, wherein the visual position for the content in the internal representation is tracked separately from the structural position of the content in the document. The method described. 27. The method of any of the preceding claims, wherein the digital content comprises content selected from the group consisting of text, graphics, audio, video, interactive scripts, and audiovisual. . 28. The method of any preceding claim, further comprising a process for exporting digital content. 29. The process for exporting digital content comprises:
29. The method of claim 28, including a process for exporting digital content in a format that represents an internal representation. 30. The process for exporting digital content comprises:
30. A method according to claim 28 or claim 29, including a process for exporting content in a format compatible with the selected known file format. 31. The format for representing the internal representation is based on a structure selected from the group consisting of a binary data structure, a text description, a markup text description, and a color model of a luminance / chrominance model. Item 29. The method according to Item 29. 32. The format for representing the internal representation is based on a universal text encoding model including an encoding selected from the group consisting of Unicode, shift mapping, and big-5. 30. The method of claim 29. 33. A computer-readable medium storing instructions for a method for representing digital content, the computer readable medium receiving a source of data representative of digital content, processing the source of data, and within the source. Identify the resulting objects, create for each object a document object that represents the internal representation of the encountered object and separates the structure of the object from the data content of the object, The document structure to represent, the data content of the object to the data content structure, and the set of pointers that connect the document objects in the document structure to the data content stored in the data content structure. A computer-readable medium including providing a computer. 34. A system for representing digital content, the input mechanism for receiving a source of data representing digital content, and processing the source of the data to identify objects occurring within the source. And to create a document object that represents the internal representation of the encountered objects and separates the structure of the object from the data content of the object, and that document object that represents the structure of digital content. A document agent for structuring the data content of an object into a data content structure, and a set of pointers that associate the document objects in the document structure with the data content stored in the data content structure. A system for representing digital content, including providing content. 35. The system of claim 34, comprising a plurality of document agents, each capable of understanding a respective type of file format of a source of data. 36. The system of claim 34, including a document agent capable of understanding multiple file formats. 37. A system as claimed in any of claims 34 to 36, further comprising a set of object types representing the type of content present at the source of the data. 38. The document agent identifies a file format by processing a characteristic selected from a characteristic selected from the group consisting of file content, file name, network type type, transport mechanism, and disk type. 37. The system of claim 36, characterized by: 39. The set of object types includes a bitmap object type, a vector graphic object type, a video type, a movie type, a button type, a script, and a text object type. The method described in.