AU2001289162A1 - Method and system of creating enhancement content to be displayed with a television program - Google Patents

Description

TELEVISION ENHANCEMENT

Cross Reference to Related Applications

This application is based upon and claims priority of United States provisional application serial number 60/227,930, entitled "SYSTEM AND METHOD FOR WEB BASED ENHANCED INTERACTIVE TELEVISION CONTENT PAGE LAYOUT". filed August 25, 2000 by Steve O. Markel; United States provisional application serial number 60/227,063, entitled "A DATA DRIVEN SYSTEM AND METHOD FOR DISTRIBUTION OF INTERACTIVE CONTENT TO MULTIPLE TARGETED PRESENTATION PLATFORMS" filed Aufcust 21 , 2000 by Steven O. Markel, and United States provisional application serial number 60/227,918, entitled "METHOD OF ENHANCING STREAMING MEDIA CONTENT' filed August 25, 2000 by Steven O.

Markel, the entire disclosure of which is herein specifically incorporated by reference for all that it discloses and teaches.

Background

a. Field

The present disclosure relates to interactive and enhanced television and, more particularly, to a method and system of creating enhancement content that may be displayed in conjunction with a television program. This disclosure discusses systems and methods for web based enhanced interactive television content page layout.

b. Description of the Background

A television program may be accompanied by additional information employed to enhance the program or to provide viewer interaction. Enhancements have historically included closed captioning and multilingual support. Advances in networking, computer systems, and video production have increased the number and types of enhancements that may be provided with a program or advertisement. Enhancements may include stock updates, news stories, Internet links, weather forecasts, bulletins, statistics, trivia, and other information. For example, a football game may include icons allowing viewing of team players, statistics, trivia and other information such as upcoming games. Further, the advent of set-top-boxes, as may be used in cable and satellite television systems, allows enhancement information to be presented in new ways, such as screen overlays and in windows, for example.

Enhanced television content may employ a combination of HTML (hypertext markup language), JavaScript, Java and other formats common to Internet page display. An enhanced display may comprise text, icons, graphics and images placed at locations on or in proximity to the television image. To produce an enhanced display, an author must create a file identifying each displayed element (such as text, icons, graphics and images),. the location where each element is displayed, and (he starting time a duration for which an element or group of elements is displayed. Previous methods employed .to enter parameters required to generate and position the elements comprising the layout of enhanced pages have involved manually entry. The resultant application program may require compilation and execution in order to view the resultant image or images. This ma be an iterative process, requiring multiple compilations before a desired result is obtained. Such iterative processes maybe costly and time consuming.

Additionally, due to the numerous differences between presentation platforms, such as set top boxes, satellite receivers, computers, or interactive televisions, content providers have historically been required to target a specific platform in the development of an application. In order to provide support for each additional platform, the interactive content provider must introduce potentially significant modifications to the existing application, resulting in the ongoing maintenance of multiple code bases and adding to the time and cost required to produce enhanced page layouts for multiple platforms. Further, web page design tools, such as FrontPage™, DreamWeaver™, and others, do not support administrative capabilities nor do they support databases. Therefore a new method of creating enhanced content that allows utilization across multiple platforms and provides an accurate preview of enhancements is needed. Summary of the Invention

The present invention overcomes the disadvantages and limitations of the prior art by providing an interactive television enhancement authoring method and system allowing simple development of text, graphics, and image display, emulation of the enhancements, and production of a platform independent enhancement file, called iTVML, that may be parsed, using a publisher tool (such as iTV Publisher from Intellocity), to create interactive television enhanced content files specific to a particular platform such as WEBTV™ AOLTV™ or other platforms. An authoring program communicates with a web browser such that the present invention may be utilized locally or across a network.

The invention may therefore comprise a method for creating a television presentation enhancement comprising: defining a window in a graphical user interface; placing a displayable element at a position in the window; defining a time when the displayable element may be rendered; employing a database to store information describing the displayable element and the time; creating a platform independent television enhancement file containing information related to the displayable element and the time; parsing the platform independent television enhancement file to produce an HTML file; and viewing the HTML file. Software downloaded to the browser provides 'drag and drop' and resizing editing functions at the user's browser, eliminating delays that may be incurred due network latencies and server workload if these functions were implemented at the server. The invention comprises a number of user screens that may be accessed through URLs that provide administrative, project, page, layout, trigger, emulation, and iTVML export. Administrative functions provide user accounts, login, and tutorials. The project and page screens provide access to projects and specific enhancement pages with the projects. The layout page provides an easy to use, user-friendly graphical editing environment where elements such as text, graphics, images, and executable routines may be placed on a video display area (canvas) and maybe moved and sized. The trigger functions provide synchronization of the presentation of enhancements to a specified event, such as frame time or presentation duration, for example. The emulation function generates an iTVML file and parses the file for web browser presentation, providing ah accurate representation of the enhancement if viewed on a television The iTVML export function provides generation and saving of an iTVML file.

The invention may therefore further comprise a system for creating television enhancements comprising: a graphical user interface implemented in a web browser environment; a rectangular area defined in the browser environment; a user interface that places a displayable element in the rectangular area; a user interface that specifies a time at which the displayable element maybe rendered; a database that stor s information associated with the displayable element and information associated with the time; a pointing device; and a user interface that initiates generation of an XML file containing tags for the information associated with the displayable element and the information associated with the time.

Advantageously, the present invention provides an efficient, easy to use system and method for creating television enhancements that produces a platform independent enhancement file. The enhancement file may be emulated using the invention to preview the appearance of the enhancements. The enhancement file may be parsed by other tools to produce platform dependent enhancement files without re-editing, resulting in lower costs to support a range of presentation platforms, and uniformity in the content of the enhancements provided.

Description of the Figures

In the figures,

Figure 1 depicts html and image support for a group of commercially available set top box products.

Figure 2 depicts the software environment of the present invention. Figure 3 depicts software components of the authoring program. Figure 4 is a screen depiction of the administration module configured for user login. Figure 5 depicts a projects screen.

Figure 6 depicts a pages screen. Figure 7 depicts a layout page screen.

Figure 8 depicts a triggers screen.

Figure 9 depicts an emulation screen.

Figure 10 depicts an XML screen. Figure 11 is a flowchart of a method for selecting an element on the canvas of the layout screen.

Figure 12 is a flowchart of a method for moving and/or resizing an element on the canvas of the layout screen.

Figure 13 depicts an iTVML generation process. Figure 14 depicts a process for creating an XML compliant string containing header information.

Figure 15 depicts a process for creating an XML compliant content string.

Figure 16 depicts a process for creating an XML compliant timeline string.

Detailed Description of the Invention

Figure 1 depicts HTML and image support for a group of commercially available set top box products. Set top box models 100 provide HTML support 102 and image support 104. HTML support 102 lists support for html 1,0, 2.0, and 3.2 versions. A limitation of HTML is that some versions lack downward compatibility. For example, HTML versions 4 and higher do not support all the tags of HTML 3.2. Figure 1 serves to illustrate that an HTML based author for creating enhanced content would not be able to support a wide range of target platforms. The present invention overcomes the disadvantages of HTML based authoring by providing an authoring tool that generates an extended XML file, called iTVML, that may be parsed using XSL scripts for each platform type to produce HTML code and Javascripts suitable for each platform. Through the use of the iTVML author of the present invention, enhancements need only be authored once, and then XSL scripts specific to each set top box, or types of set top boxes may be applied, thereby preserving the investment in authoring by not requiring changes for each platform. Figure 2 depicts the software environment of the present invention. Authoring components 200 comprise database 202 and authoring program 204. Rendering component 206 comprises a display program 208 that may be viewed employing a browser display utility such as Microsof Internet Explorer. Database 202 may comprise Microsoft ADO (ActiveX Data Objects) from Microsoft Corporation. ActiveX is a set of programming rules that allows the output of other applications, such as spreadsheets and word processors for example, to be viewed in web browser formats. Authoring program 204 may employ a programming environment such as VBScript. Visual Basic Scripting Edition (most commonly referred to as VBScript) is a subset of Microsoft Visual Basic. Display program 208 may comprise Javascript components. JavaScript is a scripting language that allows lines of Java code to be inserted into HTML scripts. Java is an object oriented programming language created by Sun Microsystems. Java is a device independent language, meaning that programs compiled in Java can be run on any computer. Java programs can be run as a free-standing application or as an applet placed on a web page. Applets written in Java may be served from a web site and executed on a client computer. For example, a JavaScript function may be employed to verify that users enter valid information into a form requesting a user ID and password. Without any network transmission, an HTML page with embedded JavaScript can interpret the entered text and alert the user with a message dialog if the input is invalid. Further, JavaScript statements embedded in an HTML page can recognize and respond to user events such as mouse clicks, form input, and page navigation. Such response may comprise execution of an applet, communication with a browser plug-in, or other action.

Figure 3 depicts components of authoring program 204 shown in figure 2. Authoring program 300 comprises administration module 302, projects module 304, pages module 306, layout module 308, triggers module 310, emulation module 312 and export module 314. Each of the aforementioned modules may be accessed employing a browser and a URL Universal Resource Locator (URL) identifying the location of the HTML and Javascript code that maybe employed to produce each page.

Figure 4 is a screen depiction of the administration module configured for user login. Administration module 400 is accessed via URL 402. Administration module 400 may provide entry of user name 404 and user password 406. The user may select login button 408, new user button 410, or tutorial button 412 to access functions of this module. New user button 410 allows an account to be established for a new user. Tutorial button 412 may be employed to receive information concerning use of the present invention. Once a user has entered a valid usemame and password, a screen representative of one of the other modules depicted in figure 3 may be displayed. The user may navigate between modules by selecting navigation buttons located in each screen.

Figure 5 depicts a projects screen. Projects screen 500 may be accessed through URL 502. Projects screen 500 comprises project selector 504, project information and control area 506 and navigation buttons 508. Project selector 504 allows the user to select from existing projects. Control area 506 comprises project information and control buttons. Project information may comprise a project name, status information to indicate the state of completion of a project, author name, client, duration of the enhancement, the number of frames for which the enhancement is displayed, the start frame, the start page, the video file to which the enhancement may be applied, return bandwidth that indicates the rate at which an enhancement may be delivered, a return connect time indicating latency in establishing a connection, the TV format employed (such as NTSC or PAL), notes concerning the enhancement, a file to which the enhancement may be published, and email addresses for XML and HTML code. Control area 506 may comprise buttons that allow selection of a new project (and saving of the current project), deletion of a project, publishing of an iTVML file and publishing of the project. Navigation buttons 508 allow the user to switch between screens of the invention. When a user navigates from the projects screen to another screen, information associated with the projects screen may be saved to a database. Figure 6 depicts a pages screen. For each project there may be one or more pages.

Pages screen 600 maybe accessed through URL 602. Project 606 shows the project name. Page select 604 provides a pull down menu for selection of existing pages. Page name 608 shows the name of a selected page, or the name given to a new page or a copy of another page. A new page may be selected through control buttons 610 that allow a page to be deleted, copied, or for a new page to be created. Navigation buttons 12 allow the user to switch between screens of the invention. Figure 7 depicts a layout page screen. Layout screen 700 may be accessed through URL 702. Project selector 704 provides selection of a project. Page selector 706 allows selection of a page in the project. The layout screen further comprises a canvas area 708 that may contain a video frame and enhancement elements, plus properties box 71 . Canvas area 708 may be implemented as a window having a width that is a multiple of the pixel width of the video image, eliminating rescaling operations. Properties box 710 provides selection of enhancement elements and parameters associated with those elements. Properties box 710 comprises a number of user input areas that are described hereafter with reference to figure 7. Display safe area check box 712 provides a reduced size canvas area such that elements on the canvas will not be obscured in some monitors. Element selection menu 714 provides user selection of text, graphic, and image elements, and instance selector 716 allows selection of an instance of the element. Further, element selection menu 714 may be employed to import HTML and Javascript routines created with the present invention or other tools such as HTML authoring software. The 'Add' button of element selection menu 714 may be employed to place an element on canvas 708 once an element and instance have been selected. The selected choices are shown in element name 718 and element type 720. Some elements include user specified values, such as text. Such values may be entered through value entry 722. The position of an element may be entered using position window 724, or the element may be positioned using a mouse or other pointing device as shall be described later. The size of an element may be specified through size entry 726, or element size may be configured using a mouse or pointing device as shall also be described later. Elements maybe placed to appear on top of other elements or behind other elements through a Z order value accessed through 2 order control 728. The order may be specified in an order box, or the order of a selected element may be adjusted using front and back buttons. The visibility_, of an element may be selected through visibility control 730. An element may also serve as a link to other information, web pages, or executable programs. The link may comprise a local address, a web address/URL, or other address. A link associated with an element , may be specified through link control 732. The font employed in text elements may be specified through font control 734. The color of text and graphics may be selected through color control 736. Flush (placing of an element at the edge of the canvas) may be selected through flush control 738. A selected element may be deleted by selecting delete button 740. Deletion of a selected element may also be performed via keyboard entry. Navigation buttons 742 allow the user to switch between screens of the invention. Figure 8 depicts a triggers screen. Triggers are employed to synchronize the rendering of enhancements with an event, such as a frame number or display time, for example. Triggers screen 800 maybe accessed through URL 802. Project select window 804 allows selection of a project and displays the project name. Page selection window 806 allows selection of a page within the project and displays the page name. Trigger controls 808 provide specification of a trigger name, the time at which the trigger may execute, the action to be taken when the trigger time occurs, the element, and a trigger list. For example, at 5 seconds, the text of an element may be changed to provide a welcome message. Triggers may provide a monitoring function downloaded to platform, such as a set top box or interactive television, for example, that then monitors a television program for a specified event. When the specified event occurs, an enhancement file comprising HTML or HTML and Javascript may be executed from platform memory, or may be retrieved using a transport method wherein the downloaded monitoring includes a URL from which the enhancement file maybe accessed.

Figure 9 depicts an emulation screen. Emulation screen 900 ma be accessed through URL 902. The emulation screen may be employed to display television images. and enhancements as they would appear on a television or other video receiving equipment. The emulation process includes generation of an iTVML file from database information, parses the iTVML file with an XSL parser configured for web browser display, producing. an HTML/Javascript output that is then provided to the browser. Generation of iTVML files is descπbed in figures 13 through 16. Figure 10 depicts an XML screen. XML screen 1000 maybe accessed through

URL 1002. Display area 1004 of XML screen 1000 provides a listing of the iTVML code generated.

Operationally, a user first opens the administration page of the present invention by employing a web browser accessing the URL of the administration page. The user may then log into the system, establish a new account, or view a tutorial. Once a user has provided a valid usemame and password, a projects page may be presented (Steve-is this how navigation is set up?).. From the projects page the user may select a project to -edit, view, publish or delete, or a new project may be started. If a new project is started, the user enters project information (as described in figure 5), including a video file and start frame information. The user may then select a navigation button on the lower portion of the screen to move to the pages screen. Using the pages screen, the user may select an existing page, copy an exiting page, delete an exiting page, or create a new page. The project name selected in the projects screen is displayed in the project window of the pages screen. A page name may be assigned to the new page, after which the user may navigate to the layout screen. The layout screen comprises a canvas area in which the video frame, identified in the projects screen, may be displayed. The properties box of the layout screen may be employed to select and position graphic, text, image, and imported executable elements within the canvas area. Advantageously, the present invention includes 'drag and drop' and 'resize' functions implemented at the user's browser. This provides the convenience and productivity of mouse (or other input device) driven, editing without incurring delays that may result from network latencies or server workload. The 'drag and drop' and 'resize' functions are implemented as a Javascript downloaded to the user's browser as part of the layout screen. Flowcharts of the implementation of 'drag and drop' and 'resize' functions are presented in figures 11 and 12. Appendix A provides an code listing for a Javascript implementation with numerical references to the flowchart functions.

Figure 11 is a flowchart of a method for selecting an element on the canvas of the layout screen. Mouse select process 1100 begins with a mousedown (button activation) at step 1102. Step 1104 determines if the mouse position is inside the canvas when the button was activated. If the mouse position is outside the canvas area, mouse data is passed to other programs such as may be employed to select items within the properties box or other items contained in the layout screen. If the mouse position is inside the canvas, step 1106 determines if the position is inside the knobs of an element. Knobs are visual elements, such as small rectangles, for example, that are displayed at the edges of an element when selected. If the mouse is inside a knob, stepl 108 removes the knobs and the process ends at step 1110. If step 1106 determines that the mouse position is not inside a knob, step 112 determines if the mouse position is inside an element. If the mouse position is not inside an element, the process ends at step 1114. If stepl 112 determines that the mouse position is inside an element, step 1116 obtains the element's x and y position, height, and width. Step 1118 then determines if the user selected a different element. If a different element was selected, step 1120 deselects the previous selection and the process sends at step 1122. If the user did not select a difference element, the new element is selected at step 1124 and the process ends at step 1126.

Having selected an element on the canvas of the layout screen using the process of figure 11, a user may now move or resize the element. Figure 12 is a flowchart of a method for moving and/or resizing an element on the canvas of the layout screen. Move and resize process 1200 begins with step 1202 where a mousemove event is received. A mouse move event occurs when a mouse button is activated while the mouse is positioned over an element and the mouse is moved. Step 1204 determines if the mouse is positioned over a resize knob displayed in conjunction with a selected element. If step 1204 determines that the mouse position does not correspond to a knob, step 1206 moves the element using mouse mo ement information. The size of the element is not altered and processing ends at step 1208. If the position of the mouse corresponds to a knob of the element, step 1210 checks if the knob corresponds to a west (left side) knob. If the west knob is selected, step 1212 checks if the west knob is a lower left knob. If the knob is not the lower left knob, step 1214 resizes the element by changing the left coordinates of the element and keeping the right edge position and height of the element unchanged. Processing then ends at step 1216. If step 1212 determines that a lower left knob is selected, step 1218 adjusts the height and width of the element, maintaining the aspect ratio of the element and the position of the upper right corner of the element. Processing then ends at step 1216. If step 1210 determines that the west knob is not selected, step 1220 checks if the east knob (right side) was selected. If the east knob is selected, step 1222 checks if the east knob is an upper right knob. If the knob is not an upper right knob, step 1224 resizes the element by changing the right coordinates of the element and keeping the left edge position and height of the element unchanged. Processing then ends at step 1226. If step 1222 determines that an upper right knob is selected, step 1228 adjusts the height and width of the element, mamtaining the aspect ratio of the element and the position of the lower left comer of the element. Processing then ends at step

l l 1226. If step 1220 determines that an east knob is not selected, step 1230 checks if a north knob is selected. If a north knob is selected, step 1232 checks if the upper left knob was selected. If the upper left knob was not selected, step 1234 resizes the element by changing the top coordinates and keeping the bottom coordinates and width of the element unchanged. Processing then ends at step 1236. If step 1232 determines that the upper left knob was selected, step 1238 adjusts the height and width of the element while maintaining the aspect ratio of the element and the position of the bottom right coordinate. Processing then ends at step 1236. If step 1230 determines that a north knob was not selected, step 1240 checks if a lower right knob was selected. If a lower right knob was not selected, step 1242 adjusts the height of the element, keep the width and top coordinates unchanged. Processing then ends at step 1244. If step 1240 determines that the knob is a lower right knob, step 1246 adjusts the height and width of the element- while maintaining the aspect ratio of the element and the position of the top left coordinate. Processing then ends at step 1244. Appendix A lists code to implement the 'drag and drop' and 'resize' functions described in figure 1 land figurel2.

After the user has placed elements on the canvas, positioned them at desired locations and sized them to desired sizes, the user may select the emulation screen to view the appearance of the enhanced frame or sequence of frames. Selecting the emulate function from the navigation buttons performs the following functions. First, the database entries associated with the current layout are accessed and a flat file of extended XML, called iTVML, is produced. The iTVML file is then passed through an emulation XSL parser that converts the iTVML into HTML and Javascript that is then sent to the user's browser to produce the emulation display.

The iTVML file is an XML compliant file with tags for the information contained in the project, layout, and triggers screens. The iTVML file is produced by retrieving information from the database, comparing each entry to a table of entries for that screen, and 'encapsulating' the entries with XML compliant formatting.

Figure 13 depicts an iTVML generation process. The iTVML process 1300 starts at stepl302. At step 1304, the database is queried using the project ID. Step 1306 determines if any records are retrieved. If no records corresponding to the project ID are found, the process ends at step 1308. If a record corresponding to the project ID is retrieved, step 1310 sets the iTVML comments to string. Step 1312 appends an iTVML header to the string. The iTVML header may be generated as described in figure 14. Continuing with figure 13, step 1314 appends a library opening to the string. At step 1316, a resource tag identifying the asset directory is appended to the string. At step 1318 a library closing is appended to the string. At step 1320 content information is appended to the string. Content information maybe generated through the process described in figure 15. Continuing with figure 13, step 1322 appends timeline information to the string. Timeline information maybe generated through a process described in figure 16. Continuing with figure 13, step 1324 terminates the string and the process ends at step 1326. The iTVML process 1300 may be viewed as aprocess that assembles (in a string format compliant with XML), information defining where assets maybe located, plus appends information from the projects, layout and triggers screens.

Figure 14 depicts a process for creating an XML compliant string containing header information. Header process 1400 begins at step 1402. At stepl 404, an opening tag, such as '<HEAD>', is appended to the string. At step 1406 the current data and time with an iTVML current date and time tag are appended to the stπng. At step 1408, the author name with an iTVML author-name tag is appended to the string. At step 1410, notes are extracted from the database and are appended to the string with an iTVML notes tag. At step 1412, the name of the project is extracted from the database and is appended to the string with an iTVML project-name tag. At step 1414, the project ID is extracted form the database and appended to the string with an iTVML project-ID tag. At step 1416, the date the project was created is extracted from the database and appended to the string with an iTVML created-date tag. At step 1418, the data the project expires is extracted form the database and appended to the string with an iTVML project-expires tag. At step 1420, the date the project was last published is extracted from the database and appended to the string with an iTVML last-published tag. At step 1422, the current project status is extracted from the database and appended to the string with an iTVML project-status tag. At step 1424, the project-company is extracted form the database and appended to the string with an iTVML project company tag. At step 1426 the video source is extracted form the database and appended to the string with an iTVML video- source tag. At step 1428, a query is performed against the transport table based on the project ID. If no transport records are found, step 1440 appends a closing tag, such as V<HEAD>', to the string and the process ends at step 1442. If step 1430 retrieves a transport record, step 1432 extracts transport A bandwidth from the record, appends the bandwidth information to the string with an iTVML transport-bandwidth tag. Step 1434 extracts the transport A return path bandwidth from the record and appends the return path bandwidth to the string with an iTVML return-bandwidth tag. Step 1436 extracts the transport A return path connect time from the record and appends the information to the string with an iTVML connect-time tag. Step 1438 extracts the transport A base URL from the record and appends the URL to the string with an iTVML base-URL tag. Step 1440 then appends a closmg tag, such as 7<HEAD>', to the string and the process ends at step 1442. Header process 1400 maybe viewed as aprocess that assembles (in a string format compliant with XML), information contained in the projects screen.

Figure 15 depicts a process for creating an XML compliant content string. Content process 1500 starts at step 1502. At step 1504, an opening tag, such as '<CONTENT>\ is appended to the string. At step 1506, the database is queried for elements corresponding to the project ID. Step 1508 checks for element records. If no element records are found, step 1510 appends a closing flag, such as V<CONTENT>', to the string and the process ends at step 1512. If step 1508 finds a record, step 1514 appends the record information to the string' searches a list of element types and appends an iTVML tag for the element type. Step 151 then selects the next record and processing continues at step 1508. If no records remain, step 1510 appends a closmg flag, such as 7<CONTENT>', to the string and the process ends at step 1512.

Figure 16 depicts a process for creating an XML compliant timeline string. Timeline process 1600 begins at step 1602. At step 1604 an opening tag, such as '<TIMELINE>', is appended to the string. At step 1606, frame length is extracted from the database and appended to the string. At step 1 08, frames per second is extracted from the database and appended to the string. At step 1 10, a 'uses drop frame' flag is extracted from the database and appended to the string. At step 1 12, start time is extracted form the database and appended to the string. At step 1614, life span is extracted from the database and appended to the string. At step 161 , a triggers table is queried using the project ID. Step 1618 checks if trigger records exist. If no trigger records exist, step 1624 appends a closing tag, such as ^/TIMELINE^, and processing ends at step 1626. If step 1618 finds a trigger r&cord, step 1620 creates a trigger tag with the time, element affected, and function call. Step 1622 then moves to the next element If step 1 18 determines that no more elements exist, step 1624 appends a closing tag, 5 such as '</TΓMELINE>', and processing ends at step 1626.

Figures 13, 14, 15, and 16, depict a method in which database entries from the project, layout, and triggers screens may be processed to produce an iTVML file. Appendix B provides an example of the form and content of the iTVML file and illustrates the present invention's placement of database information within XML o compliant tags. Once an iTVML file has been created, it may be parsed using industry standard XSL (Extensible Stylesheet Language) methods to produce HTML and Javascript that may be run on an industry standard web browser and media player such as Microsoft Internet Explorer and Windows Media Player, both from Microsoft Corporation. Additional information regarding XSL may be obtained from the following 5 books:

Title: Professional XSL Authors: Kurt Cagle et al. Publisher: Wrox Press Inc; 0 ISBN: 1861003579

Title: XSL Companion, The Author: Neil Bradley Publisher: Addison- Wesley Pub Co; ISBN: 0201674874

The iTVML file may also be parsed using a tool called iTV Publisher, that is the subject of a co pending patent application, to produce HTML or HTML and Javascript specific to platforms such as WEBTV™, AOLTV™ or other platforms. Thus, the present invention provides an easy to use, rapid means for developing a layout for an enhanced presentation platform, such as a set top box or interactive television, which produces an output platform independent, text based, script file that completely defines the assets used (graphics, text, images, and imported executable files), including their positions and properties, and timing of their rendering. The platform independent nature of iTVML allows a single enhancement file to be created that then may be parsed to provide platform dependent enhancement files.

The foregoing description of the invention has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the mvention to the precise form disclosed, and other modifications and variations may be possible in light in the above teachings. The embodiment was chosen and described in order to best explam the principles of the invention and its practical application to thereby enable others skilled in the art to best utilize the mvention in various embodiments and various modifications as are suited to the particular use contemplated. It is intended that the appended claims be construed to include other alternative embodiments of the invention except insofar as limited by the. prior art.

APPENDLX A - CODE EXAMPLE FOR CLICK & DRAG TO PLACE ELEMENTS AND TO RESIZE THEM Note: Numerical references shown in bold after '//' relate the section of code to a component of the figures. The figures are representative of the actions performed and may not reflect the exact order or functions performed.

function tnouseDown O //1100

{

//1104: Was the Mo eeDown inside of the Divpg (Canvas) ? if ( event. >= divPg.offsetLeft + divMain.offsetLeft && event. <= divPg.offsetLef - 0 + divPg .o fsetwidth + divMain.offsetLeft

&& event.y >= divPg.offsetTop + divMain.offsetTop &t event.y = divPg.offεetTop - 0 t divPg.of setHeight + divMain.offsetTop ) {

// Yes. var el = event -srcElement; var pEl = el .parentElement ; var i; var iεText = false;

//1106: Are we positioned inside a knob? if (el.id.indexOf {" knob", 0) == 0) { -

// lioa Yes, we are on a knob, and the user wants to resize the element. initlX = event. clientX; initlY = event. clientY; knob = el; hideRnobs () ; MouseDownOnElement = true;

} else //1112:

{ ^■ while (true)

{ if (el - tagName == "BODY" ) return,- if (pEl . tagName == "BODY" ) return ; if (pEl . cagϊxame == "DIV" && pEl . id . indexO ( "divEl " ) =0 ) break; el = pEl; pEl ~ el . arentElemen ; } if (el . εagName == "DIV" ) { // TEXT AREA. ob = el . s tyle ; } else { ob = pEl. style ;

} 75 //1116 initlX = event. clientX; initlY = event. clientY; initlObjX =• ob.pσsLeft; 80 ini lO jY = ob.posTop; elWidth = el.offsetwidth,- elHeight = el. of setHeight; elName = el. id; 85 i = elName.slice(5) ;

//lllθ.- Did the user select a different element ? if (elemenxSelecxed == i)

{ 90 MouseDownOnElement = true;

// 1120 -. change to newly selected element elementSelected = i; selectElemenc (i) ,- hideKnoba () ; 95 } ^• else //1124

{ var up&ared = true ;

//***+* update display with selected^' element 100 if (elementSelected > -1)

{ ^' updated = updΞlε (elementSelected) ;

}

105 if (updated)

{

MouseDownOnElement = true;

// Change to newly selected element 110 elementSelected = i; eelectElement (i) ; hideKnobε () ;

}

}

115

}

120 function mouseMove O //1200

{ if (MouseDownOnElement)

{ var fp window. fr ElPro s ; 125 var pEl; var elType; if (knob) //1204 130 var e = eval < "window . ellmg" + elementSelected) ,- elType = parseln (elements [elementSelected] [eElType] ) ; if ( elType HK kEHsTA ) { pEl a e;

135 e = β. style,-

} else

{ pEl = e.parentElement ,-

140 } var delt ; switch (knob. style.cursor)

{

145 case "w-resize": //1210

{ delta a initl - even .clientX; if (elType != kElIsTV) //1212

{

150 if (pEl. style. ixelLeft - delta •<=

0 ) //1218

{ delta = pEl .style.pixelLef ; pEl. style .pixelLeft = 0;

155 } else

{ pEl. style. ixelLeft -= delta;

}

160 } switch ( elType ) //1214 f case kEHsGraphic : case kElIsBG :

165 e . idth += delta ; ; brea ,- case kEHsTA: e.width = Ma h.abs (parselnt (e.width) + delta) + "px" ;

170 break; case kElIsTV: //JL218

// Compute available WEST k South pixels var Wpκ = pEl. style. ixelLeft; 75 var Spx = gCanvasH -

(pEl.Btyle.pixelTop + e. eight) while ( delta > Wpx ^' | | (gCanvasH/gCanvasW) +delta > Spx )

{ 80 --delta; if (delta a= o) break;

} pEl. style. ixelLe t -= delta; e. width += delta; 185 e . height = e - width *

(gCanvasH/gCanvasW) ; break ; def ult : • break ;

190 break;

} case "e-resize" : //1220

{

195 var w; delta = event.clientX - initlX; switch( elType ) //1222

{ case kElIεGraphic; //1224

200 case EHsBG: w => e.width + delta; if ( pEl. style. ixelLeft + w > gCanvasW )

{

205 w B gCanvasW pEl . style . pixelLe c ;

} e.widch » w; brea ;

210 case kEHsTA: //1224 w = Math. bs (parselnt (e. idth) + delta) ; if ( pEl. style.pixelLeft + w >= gCanvasW )

215 { w = gCanvasW - pEl . style.pixelLef ;

} e. idth =• w + "px";

220 break; case kElIsTV! //1228

// Compute available EAST & Souch pixels var Epx = gCanvasW

225 (pEl. style. ixelLe + e.width) ; var Spx « gCanvasH fpEl.style.pixelTop + e. height) ; while ( delta > Epx (gCanvasH/ CanvasW) *delta > Spx )

230 {

--delta; if (delta == 0) break;

} e. idth += delta;

235 e. height = e. idth

(gCanvasH/gCanvasW) ,- break; default : break;

240 } break; } case "n-resize" : //1230

{

245 var h; delta = initlY - event . clientY? if (elType != kElIsTV) . //1232

{

250 if (pEl. style. ixelTop - delta < 0)

{ delta a pEl. style.pixelTop; pEl. style.pixelTop = 0;

} 255 else

{ pEl. style. ixelTop -= delta;

}

. ) 260 switc ( elType ) //1234

{ case kElIsGraphic: //1238 - ^• case kElIsBG: 265 e.height += delta,- break; case kEHsTA: //1238 e. eight = Math. abs (parseln (e. height) + delta) + "px" ; 270 break; case kElIsTV:

// Compute available NORTH t West pixels var Wpx = pEl . style.pixelTop;. 275 var Wpx _* gCanvasW -

(pEl. style.pixelLe t + e. idth) ; while ( delta > Npx ) ) (gcanv 3 / CanvasH) *delta > Wpx )

{

280 --delta; if (delta «= 0) break;

} pEl. style. ixelTop -= delta; e.height += delta; 285 e. idth = e. eight *

(gCanvaεW/gCanvasH) ,- break; default: break; 290 } break;

} case "s-resize":

{ 295 var h delta x even .clientY - initlY; switch( elType ) 7/1240

{ case kElIsGraphic : //1242

300 case kElIsBG: h = e . eight + delta,- if ( pEl -style.pixelTop -t- h > gCanvasH )

305 gCanvasH pEl . style .pixelTop;

} e. height = Inbreak;

310 case kEHsTA: //1242 h = Math.abs (parselnt (e. height) + delta) ; if ( pEl. style. ixelTop + h > gCanvasH )

315 h = (gCanvasH pEl . style .pixelTop) e. eight = h + "px";

320 break; case kElIsTV: //1246

// Compute available SOUTH & Vlesz pixels var Wpx = gCanvasW -

325 (pEl. style. ixelLe + e- idth) ,- var Spx = gCanvasH - (pEl. style.pixelTop + e.height) ; while ( delta > Spx | | (gCanvasW/gCanvasH) *delta > Wpx )

330 {

--delta; if (delta == o) break;

} e. height += delta;

335 e. idth = e.height *

( CanvasW/gCanvaaH) break; def ult : break;

340 } // switch ( elType ) break; } // case s-resise:

} // swiccht knob . style . cursor )

345 var el = elements [elementSelected] ; //1206 f . xtLef .value el [eElLeft] pEl . s yle. ixelLef ,- rp . xtTo .value el [eElTop pEl. style.pixelTop; fp. txtWidfch.value ^■. el [eΞlWidth] (elType == kEllsTA ?

350 parselnt (e.width) .- e.width) ; .txtHeight.value ^■- el [eElHeighc] » (elType == kEllsTA parβeln fe. height) ; e.height); }

355 if (ob) if (ob.pixelLe + event. clientX - initl : 0) ob. ixelLeft = 0; else 360 ob. ixelLeft += even . clientX - initlX; if (ob. ixelLef + elWidth + event. clientX - initl > window. divP . client idth) ob.pixelLeft a window. divPg. clientWidth - elWidth; 365 if (ob. ixelTop + event .clientY - initlY < 0) ob .pixelTop = 0; else ob.pixelTop += event. clientY - initlY;

370 if (ob.pixelTop + elHeight + even .clientY - initlY > window. divPg . clientHeight) ob.pixelTop = window. ivPg. clientHeight - elHeight;

375 fp.txtLef .value = elements [elementSelected] [eElLef ] = ob.pixelLe t; fp . txtTop . value = elements [elementSelected] [eElTop] = ob.pixelTop; }

3S0 initlx a event - clientX; initlY = even .clientY; }

385 return false,-

390

390 APPENDIX B

Appendix B lists an ITVML file generated by the iTVML generator of the present invention. Comments are shown between asterisks. The section showing element information has been edited to reduce the number of 395 entries .

** ITVML SETUP AND INTRODUCTORY COMMENTS ** <?xml versioπ="l.θ"?>

<1D0CTYPE itvral PUBLIC "-//lntellocifcy//DTD ITVML 1.0a Draft//EN" 400 "htt : //lo .1.1.6/dtds/ITVMLl_0a .dtd">

<!-- Copyright 2000, 2001 by Intellocity USA, Inc. -->

<!-- Viziworx XML Schema 1.3 - - >

<itvml xmlns="htt : //itvml .org/dtds/ITVMLl_oa . td" >

405

÷^XHEAD: DATE PROJECT WAS CREATED, AUTHOR, NOTES, OTHER PROJECT INFO**

425

** LIBRARY: CONTAINS DESCRIPTIONS OF ASSET CONTAINERS (EXTERNAL RESOURCES REQUIRED FOR PRESENTING AND ENCODING THE ENHANCED CONTENT) ** <library> </library>

430

**CONTENT: DESCRIBES EVERY ELEMENT (NAME, TYPE OF ELEMENT, POSITION, .-) ON EVERY PAGE OF THIS PROJECT**

<content canvas="S40x480" pixelAεpect="l:l" baεeURL=" "> 435 <page narae="actionTestPage^l,>

<element naτπe="tvθ" type="tv">

<property name="action" value™"¹¹ />

<property name= "highlight" value="crue" /> 440 <property name="top" value="0" />

<property name»"left" value="0" />

<property name=" eight" value="390" />

<property name="width" value»"520" />

<property name="zθrder" v l er" -1" /> 445 <property name="visible" value="true" /> <property name="color" value=" " /> </element>

<element name="nav" type="image"> , 450 _<ρroperty name="src" value="C_:/viziworx/betaGraphics/nav. jpg" />

<property name="action" value="" />

^property name="highlight" value«"true" />

^property name="highlightSrc" value="" />

<property name="top" value-"0" /> 455 <property name="left" value="5l9" />

<property name="height" value="480" />

<ρroperty name="width" value="121" /^■>

<property name_*"zθrder" value="l" />

<property name="visible" value="true" /> 460 <property name="href" values"" />

<property name="color" valuer"" />

</elemen s

<element names"but onl" type="image"> 465 <property name="εrc" value="C:/viziworx/betaGraphics/buttonl.jpg" />

<property name="action" value="" />

<property names"highlight" value="true" />

_<property name="highlightsrc" values"C:/viziworx/betaGraphic3/button2 -jpg" /> 470 <property name="top" value="184" />

<property name="left" value="536" />

<property name="height" value_*"20" />

<property name--;"width" value="97" />

<property name="eθrder" value»"4" /> 475 <property names"visible" value="true" />

<property name="href" value=^lf" />

<proρerty name="color" values"" />

</element>

** PROPERTIES OF OTHER ELEMENTS DELETED FOR BREVITY ** 480 <action name="changeτext" >

<modify-property element="textarea3 " name="value" value="New TextJ" />

</action>

</page>

</content>

485

** TIMELINE: TRIGGERS ASSOCIATED WITH EACH PAGE **

<timeline ^• length="00 ; 00 -, 01.00" framesPerSecond="30" ntεcDropFrame="true" .videoStartAtTiτne="" loopNTimes="l"xtrigger name="actionTestTrigger" enabled="true" pageref=."text"

490 startTime="00 :00-.00.00" action= "actionTestTrigger" expires= "" / >

<trigger name_*"changeText" enabled="true" pageref="teκt" startTime=» 00:00 :0S .00" actions "changeText" expires= "" /> <trigger n me "visibleFunction" enabled="true^li pageref="actionTestPage" εtartTime-"00.-00 :05.00." actions

495 "visibleFunction" expires_^ "" /> </timeline>

</itvml>

500

Claims (28)

Claims
1. What is claimed is: 1. Method for creating a television enhancement comprising the steps of: employing a graphical user interface to position a displayable element; specifying or defining a time when said displayable element may be rendered; storing information describing said displayable element, and said time.
2. 2. The method of claim 1 wherein said employing step comprises the steps of: defining a window in said graphical user interface; and placing said displayable element at a position in said window; said method further comprising the steps of: employing a database to store said information; creating a platform independent television enhancement file containing information related to said displayable element, and said time; parsing said platform independent television enhancement file to produce an HTML file.
3. 3. The method of claim 2 further comprising the step of viewing said HTML file.
4. 4. The method of claim 1 wherein in said employing step, said graphical user interface positions said displayable element in a position relative to a television image area; and in said storing step, said information is associated with said position, and said time in a database; said method further comprising the steps of: generating an XML file using said information stored in said database; and applying an XSL translation to said XML file.
5. 5. The method of claim 4 further comprising the step: specifying a z order for said element.
6. 6. The method of claim 4 wherein said user interface further comprises: a drag and drop function implemented in a web browser environment that allows said displayable element to be positioned in response to signals from a pointing device.
7. 7. The method of claim 4 wherein said user interface further comprises: a resize function implemented in a web browser environment that allows said displayable element to be altered in size in response to signals from a pointing device.
8. 8. The method of claim 2 or 3 wherein said platform independent television enhancement file is an XML file.
9. 9. The method of claim 2 or 3 wherein said step of parsing further comprises: applying an XSL transformation to an XML file.
10. 10. The method of claim 2 or 3 wherein said step of parsing further comprises: writing Javascript in said HTML file.
11. 11. The method of claim 2 further comprising the steps of: selecting a video image for enhancement; displaying a video window in said window in said graphical user interface; parsing said platform independent television enhancement file to produce an HTML file wherein in said employing a database step, said stored information also describes said video image, and in said creating step, said enhancement file contains information related to said video image.
12. 12. The method of claim 11 further comprising: displaying said HTML file in a web browser containing said video window.
13. 13. The method of claim 11 further comprising: , saving said HTML file to said database.
14. 14. The method of claim 11 wherein said step of parsing further comprises: applying an XSL transformation to said television enhancement file.
15. 15. The method of claim 11 wherein said platform independent television enhancement file is an XML file.
16. 16. The method of claim 2, 3 or 11 wherein said step of placing a displayable element further comprises: employing a software routine, downloaded to a web browser, to locally alter the position of said element in response to input from a pointing device.
17. 17. The method of claim 1, 2, 3 or 11 wherein said displayable element comprises an imported HTML file.
18. 18. The method of claim 1 , 2, 3 or 11 wherein said step of placing a displayable element further comprises: employing a software routine, downloaded to a web browser, to locally alter the size of said element in response to input from a pointing device.
19. 19. The method of claim 1, 2, 3 or 11 wherein said step of placing a displayable element further comprises: defining a z order for said element.
20. 20. The method of claim 1, 2, 3 or 11 wherein said step of placing a displayable element further comprises: associating a link with said displayable element.
21. 21. The method of claim 11 wherein said step of parsing further comprises: writing Javascript in said HTML file.
22. 22. The method of claim 2, 3 or 11 wherein said window is contained in a web browser.
23. 23. The method of claim 22 wherein said video window or said window employs a media player contained in said web browser.
24. 24. A system for creating television enhancements comprising: a graphical user interface implemented in a web browser environment; a rectangular area defined in said browser environment; a user interface that places a displayable element in said rectangular area; a user interface that specifies a time at which said displayable element may be rendered; a database that stores information associated with said displayable element and information associated with said time; a pointing device; and a user interface that initiates generation of an XML file containing tags for said information associated with said displayable element and said information associated with said time.
25. 25. The system of claim 24 wherein said user interface further comprises: a drag and drop function implemented in said web browser environment that allows said displayable element to be positioned in response to signals from said pointing device.
26. 26. The system of claim 24 wherein said user interface for placing a displayable element further comprises: a resize function implemented in said web browser environment that allows said displayable element to be altered in size in response to signals from said pointing device.
27. 27. The system of claim 24 further comprising: a user interface that applies an XSL translation to said XML file to produce an HTML file.
28. 28. The system of claim 25 further comprising: an emulation function operable to display said HTML file on said web browser.