GB2309805A - A support system for creating multimedia contents - Google Patents

Abstract

A link creation apparatus 53 which can perform linking of media elements even when they are edited by different applications, and a structure-edit apparatus 51 which creates structure information of multimedia contents using a flowchart, are provided. The linking is visually performed by interactive use of screen display apparatus 92 for both media elements in the same application and media elements in different applications.

Description

A SUPPORT SYSTEM FOR CREATING MULTIMEDIA CONTENTS The present invention relates to a support system for creating multimedia contents. In this system, structure of the multimedia contents is visually edited by utilizing plural application programs (hereinafter called an "application program1 or 'application1) which supply various services to users. Particularly, the present invention relates to a system of interactively and visually creating structure information as to structure between pieces of information of the application program, and a system of easily creating the multimedia contents which retrieve a necessary function or necessary information from stored information and display the retrieved function or information, by linking information of the application program.

The word 'contents1 generally indicates something contained. Namely, in the case of creating application wherein multimedia such as dynamic pictures, still pictures, texts and speeches are used, the word 'contents1 indicates a group of media elements of the dynamic pictures, still pictures, texts and speeches. In this specification, the word 'contents1 indicates not only a group of the media elements but also an application or a service in which the multimedia is used. Namely, the 'contents' in this specification indicates a multimedia application created for referring to related information by linking information of multimedia such as dynamic pictures, still pictures, texts, and speeches. Therefore, the contents will now be described as 'multimedia contents'. Besides, the word media element in this specification indicates information of dynamic pictures, still pictures, texts, speeches and such created by various application programs (applications). Each media element corresponds to an application for displaying the media element. Accordingly, the expression "linking media elements' in the present specification is equivalent to 'linking applications".

In the accompanying drawings, Fig. 26 shows structure of Authorware Professional (Registered Trademark. Hereinafter called Authorware") which is a presentation tool of Xacromedia Inc. At a structure-edit apparatus 91 in Authorware, a flowchart of multimedia contents (that is a flowchart of icon) is created to specify a multimedia contents flow. It is possible for Authorware not only to embed a media element but also to create an intentioned link of application by specifying an area (anchor) to be a base of the link. In the hypermedia system such as Authorware, it is necessary to create a script at a script-edit apparatus 93 for creating a link to an external application. Created multimedia contents are displayed at a screen display apparatus 92 with media elements, such as dynamic picture data 94, still picture data 95, text data 96, speech data 97 being used. Each data is read into the structure-edit apparatus 91 and embedded into multimedia contents 90.

Fig. 27 shows structure of Director (Registered Trademark) which is another presentation tool of Macromedia Inc. The multimedia contents 90 are created by an edit apparatus 98 at Director. It is impossible for Director to edit structure by using a flowchart as stated with respect to Authorware. It is necessary to create a script at the script-edit apparatus 93 for creating a link to an external application as well as Authorware. Created multimedia contents are displayed at the screen display apparatus 92 with the media element such as the dynamic picture data 94, still picture data 95, text data 96, speech data 97 being used. Each data is read into the edit apparatus 98 and embedded into the multimedia contents 90.

Fig. 28 shows an information administration/retrieval apparatus such as IRIS, wherein a conventional hypermedia technique is applied, disclosed in "Communication of the ACM" (Vol. 35, No. 1 January 1992). An application program 1 in Fig. 28 is for providing various services to the users. For instance, the application program 1 is a program for displaying and editing document data and image data, or retrieving accumulated data. The application program 1 includes an application program body 2, a link register part 4, a link-object-information specifying part 6 and a linkretrieval executing part 8. The application program body 2 manages essential functions of the application program and does not have any relations with a linking. The link register part 4 specifies information to be a link source and calls the link-object-information specifying part 6 of a linking object. The link-object-information specifying part 6 is called by other or own application program in link setting in order to specify link-objectinformation. The link-retrieval executing part 8 calls other or own application program, or is called by other or own application program, in link retrieving. A linkinformation storing part 10 stores link information specified by the link register part 4 and the link object-information specifying part 6. There is a case that a link-information adding part (not illustrated) for adding link information and a link-information deleting part (not illustrated) for deleting link information exist as functions for linking in addition to the link register part 4, link-object-information specifying part 6 and link-retrieval executing part 8. Since operation procedure for adding and deleting link information is similar to that of the link register part and so on, though their functions are different, detailed explanation for the link-information adding part or the link-information deleting part is omitted here. The above parts for linking are sometimes provided as one module within the application program or other modules separating from the application program.

Fig. 29 shows an example of another system structure wherein a data administration part is composed by using an independent data base. In this system, link information as to information between application programs specified by the link-object-information specifying part 6 is administered by a link-information administering part 12. Access to the link-information storing part 10 from the link register part 4, linkretrieval executing part 8 and so forth is performed through the link-information administering part 12 in such a system.

Fig. 30 shows an example of another system structure wherein the link-object-information specifying part 6 of each application program 11 is provided outside of the application program 11, so that it is possible to specify link-object-information without calling the application program to be a link object.

In the conventional information administration/retrieval apparatus, it is possible to set a link between information treated at an application program and another information treated at other application program, and to call information of an application program in the same system from another information of another application program by using the link when retrieval is performed.

Operation of registering link information in the conventional arts will now be explained with reference to Fig. 28. Each application program is software which is loaded to a memory and executed by an application program executing part such as CPU (Central Processing Unit), in a general purpose computer. In order to simplify the explanation, the following processes are described with reference to operation of the application program, instead of with reference to operation of the application program executing part which executes the application program.

Users can display or utilize various information by using the application program 1. When linking from some information to other information is planned, it is necessary to create or select discriminative information to be a link source, in order to register a link in the application program 1. An area for the source of linking is called an "anchor", and the discriminative information is called "anchor information" hereinafter. The application program 1 (hereinafter called a link-source application program) calls the link register part 4 of other application program 1 for linking (hereinafter called a link-object application program) and specifies the anchor information. Generally, discriminative information such as an appropriate ID in the link-source application program is specified as the anchor information. When anchor information to be a link source is specified in the link register part 4, the link register part 4 calls a link-object application program or the link-object-information specifying part 6 corresponding to the link-object application program, in order to specify link-object-information.

The link-object-information specifying part 6 in the link-object application program specifies link-objectinformation. The link-object-information specifying part 6 specifies applicable information in the link-object application program and sets it as the link-objectinformation. Then, the link-object-information is returned to the link-object-information specifying part 6 of the link-source application program through the linkobject-information specifying part 6 of the link-object application program. The link-object-information specifying part 6 of the link-source application program stores both the anchor information and the link-objectinformation in a pair, in the link-information storing part 10.

Fig. 31A illustrates an example of specifying link information. In Fig. 31A, an anchor 14 has been set in the link-source application program (program A), and application program information 16 specified by the linkobject-information specifying part 6 has been set in the link-object application program (program B). The linking is performed to the anchor 14 and the application program information 16 from other application program or information administered in the program A. Link information based on the above linking is registered with the link-information storing part 10 of the link-source application program. Fig. 31B shows an example of contents of the link-information storing part 10. As stated above, the link information is registered.

Operation of retrieving is now explained with reference to Fig. 28. Information as stated in reference to Fig. 31B has been registered with the link-information storing part 10. The program A activates the linkretrieval executing part 8 based on the anchor information (Data 1) for performing a link retrieval, and takes out application program information of linking object as a retrieval result. According to this example, a result that Data 2 in the program B should be the application program information can be obtained. Then based on the result, the link-retrieval executing part 8 calls the link-object application program B for displaying the Data 2. As described above, the retrieval is performed.

PROBLEMS TO BE SOLVED BY THE PRESENT INVENTION Using the conventional presentation tool Authorware, it is possible to create visual multimedia contents based on whole structure information because the multimedia contents are created by connecting icons. However, it is necessary to define a link by using scripts, with respect to an external application.

As to Director, creating visual multimedia contents based on the whole structure information is impossible because it is not possible to display structure information. Also, it is needed to define a link by using scripts for the external application as well as Authorware.

In addition, both Authorware and Director do not keep a data retrieval history. Since there is no information on original data, it is difficult to gain related information or update to new data.

As the conventional information administration/retrieval apparatus applying hypermedia technique is structured as stated above, it is needed to respectively prepare a link-set part (such as the link register part, link-object-information specifying part) corresponding to a kind of link-source application program and a kind of anchor information, and respectively call the link-set part. When a new application program is added, for the purpose of registering and calling an application program individually by each link-set part, it is needed to change the link-object-information specifying parts, link-retrieval executing parts and such included in existing application programs as shown in Fig. 32. This operation needs too much time and work.

Furthermore, it is necessary for each of existing application programs to respectively administer link information when a new application program is added. In the case of an information pattern of new application program differing from that of existing application program, it is needed to re-create data structure of the link information for changing the pattern of the new information.

The present invention is contrived for solving the above problems. It is an object of the present invention to provide a supporting apparatus for multimedia contents creation wherein link definition and updating of media elements in the multimedia contents including external applications can be visually performed. It is another object to provide a supporting apparatus for multimedia contents creation wherein updating of media elements and retrieving of the most updated related information can be easily performed by keeping information about retrieval history of original data on the media element of the multimedia contents.

According to one aspect of the present invention of a support system for creating multimedia contents comprises: (a) a screen display apparatus for displaying information on a screen; (b) a structure-edit apparatus for visually editing structure of multimedia contents by setting a plurality of media elements which compose the multimedia contents and by performing a linking between media elements of the plurality of media elements; and (c) a link creation apparatus for performing a linking between media elements edited by different applications when the structure-edit apparatus designates a linking between the media elements edited by the different applications.

According to another aspect of the present invention of a support system for creating multimedia contents comprises: (a) a structure-edit apparatus for editing structure information of multimedia contents by inserting media elements into parts and setting a link between the parts; and (b) a temporary multimedia-contents executing apparatus for executing multimedia contents in a state of there existing a part to which no media element is inserted by the structure-edit apparatus.

The invention will be further described by way of non-limitative example, with reference to the accompanying drawings, in which: Fig. 1 shows a configuration of a system according to the present invention; Fig. 2 shows structure of a structure-edit apparatus according to the present invention; Fig. 3 shows a template and a part according to the present invention; Fig. 4 illustrates a link and an assigning a media element to a part, according to the present invention; Fig. 5 illustrates how to set a link-activatingarea according to the present invention; Fig. 6 shows a configuration of a link creation apparatus and a multimedia contents executing apparatus, according to the present invention; Fig. 7 shows an example of information sent and received between an application program body and a communication interface, according to the present invention; Fig. 8 shows examples of service supplied by an information transmitting/receiving part, an informationtransmission-object judging part, and a link-information administering part, and examples of format for information on the service, according to the present invention; Fig. 9 shows examples of information registered and stored in a program-register-information storing part according to the present invention; Fig. 10 shows an example of designating link information, according to the present invention; Fig. 11 shows examples information stored in a linkinformation storing part according to the present invention; Fig. 12 illustrates operation of an automatic link creation apparatus according to the present invention; Fig. 13 illustrates operation of an automatic link creation apparatus according to the present invention; Fig. 14 illustrates operation of an automatic link creation apparatus according to the present invention; Fig. 15 illustrates operation of a temporary multimedia-contents executing apparatus according to the present invention; Fig. 16 illustrates operation of a temporary multimedia-contents executing apparatus according to the present invention; Fig. 17 illustrates operation of a history administration apparatus and an automatic updating apparatus, according to the present invention; Fig. 18 illustrates operation of a history administration apparatus and an automatic updating apparatus, according to the present invention; Fig. 19 illustrates operation of a link-structure converting apparatus according to the present invention; Fig. 20 illustrates operation of a link-structure converting apparatus according to the present invention; Fig. 21 illustrates operation of a link-structure converting apparatus according to the present invention; Fig. 22 illustrates operation of a link-structure converting apparatus according to the present invention; Fig. 23 illustrates operation of a link-structure converting apparatus according to the present invent ion; Fig. 24 illustrates operation of a link-structure converting apparatus according to the present invention; Fig. 25 illustrates operation of a link-structure converting apparatus according to the present invention; Fig. 26 shows a configuration of a conventional multimedia contents creation tool; Fig. 27 shows a configuration of a conventional multimedia contents creation tool; Fig. 28 shows a configuration of an information administration/retrieval apparatus wherein a conventional hypermedia technique is applied; Fig. 29 shows a configuration of an information administration/retrieval apparatus wherein a conventional hypermedia technique is applied; Fig. 30 shows a configuration of an information administration/retrieval apparatus wherein a conventional hypermedia technique is applied; Fig. 31A illustrates an example of specifying link information; Fig. 31B shows an example of link-information stored in a link-information storing part; and Fig. 32 shows a changed part when a new application program is added to an information administration/retrieval apparatus wherein conventional hypermedia technique is applied.

Embodiments.

Fig. 1 shows a configuration of a support system for creating multimedia contents, according to the present invention. Summary of the present embodiment will now be described.

A screen display apparatus 92 displays information on a screen. A structure-edit apparatus 51 visually edits structure of multimedia contents by setting plural media elements which compose the multimedia contents and by linking the media elements. In the case of linking by the structure-edit apparatus 51 being designated for media elements of different applications, a link creation apparatus 53 performs linking for the media elements of the different applications. The structure-edit apparatus 51 creates and edits multimedia contents 111. Regarding data obtained from outside such as a network, a history administration apparatus 61 accumulates history data 62 so that history information of the data from the outside can be always retrieved. Created multimedia contents are displayed at the screen display apparatus 92. In this case, dynamic picture data 94, still picture data 95, text data 96, speech data 97, hyper text markup language (HTML) 99 and such can be used as the media elements.

For instance, various homepages supplied through the internet are concrete examples of the HTML 99. In the present system, each media element is not read into the structure-edit apparatus 51 nor embedded as contents of the multimedia contents. Multimedia contents are edited, based on a record of existing locations of media elements, by linking media elements, in the present system.

In the structure-edit apparatus 51, structure of the multimedia contents is edited, and structure and image of the multimedia contents are created with media elements being assigned. Linking to various external applications is performed at the link creation apparatus 53. Created multimedia contents are displayed at the screen display apparatus 92.

Now details will be described. Fig. 2 shows inside structure of the structure-edit apparatus 51. An information collecting/administering part 71 collects existing locations of the media elements, created dates or updated dates of the media elements, and administers the locations and the dates. The existing location of the media element can be specified by assembling a drive name, path name and a file name. The information collecting/administering part 71 retrieves a media element edited by external application outside of the support system for creating multimedia contents, and supplies a retrieved media element to the structure-edit apparatus 51 for editing the multimedia contents.

Existing location of the media element edited by the external application (ex. HTML 99) can be specified by a network address, for instance. A structure-edit body 72 edits structure of the multimedia contents. A template display part 81 creates a template for editing structure information of the multimedia contents and displays the template on the screen display apparatus 92. A parts display part 82 creates plural parts which are structure elements of the multimedia contents, such as a first part and a second part, and displays the created parts in the template displayed in the screen display apparatus 92.

An assigning part 83 assigns media elements collected by the information collecting/administering part 71 to the created parts. The assigning part 83 assigns a first media element edited by a first application to the first part displayed in the template, and assigns a second media element edited by the first application or a second media element edited by a second application, differing from the first application, to the second part displayed in the template. The assigning part 83 does not embed the media elements but assigns existing locations of media elements administered by the information collecting/administering part 71 to the parts. Namely, the media elements themselves are not embedded in the parts. The multimedia contents 111 created by the structure-edit apparatus 51 do not practically have information on the media elements but store existing locations of the media elements. When the multimedia contents are actually executed, a real existing location of media element can be specified based on the existing location of media element stored in the multimedia contents, then the media element is displayed. A link designating part 84 designates a link between the parts displayed in the template. The link designating part 84 only designates a part to be a link source and a part to be a link object. Specifying link information is practically performed by the link creation apparatus 53 stated later. A link-activating-area setting part 85 sets a link-activating-area (hereinafter, called an anchor) in order to activate a link designated by the link designating part 84. The link-activating-area setting part 85 sets the link-activating-area for a media element to be a link source, which is treated by a linksource application assigned to the part, designated by the link designating part 84. The link-activating-area setting part 85 merely specifies an anchor for a media element and generates anchor information. Specifying link information based on this anchor information is performed by the link creation apparatus 53. A linking requirement part 86 requires the link creation apparatus 53 to perform linking between media elements of linksource application and link-object application, based on information specified by the link designating part 84 and the link-activating-area setting part 85. A communication interface 20 conveys a linking requirement to the link creation apparatus 53.

Basic operation of the support system for creating multimedia contents is illustrated with reference to Figs. 3 through 5. The multimedia contents 111 of hyper link type, a template 102 being structure information of multimedia contents, a link 103, an anchor 104 being a link-activating-area, the information collecting/administering part 71, a part 106 with an inserted media element, a part 107 without an inserted media element, and a media element 108 for multimedia contents such as a still picture, dynamic picture and HTML are shown in Figs. 3 through 5. Users can automatically generate the link 103 and create the multimedia contents 111 of hyper link type, by freely allocating the part 107 of the template, inserting the media element 108 to the part, linking the parts with the link 103 and designating the anchor 104 for the linksource media element.

Operation of the structure-edit body 72 of the structure-edit apparatus 51 will be explained with reference to Figs. 2 through 5.

The template display part 81 displays the template 102 as shown in Fig. 3 on the screen display apparatus 92. The parts display part 82 generates the part 107 and displays it in the template 102. Since a media element has not been inserted into the part 107 yet at this moment, the part 107 is displayed as just a box. The assigning part 83 assigns the media elements 108 of the multimedia contents registered with the information collecting/administering part 71 to the part 107.

Fig. 4 shows the part 106 wherein a media element has been inserted. The link designating part 84 designates the link 103 between the parts 106. A connection line for connecting the parts 106 is displayed on the screen display apparatus 92 as the link 103. The link-activating-area setting part 85 sets the anchor 104 as shown in Fig. 5.

The anchor 104 in Fig. 5 shows the case of an elliptic anchor 104 being set. The anchor 104 indicates that when a mouse is clicked within the area of the anchor 104 a linking is activated and a media element edited by other application is activated and executed.

After the setting by the link designating part 84 and the link-activating-area setting part 85, the linking requirement part 86 requires the link creation apparatus 53 through the communication interface 20 to specify necessary link information. The link creation apparatus 53 performs linking to the media element based on the link requirement, and stores the linking information as contents of the multimedia contents 111.

Fig. 6 shows the link creation apparatus 53 and a multimedia contents executing apparatus 201 according to the present embodiment.

The link creation apparatus 53 and the multimedia contents executing apparatus 201 respectively have interfaces with application programs 101, the structureedit apparatus 51, and the multimedia contents 111. The link creation apparatus 53 performs linking between a program A and a program B, that is between the application programs 101. The multimedia contents executing apparatus 201 activates and executes an application based on the above linking. Since there is the interface between the link creation apparatus 53 and the structure-edit apparatus 51, linking between the program A and the program B, that is between the application programs 101, can be performed by the link creation apparatus 53 responsive to a requirement of the structure-edit apparatus 51. In executing the multimedia contents 111, the multimedia contents executing apparatus 201 is activated for executing the multimedia contents since there also exists the interface between the multimedia contents executing apparatus 201 and the multimedia contents 111.

The link creation apparatus 53 includes an information transmitting/receiving part 24, plural linkobject-information specifying parts 6, a link-information storing part 10 and a link-information administering part 112. The information transmitting/receiving part 24 inputs a linking requirement from the linking requirement part 86 of the structure-edit apparatus 51. The linkobject-information specifying part 6 is provided corresponding to each link-object application, and specifies link information to activate the link-object application for each application. The link-information storing part 10 stores link information specified by the link-object-information specifying part 6. The linkinformation administering part 112 activates the linkobject-information specifying part 6 based on the linking requirement input into the information transmitting/receiving part 24, and stores the link information specified by the link-object-information specifying part 6 in the link-information storing part 10.

The link creation apparatus 53 also includes a program-register-information storing part 28 which stores information on application, including corresponding information on the application and the link-objectinformation specifying part 6. The link-information administering part 112 refers to the program-registerinformation storing part 28 and activates the linkobject-information specifying part 6 corresponding and operation of retrieving/executing will now be stated.

The application program 101 includes an application program body 202 and the communication interface 20 composing a part of communication means. An informationtransmission-object judging part 22 judges an object for transmitting information from the application program 101 and so forth. There exist the communication interface 20 and the information transmitting/receiving part 24 composing a part of communication means, between the information-transmission-object judging part 22 and the application program 101. The information transmitting/receiving part 24 has a function of converting contents of information in order to communicate the information-transmission-object judging part 22 with the application program 101. The linkinformation administering part 112 administers link information stored in the link-information storing part 10, and administers the link-object-information specifying part 6 and the link-retrieval executing part 8, which are means for treating each link information, in each application program. Furthermore, a program activating part 26 which activates necessary application program based on a requirement from the informationtransmission-object judging part 22 and the linkinformation administering part 112 is included. In addition, the program-register-information storing part 28 which is referred to by the information-transmissionobject judging part 22, the link-information administering part 112 and the program activating part 26 is included. The program-register-information storing part 28 stores register information on plural application programs.

Each application program 101 is software which is loaded to a memory and executed by an application program executing part such as CPU (Central Processing Unit), in a general purpose computer. In order to simplify the explanation, the following processes are described with reference to operation of the application program 101, instead of with reference to operation of the application program executing part which executes each application program.

In addition to the application program 101, in this embodiment, the link-object-information specifying part 6, the link-retrieval executing part 8, the information transmitting/receiving part 24, the link-information administering part 112, the information-transmissionobject judging part 22 and the program activating part 26 are software, which is loaded to a memory and executed by CPU, in the general purpose computer. Each application program 101 does not stationarily exist on the memory but is activated when necessary, in the present embodiment.

Each application program 101 has a path to the information transmitting/receiving part 24 through the communication interface 20, so that the application programs can call one another.

The application program body 202 in the application program 101 gives information as shown in Fig. 7 to the communication interface 20 in order to require other part to perform processing such as link retrieving. "Program Name" in Fig. 7 is a name of program belonging to an object which is required processing. "Processing" stands for contents of a processing to be executed.

"Information Name" is a name of information, such as ID, to be processed. (A group of such information is defined as a "message" hereinafter.) The example of Fig. 7 shows a message that "displaying" process of information on "Map of Japan" is required for the application program "Program A".

The communication interface 20 adds information on a transmission-source application program with a message from the application program body 202, and translates the added message to be appropriate style for communicating with the information transmitting/receiving part 24. The communication interface 20 also translates information sent from the information transmitting/receiving part 24 to be a style read by the application program body 202, as shown in Fig. 7. In addition, the communication interface 20 has a function of opening a communication path to the information transmitting/receiving part 24 when the application program 101 including the corresponding communication interface 20 is activated and executed. When the application program ends, the communication interface 20 closes the communication path to the information transmitting/receiving part 24.

The message from the application program body 202 is translated in the communication interface 20 and sent to the information transmitting/receiving part 24. Namely, the practical communication means in the application program 101 is separately provided from the application program body 202. The communication interface 20 is included in the application program 101. Any concrete communication procedure between the communication interface 20 and the information transmitting/receiving part 24 is acceptable as long as necessary information can be transmitted and received. A method such as socket communication provided in Unix Operating System (Unix is a registered trademark) can be used as the communication procedure.

The operation in the present embodiment will be explained in order. First, link information registering between application programs by the link creation apparatus is now stated.

Information on requirement to create a link from the application program 101 (link-source application program) to other application program (link-object application program) is sent, as message information, to the information transmitting/receiving part 24 from the linksource application program through the communication interface 20 of the link-source application program.

Format of the message information treated by the information transmitting/receiving part 24, the information-transmission-object judging part 22 and the link-information administering part 112 has been defined in advance depending upon the contents. Fig. 8 shows examples of standard commands used in the message information and examples of format for the message information.

In the case of a link creation required by the linksource application program as shown in the example, necessary information is set and sent in a format of "Link(link-object application program name):REGIST:anchor information". It becomes "Link(program B):REGIST:001", for instance. This is a message that an anchor of program A, whose unique ID is 001, wants to register linking to the program B. Such a message is sent to the communication interface 20 from the application program body 202 of the link-source application program.

Information on link-source application program is added to the message by the communication interface 20, then the added message is sent to the information transmitting/receiving part 24. The information transmitting/receiving part 24 receives the message and sends it to the information-transmission-object judging part 22. The information-transmission-object judging part 22 checks contents of the message whether or not they are shown in standard commands of Fig. 8. When they are standard commands, the information-transmissionobject judging part 22 judges which part is to be given the information. In the case of the contents being a link information registration as shown in this example, that is the case that the first string ("Link" in this example) is the standard command defined to be processed in the link-information administering part 112, the information-transmission-object judging part 22 judges that this command can be processed in the linkinformation administering part 112. Then the information-transmission-object judging part 22 sends the message to the link-information administering part 112.

In the case of link information registration, anchor information included in the message sent from the link source application program should be information relating to a link-source area of the link-source application program. Namely, the information should be one by which the anchor can be specified, such as an anchor name or an anchor number. "ID=OOl" in the foregoing example is this information. As stated above, this information is sent to the link-information administering part 112 through the information transmitting/receiving part 24 and the information-transmission-object judging part 22. Then, the link-information administering part 112 judges a link-object application program based on the information relating to the link-object application program. The information relating to the link-object application program is a program name written in "Link (program name)" in the present example. According to the example, the link-object application program is "program B".

After the link-object application program is decided, the link-information administering part 112 refers to the program-register-information storing part 28 and activates the link-object-information specifying part 6 provided at each application program. Information on which of the link-object-information specifying parts 6 should be activated is registered and stored in the program-register-information storing part 28 as shown in the example of Fig. 9. The link-information administering part 112 calls the link-object-information specifying part 6 after referring to the information of program-register-information storing part 28. In this example, the link-information administering part 112 judges, based on the information of Fig. 9, that the link-object-information specifying part 6 of the program B is a program shown in "/usr/prob/prob-link". Then the link-information administering part 112 activates the program B.

A program as shown in Fig. 10, designating a part of some document data, can be a screen example displayed after the link-object-information specifying part 6 being activated. This link-object-information specifying part 6 is a link-object-information specifying part for the program B which is specified as the link-object application program. For example, "specification A item B" is set by the user as the information of the linkobject application program. When the link-object application program treats dynamic pictures or speech, the link-object-information specifying part has a function of specifying a particular dynamic picture or a particular speech as the information of the link-object application program. Therefore, each link-objectinformation specifying part 6 respectively has a different function of specifying different information depending upon the application program. After specifying information of the link-object application program, the link-object information specifying part 6 returns the result of the specifying to the link-information administering part 112. The link-information administering part 112 stores link information generated by combining anchor information of the link-source application program and information of link-object application program, in the link-information storing part 10.

Fig. 11 shows an example of the link-information storing part 10. For instance, link information made of the foregoing anchor information "ID=001" and information of link-object application program "SPECIFICATION A ITEM B" is stored with added information of a link-source application program name and a link-object application program name, as shown in the first line of Fig. 11.

It is not necessary for each link-object-information specifying part 6 corresponding to each application program to be particular means separating from the application program 101. It is acceptable that the application program 101 has the function of the linkobject-information specifying part 6 inside of it and is programmed to call the application program itself instead of the link-object-information specifying part 6.

Operation of retrieving between application programs by the multimedia contents executing apparatus 201 is now described.

The application program 101 specifies an anchor to be a link source, and sends anchor information of the anchor and a request for link retrieval to the information transmitting/receiving part 24 through the communication interface 20. This procedure can be expressed as information of "Link:RETRIEVE:ID=OO1", according to concrete examples of standard commands shown in Fig. 8. The information transmitting/receiving part 24 sends the information of "Link:RETRIEVE:ID=OO1" to the information-transmission-object judging part 22. The information-transmission-object judging part 22 judges from the contents of the information that processing of link-retrieval execution is required, and sends information on the judgement to the link-information administering part 112.

As this information is for a link retrieval execution, the link-information administering part 112 retrieves the link-information storing part 10 based on the anchor (link-source) information of ID=001 and gains information of a link-object application program corresponding to the information of ID=OO1.

In the case the information shown in Fig. 11 has been already stored in the link-information storing part 10, processing "display" and information name "specification A item B" can be obtained for "program B" as the retrieval result of the link-information storing part 10 by the link-information administering part 112.

The link-information administering part 112 sends this link information to the information-transmission-object judging part 22, using a message style of "program B: display:specification A item B". After receiving the message information from the link-information administering part 112, the information-transmissionobject judging part 22 sends the message to the program activating part 26. When the program activating part 26 receives the message, the program activating part 26 reads the name of the link-object application program in the message and activates an objective link-object application program, that is program B. In this case, the program activating part 26 refers to calling sequence for activation stored in the program-register-information storing part 28 shown in Fig. 9. After confirming that the program activating part 26 has activated the objective application program (program B), the information-transmission-object judging part 22 conveys the contents of the message received from the linkinformation administering part 112, as contents for processing, to the communication interface 20 of the objective application program (program B) through the information transmitting/receiving part 24. The program B receives the information and executes processing depending upon the contents.

As stated above, the retrieval is performed. If plural link-object application programs are applicable as the retrieval result after the link-information administering part 112 retrieving the link-information storing part 10, each of link-retrieval executing parts 8 for corresponding application programs is called in order to specify which of information to be executed. The link-retrieval executing part 8 further specifies information in the corresponding application program and sends a practical link retrieval object to the linkinformation administering part 112. The link-information administering part 112 activates the corresponding application program using the program activating part 26 based on the only one specified information. Activating procedure of the program activating part 26 is the same as stated above.

Procedure for adding a new application program will now be described. It is assumed that the communication interface 20 has been included in a new application program as well as the existing application programs.

First, information as to the new application program is registered with the program-register-information storing part 28 as shown in Fig. 9. Simultaneously, information for utilizing the link-object-information specifying part 6, link-retrieval executing part 8 and so forth, which are means for specifying link information of the new application program, by the link-information administering part 112 is registered in the programregister-information storing part 28. Owing to the above procedure, it becomes possible to call other application program or to call the new application program through other application program, by using the program activating part 26 and the link-information administering part 112. In the case of a link-creation being required for the application program, the link-object-information specifying part 6 is called by the link-information administering part 112, and link information is specified. Then the new application program can be utilized as a link-object application program.

When the new application is registered, it is not necessary to change existing application programs, the link-object-information specifying parts 6 and the linkretrieval executing parts 8 of the existing application programs.

Namely, the new application program can be easily combined to the system, according to this embodiment.

Though, in this embodiment, the information sent and received between the communication interface 20 and the information transmitting/receiving part 24 is expressed in characters as shown in the format of Fig. 8, formats and expression means are not restricted as long as information which the communication interface 20 and the information transmitting/receiving part 24 can understand is used.

The case that specifying link information and executing a retrieval are performed between the application programs has been stated in the above example. The same procedure can be used for specifying link information based on a requirement of the structureedit apparatus 51.

The structure-edit apparatus 51 includes a communication interface 20. This communication interface 20 having the same function as that of application program conveys information from the structure-edit apparatus 51 to the information transmitting/receiving part 24 of the link creation apparatus 53. A link requirement output from the linking requirement part 86 of the structure-edit apparatus 51 is sent to the information transmitting/receiving part 24 based on the command style as shown in Fig. 8. Procedures after this is the same as has been stated.

In the case of the multimedia contents 111 being executed, the same procedure that is used for activating and executing the program B by the program A is performed.

As stated above, the procedure used for link information specifying between the application programs can be used for the link requirement from the structureedit apparatus 51. In addition, the activating procedure used between the application programs can also be used in the case of the multimedia contents 111 being executed.

According to the present embodiment, since information from and to the new application program is conveyed through the communication interface 20 and the information transmitting/receiving part 24, it is easily communicated. It is possible to make calling program methods to be one by using the program-registerinformation storing part 28 and the program activating part 26. The information-transmission-object judging part 22 refers to contents of a sent message and judges a distribution object of the message information. Since the link-information administering part 112 totally controls means for registering and retrieving link information of the link-retrieval executing parts 8 and the link-object-information specifying part 6, for all the application programs treated in the present apparatus, only the minimum change is needed when the new application program is added.

In the present embodiment, it is possible to perform linking between application programs with visually comprehending the whole structure of the multimedia contents 111, because the structure-edit apparatus 51 can define structure information of the multimedia contents 111 using the template 102 in advance. Also, in the present embodiment, even when kinds of application programs are different, the linking can be performed by the same procedure because the above-stated structure is applied. Namely, the same procedure can be used whether the linking is performed to a media element in the same application program or in other application program of a different kind. On the other hand, in the conventional multimedia contents creation tool, though it is possible to visually create multimedia contents by using media element made in the same application program with utilizing a flowchart, it is impossible to perform a linking without performing a special description such as script when a media element made in other application program is entered in the multimedia contents. In addition, in the conventional multimedia contents creation tool, it is impossible to perform a linking without using a special interface for external application program. However, in this embodiment, since the structure shown in Fig. 6 is applied, it is possible to visually make structure information and to perform a linking by the structure-edit apparatus 51 even if programs A and B are different kinds treating different media.

Now how to utilize structure information of the multimedia contents will be stated. An automatic link creation apparatus 60, which automatically changes a linking for an old media element to a linking for a new media element by using the link creation apparatus 53 when the new media element is assigned for some part by the assigning part 83, is shown in Fig. 1. Concrete examples will be described with reference to Figs. 12 through 14.

Replacing a media element 108a of the part 106 in the template 102 is now stated with reference to Fig. 12.

When a new media element 108b is inserted from the information collecting/administering part 71 into the part 106 in the template to be updated, a linking to the new media element 108b is performed based on the link information of before the insertion and only the media element is updated, as shown in Fig. 13. Namely, the multimedia contents 111 of hyper link type can be created without changing the structure information of the multimedia contents.

Conventionally, when a media element is changed it is necessary for users to change link information regarding the media element. For instance, if the media element in Fig. 12 is changed, it has been conventionally needed to delete links 103a and 103b and to set a new link for the new media element. In the present embodiment, however, since the automatic link creation apparatus 60 is provided, the new media element 108b can be automatically and newly linked using the link information for the old media element 108a, only by a process of changing the old media element 108a to the new media element 108b. The automatic link creation apparatus 60 generates a new requirement of linking for the new media element 108b based on the link information of the old media element 108a, and requires a new linking for the link creation apparatus 53. The automatic link creation apparatus 60 also requires the link creation apparatus 53 to delete the link information on the old media element 108a. This linking requirement is performed by the command "Link(program name)REGIST" in the first line of Fig. 8. The requirement of deleting the link information is performed by the command "Link DELETE" in the fourth line of Fig. 8. The link creation apparatus 53 receives the command of linking requirement and the command of deleting the link information, and executes registering new link information and deleting the old link information by performing prepared processes. Fig. 14 shows the multimedia contents in the case of linking being automatically changed by the automatic link creation apparatus 60.

The case of setting multimedia contents regardless of media element existence or nonexistence will be explained. A temporary multimedia-contents executing apparatus 63 which can set and execute multimedia contents in spite of no media element has being prepared, is shown in Fig. 1.

The temporary multimedia-contents executing apparatus 63 executes multimedia contents in the state of there existing some part to which no media element is inserted, by using the structure-edit apparatus 51. The temporary multimedia-contents executing apparatus 63 can execute the multimedia contents by inserting a virtual media element telling that no media element is inserted, into the part wherein no media element has been inserted.

The part 106 in Figs. 15 and 16 shows the state of some media element having been inserted. The part 107 shows the state of no media element having been inserted.

A virtual media element is in advance assigned for the part 107. Characters indicating the media element are input as the virtual media element. For instance, when a media element indicates a title of multimedia contents, the characters "TITLE" are input. If the media element is for introducing temples, characters "TEMPLES" are input. Generally, the template 102 is created by allocating the part 107 of the template and inserting the media element 108 of the multimedia contents into the part 107. However, it is possible to execute the multimedia contents 111 at halfway of creating even when media elements are not inserted into all the parts 107 of the template. When the part with no inserted media element is executed, virtual media element such as characters of "TITLE" or "TEMPLES" is displayed in the white bitmap frame as shown in Fig. 16. If the characters such as "TITLE" or "TEMPLES" have not been input in advance, it is acceptable to display a file name for the media element, an existing location (existing address) of a file for the media element and so forth.

Such file name and existing location should be used in the case the media element is prepared later. It is also acceptable just to blink the display in the frame.

Automatic data updating method will now be stated.

The history administration apparatus 61 of Fig. 1 administers information of history telling wherefrom the media element composing the multimedia contents comes from. In the history data 62, existing locations and created dates (or updated dates) of the media elements are recorded in the case that the media element is created by the external application. An automatic updating apparatus 64 retrieves the media element by using the existing location of the media element stored in the history data 62 and updates the media element.

The history administration apparatus 61 stores information on retrieval history of media element which is edited by an external application retrieved by the information collecting/administering part 71. The automatic updating apparatus 64 retrieves a media element by using the retrieval history information stored in the history administration apparatus 61 and automatically updates the media element utilized for editing the multimedia contents by the structure-edit apparatus 51.

The history administration apparatus 61 stores an existing location of the retrieved media element edited by an external application, and stores an edit date in retrieving of the media element, as the history data.

The automatic updating apparatus 64 retrieves the media element edited by the external application based on the existing location stored in the history data, and compares the edit date stored in the history data with the most updated edit date of the retrieved media element edited by the external application. Then, based on the comparison result, the automatic updating apparatus 64 judges whether the media element utilized for editing the multimedia contents is to be updated or not.

For instance, an existing location (address) and a creation date of the HTML 99 are stored as the history data 62. The HTML 99 is a media element such as gained from a homepage applied through the internet. The information collecting/administering part 71 in the structure-edit apparatus 51 accesses the HTML 99 through the internet. The HTML 99 has its updated date. When the information collecting/administering part 71 gains a media element by accessing the HTML 99, the information collecting/administering part 71 gives the address and the updated date of the media element to the history administration apparatus 61. The history administration apparatus 61 stores the existing location and the updated date as the history data 62. The information collecting/administering part 71 downloads the accessed HTML and supplies the downloaded HTML to the structureedit apparatus 51 as one media element. The HTML is going to be optionally updated by the external application, whereas the HTML downloaded by the structure-edit apparatus 51 is intactly used with its old version as a media element of the multimedia contents 111. Now, in the above-stated situation, executing "UPDATE" in the menu bar in the template of Fig. 17 is explained. As shown in Fig. 18, the history administration apparatus 61 administers history information on wherefrom the media element 108 of the multimedia contents comes. In the case that the media element 108 is data gained from outside, the history administration apparatus 61 refers to the history data 62 when the "UPDATE" is executed. Then, the history administration apparatus 61 gains an updated date and an existing location of the media element stored in the history data 62. If the updated date of the accessed media element is newer than the updated date stored in the history data 62, namely if the media element is updated, the media element is newly gained and automatically updated. In addition, the existing location and the updated date of the new media element are registered as the history data 62. The newly gained media element is utilized in executing the multimedia contents 111.

According to the present embodiment, the media element created by an external application can be changed to the most updated media element by selecting the "UPDATE" in the template. In order to access a media element, an access history for the media element is stored. Therefore, whether the media element has been updated or not can be judged. In the case of the media element being updated, the updated new media element can be gained. Accordingly, the multimedia contents 111 are always composed of the most updated information.

Now, an apparatus for displaying structure of multimedia contents of hyper link type will be explained.

A link-structure converting apparatus 58 in Fig. 1 analyzes structure of multimedia contents and displays the structure of the multimedia contents in the screen display apparatus 92.

The link-structure converting apparatus 58 inputs link information on media elements of the multimedia contents and converts the link information to structure information of the multimedia contents. The screen display apparatus 92 displays the structure information of the multimedia contents converted by the linkstructure converting apparatus 58, on the screen. The link-structure converting apparatus 58 can update the structure information of the multimedia contents and display the updated structure information at the real time, in the case of the link information between the media elements of the multimedia contents being updated.

As stated in the Related Art, the tool which can create multimedia contents but which does not visually describe structure information of the multimedia contents by using a flowchart, has conventionally existed.

According to the present embodiment, when multimedia contents are created between application programs, the link-structure converting apparatus 58 analyzes information of the multimedia contents and visually describes the analyzed information using a flowchart.

The multimedia contents 111 of hyper link type of Fig. 19 are created by generating link information one after another between application programs, without creating structure information. The link-structure converting apparatus 58 reads information of the link 103 in the multimedia contents 111 of Fig. 19, converts the link information to structure information of the multimedia contents and visually displays the structure of the multimedia contents and an image of the media element 108 at the same time. Fig. 20 shows structure information of multimedia contents automatically created by the link-structure converting apparatus 58.

Figs. 21 through 25 illustrate the case that editing such as creating or deleting of the link 103 is performed to a linked application in the multimedia contents 111 of hyper link type. Fig. 21 shows the multimedia contents 111 when the linking is performed between applications.

Since the multimedia contents 111 are composed of media elements 108a, 108b and 108c, the link 103b to a part 106c is deleted in the case of deleting the linking to the media element 108c, as shown in Fig. 22. The dotted line of the 103b stands for deleting operation. In this way, the structure information of the multimedia contents shown in Fig. 22 is automatically converted to the structure information shown in Fig. 23. In the situation as shown in Fig. 23, if a media element 108d of Fig. 24 is created by a link 103c between the applications, the link 103c and a part 106d are added to the structure information of the multimedia contents. The media element 108d is assigned to the part 106d and displayed.

Namely, when editing such as creating or deleting of the link 103 on the linked application is performed, the structure of the multimedia contents is automatically updated at the real time.

As stated above, creating or editing multimedia contents of hyper link type can be freely performed according to the present embodiment, because the structure of the multimedia contents is described by a visual and simple interface. In addition, linking between applications can be performed without a conventional program or script.

In the case of changing only the media element, updating can be performed by merely inserting the media element without treating the whole structure of the multimedia contents. whereas conventionally it has been needed to manually perform a series of operations such as deleting and creating the link.

Furthermore, though it has conventionally depended too much on a media element, namely a creation of the multimedia contents can not be performed if the media element does not exist. Such a problem can be solved according to the present embodiment. Multimedia contents in the halfway of creating can be executed.

Since conventionally history information of media element has not been kept, it is difficult to perform updating operations of multimedia contents such as retrieving a location where the media element to be updated was gained or checking the date of the media element in order to gain the media element. However, since the history information is kept according to the present embodiment, the series of operations can be automatically performed. Accordingly, the work and the time for updating the multimedia contents can be remarkably reduced.

In addition, though the structure information of existing multimedia contents of hyper link type have not been conventionally displayed, it is possible to display the structure information in order to understand a whole composition and a whole image according to the present embodiment. Since real-time link information is made, it is possible to perform editing operations, such as creating and deleting a link, on the linked application.

Having thus described several particular embodiments of the invention, various alterations, modifications, and improvements will readily occur to those skilled in the art. Such alterations, modifications, and improvements are intended to be part of this disclosure, and are intended to be within the spirit and scope of the invention. Accordingly, the foregoing description is by way of example only, and not intended to be limiting.

The invention is limited only as defined in the following claims and the equivalents thereto.

Claims (13)

1. A support system for creating multimedia contents comprising: (a) a screen display apparatus for displaying information on a screen; (b) a structure-edit apparatus for visually editing structure of multimedia contents by setting a plurality of media elements which compose the multimedia contents and by performing a linking between media elements of the plurality of media elements; and (c) a link creation apparatus for performing a linking between media elements edited by different applications when the structure-edit apparatus designates a linking between the media elements edited by the different applications.

2. The support system for creating multimedia contents of claim 1, wherein the structure-edit apparatus includes a template display part for creating a template in order to edit structure information of the multimedia contents and displaying the template on the screen display apparatus; a parts display part for creating at least a first part and a second part which compose the multimedia contents, and displaying the first part and the second part in the template; an assigning part for assigning a first media element edited by a first application to the first part displayed in the template, and assigning one of a second media element edited by the first application and a second media element edited by a second application differing from the first application, to the second part displayed in the template; a link designating part for designating a link from the first part to the second part displayed in the template; a link-activating-area setting part for setting a link-activating-area to the first media element edited by the first application and assigned to the first part, in order to activate a link designated by the link designating part; and a linking requirement part for requiring the link creation apparatus to perform a linking between media elements edited by different applications, based on information specified by the link designating part and the link-activating-area setting part.

3. The support system for creating multimedia contents of claim 2, wherein the structure-edit apparatus further includes an information collecting/administering part which retrieves a media element edited by an external application outside of the support system for creating multimedia contents, and loads and supplies a retrieved media element to the structure-edit apparatus in order to edit the multimedia contents.

4. The support system for creating multimedia contents of claim 3 further comprising: a history administration apparatus for storing information on a retrieval history of the media element edited by the external application and retrieved by the information collecting/administering part; and an automatic updating apparatus for retrieving a media element by using the retrieval history information stored in the history administration apparatus, and for automatically updating the media element utilized for editing the multimedia contents by the structure-edit apparatus.

5. The support system for creating multimedia contents of claim 4, wherein the history administration apparatus stores an existing location of a retrieved media element edited by an external application and an edit date of the retrieved media element, at a time of retrieving of the retrieved media element, as history data, and wherein the automatic updating apparatus retrieves a media element edited by an external application based on an existing location stored in history data, compares an edit date stored in the history data with a most updated edit date of a retrieved media element edited by the external application, and judges whether the media element utilized for editing the multimedia contents is to be reloaded and updated, based on a comparison result.

6. The support system for creating multimedia contents of claim 2, wherein the link creation apparatus includes an information transmitting/receiving part for inputting a linking requirement from the linking requirement part of the structure-edit apparatus; a plurality of link-object-information specifying parts, provided corresponding to each linkobject application, for specifying link information to activate the link-object application for each application; a link-information storing part for storing link information specified by the plurality of link-objectinformation specifying parts; and a link-information administering part for activating the plurality of link-object-information specifying parts based on the linking requirement input into the information transmitting/receiving part, and for storing the link information specified by the plurality of linkobject-information specifying parts, in the linkinformation storing part.

7. The support system for creating multimedia contents of claim 6, wherein the link creation apparatus further includes a program-register-information storing part which stores information on applications, including corresponding relation information on the applications and the plurality of link-object-information specifying parts, and wherein the link-information administering part refers to corresponding relation information stored in the program-register-information storing part and activates one of the plurality of link-object-information specifying parts corresponding to the link-object application to be linked.

8. The support system for creating multimedia contents of claim 2 further comprising an automatic link creation apparatus which automatically changes a linking for an old media element to a linking for a new media element by using the link creation apparatus when the new media element is assigned for a part by the assigning part.

9. A support system for creating multimedia contents comprising: (a) a structure-edit apparatus for editing structure information of multimedia contents by inserting media elements into parts and setting a link between the parts; and (b) a temporary multimedia-contents executing apparatus for executing multimedia contents in a state of there existing a part to which no media element is inserted by the structure-edit apparatus.

10. The support system for creating multimedia contents of claim 9, wherein the temporary multimediacontents executing apparatus executes the multimedia contents by inserting a virtual media element indicating that no media element is inserted, into the part wherein no media element has been inserted.

11. The support system for creating multimedia contents of claim 1 further comprising: (a) multimedia contents having a specific structure specified by link information between media elements; (b) a link-structure converting apparatus for inputting link information on media elements of the multimedia contents and converting the link information to structure information of the multimedia contents; and (c) a screen display apparatus for displaying the structure information of the multimedia contents converted by the link-structure converting apparatus, on the screen.

12. The support system for creating multimedia contents of claim 11, wherein the link-structure converting apparatus update structure information of the multimedia contents and displays updated structure information on the screen display apparatus at real time, in case of link information between the media elements of the multimedia contents being updated.

13. A support system for creating multimedia contents constructed and arranged to operate substantially as hereinbefore described with reference to and as illustrated in Figures 1 to 25 of the accompanying drawings.