JP3562946B2 - Method and apparatus for processing multimedia information and recording medium - Google Patents

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a method and apparatus for processing multimedia information including content data such as images, sounds, or characters, and a recording medium, and more particularly, to a method for collectively handling a plurality of redundant contents as one continuous content. To a method of processing.
[0002]
2. Description of the Related Art With the spread of the Internet or personal computer communication in recent years, creation or access to multimedia information has been routinely performed at an individual level. Therefore, it is possible to provide or propose various problems or themes in various fields and collect personal opinions or views on them through those networks through which multimedia information is distributed.
[0003]
There is a demand for a multimedia information processing device that can be a support system for collecting such opinions or views and making a decision based on the collected views or opinions.
[0004]
[Prior art]
2. Description of the Related Art Conventionally, various contents have been provided on the Internet and personal computer communication. The multiple contents are related to each other.CommunicatingWhen attaching, it is necessary to perform an appropriate and troublesome operation such as arranging a plurality of contents in order. In addition, in order to provide continuity between a plurality of contents, means for associating narratives and the like is separately required. In addition, there is a platform where continuity produces another continuity, so that complications cannot be avoided.
[0005]
[Problems to be solved by the invention]
As described above, conventionally, when a plurality of contents are given continuity, a link to the creator for the viewer as to why those contents are connected to each other and what kind of flow exists between the contents. I did not understand the intention of the creation.
[0006]
In addition, the creator and the viewer can know the relationship between one continuous content, but determine whether there is another continuity different from the content in the continuity. If there is, you cannot know how to access it. That is, neither the creator nor the viewer could deviate from the continuity or relevance of the content provided by the creator.
[0007]
For example, in the HTML used in the WWW, it was possible to indicate a relationship from one content A to another content B together with words and symbols indicating the meaning of the relationship, but the content B was further associated with another content C. I can't say if I'm doing it.
[0008]
Also, with the push technology that has recently appeared, it is possible to describe the continuity of multiple contents, but each content is associated with the next content or another content based on what logic and necessity. Cannot be described along with words or symbols that indicate the relevant meaning.
[0009]
In other words, in the conventional content creation and visual design processes, the links of multiple pieces of image information, the meanings of the links, or the branches, etc., cannot be managed well, so that the creator can give a certain meaning between the continuous contents. I couldn't express it. Therefore, for example, it is possible to support the creative process of expressing the meaning or intention between contents, which can successfully absorb the intention of maintaining or differing the continuity of the contents among multiple producers. could not.
[0010]
SUMMARY OF THE INVENTION The present invention has been made in view of the above-described problems, and has a meaning associated with a creator included in a multimedia information including content by giving a meaning to a link for associating the content with each other. It is an object of the present invention to provide a multimedia information processing method and apparatus and a recording medium that can be easily known by a viewer.
[0011]
[Means for Solving the Problems]
According to the invention of claim 1apparatusProcesses multimedia information including content data such as images, audio, or textapparatusAndA means for recording, for each story data, a series of content data associated with each other by a link, link information on the link, and story data as data on a story including comment information added to the link. And a table for associating each content data with each story, means for displaying the content data in the specified story on the display surface of the display device, and displaying the content data when displaying the content data on the display surface. Means for displaying, on the display surface, comment information on a link provided for the data, and a button indicating that the content data is used when the content data is used in another story other than the story, One was selected from the comment information Means for displaying other content data associated with the link corresponding to the selected comment information on the display surface, and searching for another story by referring to the table when the button is selected. And means for displaying a list of searched stories, and means for displaying the content data under management of the stories selected from the list.
[0012]
According to the invention of claim 2recoding mediaIsA process of recording, for each story data, a series of content data associated with each other, link information on the link, and story data that is data on a story including comment information added to the link, for each story data A process of creating a table that associates each content data with each story; a process of displaying content data in a specified story on a display surface of a display device; and a process of displaying the content data on the display surface. A process of displaying comment information on a link provided for the content data and a button indicating that the content data is used in another story other than the story on the display surface, and , One of the displayed comment information When the button is selected, a process of displaying other content data associated with the link corresponding to the selected comment information on the display surface, and when the button is selected, referring to the table A program for causing a computer to execute a process of searching for a story and displaying a list of the searched stories, and a process of displaying the content data under management of the story selected from the list. Computer-readable recording medium.
[0021]
The multimedia information includes the content data DCN or the content data DCN and its accompanying information. That is, the multimedia information may be the content data DCN itself.
[0022]
Next, an example of an operation and a usage method of the multimedia information processing system 1 according to the present invention will be described with reference to the drawings.
As shown in FIG. 10A, in a state where a plurality of pieces of content data DCN are arranged, one piece of content data DCN1 to be linked is designated, and from that state, the other piece of content data DCN2 to be linked is assigned. Drag. As a result, a link LK1 is established between the content data DCN1 and DCN2, and is displayed by an arrow. Next, in order to add comment information to the link LK1, the cursor is placed on the link LK1 and the mouse is clicked. As a result, as shown in FIG. 10B, the comment frame WKC is displayed substantially at the center of the link LK1. Therefore, appropriate comment information CMF1 is input into the comment frame WKC.
[0023]
Usually, a conjunction is used as the comment information CMF1. In other words, it clearly shows that the creator who established the link LK1 from the content data DCN1 to the content data DCN2 is thinking about the relationship between the content data DCN1 and the content data DCN2, and why the link LK1 was established between them. The conjunction is written in the comment frame WKC. Thus, when a link is established between a plurality of content data DCNs, a creator's link creation such as how the content data DCNs are connected, why they are connected, and what kind of flow exists between the content data DCNs. Can be shown.
[0024]
In principle, a conjunction is used as a phrase of the comment information CMF, but a word or a symbol of another part of speech may be used. The comment information CMF can be modified. Two or more links may be provided for one content data DCN. A link may be made to content data stored in another database or server by indicating its storage location or URL.
[0025]
As shown in FIG. 13, below the content data DCN2 displayed on the display surface, buttons BL indicating links are displayed, and comment information CMF is displayed on each button BL. The button BL11 indicates a link between the content data DCN2 and the content data DCN1 located above the content data DCN2, and the comment information CMF1 is displayed. The button BL21 indicates a link between the content data DCN2 and the content data DCN3 located therebelow, and the comment information CMF2 is displayed.
[0026]
When the content data DCN2 is used in a story SR other than the story SR1, that is, when a link is provided in a story SR other than the story SR1, for example, the fact is displayed as the button BW11. In this case, the viewer knows from the display of the button BW11 that the currently displayed content data DCN2 is associated with another story other than the story SR1 currently being accessed. By pressing the button BW11, another story is searched for, and a list of another searched story is displayed. By selecting one story (this is referred to as a story SRT) from the displayed list, the story SRT can be accessed and the content data DCN2 associated with the story SRT can be displayed. When the content data DCN2 is displayed, a button BL indicating a link is displayed as shown in FIG. 13, and the story SRT can be browsed by pressing the button BL. That is, even if the viewer or creator of the story SR1 does not know about the existence of another story SRT, the viewer or the creator of the story SR1 can escape from the story SR1 through the content data DCN2 and warp (migrate or escape) to another story SRT. You can. Conversely, a viewer who has viewed the content data DCN2 in the story SRT can warp from the story SRT to the story SR1 in a similar procedure.
[0027]
As a method of recording the link information or the content data DCN and the story SR in association with each other, a method of recording a story ID indicating each story SR in the story data DS which is data for managing the story SR, a method of recording the content data DCN There is a method of providing a table TB in which a table ID is associated with a story ID, and a method of adding a story ID as additional information of the content data DCN. These can be used in combination. Each is used for search at various timings.
[0028]
The processing device or the multimedia information processing system according to the present invention is realized using, for example, a personal computer or a workstation. A program for executing the method according to the present invention is stored in a recording medium such as a semiconductor memory, a hard disk, a CD-ROM, a floppy disk, or a magneto-optical disk. The program stored in the recording medium is loaded onto the main memory as appropriate, and is executed by the processing device. At that time, a drive device such as a CD-ROM drive, a floppy disk drive, or a magneto-optical disk drive is used as necessary. When the recording medium is provided in a server connected by a communication line such as a network, the program is read or downloaded from the server through the communication line. When the program is transferred to the processing device via a communication line, the communication line itself also corresponds to a recording medium. The program can be supplied to operate under various OSs, platforms, system environments, or network environments.
[0029]
BEST MODE FOR CARRYING OUT THE INVENTION
FIG. 1 is a block diagram showing a configuration of a multimedia information processing system 1 according to the present invention, FIG. 2 is a block diagram showing a configuration of a client 3 of the multimedia information processing system 1, and FIG. It is a figure showing the structure of multimedia information.
[0030]
1, the multimedia information processing system 1 includes a server 2, a plurality of clients 3, 3,... The server 2 is provided with a content database DBC and a tag database DBT.
[0031]
The server 2 sends information stored (registered) in the content database DBC or the tag database DBT in response to a request from the client 3, and registers information sent from the client 3 in the content database DBC or the tag database DBT. Note that in this specification, registering in the content database DBC, the tag database DBT, or another database of the server 2 may be referred to as “registering in the server 2”.
[0032]
The client 3 can input and reproduce content data such as an image, a sound, or a character, and transmit the content data for registration with the server 2 or transmit the content data from the server 2. Also, comment data on content data can be input, reproduced, transmitted, and transmitted.
[0033]
The server 2 and the client 3 can be configured by, for example, a personal computer or a workstation.
Although a LAN (local area network) is used as the network 4 in the present embodiment, the Internet or a network for various types of personal computer communication may be used. Further, a CATV network may be used. When a CATV network is used, the server 2 is installed in a base station, and information is transmitted and received via a video transmission device. Alternatively, the server 2 is installed as one of the terminals of the CATV network, information is transmitted to the base station using a dedicated channel, and information is transmitted from the base station to another terminal using another channel. You may.
[0034]
When an open network such as the Internet is used as the network 4, or when a LAN is used and the apparatus is connected to the Internet or the like, the client 3 uses various content databases stored in other servers as well as the server 2. Alternatively, the user can access a multimedia information database and acquire the data or information.
[0035]
In FIG. 2, the client 3 includes a processing device 10, a keyboard 11, a mouse 12, a display device 13, a printer device 14, a speaker 15, a microphone 16, a magnetic disk device 17, and the like. The magnetic disk device 17 stores a content file FC, a work file FW, and various other files and databases.
[0036]
In the client 3, various known application programs or editor programs stored in the magnetic disk device 17 are executed or executable by the processing device 10 in a multitasking manner. By operating, various multimedia information can be newly created, read from various media already created and stored, edited, or processed.
[0037]
In FIG. 3A, content information MNC includes content data DCN such as still image data, moving image data, audio data, or character data, and an object ID (BID) for identifying each content data DCN. Consists of The object ID is also a file name of the content data DCN. That is, the file name of the content data DCN is link information with comment data attached to each content data DCN. The file name of the content data DCN is provided with an identifier indicating the type or compression method of each content data DCN.
[0038]
In FIG. 3B, the primary tag information MNP includes a primary data DPR and an object ID for identifying the content data DCN associated with the primary data DPR. The object ID is link information to the content data DCN as described above.
[0039]
As shown in FIG. 3C, the primary data DPR includes attribute information such as the title CTL, creator name CAT, creation date CDT, type CKD, and element CEL of the corresponding content data DCN, information indicating operation authority, and The creator's comment data CCM and the like.
[0040]
In FIG. 3D, the secondary tag information MNS includes an object ID for identifying the secondary data DSC and the content data DCN related to the secondary data DSC, and an identifier for identifying each secondary data DSC within the same object ID. It is composed of a tag ID (TID) and a reference ID (RID) indicating a parent node of each of the hierarchized secondary data DSCs. As shown in FIG. 3E, the secondary data DSC includes attribute information such as the title STL, creation date SDT, and creator name SAT of the secondary data DSC, information indicating operation authority, and text (creator comment data). SCM and the like.
[0041]
Next, the operation and usage of the multimedia information processing system 1 will be described.
4 shows a browser screen HG1 displayed on the display device 13, FIG. 5 shows a list screen HG2 displayed on the display device 13, and FIG. 6 shows a primary tag registration screen HG3 displayed on the display device 13. FIG.
[0042]
In FIG. 4, on the browser screen HG1, the contents of a plurality of pieces of content data DCN are displayed as a list (thumbnail display) of the content data DCN stored in the content database DBC. The title CTL of each content data DCN is displayed on the browser screen HG1 based on the primary tag information MNP stored in the content database DBC. In addition, a type (type) CKD, an element CEL, and a keyword CKW of the content data DCN, which are search conditions for displaying the screen HG1, are displayed.
[0043]
There are three types of CKD: “element”, “scene”, and “story”. “Element” indicates that the content data DCN is content data itself created using various application programs such as an image processor or a text processor. “Scene” indicates that the content data is an element to which HTML is added. A "story" is a collection of a plurality of scenes.
[0044]
The element CEL indicates an editor, processor, or tool that has created the element, and is usually indicated by the name of an application program.
The browser screen HG1 is displayed as a result of a search by inputting search conditions such as a type CKD, an element CEL, a period FPR, and a keyword CKW on a search screen (not shown) and instructing a search start. The search is performed on the tag database DBT and the content database DBC, and the content data DCN and the corresponding primary tag information MNP are extracted. If the search results cannot be displayed on one screen, all data is displayed by scrolling.
[0045]
When one of the content data DCNs displayed on the browser screen HG1 is selected by clicking the mouse 12, a primary tag registration screen HG3 or a secondary tag registration screen HG4 (not shown) for the selected content data DCN is displayed. When "list display" displayed on the upper right of the screen HG1 is selected, the screen is switched to a list screen HG2 described below.
[0046]
In FIG. 5, a list screen HG2 displays, for the same content data DCN as the browser screen HG1, title CTL, type CKD, creation date CDT, creator name CAT, number of tags, number of accesses, and the like. When one of the content data DCNs is selected on the list screen HG2, a primary tag registration screen HG3 or a secondary tag registration screen HG4 for the selected content data DCN is displayed. Note that when "thumbnail display" displayed at the upper right of the screen HG2 is selected, the screen is switched to the previous browser screen HG1.
[0047]
In FIG. 6, a tag changeover switch CTS, content data DCN, title CTL, creator name CAT, creation date CDT, type CKD, element CEL, information indicating operation authority, and comment data CCM are displayed on the primary tag registration screen HG3. Is displayed. On the primary tag registration screen HG3, since the creator of the content data DCN has the operation authority, it is possible to write or modify the content, but other persons without the operation authority can only view.
[0048]
When the content data DCN is still image data, a reduced image is displayed. When the content data DCN is moving image data, audio data, or character data, an illustration indicating that fact is displayed. . By selecting these illustrations, an editor corresponding to the type is activated and the contents of the content data DCN are reproduced. That is, if the image data is still image data, an image is displayed on the entire screen HG, if the image data is moving image data, a moving image is displayed in a predetermined size, and if the image data is audio data, the image is displayed. Sound is reproduced from the speaker 15. These processes are executed in the processing device 10.
[0049]
Further, not only the content data DCN is displayed in the frame of the content data DCN, but also the content data DCN can be input. In this case, an image displayed in another window can be input as content data DCN by drag and drop.
[0050]
The creator of the content data DCN, for the content data DCN that he or she has created, stores the content data DCN itself in the content database DBC and the primary tag information MNP input on the primary tag registration screen HG3 in relation to the content database DBC in the tag database DBT. , Respectively. In the registration, after inputting necessary data on the primary tag registration screen HG3, the save button BT1 is pressed. To delete the content data DCN and the primary tag information MNP, the user presses a delete button BT2. To close the primary tag registration screen HG3 without saving it, press the close button BT3. When the “secondary tag” of the tag changeover switch CTS displayed on the upper left of the screen HG3 is selected, the screen is switched to the secondary tag registration screen HG4.
[0051]
On the secondary tag registration screen HG4, an opinion or opinion related to the content data DCN of a creator who intends to create the secondary data DSC, or an opinion or opinion with respect to another person's opinion or opinion is input.
[0052]
In the multimedia information processing system 1, links for associating the content data DCN registered in the server 2 with each other and between the content data DCN registered in the server 2 and the content data stored in another server other than the server 2 , And comment information for giving each link its meaning can be added. Usually, conjunctions are used as comment information. The operation of linking the content data DCN and the operation of adding comment information can be performed on the screen HG5 of the story editor of the server 2 and the client 3.
[0053]
7 is a diagram showing a screen HG5 of the story editor, FIG. 8 is a diagram showing a pull-down menu usable in the story editor, FIG. 9 is a diagram showing a palette PL1 used in the story editor, and FIG. FIG. 11 is a diagram for explaining a procedure for setting the story, FIG. 11 is a diagram showing an example of the created story SR1, FIG. 12 is a diagram showing story data DS for the story SR1 shown in FIG. 11, and FIG. FIG. 7 is a diagram showing a screen HG6 displaying one piece of content data DCN1.
[0054]
In FIG. 7, on a screen HG5, content data DCN is arranged and displayed in a matrix in a certain set story SR. In the example of FIG. 7, nine pieces of content data DCN, three in the row direction and three in the column direction, can be simultaneously displayed. However, for one story SR, it is possible to arrange a total of 110 pieces of content data DCN, for example, 11 pieces in the row direction and 10 pieces in the column direction, and these can be displayed by scrolling the screen HG5. . In addition, the arrangement number of the content data DCN per one story SR and the display number on the screen HG5 can be variously changed other than the example here.
[0055]
On the screen HG5, the position of the content data DCN arranged for a certain story SR is specified by the coordinates in the row direction and the column direction. Regarding the row direction, the center of the screen HG5 is “0”, which is −1, −2,... -5 to the left, and 1, 2,. In the column direction, the top row is 1, and downward, 2, 3,... On the screen HG5, only the content data DCN1 at the coordinates (0, 1) is arranged.
[0056]
There are various ways to arrange the content data DCN on the screen HG5. For example, the content data DCN is brought to the coordinate position where the content data DCN is to be arranged by dragging and dropping from the browser screen HG1 or the like. When the content of the content data DCN has not been determined, for example, “palette” is selected from “display” in the pull-down menu, and the palette PL1 shown in FIG. 9 is displayed. By pressing the blank button BT1 of the pallet PL1 in a state where the position of the coordinates (0, 1) is selected, the content frame is arranged at the position of the coordinates (0, 1). The content frames arranged in this way can be linked like the content data DCN. Further, the content data DCN can be inserted into the content frame at any time by drag and drop.
[0057]
Further, when a URL button BT2 of the pallet PL1 is pressed, a URL (Universal Resource Locator) can be written at the designated coordinate position. Thereby, it can be associated with various other content data DCN or multimedia information (that is, resources) connected via a network.
[0058]
When the button BT3, 4, or 5 is pressed on the palette PL1 shown in FIG. 9, the content data DCN or the content frame is arranged at the lower left, right below, or lower right coordinate position of the currently designated coordinate position. When the cut button BT7 is pressed, the content data DCN at the designated coordinate position is deleted. In this case, the content frame and the link remain without being deleted. When the cut button BT8 is pressed, the content data DCN at the designated coordinate position is deleted together with the content frame and the link. When the button BT11 is pressed, it becomes possible to input comment information for the link.
[0059]
Next, a method of linking will be described.
As shown in FIG. 10A, in a state where a plurality of content data DCNs are arranged on the screen HG5, a cursor is placed on a link anchor AK provided below one of the content data DCN1 to which a link is to be provided. From that state, the user drags the content data DCN2 to which a link is desired to be provided. As a result, a link LK1 is established between the content data DCN1 and DCN2, and is displayed by an arrow. Next, in order to add comment information to the link LK1, the cursor is placed on the link LK1 and the mouse is clicked. As a result, as shown in FIG. 10B, the comment frame WKC is displayed substantially at the center of the link LK1. Therefore, appropriate comment information CMF1 is input into the comment frame WKC. When the content data DCN is designated for linking, the designated content data DCN is displayed in reverse video.
[0060]
Usually, a conjunction is used as the comment information CMF1. In other words, it clearly shows that the creator who established the link LK1 from the content data DCN1 to the content data DCN2 is thinking about the relationship between the content data DCN1 and the content data DCN2, and why the link LK1 was established between them. The conjunction is written in the comment frame WKC.
[0061]
Thus, when a link is established between a plurality of content data DCNs, a creator's link creation such as how the content data DCNs are connected, why they are connected, and what kind of flow exists between the content data DCNs. Can be shown. Therefore, a series of multimedia information linked to each other by the link LK is opened not only to the creator but also to a plurality of other creators and viewers.
[0062]
In principle, a conjunction is used as a word of the comment information CMF. However, if there is no appropriate conjunction, a word or a symbol of another part of speech may be used. The number of characters of the comment information CMF is limited to, for example, about 40 characters. However, since about 8 to 10 characters are displayed on the button BL described later, the remaining characters may be displayed by scrolling, for example. The comment information CMF can be modified. When displaying the comment frame WKC, an appropriate word may be displayed as a default value. It is also possible to link two or more links to one content data DCN. A link can also be established for content data stored in another database or server by indicating the storage location.
[0063]
In this way, the link LK is established between the content data DCN, and the story SR1 is created. The created story SR1 is registered in the server 2 and managed by the story editor. .. Can be created and managed by the story editor. This will be described later.
[0064]
In FIG. 11, the story SR1 starts with the content data DCN1, is linked to the content data DCN2, 4, 5, and is further linked to other content data DCN3, 6, 7,. . The comment information CMF1, 2, 3,... Is added to each link LK1, 2, 3,.
[0065]
FIG. 12 shows story data DS including content data DCN, link information, and comment information CMF registered as story SR1. In each row of the story data DS, for the content data DCN, the first two numbers indicate the coordinates, the characters in the quotes indicate the title CTL of the content data DCN, and the last number is the identification code of the content data DCN. Indicates the content ID.
[0066]
Regarding link information and the like, the first two numbers indicate two linked content data DCN, the characters in the quotes indicate comment information CMF, and the last number indicates that it is link information (arrow). Show. In the link information, the first two numbers indicating the content data DCN indicate the order in which the content data DCN is arranged in the story SR.
[0067]
In FIG. 13, the content data DCN2 is displayed on the screen HG6. Buttons BL indicating links are displayed below the content data DCN2, and comment information CMF is displayed on each button BL.
[0068]
The button BL11 shows a link between the content data DCN2 and the content data DCN1 located above the content data DCN2, and the comment information CMF1 “So” is displayed. The button BL21 indicates a link between the content data DCN2 and the content data DCN3 located below the content data DCN2, and the comment information CMF2 of "then" is displayed.
[0069]
When there are a plurality of links, a plurality of buttons BL are displayed together with the comment information CMF, for example, buttons BL22 and BL23. Note that the content of the content data DCN at the link destination when the button BL is pressed may be displayed in a reduced size near the button BL or in order to understand the correspondence with the button BL.
[0070]
Then, when one of these buttons BL is pressed, the other content data DCN associated with the link is displayed on the screen HG6. The viewer can easily know the meaning of the creator included in each link by the comment information CMF displayed on the button BL. Therefore, by selecting the button BL with reference to the comment information CMF, the content data DCN can be browsed one after another while considering the creator's intention. When the viewer presses the button BL, the viewer can browse the content data DCN one after another with reference to the comment information CMF according to a certain intention.
[0071]
Further, when the displayed content data DCN2 is used in another story SR other than the story SR1, that is, when the content data DCN2 is linked in another story SR, this is indicated. Button BW11 is displayed. The viewer knows from the display of the button BW11 that the currently displayed content data DCN2 is associated with another story SR other than the story SR1 currently being accessed.
[0072]
Then, when the button BW11 is pressed, the search for the different story SR is performed, and a list of the searched different stories SR is displayed. By selecting one story SR from the list of story SRs, the selected story SR is accessed, and the content data DCN linked in the story SR is displayed in the same manner as shown in FIG. be able to.
[0073]
In this manner, transition from the content data DCN in the story SR1 to another story SR using the content data DCN is referred to as “warp” in this specification. In the multimedia information processing system 1, since warp is possible, it is possible to freely transfer from one to the other between a plurality of stories SR each of which is linked to one content data DCN. Further, it is possible to deviate from one story SR to another story SR unknown to the viewer or the creator.
[0074]
In the story editor, it is possible to search for the content data DCN used in all the stories SR. Such a search is referred to herein as a “warp search”. In the warp search, one or a plurality of content data DCNs are specified as search parameters. When a plurality of content data DCNs are specified, a logical condition between them is also specified as a search parameter. As such a logical condition, an AND condition or an OR condition can be designated. When the AND condition is specified, the story SR including all the content data DCN specified as the search parameter is searched.OWhen the R condition is specified, the story SR including any one of the content data DCN specified as the search parameter is searched.
[0075]
The plurality of stories SR1, 2, 3,... Created by the story editor are managed by a story editor (or a story management system) as shown in FIG.
[0076]
The story editor is provided with a table TB as shown in FIG. The table TB shows, for the content data DCN used in each story SR, the correspondence between the story ID and the content ID. When the warp search is instructed, the table TB is referred to and the story SR is searched according to the specified search parameters.
[0077]
Instead of providing such a table TB, a story ID indicating the story SR in which the content data DCN is used may be described after the content ID in the story data DS shown in FIG.
[0078]
Further, a story ID in which the scene is used may be described as additional information of the content data DCN of the scene.
These tables TB or story IDs are searched at various different timings in the operation. For example, the search is performed when the warp search is instructed as described above or every time the content data DCN is displayed.
[0079]
Next, the procedure of link information processing will be described with reference to the flowchart shown in FIG. FIG. 14 is a flowchart showing a procedure for creating a story SR by the story editor.
[0080]
In FIG. 14, one content data DCN to be associated with each other is designated from among the displayed plurality of content data DCNs (# 11), and then the other content data DCN is designated (# 12). As a result, a link LK is provided between the contents and displayed (# 13), and the link information is stored in the memory (# 14). When the displayed link is designated (# 15), a comment frame WKC is displayed (# 16), and comment information CMF is input (# 17). The input comment information CMF is stored in association with the link information, that is, for example, added to the link information (# 18).
[0081]
FIG. 17 is a diagram showing a form of a recording medium ST of a program for executing the method according to the present invention.
As shown in FIG. 17, a storage device STA such as a main memory, a RAM, a ROM, or a hard disk provided in a processing device PS of a computer, a portable medium STB such as a CD-ROM, a floppy disk, or a magneto-optical disk; Alternatively, a line destination medium STC such as a server or DASD connected by the communication line STD, or the communication line STD itself can be used as the recording medium ST.
[0082]
If the recording medium ST is a portable medium STB, the program is read by a drive device corresponding to the type of the portable medium STB, stored in the storage device STA of the processing device PS or loaded on the main memory, Be executed. When the recording medium ST is the line destination medium STC, the program is downloaded to the storage device STA via the communication line STD, or is transferred and executed at an appropriate time. The program can be supplied to operate under various OSs, platforms, system environments, or network environments.
[0083]
In the multimedia information processing system 1 described above, the operator of the client 3 views the primary data DPR or the secondary data DSC corresponding to each content data DCN registered in the server 2 so that the content data DCN can be obtained. The creator can know the intention and opinion of the creator, easily know the opinion or opinion of another person, and easily input and register the opinion or opinion of the operator.
[0084]
Therefore, personal opinions or views on various problems or themes in various fields provided or proposed by the content data DCN and the primary data DPR can be easily collected. Then, by collecting and integrating those opinions or opinions, it becomes easy to make a decision on the raised problem.
[0085]
According to the multimedia information processing system 1 of the above-described embodiment, the comment information CMF related to the link LK can be added to the link LK, and the continuity (story nature) of the content data DCN can be obtained by following the comment information CMF. I can follow.
[0086]
In addition, when producing information with continuous content such as images, it is possible to record the intention of the creator, so that communication between the creator and the browsing sound can be achieved, and content creation and visual design It greatly contributes to development.
[0087]
The multimedia information processing system 1 according to the above-described embodiment can be applied to opinion collection and decision making in the case of reconstruction when an earthquake disaster occurs. In such a case, for example, photos or illustrations of buildings, bridges, rivers, etc. damaged by the earthquake are registered as content data DCN as the content data DCN, and an overview of the content is registered in the server 2 as primary data DPR. In advance, a plurality of specific intellectuals or ordinary people involved in the recovery measure may freely operate the client 3 and input an opinion or the like.
[0088]
In the above embodiment, the content database DBC and the tag database DBT can be created in the same database. Although the comment information CMF is directly input into the comment frame WKC, a dialog box “link property” for inputting the comment information CMF may be displayed and written therein. In addition, the configuration of the client 3, the server 2, and the whole or each part of the multimedia information processing system 1, the configuration of data, the content or sequence of processing, the content or configuration of the screen HG, etc. are appropriately changed according to the gist of the present invention. can do.
[0089]
【The invention's effect】
Claim 1andClaim2According to the invention of (1), regarding multimedia information including contents, by giving meanings to links that link them, a viewer can easily know the meaning of the creator included in those links.
[0090]
further,Even if a viewer or creator of a story does not know about the existence of another story, he / she can escape from the story and transition to another story through the content data.
In other words, when creating a story by connecting content data to each other, the meaning of linking the content data of the link source and the content data of the link destination, that is, why those pieces of content were connected to each other, and what kind of content It is possible to know from the comment information the intention of the creator of link creation as to whether there is a flow. Therefore, the viewer can browse the content data one after another while considering the intention of the creator.
Then, when the content data is used in another story other than the story, a button indicating that fact is displayed on the display surface, so that the viewer can display the content data currently displayed by displaying the button. The user can know that the story is related to another story other than the story currently being accessed, and can escape from the story and move to another story.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a configuration of a multimedia information processing system according to the present invention.
FIG. 2 is a block diagram illustrating a configuration of a client of the multimedia information processing system.
FIG. 3 is a diagram showing a structure of multimedia information handled by the multimedia information processing system.
FIG. 4 is a diagram showing a browser screen displayed on a display device.
FIG. 5 is a diagram showing a list screen displayed on a display device.
FIG. 6 is a diagram showing a primary tag registration screen displayed on a display device.
FIG. 7 is a diagram showing a screen of a story editor.
FIG. 8 is a diagram showing a pull-down menu that can be used in the story editor.
FIG. 9 is a diagram showing a palette used in the story editor.
FIG. 10 is a diagram for explaining a procedure for establishing a link.
FIG. 11 is a diagram showing an example of a created story.
FIG. 12 is a diagram showing recorded data of the story shown in FIG. 11;
FIG. 13 is a diagram showing a screen on which one piece of content data in a story is displayed.
FIG. 14 is a flowchart showing a procedure in creating a story by a story editor.
FIG. 15 is a diagram showing the concept of a story managed by a story editor.
FIG. 16 is a diagram showing a table used for warp search.
FIG. 17 is a diagram showing a form of a recording medium of a program for executing the method according to the present invention.
[Explanation of symbols]
1 Multimedia information processing system (multimedia information processing device)
10 Processing unit (means for recording, means for displaying, means for selecting)
12 mouse (registration hierarchy designation means)
LK, LK1 link
DCN content data (multimedia information)
CMF comment information
DBC content database (database)
SR Story
STA, STB, STC, STD recording media

Claims (2)

An apparatus that processes multimedia information including content data such as images, sounds, or characters,
Means for recording, for each story data, a series of content data associated with each other by a link, link information on the link, and story data that is data on a story including comment information added to the link. When,
A table for associating each content data with each story,
Means for displaying the content data in the specified story on the display surface of the display device;
When displaying the content data on the display surface, comment information on a link provided for the content data, and indicating that fact when the content data is used in another story other than the story Means for displaying a button on the display surface;
Means for, when one of the displayed comment information is selected, displaying other content data associated with a link corresponding to the selected comment information on the display surface;
Means for searching for other stories by referring to the table when the button is selected, and displaying a list of searched stories;
Means for displaying the content data under the management of the story selected from the list,
A multimedia information processing device, comprising: A recording medium that records a program for processing multimedia information including content data such as images, sounds, or characters,
A process of recording, for each story data, a series of content data associated with each other, story information that is data about a story including link information about the link, and comment information added to the link, for each story data When,
Processing to create a table that associates each content data with each story;
A process of displaying content data in a specified story on a display surface of a display device;
When displaying the content data on the display surface, comment information on a link provided for the content data, and indicating that fact when the content data is used in another story other than the story Displaying a button on the display surface;
A process of, when one of the displayed comment information is selected, displaying, on the display surface, other content data associated with a link corresponding to the selected comment information;
When the button is selected, searching for another story by referring to the table, and displaying a list of searched stories;
A process of displaying the content data under the management of the story selected from the list;
And a computer-readable recording medium recording a program for causing a computer to execute the program.

Images