JPH11161668A - Method, device and recording method for processing multimedia information - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow a perusing person to easily know the meaning of a producing person contained in a link by providing a mean for the link correlating the pieces of multimedia information including contents with each other. SOLUTION: Link information on the link arranged between multimedia information is recorded and comment information added to the link is recorded by correlating with link information of the link. In order to add comment information, a cursor is placed on LK1 and a mouse is clicked. Therefore, a comment frame WKC1 is displayed nearly at the center position of the link LK1 to input comment information CMF1 within the frame WKC1. A conjunction is used as information CMF1. Namely a conjunction showing that the producing person arranging the link LK1 from contents data DCN1 to contents data DCN2 thinks about the relation between contents data DCN1 and DCN2 is written in the fame WKC1.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method and apparatus for processing multimedia information including content data such as images, sounds, and characters, and a recording medium.
The present invention relates to a processing method for enabling a plurality of redundant contents to be collectively handled as one continuous content.

[0002] With the spread of the Internet or personal computer communication in recent years, it has become common practice to create or access multimedia information at an individual level. Therefore, it is possible to provide or propose various problems or themes in various fields and collect personal opinions or views on them through those networks through which multimedia information is distributed.

[0003] There is a demand for a multimedia information processing device that can be a support system for collecting such opinions or opinions and making a decision based on the collected opinions or opinions.

[0004]

2. Description of the Related Art Conventionally, various contents have been provided on the Internet and personal computer communication.
When associating the plurality of contents with each other, it is necessary to perform an appropriate and troublesome work such as arranging the plurality of contents in order. In addition, in order to provide continuity between a plurality of contents, a means for associating narratives and the like is separately required. In addition, there is a platform where continuity produces another continuity, so that complications cannot be avoided.

[0005]

As described above, conventionally, when a plurality of contents are provided with continuity, it is difficult for the viewer to understand why those contents are connected to each other and what kind of flow exists between the contents. I didn't understand the creator's intention to create a link.

[0006] In addition, the creator and the viewer can know the relation between one continuous content, but whether there is another continuity different from the content in the continuity. No, if there is, you cannot know how to access it. That is, neither the creator nor the viewer could deviate from the continuity or relevance of the content provided by the creator.

For example, HTML used in WWW
In the above, it was possible to indicate the association from one content A to another content B together with words and symbols indicating the meaning of the association, but further describe whether the content B is related to another content C. Can not do it.

[0008] In the push technology that has recently appeared, it is possible to describe the continuity of a plurality of contents. However, each content is based on what logic and necessity with the next content or another content. Whether or not they are related cannot be described with words or symbols indicating the meaning of the relation.

[0009] In other words, in the conventional content production and visual design processes, links of a plurality of image information,
Since the meaning or branching of the link cannot be managed well, even if the creator tries to give a certain meaning between continuous contents, it cannot be expressed. Therefore, it is possible to support the creative process of expressing the meaning or intention between contents, for example, in order to maintain the continuity of the content and to make a difference between the content continuity among multiple producers. could not.

[0010] The present invention has been made in view of the above-mentioned problems, and has been made in consideration of multimedia information including contents.
Provided are a method and apparatus for processing multimedia information and a recording medium that allow a viewer to easily know the meaning of a creator included in the link by giving a meaning to a link that associates the link with each other. The purpose is to:

[0011]

According to a first aspect of the present invention, there is provided a method for processing multimedia information including content data such as images, sounds, and characters, wherein the multimedia information includes a plurality of pieces of information. The link information about the linked link is recorded, and the comment information added to the link is recorded in association with the link information of the link.

According to a second aspect of the present invention, when the multimedia information is displayed on a display surface of a display device, comment information on a link provided for the multimedia information is simultaneously displayed on the display surface. When one of the displayed comment information is selected, other multimedia information associated with a link corresponding to the selected comment information is displayed on the display surface.

According to a third aspect of the present invention, there is provided a method for providing a table for associating the multimedia information with a story for managing a link provided between the multimedia information, the link being managed by one story. When a link managed by another story is provided for the multimedia information with the, it is necessary to search for the other story by referring to the table, and shift to the management of the searched story. This is a possible method.

According to a fourth aspect of the present invention, there is provided a method for processing multimedia information including content data such as an image, a sound, or a character, wherein a link between links of the multimedia information is provided. In this method, information is recorded in association with a story for managing a set of links related to each other, and comment information added to the link is recorded in association with link information of the link.

[0015] In the method according to the fifth aspect of the present invention, when a link managed by another story is set for multimedia information linked by one story, the other story is linked to the multimedia information. Search and
This is a method that makes it possible to shift to the management of the searched story.

A method according to a sixth aspect of the present invention is a method for simultaneously reproducing the information indicating the existence of the other story while reproducing the multimedia information. An apparatus according to the invention of claim 7 is an apparatus for processing multimedia information including content data DCN such as images, voices, or characters, wherein link information about a link provided between the multimedia information is provided. Means for recording;
Means for recording the comment information CMF added to the link in association with the link information of the link.

In the apparatus according to the present invention, when the multimedia information is displayed on a display surface of the display device, comment information CMF about a link provided for the multimedia information is simultaneously displayed on the display surface. Means for selecting one of the displayed comment information CMFs, and means for displaying other multimedia information associated with the link corresponding to the selected comment information CMF on the display surface. Do it.

According to a ninth aspect of the present invention, there is provided an apparatus for displaying a plurality of pieces of multimedia information on a display surface of a display device,
Means for linking two of the displayed multimedia information in association with each other, means for adding comment information CMF to the provided link and inputting the link, link information on the provided link, and the link Means for associating and recording the comment information CMF added to.

According to a tenth aspect of the present invention, in the recording medium, a step of recording link information about a link provided between the multimedia information, and a step of recording comment information CMF added to the link with link information of the link. And a computer-readable recording medium on which a program for causing a computer to execute the steps of recording in association with each other is recorded.

The recording medium according to the eleventh aspect of the present invention provides a process for displaying a plurality of pieces of multimedia information on a display surface of a display device, and a link to two associated pieces of multimedia information in the displayed multimedia information. Processing and
Comment information CMF to be entered for the linked link
And a process of integrally recording link information about the link and comment information added to the link, using a computer-readable recording medium storing a program for causing a computer to execute the process. is there.

The multimedia information is composed of the content data DCN or the content data DCN and its accompanying information. That is, the multimedia information may be the content data DCN itself.

Next, an example of the operation and usage of the multimedia information processing system 1 according to the present invention will be described with reference to the drawings. As shown in FIG. 10A, in a state where a plurality of pieces of content data DCN are arranged, one piece of content data DCN1 to be linked is designated, and from that state, the other piece of content data DCN to be linked is set.
Drag to N2. As a result, a link LK1 is established between the content data DCN1 and DCN2, and is displayed by an arrow. Next, in order to add comment information to the link LK1, the cursor is placed on the link LK1 and the mouse is clicked. by this,
As shown in FIG. 10B, a comment frame WKC is displayed substantially at the center of the link LK1. Therefore, appropriate comment information CMF1 is input into the comment frame WKC.

Usually, a conjunction is used as the comment information CMF1. In other words, the creator who established the link LK1 from the content data DCN1 to the content data DCN2,
Conjunctions that clearly indicate what you think about the relationship with N2 and why you set up a link LK1 between them,
This is written in the comment frame WKC. Thus, when a link is established between a plurality of content data DCNs, a creator's link creation such as how those content data DCNs are connected, why they are connected, and what kind of flow exists between the content data DCNs. Can be shown.

In principle, a conjunction is used as a phrase of the comment information CMF, but words or symbols of another part of speech may be used. The comment information CMF can be modified. Two or more links may be provided for one content data DCN. A link may be made to content data stored in another database or server by indicating its storage location or URL.

As shown in FIG. 13, buttons BL indicating links are displayed below the content data DCN2 displayed on the display surface, and comment information CMF is displayed on each button BL. The button BL11 indicates a link between the content data DCN2 and the content data DCN1 located thereabove, and the comment information CMF1 is displayed. The button BL21 indicates a link between the content data DCN2 and the content data DCN3 located therebelow, and the comment information CMF2 is displayed.

When the content data DCN2 is used in a story SR other than the story SR1, that is, when a link is established in a story SR other than the story SR1, for example, the fact is displayed as a button BW11. Is done. In this case, the viewer knows from the display of the button BW11 that the currently displayed content data DCN2 is associated with another story other than the story SR1 currently being accessed. By pressing the button BW11, a search for the another story is performed, and a list of the searched other stories is displayed. By selecting one story (this is referred to as a story SRT) from the displayed list, the story SRT can be accessed and the content data DCN2 associated with the story SRT can be displayed. When the content data DCN2 is displayed, a button BL indicating a link is displayed as shown in FIG. 13, and the story SRT can be browsed by pressing the button BL. That is, even if the viewer or the creator of the story SR1 does not know about the existence of another story SRT, the viewer or the creator of the story SR1 can escape from the story SR1 through the content data DCN2 and warp (migrate or escape) to another story SRT. You can. Also, on the contrary,
The viewer who was browsing the content data DCN2 in the story SRT,
Can warp to the story SR1.

The link information or the content data D
As a method of associating and recording the CN and the story SR, a method of recording a story ID indicating each story SR in the story data DS which is data for managing the story SR, and associating the content data DCN with the story ID Method of providing a table TB, a story ID as additional information of the content data DCN
Is added. These can be used in combination. Each is used for search at various timings.

The processing device or the multimedia information processing system according to the present invention is realized using, for example, a personal computer or a workstation. A program for executing the method according to the present invention includes a semiconductor memory,
Hard disk, CD-ROM, floppy disk,
Alternatively, it is stored in a recording medium such as a magneto-optical disk. The program stored in the recording medium is loaded on the main memory as appropriate and executed by the processing device. At that time, a drive device such as a CD-ROM drive, a floppy disk drive, or a magneto-optical disk drive is used as necessary. When the recording medium is provided in a server connected by a communication line such as a network, the program is read or downloaded from the server through the communication line. When the program is transferred to the processing device via a communication line, the communication line itself also corresponds to a recording medium. The program consists of various OS,
It can be supplied to operate under a platform, system environment, or network environment.

[0029]

FIG. 1 is a block diagram showing a configuration of a multimedia information processing system 1 according to the present invention, FIG. 2 is a block diagram showing a configuration of a client 3 of the multimedia information processing system 1, and FIG. FIG. 2 is a diagram illustrating a structure of multimedia information handled by the media information processing system 1.

In FIG. 1, a multimedia information processing system 1 includes a server 2, a plurality of clients 3, 3,.
And a network 4. The server 2 is provided with a content database DBC and a tag database DBT.

The server 2 sends information stored (registered) in the content database DBC or the tag database DBT in response to a request from the client 3, and sends the information sent from the client 3 to the content database DBC or the tag database DBT. sign up.
In this specification, the content database DB
Registering in C, the tag database DBT, or another database of the server 2 may be described as “registering in the server 2”.

The client 3 can input and reproduce content data such as an image, a sound, or a character, and transmit the content data for registration with the server 2 or transmit the content data from the server 2. Also, comment data on content data can be input, reproduced, transmitted, and transmitted.

The server 2 and the client 3 can be constituted by, for example, a personal computer or a workstation. Although a LAN (Local Area Network) is used as the network 4 in the present embodiment, the Internet or a network for various types of personal computer communication may be used. Also, CA
A TV network may be used. When using a CATV network,
The server 2 is installed in a base station, and transmits and receives information via a video transmission device. Alternatively, the server 2 is connected to one of the terminals of the CATV network.
The information may be transmitted to the base station using a dedicated channel, and the information may be transmitted from the base station to another terminal using another channel.

When an open network such as the Internet is used as the network 4 or when a LAN is used and the apparatus is connected to the Internet,
The client 3 can access various content databases or multimedia information databases stored not only in the server 2 but also in other servers and acquire the data or information thereof.

In FIG. 2, the client 3 includes a processing device 10, a keyboard 11, a mouse 12, a display device 13,
Printer device 14, speaker 15, microphone 1
6 and a magnetic disk drive 17. The content file F is stored in the magnetic disk drive 17.
C, a work file FW, and various other files and databases are stored.

In the client 3, various known application programs or editor programs stored in the magnetic disk device 17 are executed or executable by the processing device 10 in a multitasking manner. Alternatively, by operating the mouse 12, various multimedia information can be newly created, read from various media already created and stored, edited, or processed.

In FIG. 3A, content information MN
C includes content data DCN such as still image data, moving image data, audio data, or character data, and an object ID (BID) for identifying each content data DCN. The object ID is
It is also the file name of the content data DCN. That is, the file name of the content data DCN is link information with comment data attached to each content data DCN. Note that the content data DCN
Of the content data DCN, an identifier indicating the type or compression method of each content data DCN is attached to the file name.

In FIG. 3B, the primary tag information MNP includes a primary data DPR and an object ID for identifying the content data DCN associated with the primary data DPR. Object ID
Is link information to the content data DCN as described above.

As shown in FIG. 3C, the primary data DPR includes the title CTL, creator name CAT, creation date CDT, and type CK of the corresponding content data DCN.
D, attribute information such as element CEL, information indicating operation authority, and comment data CCM of the creator.

In FIG. 3D, the secondary tag information MNS includes an object ID for identifying the secondary data DSC and the content data DCN related to the secondary data DSC, and identifies each secondary data DSC within the same object ID. A tag ID (TID) for performing the operation and a reference ID (RID) indicating a parent node of each hierarchically structured secondary data DSC. As shown in FIG. 3E, the secondary data DSC includes attribute information such as a title STL, a creation date SDT, and a creator name SAT of the secondary data DSC, information indicating operation authority, and a text (creator comment data). SCM and the like.

Next, the multimedia information processing system 1
The operation and usage of will be described. FIG. 4 is a diagram showing a browser screen HG1 displayed on the display device 13, FIG. 5 is a diagram showing a list screen HG2 displayed on the display device 13,
FIG. 6 is a diagram showing the primary tag registration screen HG3 displayed on the display device 13.

In FIG. 4, a browser screen HG1 includes
For the content data DCN stored in the content database DBC, a plurality of content data DCN
The contents of a list are displayed by image (thumbnail display)
Have been. The title CTL of each content data DCN is displayed on the browser screen HG1 based on the primary tag information MNP stored in the content database DBC. Further, the content data DC, which is a search condition for displaying the screen HG1, is displayed.
N types (types) CKD, elements CEL, and keywords CKW are displayed.

The types CKD are "element" and "scene".
There are three types of "story". “Element” indicates that the content data DCN is content data itself created using various application programs such as an image processor or a text processor. “Scene” indicates that data is obtained by adding HTML to content data as an element. A "story" is a collection of a plurality of scenes.

The element CEL indicates an editor, processor, or tool that has created the element, and is usually indicated by the name of an application program. The browser screen HG1 displays a type CK on a search screen (not shown).
D, element CEL, period FPR, keyword CKW
The search result is displayed by inputting search conditions, such as, and instructing the start of the search. The search is performed on the tag database DBT and the content database DBC, and the content data DCN and the corresponding primary tag information MNP are extracted. If the search result cannot be displayed on one screen, all data is displayed by scrolling.

When one of the content data DCNs displayed on the browser screen HG1 is selected by clicking the mouse 12, a primary tag registration screen HG3 or a secondary tag registration screen HG4 (not shown) for the selected content data DCN is displayed. Is done. When "list display" displayed on the upper right of the screen HG1 is selected, the screen is switched to a list screen HG2 described below.

In FIG. 5, a list screen HG2 displays, for the same content data DCN as the browser screen HG1, title CTL, type CKD, creation date CDT, creator name CAT, number of tags, number of accesses, and the like. When one of the content data DCNs is selected on the list screen HG2, the primary tag registration screen HG for the selected content data DCN is displayed.
3 or the secondary tag registration screen HG4 is displayed. The “thumbnail display” displayed at the upper right of the screen HG2
When is selected, the screen is switched to the previous browser screen HG1.

In FIG. 6, a primary tag registration screen H
G3 displays a tag changeover switch CTS, content data DCN, title CTL, creator name CAT, creation date CDT, type CKD, element CEL, information indicating operation authority, and comment data CCM.
On the primary tag registration screen HG3, since the creator of the content data DCN has the operation authority, it is possible to write or modify the content, but other persons without the operation authority can only browse.

If the content data DCN is still image data, a reduced image is displayed. If the content data DCN is moving image data, audio data, or character data, an illustration to that effect is displayed. Is displayed. By selecting these illustrations, an editor corresponding to the type is activated and the contents of the content data DCN are reproduced. That is, if the image data is still image data, the image is displayed on the entire screen HG, if the image data is moving image data, a moving image is displayed in a predetermined size, and if the image data is audio data, the image is displayed. Sound is reproduced from the speaker 15. These processes are executed in the processing device 10.

Further, not only the content data DCN is displayed in the frame of the content data DCN, but also the content data DCN can be input. In that case, an image displayed in another window can be input as content data DCN by drag and drop.

The creator of the content data DCN stores the content data DCN itself in the content database DBC.
And the primary tag information M input on the primary tag registration screen HG3 in relation to the content database DBC.
The NP is registered in the tag database DBT.
For registration, after inputting necessary data on the primary tag registration screen HG3, the save button BT1 is pressed. When deleting the content data DCN and the primary tag information MNP, the user presses a delete button BT2. To close the primary tag registration screen HG3 without saving it, press the close button BT3. When the “secondary tag” of the tag changeover switch CTS displayed on the upper left of the screen HG3 is selected, the screen is switched to the secondary tag registration screen HG4.

On the secondary tag registration screen HG4, an opinion or opinion related to the content data DCN of the creator who intends to create the secondary data DSC is displayed.
Alternatively, an opinion or opinion on another person's opinion or opinion is input.

In the multimedia information processing system 1, the content data DCN registered in the server 2 and the content data stored in another server other than the server 2 are associated with each other. Links can be provided, and comment information for giving each link its meaning can be added. Usually, conjunctions are used as comment information. Content data D
The operation of linking between CNs and the operation of adding comment information can be performed on the screen HG5 of the story editor of the server 2 and the client 3.

FIG. 7 shows a screen HG5 of the story editor, FIG. 8 shows a pull-down menu usable in the story editor, FIG. 9 shows a palette PL1 used in the story editor, and FIG. 10 shows a screen HG5.
Diagram for explaining the procedure when linking in,
11 is a diagram showing an example of the created story SR1, FIG. 12 is a diagram showing story data DS for the story SR1 shown in FIG. 11, and FIG. 13 is a screen H displaying one content data DCN1 in the story SR1.
It is a figure which shows G6.

In FIG. 7, on screen HG5, content data DCN is displayed in a matrix in a certain set story SR. In the example of FIG. 7, nine pieces of content data DCN, three in the row direction and three in the column direction, can be simultaneously displayed. However, for one story SR, for example, 1
It is possible to arrange a total of 110 pieces of content data DCN, one in the column direction and ten in the column direction.
G5 can be scrolled and displayed. In addition,
Content data DCN per one story SR
Can be variously changed in addition to the example here.

On the screen HG5, the position of the content data DCN arranged for a certain story SR is specified by the coordinates in the row and column directions. Regarding the row direction, the center of the screen HG5 is “0”, which is −1, −2,... -5 to the left, and 1, 2,. In the column direction, the top row is 1, and downward, 2, 3,... On screen HG5,
Only the content data DCN1 at the coordinates (0, 1) is arranged.

There are various ways to arrange the content data DCN on the screen HG5. For example, the content data DCN is brought to the coordinate position where the content data DCN is to be arranged by dragging and dropping from the browser screen HG1 or the like. When the content of the content data DCN has not been determined, for example, “palette” is selected from “display” in the pull-down menu, and the palette P shown in FIG.
L1 is displayed. By pressing the blank button BT1 of the pallet PL1 in a state where the position of the coordinates (0, 1) is selected, the content frame is arranged at the position of the coordinates (0, 1). The content frames arranged in this manner can be linked like the content data DCN. Further, the content data DCN can be inserted into the content frame at any time by drag and drop.

The URL button BT on the pallet PL1
Press 2 to move the URL (Universal) to the specified coordinate position.
sal Resource Locator). Thereby, it can be associated with various other content data DCN or multimedia information (that is, resources) connected via the network.

When the button BT3, 4, or 5 is pressed on the pallet PL1 shown in FIG. 9, the content data DCN or the content frame is arranged at the lower left, right lower, or lower right coordinate position of the currently designated coordinate position. You. When the cut button BT7 is pressed, the content data DCN at the designated coordinate position is deleted. In this case, the content frame and the link remain without being deleted. Cut button BT
8 is pressed, the content data DC at the designated coordinate position is
N is deleted along with the content frame and the link. When the button BT11 is pressed, it becomes possible to input comment information for the link.

Next, a method for establishing a link will be described.
As shown in FIG. 10A, in a state where a plurality of content data DCNs are arranged on the screen HG5, a cursor is placed on a link anchor AK provided below one of the content data DCN1 to which a link is to be provided. , From the state, the other content data DC to be linked
Drag to N2. As a result, a link LK1 is established between the content data DCN1 and DCN2, and is displayed by an arrow. Next, in order to add comment information to the link LK1, the cursor is placed on the link LK1 and the mouse is clicked. by this,
As shown in FIG. 10B, a comment frame WKC is displayed substantially at the center of the link LK1. Therefore, appropriate comment information CMF1 is input into the comment frame WKC. Note that the content data DCN
Is specified, the specified content data DCN
Is highlighted.

Normally, a conjunction is used as the comment information CMF1. In other words, the creator who established the link LK1 from the content data DCN1 to the content data DCN2,
Conjunctions that clearly indicate what you think about the relationship with N2 and why you set up a link LK1 between them,
This is written in the comment frame WKC.

Thus, a plurality of content data D
When linking to CN, the content data D
It is possible to show the creator's intention to create links, such as how the CNs are connected, why they are connected, and what flow is present between the content data DCNs. Therefore, a series of multimedia information linked by the link LK is opened not only to the creator but also to a plurality of other creators and viewers.

Note that, in principle, a conjunction is used as a word in the comment information CMF. However, if there is no appropriate conjunction, a word or symbol of another part of speech may be used. The number of characters of the comment information CMF is limited to, for example, about 40 characters. However, since about 8 to 10 characters are displayed on the button BL described later, the remaining characters may be displayed by scrolling, for example. Comment information CM
F can be modified. When displaying the comment frame WKC, an appropriate word may be displayed as a default value. It is also possible to link two or more links to one content data DCN. It is also possible to link a content data stored in another database or server by indicating the storage position.

As described above, the content data DCN
Link LK between the two, story SR1
Create The created story SR1 is stored in the server 2
And managed by the story editor.
In addition, multiple stories S
R1, 2, 3,... Can be created and managed.
This will be described later.

In FIG. 11, the story SR1 starts with the content data DCN1, is linked to the content data DCN2, 4, 5, and is further linked to other content data DCN3, 6, 7,... Have been. Each link LK
The comment information CMF1, 2, 3,... Is added to 1, 2, 3,.

FIG. 12 shows story data DS including content data DCN, link information, and comment information CMF registered as story SR1. In each row of the story data DS, for the content data DCN, the first two numbers indicate coordinates, and the characters in the quotation marks indicate the content data DCN.
N indicates the title CTL, and the last number indicates a content ID which is an identification code of the content data DCN.

Regarding link information and the like, the first two numbers indicate the two linked content data DCN, the characters in the quotes indicate the comment information CMF, and the last number indicates the link information (arrow). Indicates that there is. In the link information, the content data DC
The first two numbers indicating N are the content data DCN
Indicates the order in which they are arranged in the story SR.

In FIG. 13, content data DCN2 is displayed on screen HG6. Buttons BL indicating links are displayed below the content data DCN2, and comment information CMF is displayed on each button BL.

The button BL11 is used for the content data DC.
This indicates a link between N2 and the content data DCN1 located above it, and "Soru", which is comment information CMF1, is displayed. The button BL21 indicates a link between the content data DCN2 and the content data DCN3 located below the content data DCN2, and the comment information CMF2 of "then" is displayed.

When there are a plurality of links, a plurality of buttons BL are displayed together with comment information CMF, for example, buttons BL22 and BL23. It should be noted that the content data D of the link destination when the button BL is pressed is displayed near the button BL or in order to understand the correspondence with the button BL.
The contents of the CN may be reduced and displayed.

When any one of the buttons BL is pressed, the other content data DCN associated with the link is displayed on the screen HG6. The viewer can easily know the meaning of the creator included in each link by the comment information CMF displayed on the button BL. Therefore, by selecting the button BL with reference to the comment information CMF,
The content data DCN can be browsed one after another while considering the intention of the creator. When the viewer presses the button BL, the viewer can browse the content data DCN one after another with reference to the comment information CMF according to a certain intention.

The displayed content data DCN
2 is a story SR other than the story SR1
, That is, other stories S
If a link is provided to the content data DCN2 in R, a button BW11 for indicating this is displayed. The viewer can display the content data DCN2 currently displayed by displaying the button BW11.
The user knows that it is associated with another story SR other than the story SR1 currently being accessed.

When the button BW11 is pressed, the search for another story SR is performed, and a list of the searched other stories SR is displayed. By selecting one story SR from the list of story SRs, the selected story SR is accessed and the content data D linked in the story SR is accessed.
The CN can be displayed as shown in FIG.

As described above, the content data DCN in the story SR1 is
The transition to another story SR using N is referred to as "warp" in this specification. In the multimedia information processing system 1, since warp is possible, it is possible to freely transfer from one to the other between a plurality of stories SR each of which is linked to one content data DCN. Further, it is possible to deviate from one story SR to another story SR unknown to the viewer or the creator.

In the story editor, it is possible to search for the content data DCN used in all the stories SR. Such a search is referred to herein as a “warp search”.
In the warp search, one or a plurality of content data DCNs are specified as search parameters. When a plurality of content data DCNs are specified, the logical condition between them is also specified as a search parameter. As such a logical condition, an AND condition or an OR condition can be designated. When the AND condition is specified, the story SR including all the content data DCN specified as the search parameter is searched. When the 0R condition is specified, the story SR including any one of the content data DCN specified as the search parameter is searched.

The plurality of stories SR1, 2, 3,... Created by the story editor are managed by the story editor (or story management system) as shown in FIG.

The story editor is provided with a table TB as shown in FIG. The table TB stores the content data DCN used for each story SR.
Are shown by the correspondence between the story IDs and the content IDs. When a warp search is instructed, the table TB is referred to and the story SR is searched according to the specified search parameters.

Instead of providing such a table TB, in the story data DS shown in FIG.
After the content ID, a story ID indicating a story SR in which the content data DCN is used may be described.

Further, a story ID in which the scene is used may be described as additional information of the content data DCN of the scene. These tables TB or story IDs are searched at various different timings in the operation. For example, the search is performed when the warp search is instructed as described above or every time the content data DCN is displayed.

Next, the procedure of link information processing will be described with reference to the flowchart shown in FIG. FIG. 14 is a flowchart showing a procedure for creating a story SR by the story editor.

In FIG. 14, one of the plurality of displayed content data DCNs is specified (step # 11), and the other content data DCN is specified (step # 12). As a result, a link LK is set up and displayed between the contents (# 13), and the link information is stored in the memory (# 13).
14). When the displayed link is designated (# 15), a comment frame WKC is displayed (# 16), and the comment information C
The MF is input (# 17). Input comment information C
The MF is stored in association with the link information, that is, for example, added to the link information (# 18).

FIG. 17 is a diagram showing a form of a recording medium ST of a program for executing the method according to the present invention. As shown in FIG. 17, a storage device STA such as a main memory, a RAM, a ROM, or a hard disk provided in a processing device PS of a computer, a portable medium ST such as a CD-ROM, a floppy disk, or a magneto-optical disk.
B, a destination medium STC such as a server or DASD connected by a network or a communication line STD, or the communication line STD itself can be used as the recording medium ST.

When the recording medium ST is a portable medium STB, the program is read by a drive device corresponding to the type of the portable medium STB and stored in the storage device STA of the processing device PS or stored in the main memory. Loaded and executed. When the recording medium ST is the line destination medium STC, the program is downloaded to the storage device STA via the communication line STD, or is transferred and executed at appropriate times. The programs can be supplied to operate under various OSs, platforms, system environments, or network environments.

The above multimedia information processing system 1
, The operator of the client 3 determines, for each content data DCN registered in the server 2, the corresponding primary data DPR or secondary data DN.
By browsing the SC, it is possible to know the intention and opinion of the creator of the content data DCN and easily know the opinion or opinion of another person, and easily input the opinion or opinion of the operator with respect to them. You can register at

Therefore, for various problems or themes in various fields provided or proposed by the content data DCN and the primary data DPR,
Personal opinions or opinions on them can be easily collected. Then, by collecting and integrating the opinions or views, it becomes easy to make a decision on the raised problem.

According to the multimedia information processing system 1 of the above embodiment, the comment information CMF related to the link LK can be added to the link LK, and the continuity of the content data DCN (story Gender).

[0086] In producing information with continuous contents such as images, the intention of the creator can be recorded, so that communication between the creator and the browsing sound can be achieved. It greatly contributes to the development of visual design.

The multimedia information processing system 1 according to the above-described embodiment can be applied to opinion collection and decision-making in reconstruction when an earthquake disaster occurs. In this case, for example, photos or illustrations of buildings, bridges, rivers, and the like damaged by the earthquake are registered as content data DCN as content data DCN, and an overview of the content is registered in server 2 as primary data DPR. In advance, a plurality of specific intellectuals or ordinary persons involved in the recovery measure may freely operate the client 3 and input an opinion or the like.

In the above embodiment, the content database DBC and the tag database DBT can be created in the same database. Although the comment information CMF is directly input into the comment frame WKC, a dialog box “link property” for inputting the comment information CMF may be displayed and written therein. In addition, the configuration of the client 3, the server 2, and the whole or each part of the multimedia information processing system 1, the data configuration, the content or order of processing,
The content or configuration of the screen HG can be changed as appropriate in accordance with the gist of the present invention.

[0089]

According to the first to eleventh aspects of the present invention, regarding multimedia information including contents, by giving meaning to links that relate to each other, the creator of the creator included in those links is provided. The meaning can be easily understood by the viewer.

According to the third to sixth aspects of the present invention, even if the viewer or creator of the story does not know about the existence of another story, the story viewer exits from the story using the content data as a medium and shifts to another story. can do.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a multimedia information processing system according to the present invention.

FIG. 2 is a block diagram illustrating a configuration of a client of the multimedia information processing system.

FIG. 3 is a diagram showing a structure of multimedia information handled by the multimedia information processing system.

FIG. 4 is a diagram showing a browser screen displayed on a display device.

FIG. 5 is a diagram showing a list screen displayed on a display device.

FIG. 6 is a diagram showing a primary tag registration screen displayed on a display device.

FIG. 7 is a diagram showing a screen of a story editor.

FIG. 8 is a diagram showing a pull-down menu that can be used in the story editor.

FIG. 9 is a diagram showing a palette used in the story editor.

FIG. 10 is a diagram for explaining a procedure for establishing a link.

FIG. 11 is a diagram showing an example of a created story.

FIG. 12 is a diagram showing recorded data of the story shown in FIG. 11;

FIG. 13 is a diagram showing a screen on which one piece of content data in a story is displayed.

FIG. 14 is a flowchart showing a procedure in creating a story by a story editor.

FIG. 15 is a diagram showing the concept of a story managed by a story editor.

FIG. 16 is a diagram showing a table used for warp search.

FIG. 17 is a diagram showing a form of a recording medium of a program for executing the method according to the present invention.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 Multimedia information processing system (multimedia information processing device) 10 Processing device (recording means, display means, selection means) 12 Mouse (registration hierarchy designation means) LK, LK1 link DCN content data (multimedia information) CMF comment information DBC content database (database) SR story STA, STB, STC, STD Recording medium

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Seiji Takemoto 4-1-1 Kamikadanaka, Nakahara-ku, Kawasaki City, Kanagawa Prefecture Inside Fujitsu Limited (72) Inventor Hiroshi Matsumoto 4-1-1 Kamiodanaka, Nakahara-ku, Kawasaki City, Kanagawa Prefecture No. 1 Inside Fujitsu Limited (72) Inventor Shigeru Kameda 4-1-1 Kamikadanaka, Nakahara-ku, Kawasaki City, Kanagawa Prefecture Inside Fujitsu Limited (72) Norihito Hiraoka 6-25-8 Jingumae, Shibuya-ku, Tokyo (72) Inventor Ryugo Kijima 265 Oritate Kitaura, Gifu City, Gifu Prefecture, Japan

Claims (11)

[Claims] 1. A method for processing multimedia information including content data such as an image, a sound, or a character, comprising: recording link information on a link provided between the multimedia information; A method of processing multimedia information, comprising: recording comment information added to a link in association with link information of the link. 2. When the multimedia information is displayed on a display surface of a display device, comment information on a link provided for the multimedia information is displayed on the display surface at the same time. 2. The multimedia information processing method according to claim 1, wherein when one of the multimedia information is selected, other multimedia information associated with a link corresponding to the selected comment information is displayed on the display surface. 3. A table for associating the multimedia information with a story for managing a link provided between the multimedia information is provided, and the multimedia information provided with a link managed by one story is provided. 2. When a link managed by another story is provided, it is possible to search for the other story by referring to the table and shift to the management of the searched story. The method for processing multimedia information according to claim 2. 4. A method for processing multimedia information including content data such as images, sounds, or characters, wherein link information about links provided between the multimedia information is stored in a series of mutually related series. A multimedia information processing method, comprising: recording in association with a story for managing a set of links; and recording comment information added to the link in association with link information of the link. 5. When multimedia information having a link managed by one story has a link managed by another story, the other story is searched for and the searched story is searched for. 5. The method for processing multimedia information according to claim 4, wherein the method is capable of shifting to management. 6. The multimedia information processing method according to claim 5, wherein the information indicating the existence of the other story is simultaneously reproduced when the multimedia information is being reproduced. 7. An apparatus for processing multimedia information including content data such as an image, a sound, or a character, comprising: means for recording link information on a link provided between the multimedia information; Means for recording comment information added to the link in association with the link information of the link, and a multimedia information processing apparatus. 8. When the multimedia information is displayed on a display surface of a display device, means for simultaneously displaying comment information on a link provided for the multimedia information on the display surface, and the displayed comment information The multimedia information according to claim 7, further comprising: means for selecting any of the following: and means for displaying, on the display surface, other multimedia information associated with a link corresponding to the selected comment information. Processing equipment. 9. An apparatus for processing multimedia information including content data such as images, sounds, characters, etc., comprising: means for displaying a plurality of pieces of multimedia information on a display surface of a display device; Means for associating two of the information with each other to form a link, means for adding comment information to the provided link, and inputting the link information, link information on the provided link, and comment information attached to the link Means for recording in association with each other, and a multimedia information processing apparatus comprising: 10. A recording medium on which a program for processing multimedia information including content data such as images, sounds, and characters is recorded, wherein link information about a link provided between the multimedia information is stored. A computer-readable recording medium recording a program for causing a computer to execute: a step of recording; and a step of recording comment information added to the link in association with link information of the link. 11. A recording medium storing a program for processing multimedia information including content data such as images, sounds, and characters, wherein a plurality of pieces of multimedia information are displayed on a display surface of a display device. And associated 2 in the displayed multimedia information.
Linking two pieces of multimedia information, adding comment information input to the link, and link information about the link and the comment information added to the link. A computer-readable recording medium on which a recording process and a program for causing a computer to execute are recorded.