JP3545121B2 - Multimedia information processing device - Google Patents

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a multimedia information processing device that processes multimedia information.
[0002]
[Prior art]
Conventionally, a system for processing multimedia information composed of text data, image data and audio data is required to process a variety of multimedia information corresponding to a figure displayed on a screen, after selecting a figure corresponding to the multimedia information. The multimedia information is processed by selecting a processing procedure from a menu or the like, or by selecting multimedia information to be processed after starting each multimedia tool.
[0003]
[Problems to be solved by the invention]
For this reason, after selecting a figure corresponding to the conventional multimedia information, a method of selecting a procedure to be processed from a menu or the like, or after starting various multimedia tools, a figure corresponding to the multimedia information to be processed is selected. In the selection method, there have been problems that the number of operations is increased in order to process the multimedia information and that the thinking is hindered by operating the tool.
[0004]
In order to solve these problems, an object of the present invention is to provide an operation / control method that reduces the number of operations for processing multimedia information and does not hinder the thinking.
[0005]
[Means for Solving the Problems]
Means for solving the problem will be described with reference to FIG.
In FIG. 1, a processing device 1 performs various processes, and here is configured by multimedia information processing means 5 and the like.
[0006]
The base screen 11 is a screen that displays a target to be processed by a graphic.
The multimedia screen 12 is a screen for displaying the area of the attribute of the multimedia information and for highlighting the area corresponding to the attribute of the figure selected on the base screen 11.
[0007]
Next, the operation will be described.
When a graphic is selected on the base screen 11, the processing device 1 highlights the attribute area of the selected graphic on the multimedia screen 12, and displays the selected graphic on any of the highlighted graphics. When dropped in an area, information on the attribute of the dropped area is processed.
[0008]
At this time, when the selected graphic is dropped on any of the highlighted areas, a tool (multimedia information processing means 5) corresponding to the dropped area is activated, and the activated tool is activated. (Multimedia information processing means 5) processes the attribute information of the area.
[0009]
Further, the tool processes the attribute of the dropped area and the information of the attribute linked in advance to the attribute.
Therefore, it is possible to provide an operation / control method that reduces the number of operations for processing the multimedia information and does not hinder the thinking.
[0010]
BEST MODE FOR CARRYING OUT THE INVENTION
Next, an embodiment and operation of the present invention will be sequentially described in detail with reference to FIGS.
[0011]
FIG. 1 shows a system configuration diagram of the present invention.
In FIG. 1, a processing device 1 performs various processes, and here, comprises a figure selecting means 2, a drag and drop means 3, a processing procedure determining means 4, a multimedia information processing means 5, and the like. Things.
[0012]
The figure selecting means 2 selects a figure which is displayed on the base screen 11 and indicates a target to be processed. For example, when the mouse cursor is positioned on the figure indicating the target to be processed and is clicked. The clicked coordinates (x1, y1) are detected to detect the selected figure (see the description of FIG. 2 described later).
[0013]
The drag and drop means 3 is for dragging a figure selected on the base screen 11 and dropping the figure on a corresponding area on the multimedia screen 12.
The processing procedure determination means 4 determines the processing procedure of the multimedia information corresponding to the graphic when the graphic is dragged and dropped (see the description of FIG. 2 described later).
[0014]
The multimedia information processing means 5 processes multimedia information. For example, when the multimedia information is text, it is displayed on the screen. When the multimedia information is a still image, the still image is displayed on the screen. The moving image is displayed on the screen, and the sound is generated from the speaker 9 when the sound is sound.
[0015]
The storage device 6 stores various tables, and stores 61 to 67 shown in the drawing.
The multimedia attribute table 61 is a table in which multimedia attributes and link information are registered in association with objects (see FIG. 4B described later).
[0016]
The object arrangement table 62 is a table in which coordinates (for example, upper left coordinates and lower right coordinates) of a region where an object is displayed on the base screen 11 are registered in advance.
[0017]
The multimedia screen table 63 is for displaying the multimedia screen 12. Here, the multimedia screen table 63 is associated with a multimedia screen name (for example, text, photo, video, audio), arrangement coordinates, processing procedure, flag, and the like. Is registered in advance (see FIG. 4 (c) described later).
[0018]
The text file table 64 is for displaying text, and here, a text file name is registered in advance in association with an object (see FIG. 4 (d) described later).
[0019]
The still image file table 65 is for displaying a still image. Here, a still image file name is registered in advance in association with an object (see FIG. 4E described later).
[0020]
The moving image file table 66 is for displaying a moving image. Here, a moving image file name is registered in advance in association with an object (see FIG. 4 (f) described later).
[0021]
The sound file table 67 is for generating sound, and here, a sound file name is registered in advance in association with an object (see FIG. 4 (g) described later).
[0022]
The input device 8 is for inputting data, instructions, and the like, and here is a mouse, a keyboard, or the like.
The speaker 9 produces a voice.
[0023]
Next, the operation of the configuration of FIG. 1 will be described in detail with reference to FIGS. 3 and 4 in accordance with the order shown in the flowchart of FIG.
FIG. 2 is a flowchart illustrating the operation of the present invention.
[0024]
In FIG. 2, S1 displays the base screen and the multimedia screen thinly. For example, as shown in FIG. 3A described later, the object to be processed is represented by a graphic on the base screen 11, and the attributes (text, text, etc.) of the multimedia information are displayed on the multimedia screen 12. Photos (still images), moving images, and audio) are displayed thinly with dotted lines.
[0025]
S2 selects a figure. This is done by, for example, moving the mouse cursor over a target graphic to be processed on the base screen 11 of FIG. The figure “house A” is selected.
[0026]
In step S3, the coordinates (x1, y1) of the click are acquired.
S4 searches for an object corresponding to the coordinates. This is because, based on the coordinates (x1, y1) acquired in S3, an object arrangement table 62 shown in FIG. 4A described later is searched for an object having arrangement coordinates including the coordinates (x1, y1). Find, for example, find object "Home A".
[0027]
In step S5, multimedia information is obtained based on the object. This is because, based on the object (for example, the object "A house") found in S4, a multimedia information table 61 of FIG. For example, “text”, “still image”, and “audio”) are acquired.
[0028]
In step S6, a screen corresponding to the obtained multimedia information is highlighted and a flag is set. This highlights the multimedia information 12 acquired in S5, for example, the multimedia screen 12 of "text", "still image (photograph)", and "sound", and displays it as shown in FIG. . As a result, as shown in FIG. 3B, the screens (areas) of “text”, “still image (photograph)”, and “audio” are highlighted on the multimedia screen 12 and selected in S2. The multimedia information registered for the figure (object) is determined.
[0029]
In step S7, the object is dragged and dropped on the multimedia screen. This is because the figure (object) selected by clicking the mouse button in S2 and dragged on the screen as it is is highlighted on the multimedia screen 12, for example, "text", "text" in FIG. Release the mouse button and drop it with the mouse button positioned on one of "still image (photo)" and "audio".
[0030]
In S8, the coordinates (x2, y2) of the drop are acquired.
A step S9 decides whether or not the flag of the multimedia screen corresponding to the coordinates (x2, y2) is true. This is because the flag of the entry (text, still image (photograph), moving image, audio) whose dropped coordinates (x2, y2) are included in the arrangement coordinates on the (c) multimedia screen table 63 in FIG. (The flag is set when S6 is highlighted) to determine whether or not the flag exists. In the case of YES, the process proceeds to S10. In the case of NO, it is determined that there is no multimedia information in the dropped area on the multimedia screen 12, so the process ends as an error.
[0031]
In step S10, a file name is extracted using the object name as a key. This is because it is determined that the flag is “1” on the multimedia screen 12 at the dropped coordinates (x2, y2) (it is determined that the flag is highlighted in S6), and the file name is extracted using the object name as a key. (For example, the text file name “A home-text” is extracted from the text file table 64 of FIG. 4D using the object name “A home” as a key.
[0032]
In S11, it is determined whether there is link information. This is determined as to whether or not link information is registered in a link information column of a corresponding object, for example, an entry of the object “A house” in the multimedia attribute table 61 of FIG. In the case of YES, the process proceeds to S12. In the case of NO, the process proceeds to S14.
[0033]
In S12, since it is determined that the link information is present in YES in S11, it is determined whether the processing of the link information is designated. For example, since the link information "voice" is registered in the multimedia attribute "text" link information column of the object "A house" in the multimedia attribute table 61 of FIG. In the case of YES, the file name is extracted using the link information as a key in S13 (for example, the audio file of the object "A-home" is obtained from the audio file table 67 of FIG. The name "A home-voice" is taken out). Then, the process proceeds to S14. On the other hand, if NO in S12, the process proceeds to S14.
[0034]
In step S14, the corresponding process is started and the file name is passed. This activates the processing procedure to the corresponding entry of the multimedia screen table 63 in FIG. 4C, and passes the file name extracted in S10 and S13.
[0035]
S15 executes multimedia processing based on the file. This means displaying text on the screen for text, displaying a still image (photo) on the screen for still images (photos), displaying a video on the screen for videos, and A voice is uttered from the speaker 9.
[0036]
As described above, an arbitrary figure is clicked on the base screen 11, the multimedia information of the clicked object is highlighted on the multimedia screen 12, and the figure is dragged to any one of the highlighted multimedia screens 12. Then, the multimedia information corresponding to the attribute of the dropped multimedia screen 12 is taken out and processed (displayed / voiced), and the linked multimedia information is processed together (displayed / voiced). With these operations, the operator can simply click on a graphic to be processed on the base screen 11 and drop it on the highlighted multimedia screen 12 to obtain a target text represented by the desired graphic, It is possible to simultaneously display / speak any one of an image (photograph), a moving image, and audio, and one or more of linked text, a still image (photograph), a moving image, and audio.
[0037]
FIG. 3 shows a display example of the present invention.
FIG. 3A shows an example of a screen at the beginning of display. Here, on the base screen 11, a map representing the home A, the home B, and the road is displayed. In addition, on the multimedia screen 12, four windows of "text", "photo (still image)", "moving image", and "audio" are indicated by dotted lines as attributes that may be multimedia information. It is displayed faintly. This makes it possible to determine at a glance the attributes that may exist as multimedia information.
[0038]
FIG. 3B shows a state where a figure is clicked and dragged on the base screen 11 and dropped on the highlighted multimedia screen 12. This is because, when the mouse cursor is positioned on the graphic “A house” on the base screen 11 and the left button of the mouse is clicked, the arrangement coordinates in FIG. 4A to which the coordinates (x1, y1) at the time of the click belong. Find the rectangle represented by and find the object at that time, here, the object "house A", drag this object "house A" and drop it on the multimedia screen "text". The coordinates at the time of this drop This is a state in which a rectangle represented by the arrangement coordinates of the multimedia screen table 63 in FIG. 4C to which (x2, y2) belongs is found, and a multimedia screen name at that time, for example, “text” is found.
[0039]
FIG. 3C shows a state in which multimedia information is processed on the multimedia screen 12. Here, the text file name “A” of the object “A house” is read from the text file table 64 of FIG. 4B, for example, on the multimedia screen 11 “Text” found in FIG. 3B. This is a state in which the contents of the text file name “A home-text” are displayed. At this time, since “voice” is registered in the link information of the entry of the object “A home” in FIG. 4B, the voice of the object “A home” is stored in the voice file table 67 of FIG. The file name “A home-voice” is extracted, and the contents of the voice file name “A home-voice” are uttered from the speaker.
[0040]
FIG. 4 shows an example of a table according to the present invention.
FIG. 4A shows an example of an object arrangement table. Here, as shown in the figure, the object arrangement table 62 registers information representing a rectangular area of coordinates (upper left and lower right) on the base screen 11 of FIG. 3 in association with an object (for example, “A house”). Things.
[0041]
FIG. 4B shows an example of a multimedia attribute table. Here, the multimedia attribute table 61 registers multimedia attributes (for example, “text”) and link information in association with an object (for example, “A house”), as shown in the figure. The multimedia attribute is an attribute of the object and is one or more of text, still image, moving image, and audio. The link information registers information to be processed by linking to an attribute of the object.
[0042]
FIG. 4C shows an example of a multimedia screen table. Here, the multimedia screen table 63 registers arrangement coordinates (upper left and lower right), processing procedures, and flags in association with the multimedia screen name, as shown in the figure. The multimedia screen names are, for example, “text”, “photo (still image)”, “moving image”, and “audio” indicated by dotted lines on the multimedia screen 12 in FIG. The arrangement coordinates are upper left coordinates and lower right coordinates of “text”, “photo (still image)”, “moving image”, and “audio” indicated by dotted lines on the multimedia screen 12 in FIG. The processing procedure is a procedure for processing multimedia information. As shown, when the multimedia information is “text”, a text display tool is activated. The flag is set in S6 of FIG. 2 described above, and multimedia information “text”, “photo (still image)”, “multimedia information” that needs to be processed when a figure is selected on the base screen 11 The corresponding one of "moving image" and "audio" is set and stored.
[0043]
FIG. 4D shows an example of a text file table. In this case, a text file name (for example, “Home A-Text”) is registered in association with an object (for example, “Home A”).
[0044]
FIG. 4E shows an example of a still image file table. In this case, a still image file name (eg, “A house-photo”) is registered in association with an object (eg, “A house”).
[0045]
FIG. 4F shows an example of a moving image file table. In this example, a moving image file name (eg, “A house-moving image”) is registered in association with an object (eg, “A house”).
[0046]
FIG. 4G shows an example of an audio file table. In this case, an audio file name (for example, “A house-voice”) is registered in association with an object (for example, “A house”).
[0047]
【The invention's effect】
As described above, according to the present invention, a graphic to be processed on the base screen 11 is selected, dragged, dropped on any of the highlighted multimedia screens 12, and displayed on the dropped screen. Is adopted, the operation for displaying / speaking the multimedia information and the multimedia information linked to the multimedia information is adopted, so that the operation for processing the multimedia information can be easily displayed / speaked with a minimum number of operations. . As a result, the number of operations for processing multimedia information can be reduced, and operations can be performed without hindering thinking.
[Brief description of the drawings]
FIG. 1 is a system configuration diagram of the present invention.
FIG. 2 is a flowchart illustrating the operation of the present invention.
FIG. 3 is a display example of the present invention.
FIG. 4 is an example of a table according to the present invention.
[Explanation of symbols]
1: Processing device 2: Graphic selection means 3: Drag and drop means 4: Processing procedure determination means 5: Multimedia information processing means 6: Storage device 61: Multimedia attribute table 62: Object arrangement table 63: Multimedia screen table 64 : Text file table 65: Still image file table 66: Operation file table 67: Audio file table 8: Input device 9: Speaker 11: Base screen 12: Multimedia screen

Claims (3)

In a multimedia information processing apparatus that processes multimedia information,
A base screen that displays the objects to be processed as graphics,
A multimedia screen displaying a plurality of areas having the attribute of multimedia information and highlighting an area corresponding to the attribute of the figure selected on the base screen;
A multimedia attribute table in which the attribute of the graphic and information of the attribute linked to the attribute are registered in association with the graphic;
When a graphic is selected on the base screen , the multimedia attribute table is searched, an attribute associated with the selected graphic is obtained, and an area corresponding to the attribute of the selected graphic is obtained. and the figure selection means you highlighted in the multimedia screen,
When the selected graphics is dropped on any of the areas that are above highlighted, searching the multimedia attribute table, the attribute of the selected the area where the graphic is dropped were, a link attributes Processing procedure determining means for determining whether or not the instruction is designated;
If it is determined that the linked attribute is specified, the attribute of the dropped area and the information of the linked attribute are processed , while it is determined that the linked attribute is not specified. It has been if the multimedia information processing apparatus characterized by comprising a multimedia information processing means for processing the information of the attributes of the dropped area. The process determination processing means causes the tool the selected graphics corresponds to the region that was dropped, according to claim 1, wherein the activated tool is characterized in that processing the information of the attributes of the area Multimedia information processing device. 3. The multimedia information processing apparatus according to claim 1 , wherein the base screen is a map .

Images