JP3471389B2 - Multimedia filing system - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multimedia filing system for registering and retrieving multimedia information in a system for storing and managing multimedia information.

[0002]

2. Description of the Related Art Media are generally character data areas such as newspapers and word processors, image data areas such as facsimiles, video data areas such as televisions,
It can be classified into four areas, which are sound data areas represented by radio and CD. In recent years, with the spread of personal computers and workstations, an environment in which information in these four areas can be managed in common has been established. An environment in which information in these four areas can be digitized and handled freely is called multimedia.
What is needed in this multimedia environment is how to efficiently store, manage, and retrieve this information.

However, in the past, the technology of the multimedia filing system has not been established yet, and the means for classifying and managing a large amount of multimedia information have various information as seen in the conventional electronic file system. It is a general method to add a character string keyword to and register and manage it in a database. Further, as a method of representing stored information, it is customary to display icons for grouping stored information into a plurality of groups or icons representing specific stored information for classification and management. In order to find desired information in such a management system,
A method of performing a search using a character string keyword and specifying from the result or visually selecting an icon representing the content of desired information itself has been used. further,
There is also a method of defining and managing information representing the contents of the stored multimedia information. A method related to this kind of method is disclosed in, for example, JP-A-63-25.
No. 0699 and Japanese Patent Laid-Open No. 177267/1989 are mentioned, but in these methods, the contents of desired information defined in the desired information after narrowing down the desired information to some extent Since it is specified by listening to information indicating, for example, voice information, it has a strong meaning to be used as confirmation, and is not sufficient as a tool for searching from a large amount of information.

[0004]

As described above, in the above-mentioned conventional system, in order to search for a desired information from a large amount of information, a database using a character string as a keyword is used or a classification is selected. However, I had to take the method of finding the desired information. In addition, considering the character of multimedia information, there is a message property of a medium called a medium. Considering this, a character string is used as a keyword as in the past,
There is a problem in that some kind of information is missing in expressing multimedia information, and as a result, it is insufficient in expressing multimedia information properly.

The present invention solves the above-mentioned problems of the related art, and the keyword for searching for desired multimedia information is not limited to a character string, but multimedia information having the same meaning is regarded as a keyword. An object of the present invention is to provide a multimedia filing system that makes it easy to search for desired information. The multimedia information that is regarded as a keyword is called a multimedia keyword, and the ID converted from this is called a multimedia keyword ID. In the following description, the multimedia keyword is MMK,
Let the multimedia keyword ID be MMK-ID.

[0006]

In order to achieve the above object, the multimedia filing system of the present invention comprises:
Means to register multimedia information and related to sound and video
Multimedia keyword consisting of attached icons
Storage means for storing a multimedia keyword information management means for managing allocates icons and ID represent multimedia keyword of the storage means to the registered multimedia information, by selecting the displayed icon A search means for searching corresponding multimedia information based on the ID is provided.

[0007]

When a multimedia keyword is selected through the icon for searching multimedia information, the multimedia keyword is converted into a multimedia keyword ID and passed to the search section. As a result of the search, the multimedia information is specified and desired multimedia information is output. At this time, in order to determine whether the multimedia keyword used for the search is an appropriate keyword, it is possible to define the multimedia information for supplementing the keyword information in the multimedia keyword. You can output and check.

[0008]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing the configuration of a multimedia filing system according to an embodiment of the present invention.
In FIG. 1, reference numeral 110 is a multimedia information input / output device for inputting / outputting multimedia information such as image information, voice, and video, and 120 is a standard input such as a CRT or keyboard that is normally installed in a workstation. The output device 130 is a graphical user interface control unit for controlling the man-machine interface,
An input / output control unit 140 controls data of the multimedia information input / output device 110, the standard input / output device 120, and the graphical user interface control unit 130.
Reference numeral 50 is an MMK information management unit that realizes multimedia keywords, 160 is a search processing unit that manages the storage location of multimedia information to be stored, and 170 is an auxiliary storage device 180.
Is a file control unit that manages a file group stored in. The auxiliary storage device 180 includes a multimedia information file group 181, which stores multimedia information registered by the input / output control unit 140, an MMK information-related file group 182 created by the MMK information management unit 150, and a search processing unit 160. Database related files 1 managed by
And 83.

Next, the operation of the above embodiment will be described.
First, an operation example of this system will be described. By understanding the operation image, the explanation of each processing block will be easier to understand. The operation example is performed assuming the operation of the search process in which the effect of the present embodiment is utilized.

First, assume that the multimedia information to be searched for is a moving image 200 showing a fire station along the coast as shown in FIG. The search screen is a multimedia keyword input screen in the graphical user interface control unit 130 shown in FIG. This screen has an icon display / selection area 220 for selecting a multimedia keyword. The multimedia keyword uses clicking, dragging, and dropping of an icon as its access means. To check the multimedia keyword, double-click on the icon in the icon display / selection area 220 or MMK in the function button area 260.
It is executed by dragging and dropping on the play button 203. The confirmation of the multimedia keyword means the output of the information defined in the multimedia keyword. For example, if you double-click on the “Hinomaru” icon, the song “Kimigayo” will play.

Here, an example of selecting a multimedia keyword that is associated with the information in order to search for the moving picture 200 showing the above-mentioned coastal fire department is shown. For example, as shown in FIG. 2, there are a surfboard icon 221a in which a "wave sound" flows, a speaker icon 221b in which a "siren sound" flows, and a red icon 221c in which a "video of a fire engine" is projected. . These are selected and dragged and dropped onto the multimedia keyword drop area 240 of the keyword input area 250.
This operation specifies the multimedia keyword and the search is executed. As a result of the search, the moving image 200 showing the fire department along the coast is displayed on the multimedia information input / output device 110. The above is the explanation assuming the operation of the search process.

Next, the process of registering multimedia information will be described. The multimedia information is input from the multimedia information input / output device 110, and the multimedia information file 1 in the multimedia information file group 181 of the auxiliary storage device 180 is input by the input / output control unit 140.
84 is registered. Next, using the multimedia keyword input screen shown in FIG. 3, one or more multimedia keywords suitable for the registered multimedia information are selected through the icon 221. As a result, MM
MMK management information 185 of the MMK information related file group 182 managed by the K information management unit 150 to MMK-I
Acquire D. Next, through the search processing unit 160, a database record 186 having a multimedia information file name that associates the MMK-ID with which the MMK management information 185 is associated and the multimedia information file 184 is registered in the database-related file group 183.

Next, a process for searching multimedia information will be described. Using the multimedia keyword input screen shown in FIG. 3, one or more multimedia keywords required to search for desired multimedia information are specified through the icon 221. As a result, the MMK-ID is obtained from the MMK management information 185 of the MMK information-related file group 182 managed by the MMK information management unit 150, and the search processing unit 160 is instructed to perform the search process.
As a result, the database record 186 is acquired from the database related file group 183. From the multimedia information file name of the database record 186 thus obtained, the desired multimedia information file 184 managed in the multimedia information file group 181 is acquired through the file control unit 170. The above is the rough processing flow of the multimedia keyword and the multimedia information managed using the keyword.

Next, the multimedia keyword input screen will be described in more detail. In FIG. 3, the multimedia keyword input screen is displayed in the keyword input area 2
50, a function button area 260, and a multimedia keyword reference / selection area 270. The keyword input area 250 includes a character string input area 230 for specifying a normal character string keyword, a multimedia keyword drop area 240 for specifying a multimedia keyword, and an icon display area 241 for displaying an icon of a multimedia keyword. Become. The function button area 260 is for the multimedia keyword.
New MMK registration button 20 for individual processing
1, MMK delete button 202, MMK play button 20
3, related MMK acquisition button 204, and selection button 20
5 is displayed. The multimedia keyword reference / selection area 270 is a multimedia keyword classification name 2
11 includes a classification area 210 in which 11 is displayed, and an icon display / selection area 220 in which a multimedia keyword icon 221 and a character comment for supplementing the expression of the icon are displayed. To specify multimedia keywords, refer to multimedia keyword reference / selection area 27
After selecting a multimedia keyword category in the 0 category area 210, select the multimedia keyword icon 221 required to search for desired multimedia information on the icon display / selection area 220, and enter a keyword. It is realized by dropping on the multimedia keyword drop area 240 in the area 250.

FIG. 4 is a block diagram showing the internal structure of the MMK information management unit 150 for realizing the multimedia keyword shown in FIG. 1. The processing flow will be described for each button in the function button area 260 of FIG. To do. First of all, the new M
The processing outline of the MK registration button 201 will be described. The bitmap creation means 301 creates bitmap information necessary for displaying an icon. Further, the multimedia information creating means 302 creates multimedia information associated with the icon. For example, in the previous example, a wave sound is created for the surfboard icon. Further, the character comment creating means 303 creates a character comment for supplementing the expression of the icon. These three pieces of information are delivered to the MMK creating means 310. The MMK creating means 310 instructs the MMK-ID managing means 320 to send the MMK-ID.
Request an ID. The MMK-ID management means 320 creates an MMK-ID based on the MMK-ID management file 332 stored in the auxiliary storage device 330, and returns the MMK-ID to the MMK creation means 310. MMK creating means 3
10 uses the MMK-ID to store the information created by the bitmap creation means 301, the multimedia information creation means 302, and the character comment creation means 303 in the MMK information storage means 322 in the auxiliary storage device 330. A bitmap file 336, a multimedia information file 337, and a character comment file 338 are created therein. After that, the MMK management information file 33 describes the relationship between the bitmap file 336, the multimedia information file 337, and the character comment file 338 by the MMK management information creating unit 321.
Create 5. Furthermore, MMK management information list file 3
A record of the MMK management information file 335 is added to 34. The above is the outline of the processing of the new MMK registration button 201.

Next, the processing outline of the MMK delete button 202 will be described. MM to be deleted from the MMK selecting means 307
When the K information is passed to the MMK-ID acquisition means 312, M
The MK-ID acquisition means 312 uses the MMK information deletion means 32.
5, the four files of the deletion target bitmap file 336, the multimedia information file 337, the character comment file 338, and the MMK management information file 335 stored in the auxiliary storage device 330 are deleted. Furthermore, the MMK management information list file 334
Then, the related record of the MMK management information file 335 is deleted. The above is the outline of the processing of the MMK delete button 202.

Next, the processing outline of the MMK playback button 203 will be described. The MMK play button 203 is a process for outputting information on multimedia keywords. When the MMK information to be reproduced is passed from the MMK selection means 307 to the MMK-ID acquisition means 312, the MMK-ID acquisition means 31.
2 obtains the MMK-ID and acquires the MMK information extracting means 32.
Hand over to 3. The MMK information extraction unit 323 is a bitmap file 336, a multimedia information file 337, a character comment file 338, and a MMK management information file 33 stored in the auxiliary storage device 330.
The contents of 5 are delivered to the MMK information output means 311. The contents of the delivered information in the MMK management information file 335 are analyzed and output by the bitmap display unit 304, the multimedia information output unit 305, and the character comment display unit 306, which are the output units. The above is MM
6 is a processing outline of the K playback button 203.

Next, an outline of processing of the related MMK acquisition button 204 will be described. When the basic MMK information is passed from the MMK selection means 307 to the MMK-ID acquisition means 312, the MMK-ID acquisition means 312 receives the acquired MMK-ID.
The ID is delivered to the related MMK-ID search means 324. The related MMK-ID search means 324 uses the auxiliary storage device 330.
The record of the MMK management information list file 334 in the category in which the basic MMK information is stored is searched. Since the arrangement of the records in the MMK management information list file 334 itself describes the relationship of multimedia keywords, refer to the information in the MMK management information file 335 obtained from the records before and after the record corresponding to the basic MMK information. By doing so, the related MMK-
ID is obtained. For example, in the case of color information, color information close to the original color is obtained, and in the case of sound information, sound information close to the original sound is obtained. Further, when handing over the search instruction to the related MMK-ID search means 324, the range of acquiring the related MMK-ID is limited by selecting one of the three selection buttons 205 of distant, normal, and close in FIG. be able to.
When the "far" selection button 205 is selected, the MMK indicated by all records in the MMK management information list file 334.
-Return the ID. When the "normal" selection button 205 is selected, the MMK-IDs shown by the 10 records before and after the record corresponding to the basic MMK information from the records of the MMK management information list file 334 are returned. Further, when the “close” selection button 205 is selected, the MMK-ID indicated by the three records before and after the record corresponding to the basic MMK information is returned from the records of the MMK management information list file 334. As described above, the number of MMK-IDs to be acquired changes as the record range referred to by the MMK management information list file 334 changes. The above is the outline of the processing of the related MMK acquisition button 204.

The record format of FIG. 5 is M of FIG.
This shows the contents of the MK management information file 335. As the bitmap file information 401, the bitmap file 336 of FIG.
02 is the multimedia information file 337 of FIG.
The character comment file information 403 indicates the character comment file 338 of FIG. 4, and the MMK-ID 404 indicates the multimedia key word ID.

The record format of FIG. 6 is M of FIG.
This shows the contents of the MK management information list file 334. In the record, the MMK information management file name 501 is described, and the position of each record directly expresses the closeness of association of each multimedia keyword.

[0021]

As described above, according to the present invention, the same kind of media information as the desired multimedia information is used for the keyword necessary for searching the multimedia information, or the desired multimedia information is used. Since it is possible to specify effective media information to represent, it is possible to search information on a different side than the conventional search method in which character strings are limited to keywords. It is effective to manage various information.
For example, it is possible to perform a sensitive search such as "comfortable images and music". Furthermore, as a method for managing multimedia keywords, first, the ID is converted into an ID, and the ID is used as a keyword. Therefore, there is an effect that the system can be easily transferred to an existing database management system.

[Brief description of drawings]

FIG. 1 is a block diagram showing the configuration of a multimedia filing system according to an embodiment of the present invention.

FIG. 2 is a schematic diagram for simply illustrating the operation of the system.

[Figure 3] Multimedia keyword input screen diagram in the same system

FIG. 4 is a block diagram showing a configuration of an MMK information management unit in the system.

FIG. 5 is a record format diagram of an MMK information management file in the system.

FIG. 6 is a record format diagram of an MMK management information list file in the system.

[Explanation of symbols]

110 Multimedia information input / output device 120 standard input / output devices 130 Graphical User Interface Control Unit 140 I / O controller 150 MMK Information Management Department 160 Search processing unit 170 File control unit 180 Auxiliary storage device 181 multimedia information files 182 MMK information related files 183 Database related files 184 multimedia information files 185 MMK management information 186 database records

Continuation of the front page (56) Reference JP-A 64-21625 (JP, A) JP-A 63-261424 (JP, A) JP-A 5-242165 (JP, A) JP-A 2-232769 (JP , A) Tanahashi et al., Study of symbol retrieval method in personal color image database, Proceedings of IEICE Spring Conference 1992, Japan, The Institute of Electronics, Information and Communication Engineers, March 24, 1992, PART 7 , P. 195 (58) Fields surveyed (Int.Cl. ⁷ , DB name) G06F 17/30 G06F 12/00 JISST file (JOIS)

Claims (4)

(57) [Claims] 1. A means for registering multimedia information,
A multimedia system consisting of icons associated with sounds and videos.
Storage means for storing a keyword, and an icon representing the multimedia keyword of the storage means and its ID are assigned to the registered multimedia information.
Multimedia Filing system comprising a multimedia keyword information management means for managing, and retrieving means for retrieving multimedia information corresponding through its ID by selecting the displayed icon. Wherein said multimedia keyword information management means, according to claim characterized by comprising output means for outputting a sound or video <br/> associated with the icon 1
The multimedia filing system described in. Wherein the multimedia keyword information management means includes generation means for generating an ID corresponding to the icon that is associated with any ID based and became icon allocated to the icon, the search means selects Aiko
Icon associated with the user's ID and the selected icon
The corresponding multimedia information through the ID corresponding to
The multimedia filing system according to claim 1 , wherein the multimedia filing system is searched . 4. The multimedia filing system according to claim 3, wherein the generation unit generates an ID by designating a related range.