JPH1083401A - Multimedia data base device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a multimedia data base device which can easily input index information by a plurality of operators and whose system load is small by permitting the transmission means or the reception means of index information to identify transmission means transmitting index information. SOLUTION: Multimedia information inputted from input means 10 is stored in a data base constructed in a storage 20 means. An index information transmission means 50 transmits index information by an ultrasonic wave to an index information reception means 60 by permitting a conference attendant to depress it. The index information reception means 60 converts received information into an electric signal and transmits it to an index information correspondence means 70. The index information transmission means 50 or the index information reception means 60 can identify index information transmitters 50a, 50b, 50c... transmitting index information.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to a multimedia database device for inputting, searching for, and outputting multimedia information comprising at least one of image information, audio information, and text information.

[0002]

2. Description of the Related Art Meetings play an extremely important role in office activities. With the progress of the information society, the types of presentations submitted to conferences are also diversifying, and in addition to conventional paper materials, for example, overhead projectors and whiteboards are widely used as presentation tools in conferences. ing. Recently, electronic tools such as an electronic blackboard and a projector connected to a computer have appeared. Further, a remote conference system (also called a video conference system) that can be held even when conference participants are in remote locations has been put to practical use. As a further attempt,
Introducing a multimedia database storing multimedia information consisting of image information, audio information, text information, etc. into the conference system, extracting necessary information from various multimedia information stored in the database, and presenting it with a projector etc. And support for the creation of minutes.

[0003] As an input means for inputting such multimedia information to a database, a camera, a microphone, a portable terminal or the like is mainly used. Then, when the multimedia information is input, the multimedia information is input so that important parts of the presented multimedia information can be searched later so that the multimedia information can be efficiently extracted from the database after the conference. The association of index information is also performed. Regarding the generation of the index information, for example, in Japanese Patent Application Laid-Open No. Hei 7-226931, a minutes creator (moderator or clerk) inputs text information related to remarks of a conference attendee regarding multimedia information as needed. A method has been proposed in which the minutes are stored in a multimedia database, and when the minutes are created, the text information is searched from the multimedia database to facilitate the minutes creation. In addition, for example, Japanese Patent Laid-Open No.
No. 343146 discloses a method of associating audio information and image information stored in a database with input information input from a portable terminal of a conference attendee by occurrence time. Also, for example, Japanese Patent Application Laid-Open No. 4-362770 discloses a method of extracting key data from image information or audio information and making the data correspond to index information.

[0004]

However, these methods have the following problems. That is, JP-A-7
Even if the minutes creator adds index information to a place deemed important by the method disclosed in Japanese Unexamined Patent Publication No. It is difficult to search for important places for each participant using the index information. In Japanese Patent Laid-Open Publication No. Hei 6-343146, a conference attendee can enter index information at a location important to him / her. However, a memory at the time of input, for example, writing a certain character, If you do not keep the memory that you did, you can not retrieve later.
This is the same in the method disclosed in Japanese Patent Application Laid-Open No. 4-362770. As the storage at the time of the input, partial storage may be sufficient in some cases, but the storage contents must be accurate. If the speaker can be identified using speech recognition, a fairly efficient search can be expected. However, speech recognition of an unspecified speaker has many system technical problems, and is introduced into a conference system. Is quite difficult. For the above reasons, in the conventional conference system,
The most realistic way is for each meeting participant to make notes for each of the important situations. In addition, instead of taking notes individually, it is conceivable that conference participants can input index information from a mobile computer to the database.However, it is necessary to construct a system that allows multiple mobile computers to be connected to the database and input simultaneously. In addition, the system becomes complicated, and it is necessary to always prepare a portable personal computer for the capacity of the conference room, so that the system becomes expensive. In addition, since the portable personal computer is premised on information display and information input, it occupies a large area on the desk, which is inconvenient for placing paper materials and the like.

It is conceivable to use a remote controller as an input means for index information.
When a plurality of remote controls are used, the receiver cannot identify which remote control transmitted the information. Also, when using a multimedia database device for presentations targeting a larger number of participants compared to a normal relatively small number of meetings,
Providing a portable terminal for inputting index information to each participant puts a large load on the system and is difficult to put into practical use in terms of cost.

SUMMARY OF THE INVENTION In view of the above circumstances, an object of the present invention is to provide a multimedia database apparatus with a small system load, which allows a plurality of operators to easily input index information.

[0007]

According to the present invention, there is provided a multimedia database apparatus which achieves the above objects.
Input means for inputting multimedia information comprising at least one of voice information and text information; storage means for storing the input multimedia information; and desired multimedia from the stored multimedia information. In a multimedia database device having a search means for searching for information and an output means for outputting the searched multimedia information, the multimedia database apparatus is associated with the multimedia information and serves as an index for searching for desired multimedia information. A plurality of index information transmitting means for transmitting the index information; an index information receiving means for receiving the index information transmitted from the index information transmitting means; and the index information received by the index information receiving means as multimedia information. Index to attach And a scan information associating unit, the index information transmission means or the index information receiving means, characterized in that it is capable to identify the index information transmitting means transmits the index information.

[0008] Here, the index information transmitting means has an instruction button for instructing transmission of index information by pressing, and the instruction button is operated in accordance with the length of pressing time or the number of continuous pressing. It is also preferable that the information also serves as an instruction to transmit the predetermined reference information. Further, the index information transmitting means includes a first instruction button for instructing transmission of index information by pressing, and a second instruction button for instructing transmission of predetermined reference information according to the length of the pressing time or the number of continuous pressings. It is also preferable to have the instruction button of the above.

Further, the index information transmitting means transmits, as one of the index information or the reference information, ID information for distinguishing the index information transmitting means from other index information transmitting means. Is also one of the preferred embodiments, or,
It is also a preferable embodiment that the index information transmitting means transmits, as one of the index information or the reference information, an operator identification code of an operator who operates the index information transmitting means. Here, the index information associating means may associate the operator identification code received by the index information receiving means with the multimedia information as the index information.

In the multimedia database apparatus of the present invention, "transmitting and receiving index information" means not only transmitting and receiving index information each time, but also the ID of the index information transmitting means. A method of transmitting information and the identification code of the operator first, and then transmitting and receiving only the timing of associating the index information is also included.

[0011]

Embodiments of the present invention will be described below. FIG. 1 is a schematic configuration diagram of an embodiment of a multimedia database device of the present invention. The multimedia database device 100 includes an input unit 10,
The storage means 20, the search means 30, the output means 40, and a plurality of index information transmitting means 50 (in the present embodiment, index information transmitters 50a, 50b, 50c,...).
Is provided), and the index information receiving means 60
And index information associating means 70. Also, this multimedia database device 100
Is connected to a network so that it can communicate with other multimedia database devices and other client computers.

The input means 10 is for inputting multimedia information including image information, audio information, text information, and the like. The image information and text information are input by a camera 11 for photographing a presenter, a camera 12 for photographing the entire conference room, The voice information is input from the personal and material photographing camera 13 and the like, and the voice information is input from the individual microphone 14, the presenter's microphone 15, and the like. The input multimedia information is stored in the storage unit 20.
It is stored in a database built inside. The search means 30 searches for desired multimedia information from the multimedia information stored in the database. The searched multimedia information is output via the output means 40, that is, the individual monitor 41, the presenter monitor 42, and the like.

The index information transmitting means 50 (index information transmitters 50a, 50b, 50c,...)
A plurality of devices that can instruct transmission of index information when pressed by conference attendees are provided.
, 50c,..., the index information receiving means 60
For example, the index information is transmitted by ultrasonic waves, infrared rays, radio waves, or the like. The simplest configuration of the index information transmitters 50a, 50b, 50c,... Is a configuration in which only one index button is used to transmit only index information. Index information transmitter 50
When a, 50b, 50c,... are constituted by one instruction button, the instruction button also serves as an instruction to transmit predetermined reference information according to the length of the pressing time or the number of continuous pressings. can do.

Reference information other than the index information, for example, index information transmitters 50a, 50b, 50c,
.. The use of the multimedia database device is made more effective by being configured to transmit various reference information such as the identification code of each operator who operates... And the importance information of the index information. It can be. To enter various reference information into the database, the index information transmitters 50a, 50b, 50c,
... has a plurality of instruction buttons. By doing so, for example, the type of input information is identified based on which of the plurality of instruction buttons has been operated, or a combination of the plurality of instruction buttons, for example, a specific instruction button It is also possible to instruct transmission of predetermined reference information according to the length of the pressing time or the number of continuous pressings.

On the other hand, index information transmitters 50a, 5
The index information receiving means 60 which receives the information transmitted from 0b, 50c,... Detects the transmitted information, converts it into an electric signal, and sends the converted electric signal to the index information associating means 70. . The index information associating means 70 analyzes the transmitted electric signal, performs identification processing of which of the plurality of index information transmitters the information is transmitted from, and performs identification processing. The processed information is sent to the storage unit 20. In order to perform this identification process, in the multimedia database device 100 of the present embodiment, the index information transmitters 50a, 50b, 50c,. It is configured so that identification is possible. In the present embodiment, one index information receiving unit 60 is provided for a plurality of index information transmitters 50a, 50b, 50c,..., But the index information transmitter and the index information receiving unit are provided in one-to-one correspondence. It may be configured to correspond. When the index information transmitter and the index information receiving means are made to correspond one-to-one, it is easy to identify the index information transmitter that transmitted the index information, but one index information receiving means is used for a plurality of index information transmitters. In the case of the present embodiment, ID information for distinguishing the index information transmitter that has transmitted the index information from other index information transmitters is transmitted together with the index information.

The index information associating means 70 performs an identification process by analyzing the electric signal to determine whether the information is index information or reference information added to the index information. The index information associating means 70 associates the information with the multimedia information in the database after performing the above analysis processing. The above-described analysis processing may be configured to be performed by the index information associating unit 70, or may be configured to be performed by the index information receiving unit 60. Also,
At the stage of this analysis processing, identification processing of an operator who operates the index information transmitter is also performed.

By recording the ID information of the index information transmitter and the operator of the index information transmitter in association with each other in the database, a great effect can be exhibited at the stage of searching the database. In order to make the ID information of the index information transmitter correspond to the operator of the index information transmitter, input the operator identification code of the operator of the index information transmitter to each index information transmitter prior to the start of the conference. After the conference starts, an operator identification code may be added to the information when transmitting the information from the index information transmitter, or each index information transmitter may transmit the information before the conference starts. The operator identification code of the operator of the index information transmitter is transmitted to the index information receiving means at least once, and only the index information is transmitted at the time of the normal operation of transmitting the index information. On the side, the operator identification code received at least once is combined with the ID information of each index information transmitter. Combined with the operator identification code and index information transmitter which may be made to correspond. Alternatively, in the case of a multimedia database device in which the index information transmitter and the index information receiving means are made to correspond one-to-one, the index information can be provided by assigning ID information to each of the plurality of index information receiving means. When information is sent from the receiving means to the index information associating means, ID information of the index information receiving means device may be added to the information and sent.

As a method of automatically identifying the correspondence between each index information transmitter and its operator, for example, the operator is identified by performing image recognition processing on a video recording screen taken in the hall, A method of associating with the index information transmitter can be adopted. In the case of a method of associating the operator with the index information transmitter by the operator's own operation, the operator inputs the operator identification code each time the index information is transmitted, and then transmits the index information. A memory may be provided in each index information transmitter, and an operator identification code once input by an operator is stored in the memory, and the index information is automatically transmitted each time the operator transmits the index information. And the operator identification code may be transmitted.

As the storage means 20 for storing the index information in the database and the search means 30 for searching the stored index information from the database, storage means and search means in a general-purpose multimedia database system can be used. That is, image information, audio information, text information, time information, and the like are accumulated and stored in a searchable format. Furthermore, by connecting the multimedia database device 100 to a network, it can be made accessible from other multimedia database devices. Further, the voice information and the image information taken into the multimedia database apparatus 100 may be recognized, coded, and stored.

Hereinafter, an example of the arrangement of devices in the actual conference room of the multimedia database device of the present embodiment will be described. FIG. 2 is a device layout diagram of the multimedia database device shown in FIG. 1 in an actual conference room. As shown in FIG. 2, a conference table is arranged in a U-shape, and a presenter's seat is provided in the center thereof. Paper materials are distributed on the desks of each meeting participant, and the presenter shows a situation where they report to each meeting participant based on the paper materials. Behind the presenter, a presentation device for a remote conference system (for example, a live board manufactured by Fuji Xerox Co., Ltd.)
By using this, it is possible to hold a large-scale conference while communicating with a multimedia database device installed in a plurality of conference rooms at remote locations.

For each conference attendee, an index information transmitter for transmitting index information, a microphone for inputting speeches of the conference attendees, a material display monitor for presenters and conference attendees, and each personal photographer In addition, a camera for photographing materials is arranged. These cameras are so-called video cameras for recording moving image data in a database, and are mainly used to record facial expressions and actions of each conference attendee, documents and memos at hand, and to photograph the entire conference room. Used for The camera arranged in front of the presenter is for recording the expression of the presenter and the screen displayed on the OHP or the presentation device. A monitor installed on each meeting participant's desk can be used to show detailed data owned by each meeting participant to other meeting attendees, or to reproduce and display scenes that meeting attendees missed. belongs to.

The index information transmitter according to the present embodiment employs an infrared communication system. There is no problem in terms of function even if a method of transmitting index information by wire is adopted. . Two infrared receivers are installed as index information receiving means. The conference attendee operates the index information transmitter toward the infrared receiver that is closer in distance, and transmits the index information.

FIG. 3 is a schematic diagram of an index information transmitter according to the present embodiment. As shown in FIG. 3, the index information transmitter is provided with two instruction buttons for performing a click operation similar to a mouse button and one simple viewer. The button on the left side in the drawing is a button for instructing transmission of index information, and the button on the right side is a command input button for transmitting various reference information. The left button instructs transmission of index information when pressed, and the right button instructs transmission of reference information according to the length of the pressing time or the number of continuous pressings. The contents of the transmitted information are displayed on the viewer.

FIG. 4 is a schematic configuration diagram of the inside of the index information transmitter in the present embodiment. The index information transmitter 50 includes an input unit, an analysis unit, and an output unit. The input unit is for inputting commands for transmitting index information and various types of reference information, and includes two instruction buttons (see FIG. 3) as described above. The analysis unit generates index information and reference information from the input command. The analysis unit interprets that the button is pressed for less than 0.5 s as a normal click (“short click”), and that the button is pressed for more than 0.5 s as “long click”. Is interpreted as two types of clicks. Index information and reference information are configured by a combination of these two types of clicks. The analysis unit sends the analysis result of the click to the output unit, and the output unit transmits the result to the index information receiving device. The exchange and processing of data inside the index information transmitter is controlled by the control unit. When the transmission is performed, information corresponding to the transmission content is displayed on the viewer, and the operator can check the content of the index information and the reference information transmitted by the operator.

FIG. 5 is a schematic configuration diagram of the inside of the index information receiving apparatus in the present embodiment. The index information receiving device 60 includes a detection unit, an analysis unit, and a communication unit. The detection unit photoelectrically converts the received infrared light into an electric signal and sends it to the analysis unit. The analysis unit converts it into a command. The command is sent from the communication unit to the index information association unit 70 (see FIG. 1).

The information sent from the index information receiving device 60 to the index information associating means 70 is reference information such as ID information of the index information transmitter, index information, and index importance information. The information sent to the index information associating means 70 is
Are managed in the format shown in Table 1, together with moving image information including audio information input from microphones 14, 15,.

Table 1 is a table showing the contents of an index file that associates index information with a multimedia database.

[0028]

[Table 1]

In the first column "frame number" of Table 1, each image frame number of the moving image information is recorded.
The column “time log” records the elapsed time (in seconds) from the start of recording corresponding to the frame number.
In the column “index”, it is recorded that the index has been input to the frame number, and the fourth column “de” is recorded.
v. In “ID”, device ID information of the index information transmitter that transmitted the index is recorded, and in the fifth column “User ID”, an operator identification code of an operator who operated the index information transmitter is recorded. ,further,
In the sixth column “reference information”, reference information transmitted together with the index information is recorded. In addition, "
The reference information recorded as “High” indicates that the moving image data after this frame number has been subjected to security processing of confidentiality “High”, and that access by anyone other than the access right designated in advance is prohibited. Represents.

The reference information recorded as "link 1329" in Table 1 corresponds to the intranet (INTRANE) of the user identified by the operator identification code "1329".
T) The home page above and this frame number "11
6 "indicates that the moving image data is linked. The multimedia database apparatus searches this user's home page based on this user ID "1329" and adds a hypertext document linked to the moving image data after the indexed frame number "116" to the user's home page. And save.

As described above, the multimedia information and the index information are associated with each other by the frame number and the time log. The device ID information of the index information transmitter is set for each index information transmitter, and is always transmitted when transmitting the index information. The user ID is associated with the device ID information “5” by inputting “5968” or the like from the operator before the start of the conference. In order to input the user ID with the instruction button, for example, after clicking the right button to set the user ID input mode, a four-digit number is input with the left button. To enter a number, make a "short click" the number of times corresponding to that number. Perform a "long click" to advance to the next digit. Click the left button twice to finish inputting. To input the secrecy level, for example, the right button is clicked until the secrecy level input mode is entered, and then the left button is clicked the number of times corresponding to the secrecy level.

The multimedia database device configured as described above is used as follows. That is,
After the conference, the presenters and conference participants access the multimedia database from the database search terminal connected to the multimedia database device,
By inputting the searcher's user ID, the user can easily search the moving image data at the place where the user himself / herself determines that it is important and associates the index information, and accurately reproduce the situation at that time. You can check its contents. The top screen of the searched moving image data is listed in a catalog format, and a moving image can be reproduced by specifying this with a mouse. Furthermore, if the user links to his own homepage with the automatic link command, even if he or she forgets, the index information is listed when the user accesses the homepage, so that the user can easily remember it.

In the above description, only the example in which the multimedia database apparatus of the present invention is applied to a conference has been described. However, the present invention can be applied not only to a standard conference but also to various discussions. Of course, the present invention can be applied to a presentation hall for a relatively large number of participants.

[0034]

As described above, when the multimedia database device of the present invention is applied to, for example, a conference system, a plurality of conference participants can easily input index information by themselves. After the meeting, the user can easily search for important parts and reproduce the important parts to check the contents.

Since the multimedia database device of the present invention uses a transceiver having a relatively simple configuration, a multimedia database device with a small system load can be realized. Also, in preparing the minutes, by inputting index information for each scene considered to be the key point during the meeting, it is possible to create accurate minutes with a small amount of effort and in a very short time after the meeting. it can.

[Brief description of the drawings]

FIG. 1 is a schematic configuration diagram of an embodiment of a multimedia database device of the present invention.

FIG. 2 is a device layout diagram of the multimedia database device shown in FIG. 1 in an actual conference room.

FIG. 3 is a schematic diagram of an index information transmitter according to the embodiment.

FIG. 4 is a schematic configuration diagram of the inside of an index information transmitter according to the present embodiment.

FIG. 5 is a schematic configuration diagram of the inside of an index information receiving device in the present embodiment.

[Explanation of symbols]

Reference Signs List 10 input means 11 presenter photographing camera 12 conference room whole photographing camera 13 personal and document photographing camera 14 individual microphone 15 presenter's microphone 20 storage means 30 search means 40 output means 50 index information transmitting means 50a, 50b, 50c Index information transmitter 60 Index information receiving means 70 Index information associating means 100 Multimedia database device

Claims (6)

[Claims] 1. An input unit for inputting multimedia information including one or more of image information, audio information, and text information; a storage unit for storing the input multimedia information; and the stored multimedia. In a multimedia database apparatus having a search unit for searching for desired multimedia information from information and an output unit for outputting the searched multimedia information, a multimedia information device associated with the multimedia information A plurality of index information transmitting means for transmitting index information serving as an index for searching, an index information receiving means for receiving the index information transmitted from the index information transmitting means, and an index information receiving means for receiving the index information. Index information, multimedia A multimedia database comprising: index information associating means for associating information; wherein the index information transmitting means or the index information receiving means is capable of identifying the index information transmitting means which transmitted the index information. apparatus. 2. The method according to claim 1, wherein the index information transmitting means has an instruction button for instructing transmission of index information by pressing, and the instruction button is adapted to correspond to a length of a pressing time or a number of continuous pressings. 2. The multimedia database apparatus according to claim 1, wherein the apparatus also serves as an instruction to transmit predetermined reference information. 3. The index information transmitting means includes a first instruction button for instructing transmission of index information when pressed, and an instruction for transmitting predetermined reference information according to a length of a pressing time or a number of continuous pressings. 2. The multimedia database apparatus according to claim 1, further comprising a second instruction button for performing the operation. 4. The index information transmitting means transmits, as one of the index information and the reference information, ID information for distinguishing the index information transmitting means from other index information transmitting means. 4. The multimedia database device according to claim 2, wherein: 5. The index information transmitting means transmits an operator identification code of an operator who operates the index information transmitting means as one of the index information and the reference information. The multimedia database device according to claim 2 or 3. 6. The method according to claim 1, wherein the index information associating means associates the index information with multimedia information using the operator identification code received by the index information receiving means as the index information. The multimedia database device according to claim 5.