JPH07226931A - Multi-medium conference equipment - Google Patents

Abstract

PURPOSE:To provide the multi-medium conference equipment in which the retrieval and the edit are facilitated in the re-processing generating an agenda or a paper material after the end of conference. CONSTITUTION:The-utterance of conference participants 10-1-10-4 is detected based on a sound volume and a consecutive period of voice information received from microphones 14-1-14-4, text information relating to the utterance of the conference participant received from a data terminal equipment 15-0 of a modulator 10-0 is detected and the voice information and the audio information received from the conference participant are stored in an information storage/retrieval device 100 with same link information together with the text information received by the modulator and the voice information and the video information received from the conference participant are retrieved from the information storage/retrieval device 100 based on the text information and the link information.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multimedia conference apparatus for conducting conference communication between a plurality of conference participants using multimedia information including audio information and video information,
In particular, multimedia information input from each conference participant is stored in real time in association with text information input from the moderator, and minutes and minutes are created after the conference. Searching and editing during reprocessing is easy. Multimedia conference device.

[0002]

2. Description of the Related Art Conventionally, as a conference device for providing a conference service, a conference device for making a conference call using a voice between a plurality of conference participants is known.

With the development of the information-oriented society in recent years, in addition to voice, video information, facsimile information, and text information can be communicated among the conference moderators. Devices have also been proposed.

By the way, in this type of conferencing apparatus, in order to create the minutes or materials relating to the conference after the conference, the input voice of each conference participant during the conference call,
Although it is configured to store facsimile information, text information, etc., in order to facilitate the creation of the minutes or materials mentioned above, a memo in which the above-mentioned input voice, facsimile information, text information, etc. are input by the conference moderator. A configuration in which the item is attached and stored is also considered.

In this case, there is a problem in how the memo input by the conference chairperson and the input voice, facsimile information, text information, etc. are stored in association with each other.

[0006] Conventionally, as a service that fuses a plurality of media, hypertext in which voice and video are linked to text is known. Since hypertext can link multiple pieces of information with link information, you can randomly retrieve the information you saw or heard in a fixed order by text or keywords, and record the minutes or materials after the meeting. It is very convenient for reprocessing the information to be created, but it takes a very long time to create this hypertext, and it is difficult to directly apply it to the conference device.

That is, hypertext is suitable for converting encyclopedias that can be shared by a large number of people into data. For example, considering the case where encyclopedias are converted into hypertext, audio, video, and document are considered. Edit separately (the audio and video may be edited the same),
Link information is added to these to generate hypertext. In this case, each piece of information is stored as a single medium, and this stored information is edited for a time longer than the information collection time.

[0008]

As described above, in the conventional conference apparatus, in order to create the minutes or materials relating to the conference after the conference is finished, the input voice and facsimile information of each conference participant during the conference call. , It is configured to store text information, etc., but in this case, it is very time-consuming to create the above minutes or materials, because the information viewed or heard can only be retrieved in a fixed order. , With the introduction of hypertext,
Since multiple pieces of information can be linked by link information, the information that you see or hear in a fixed order can be retrieved at random by text or keywords. Although it is very convenient in the reprocessing of the above, it takes a very long time to create this hypertext, and it is difficult to apply this hypertext to the conference device as it is.

Therefore, an object of the present invention is to provide a multimedia conferencing apparatus which facilitates retrieval and editing at the time of reprocessing for creating minutes or materials after the end of a conference.

[0010]

To achieve the above object, the present invention provides a conference communication between at least one moderator and a plurality of conference participants using multimedia information including audio information and video information. In the multimedia conferencing apparatus for performing the following, from the multimedia information input / output unit provided corresponding to the moderator and the conference participant, and the volume and duration of the voice information input by the multimedia information input / output unit. While detecting the speech of the conference participant, the text information relating to the speech of the conference participant input by the moderator is detected, and the multimedia information input from the conference participant is input by the moderator. Multimedia information storage means for storing the same link information together with the stored text information and the text information. Characterized by comprising a multimedia information retrieval means for searching for multimedia information inputted from said conferee outputs from the multimedia information input and output unit.

[0011]

According to the present invention, the speech of the conference participant is detected from the volume and duration of the voice information input by the multimedia information input / output means, and the text information relating to the speech of the conference participant input by the moderator. The multimedia information input from the conference participant is stored in the multimedia information accumulating means with the same link information as the text information input by the moderator, and then the above-mentioned text information is used as the basis. At the time of reprocessing, the multimedia information input from the conference participants is searched by the multimedia information search means and output from the multimedia information input / output means, and the minutes or materials are created after the conference is over. Facilitates searching and editing in.

[0012]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT An embodiment of a multimedia conference apparatus according to the present invention will be described below in detail with reference to the drawings.

FIG. 1 shows the overall configuration of a multimedia conference apparatus according to the present invention. In the multimedia conference apparatus shown in FIG. 1, four conference participants 10-
Providing a conference communication service using voice and video with the information storage / retrieval device 100 between the one, 10-2, 10-3, 10-4 and one conference moderator 10-0. To do.

Here, each conference participant 10-1, 10-
Monitors 11-1, 11-2, 11-3, and 11- that output images corresponding to 2, 10-3, and 10-4, respectively.
4. Cameras 12-1, 12-2, 12-for inputting images
3, 12-4, speakers 13-1, 13 for outputting voice
-2, 13-3, 13-4, microphones 14-1, 14-2, 14-3, 14-4 for inputting audio are provided, and video is output corresponding to the conference moderator 10-0. Monitor 11-0, camera 12-0 for inputting video, speaker 13-0 for outputting audio, microphone 14-0 for inputting audio, data terminal 15-0 for inputting text
Are provided, and these are connected to the information storage / retrieval apparatus 100.

In this structure, the conference participants 10-
1, 10-2, 10-3, 10-4 and conference moderator 1
0-0 indicates monitors 11-1, 11-2, 11 respectively.
-3, 11-4, 11-0, cameras 12-1, 12-
2, 12-3, 12-4, 12-0, speaker 13-
1, 13-2, 13-3, 13-4, 13-0, microphones 14-1, 14-2, 14-3, 14-4, 1
4-0 is used to hold a conference via the information storage / retrieval apparatus 100.

The information storing / retrieving apparatus 100 has a multimedia information exchanging function in addition to the multimedia information storing / retrieving function which will be described later in detail, and voice information input from a microphone corresponding to each conference participant. And the video information input from the camera is sent to the other conference participants and the moderator, and the audio is output from the speaker corresponding to the other conference participants and the moderator, and the video information is output from the monitor. Is configured.

That is, the information storage / retrieval apparatus 100 is
The voice information input from the microphone corresponding to each participant is monitored, and this voice information is equal to or higher than a predetermined volume,
And, if it has a predetermined duration, it is detected as the speech of the conference participant who has input the audio information, and the audio information input from the microphone corresponding to the conference participant and the video information input from the camera are detected. Conference communication is performed by transmitting to other conference participants and the conference moderator.

The conference moderator 10-0 listens to the speech contents of each participant, summarizes the speech contents of each participant, and stores the information as text information using the data terminal 15-0. By inputting to the search device 100, a memo of the meeting agenda is input.

If the voice information input from the microphones corresponding to each participant is equal to or more than a predetermined volume and has a predetermined duration, the information storage / retrieval apparatus 100 cuts out based on the duration. At this time, the audio information corresponding to one utterance and the video information input from the camera are transferred from the conference moderator 10-0 to the data terminal 15-
The same link information is added and stored together with the text information input using 0.

When the conference is over, the conference moderator 10-0
Creates minutes and materials related to the conference on the basis of the text information input by memo using the data terminal 15-0. Here, if the content of the proceedings cannot be remembered from the text information entered in the memo, the content having the same link information (voice information, video information) is searched from the stored information of the information storage / retrieval device 100 to confirm the content. I do.

Here, since the text information input by memo using the data terminal 15-0 may be input later or earlier than the utterance, the information storage / retrieval apparatus 100 may make a utterance. It has a function of searching backward in time and a function of searching in time.

The meeting moderator 10-0 creates the minutes and materials based on the text information entered in the memo, and then
Again, the data is stored in the information storage / retrieval device 100 by using the data terminal 15-0, and at that time also, the utterance is selected and the link information is added to the minutes and materials. Here, it is also possible to add link information different from the text information input as a memo to the selected utterance (audio information, video information).

As a result, even when the conference participants confirm the contents of the proceedings, it is possible to search the voice information and the image information in the same manner, and the work of preparing the proceedings and confirming the proceedings can be improved.

In the above description, the speech of the conference participant is automatically specified based on the volume and duration of the voice information input by each participant. It may be configured to specify the utterance of the conference participant by the instruction using the data terminal 15-0 and add the link information.

Further, in the above embodiment, since the microphones are provided for the respective conference participants, if the microphones are associated with the conference participants at the start of the conference, the name of the speaker Can be stored in the information storage / retrieval apparatus 100 as information.

FIG. 2 shows a detailed configuration of the information storage / retrieval apparatus 100 shown in FIG. In FIG.
The information storage / retrieval apparatus 100 includes a control unit 101, a storage / retrieval unit 102, and a selection / distribution unit 103, and further includes a voice processing unit 104-0 and a video processing unit 1 corresponding to a conference moderator.
05-0 and a data processing unit 106-0, corresponding to each conference participant, voice processing units 104-1, 104-2,
104-3 and 104-4 and the video processing unit 105-1,
105-2, 105-3, 105-4 is comprised and comprised.

The audio processing unit 104-0 is connected to the speaker 13-0 and the microphone 14-0 shown in FIG. 1, and the video processing unit 105-0 is connected to the monitor 11-0 and the camera shown in FIG. 12-0, and the data processing unit 106-0 is connected to the data terminal 15-0 shown in FIG.

The voice processing units 104-1, 104-
2, 104-3, 104-4 are connected to the speakers 13-1, 13-2, 13-3, 13-4 and the microphones 14-1, 14-2, 14-3, 14-4 shown in FIG. The video processing units 105-1, 105-2, which are respectively connected,
105-3 and 105-4 are monitors 11- shown in FIG.
1, 11-2, 11-3, 11-4 and camera 12-
1, 12-2, 12-3, 12-4, respectively.

Here, the control unit 101 controls the voice processing unit 10
4-0, 104-1, 104-2, 104-3, 104
-4, the selection / distribution unit 103 is instructed to select the voice information and the video information of the speaker in response to the speaker notification, and the link information to be added to the voice information and the video information is stored / retrieved. Instruct.

At this time, when text information is input from the data processing unit 106-0, the control unit 101 adds the same link information as the above-mentioned link information to the storage / retrieval unit 102. The storage / retrieval unit 102 is instructed.

When the moderator notifies the control unit 101 of the search instruction via the data processing unit 106-0, the control unit 101 uses the link information and the search key information to retrieve the corresponding text information, voice information, and video. The accumulation / retrieval unit 102 is instructed to output the information to the moderator, and the data processing unit 106-0 outputs the corresponding information.

Under the control of the control unit 101, the accumulation / retrieval unit 102 is based on the text information output from the data processing unit 106-0 and the speech of the participants, and the voice processing unit 104.
-1, 104-2, 104-3, 104-4 output audio information and video processing units 105-1, 105-
The video information output from 2, 105-3, and 105-4 is input via the selection / distribution unit 103, and the corresponding link information is added and accumulated.

Further, the storage / retrieval unit 102 includes a control unit 10
1. Based on the link information and search key information given from 1, the corresponding text information, audio information, and video information are searched, and the data processing unit 106-0 and the audio processing unit 104-
0, 104-1, 104-2, 104-3, 104-
4, video processing units 105-0, 105-1, 105-2,
Output to 105-3 and 105-4.

Under the control of the control unit 101, the selection / distribution unit 103 selects the audio information output from the audio processing unit and the video information output from the video processing unit corresponding to the conference participant making a statement. Then, it outputs the audio information and the video information to the audio processing unit and the video processing unit corresponding to other conference participants and the conference moderator, and stores / retrieves the audio information and the video information.
Output to.

Voice processing units 104-0, 104-1, 10
4-2, 104-3, 104-4 select / distribute unit 103, respectively, using the voice input from the microphones corresponding to the conference moderator and each conference participant as voice information.
The audio information output from the selecting / distributing unit 103 is also output to the conference moderator and speakers corresponding to each conference participant as voice.

Further, the voice processing units 104-0 and 104-
Numerals 1, 104-2, 104-3, and 104-4 detect the volume level of the voice input from the microphones corresponding to the conference moderator and each conference participant and a period of a certain volume level or more, respectively, and the moderators of the conference. Also, the speech of each conference participant is detected, and the detection result is notified to the control unit 101.

Video processing units 105-0, 105-1, 10
Reference numerals 5-2, 105-3, and 105-4 convert the images input from the cameras corresponding to the conference moderator and each conference participant into digital signals (image information) to select / distribute unit 10.
3 and outputs to the selection / distribution unit 103.
The video information output from is added to the monitors corresponding to the conference moderator and each conference participant, and a process of outputting as video is performed.

The data processing unit 106-0 performs a process of outputting the text information input by the conference moderator using the data terminal 15-0 shown in FIG. 1 to the storage / retrieval unit 102, and also stores / retrieves the text information. The text information retrieved from the unit 102 is output to the data terminal 15-0 shown in FIG.

Further, the data processing unit 106-0 uses the control information to interface with the control unit 101 via the data terminal 15-0 shown in FIG.

FIG. 3 shows the storage / retrieval unit 102 shown in FIG.
2 shows an example of the information format in.

The storage / retrieval unit 102, as described above,
It is used to store and retrieve text information, audio information, and video information, and includes a text control area 131, a voice control area 132, and a video control area 133. In each area, control information for storing the cut-out information in each utterance unit, link information, a storage start address,
An area for storing the length is provided.

Here, the control information is information indicating a pointer to the front and back and validity / invalidity of the information.

The link information is used for associating the text information, the audio information, and the video information in the cut-out utterance units. Here, the same link information is added to one utterance.

The storage start address indicates the start address of the information storage area in which text information, audio information, and video information are stored, and the length indicates the amount of information.

With such a configuration, it is possible to extract the audio information and the video information from the text information using the link information. It is also possible to retrieve the former utterance and the latter utterance temporally using the control information.

When the utterances are detected from two or more conference participants at the same time, by accumulating the different link information for each conference participant, a plurality of accumulated conference participants are generated. It is also possible to select two or more simultaneous utterances and output them one by one by searching the text information, which is one of the above information.

In this case, even if two or more persons are talking at the same time when speaking, the contents of these conversations can be separated and reproduced one by one.

FIG. 4 shows another configuration of the information storage / retrieval apparatus 100 shown in FIG. The information storage / retrieval apparatus 100 shown in FIG. 4 is configured by adding a voice / text conversion dictionary 107 to the information storage / retrieval apparatus 100 shown in FIG. Other configurations are the same as those shown in FIG.

Here, the voice / text conversion dictionary 107 is used.
Is a dictionary for converting the voice information input from the conference participant or the conference moderator into text information. The voice information of the conference participant or the conference moderator output from the selection / distribution unit 103 is input. The voice information is converted into text information and output to the storage / search unit 102.

Under the control of the control unit 101, the storage / retrieval unit 102 is based on the text information output from the data processing unit 106-0 and the speech in the participants, and the voice processing unit 104.
-1, 104-2, 104-3, 104-4 output audio information and video processing units 105-1, 105-
The video information output from 2, 105-3, and 105-4 is input through the selection / distribution unit 103, the corresponding link information is added and stored, and the video information is input from the voice / text conversion dictionary 107. Text information corresponding to voice information is added with corresponding link information and stored.

With such a configuration, the voice information of the conference participant or the conference moderator can be stored as text information in the storage / retrieval unit 102, and the control unit 101 can be used.
Based on the link information and the search key information given from, the text information corresponding to the corresponding voice information can be searched.

FIG. 5 shows still another configuration of the information storage / retrieval apparatus 100 shown in FIG. The information storage / retrieval apparatus 100 shown in FIG. 5 is the same as the information storage / retrieval apparatus shown in FIG.
It is configured by adding the personal authentication dictionary 108 to the search device 100. Other configurations are the same as those shown in FIG.

Here, the personal authentication dictionary 108 is a dictionary that personally authenticates the conference participants based on the video information input from the conference participants and converts it into information indicating the name of each speaker.
The video information of the conference participants output from the selection / distribution unit 103 is input, the conference participants are individually authenticated from this video information, and the information indicating the name of each speaker is stored / retrieved.
Output to.

The individual authentication of the conference participant in the individual authentication dictionary 108 can be performed by extracting the characteristic of the image of the face of the conference participant included in the image information, for example. .

Under the control of the control unit 101, the accumulation / retrieval unit 102, based on the text information output from the data processing unit 106-0 and the speech of the participants, the voice processing unit 104.
-1, 104-2, 104-3, 104-4 output audio information and video processing units 105-1, 105-
Speakers input from the personal authentication dictionary 108 while inputting the video information output from 2, 105-3, and 105-4 via the selecting / distributing unit 103, adding and storing corresponding link information, respectively. Information indicating an individual's name is accumulated by adding corresponding link information.

According to this structure, the information indicating the name of each speaker can be stored in the storage / retrieval unit 102, and the information corresponding to the speaker name can be stored based on the link information and the search key information provided from the control unit 101. It is possible to retrieve information indicating the name of each speaker.

In the above-described embodiment, the conference participant is configured to perform individual authentication based on the video information input from the conference participant, but the conference participant is identified based on the voice information input from the conference participant. It may be configured to perform personal authentication. In this case, for example, the feature of the voice information input from the conference participant can be extracted to configure the conference participant to perform individual authentication.

FIG. 6 shows another embodiment of the multimedia conferencing apparatus according to the present invention, which is constructed so as to provide a teleconference service by utilizing a network such as a public telephone network. Also in this embodiment, as in the embodiment shown in FIG. 1, four conference participants 10-1, 10-2, 10-3, 10-4.
And one conference moderator 10-0 provide a conference communication service using audio and video via the network 300.

That is, each conference participant 10-1, 10-
Monitors 11-1, 11-2, 11-3, and 11- that output images corresponding to 2, 10-3, and 10-4, respectively.
4. Cameras 12-1, 12-2, 12-for inputting images
3, 12-4, speakers 13-1, 13 for outputting voice
-2, 13-3, 13-4, microphones 14-1, 14-2, 14-3, 14-4 for inputting audio are provided, and video is output corresponding to the conference moderator 10-0. Monitor 11-0, camera 12-0 for inputting video, speaker 13-0 for outputting audio, microphone 14-0 for inputting audio, data terminal 15-0 for inputting text
Is provided. Then, the monitor 11-1, the camera 12-1, the speaker 13-1, which corresponds to the conference participant 10-1,
The microphone 14-1 is connected to the network 300 via the communication terminal 200-1, and the monitor 11-2, the camera 12-2, the speaker 13-2 corresponding to the conference participant 10-2,
The microphone 14-2 is connected to the network 300 via the communication terminal 200-2, and the monitor 11-3, the camera 12-3, the speaker 13-3 corresponding to the conference participant 10-3,
The microphone 14-3 is connected to the network 300 via the communication terminal 200-3, and the monitor 11-4, the camera 12-4, the speaker 13-4 corresponding to the conference participant 10-4,
The microphone 14-4 is connected to the network 300 via the communication terminal 200-4, and the monitor 11-0, the camera 12-0, the speaker 13-0 corresponding to the conference moderator 10-0,
The microphone 14-0 and the data terminal 15-0 are connected to the network 300 via the communication terminal 200-0.

Further, an information storage / retrieval device 400 is connected to the network 300.

In this structure, the conference participants 10-
1, 10-2, 10-3, 10-4 and conference moderator 1
0-0 indicates monitors 11-1, 11-2, 11 respectively.
-3, 11-4, 11-0, cameras 12-1, 12-
2, 12-3, 12-4, 12-0, speaker 13-
1, 13-2, 13-3, 13-4, 13-0, microphones 14-1, 14-2, 14-3, 14-4, 1
A conference is held via the network 300 using 4-0.

The conference moderator 10-0 listens to the speech contents of each participant, summarizes the speech contents of each participant, and inputs this as text information using the data terminal 15-0. Enter the memo of the meeting agenda.

If the voice information input from the microphones corresponding to each participant is equal to or higher than a predetermined volume and has a predetermined duration, the information storage / retrieval device 400 cuts out based on the duration. At this time, the audio information corresponding to one utterance and the video information input from the camera are transferred from the conference moderator 10-0 to the data terminal 15-
The same link information is added and stored together with the text information input using 0.

When the conference is over, the conference moderator 10-0
Creates minutes and materials related to the conference on the basis of the text information input by memo using the data terminal 15-0. Here, if the content of the agenda cannot be recalled from the text information entered in the memo, the content having the same link information (voice information, video information) is searched from the stored information of the information storage / retrieval device 400 to confirm the content. I do.

Since the text information memo-inputted using the data terminal 15-0 may be input later or earlier than the utterance, the information storage / retrieval apparatus 100 may make a utterance. It has a function of searching backward in time and a function of searching in time.

The meeting moderator 10-0 creates the minutes and materials based on the text information entered in the memo, and then
Again, the data is stored in the information storage / retrieval device 400 by using the data terminal 15-0. At that time as well, the statement is selected and the link information is added to the minutes and materials. Here, it is also possible to add link information different from the text information input as a memo to the selected utterance (audio information, video information).

As a result, even when the conference participants confirm the contents of the proceedings, it becomes possible to retrieve the voice information and the video information in the same manner, and the work of preparing the proceedings and confirming the proceedings can be improved.

Further, in the above description, the configuration is such that the speech of the conference participant is automatically specified based on the volume and duration of the voice information input from each participant. It may be configured to specify the utterance of the conference participant by the instruction using the data terminal 15-0 and add the link information.

Further, in the above-mentioned embodiment, since the microphones are provided for the respective conference participants, if the microphones are associated with the conference participants at the start of the conference, the name of the speaker can be obtained. Can be stored in the information storage / search device 400 as information.

FIG. 7 shows the communication terminal 200-0 shown in FIG.
2 shows a detailed configuration of. In FIG. 7, the communication terminal 200-0 includes a voice processing unit 201 and a video processing unit 20.
2, data processing unit 203, control unit 204, communication processing unit 2
It is configured by including 05.

Here, the voice processing unit 201 is connected to the speaker 13-0 and the microphone 14-0 shown in FIG. 6, and outputs the voice input from the microphone 14-0 to the communication processing unit 205 as voice information. Processing and processing of outputting voice information from the communication processing unit 205 as voice from the speaker 13-0 is performed.

Further, the voice processing unit 201 detects the volume level of the voice input from the microphone 14-0 and the period of time equal to or higher than a certain volume level to detect the utterance of the chairperson of the conference, and the control unit outputs the detection result. Notify 204.

The image processing unit 202 converts the image input from the camera 12-0 into a digital signal (image information) and outputs the digital signal to the communication processing unit 205, and at the same time, outputs the image output from the communication processing unit 205. Information is added to the monitor 11-0 corresponding to the moderator and output as a video.

In the data processing unit 203, the conference moderator is shown in FIG.
The text information input using the data terminal 15-0 shown in FIG. 6 is output to the communication processing unit 205, and the text information from the communication processing unit 205 is output to the data terminal 15-0 shown in FIG. Perform processing to

The control unit 204 controls the communication processing unit 205 in response to the speaker notification from the audio processing unit 201, and the audio information output from the audio processing unit 201 and the video information output from the video processing unit 202. The net 300 shown in FIG.
Process to send to.

Further, the communication processing unit 205 outputs the voice information received from the network 300 to the voice processing unit 201, and the network 30
The video information received from 0 is output to the video processing unit 202,
The data processing unit 20 receives the text information received from the network 300.
Output to 3.

Although the detailed configuration of the communication terminal 200-0 corresponding to the conference moderator 10-0 is shown in FIG. 7, each conference participant 10-1, 10-2, 10-3, 10-. 4 is
From the communication terminal 200-0 shown in FIG. 7 to the data processing unit 20
With the exception of the configuration of FIG. 3, the other configurations are the same as those shown in FIG.

FIG. 8 shows a detailed structure of the information storage / retrieval apparatus 400 shown in FIG. In FIG.
The information storage / retrieval device 400 includes a control unit 401, a storage / retrieval unit 402, and a communication processing unit 403.

Here, the control unit 401 controls the communication processing unit 40.
The storage / retrieval unit 4 with the same link information added to the audio information, the video information, and the text information from the network 300 received in 3
The storage / retrieval unit 402 is instructed to store the data in 02.

When the conference moderator 10-0 notifies the control unit 401 of the search instruction via the communication processing unit 403, the control unit 401 sends the corresponding audio information, video information, and text information. The accumulation / retrieval unit 402 gives a retrieval instruction to the accumulation / retrieval unit 402.

The accumulation / retrieval unit 402 executes a process for retrieving the corresponding voice information, video information, and text information in response to this instruction, and the retrieved voice information, video information, and text information are processed by the communication processing unit. Output to 403.

The communication processing unit 403 outputs the voice information, the video information and the text information from the network 300 to the storage / retrieval unit 402, and the voice information, the video information and the text information output from the storage / retrieval unit 402. Is transmitted to the network 300.

[0083]

As described above, according to the present invention,
The speech of the conference participant is detected from the volume and the duration of the voice information input by the multimedia information input / output means, and the text information related to the speech of the conference participant input by the moderator is detected to participate in the conference. The multimedia information input by the person in charge is stored in the multimedia information storage means with the same link information as the text information input by the moderator, and then stored by the conference participants based on the above text information. Since the multimedia information is retrieved by the multimedia information retrieval means and output from the multimedia information input / output means, the retrieval and editing at the time of reprocessing to create the minutes or materials after the conference can be easily performed. There is an effect that it can be performed.

[Brief description of drawings]

FIG. 1 is a block diagram showing an embodiment of the overall configuration of a multimedia conference device according to the present invention.

FIG. 2 is a block diagram showing a detailed configuration of the information storage / retrieval device shown in FIG.

FIG. 3 is a diagram showing an example of an information format in a storage / retrieval unit shown in FIG.

FIG. 4 is a block diagram showing another configuration of the information storage / retrieval device shown in FIG.

5 is a block diagram showing still another configuration of the information storage / retrieval device shown in FIG.

FIG. 6 is a block diagram showing another embodiment of the multimedia conferencing apparatus of the present invention configured to perform a teleconference service using a network such as a public telephone network.

7 is a block diagram showing a detailed configuration of the communication terminal shown in FIG.

8 is a block diagram showing a detailed configuration of the information storage / retrieval device shown in FIG.

[Explanation of Codes] 10-0 Conference moderator 10-1, 10-2, 10-3, 10-4 Conference participant 11-1, 11-2, 11-3, 11-4, 11-0
Monitor 12-1, 12-2, 12-3, 12-4, 12-0
Cameras 13-1, 13-2, 13-3, 13-4, 13-0
Speakers 14-1, 14-2, 14-3, 14-4, 14-0
Microphone 100 Information storage / search device 101 Control unit 102 Storage / search unit 103 Selection / distribution unit 104-1, 104-2, 104-3, 104-4, 1
04-0 Audio processing unit 105-1, 105-2, 105-3, 105-4, 1
05-0 video processing unit 106-0 data processing unit 131 text control area 132 voice control area 133 video control area 107 voice / text conversion dictionary 108 personal authentication dictionary 200-1, 200-2, 200-3, 200-4, Two
00-0 communication terminal 300 network 400 information storage / search device 201 audio processing unit 202 video processing unit 203 data processing unit 204 control unit 205 communication processing unit 401 control unit 402 storage / search unit 403 communication processing unit

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁶ Identification number Internal reference number for FI Technical indication H04L 12/18 H04M 3/56 Z (72) Inventor Toshihiko Wakahara 1-1-1, Uchisaiwaicho, Chiyoda-ku, Tokyo No. 6 Nippon Telegraph and Telephone Corp. (72) Inventor Moto Sato 1-1-6 Uchisaiwaicho, Chiyoda-ku, Tokyo Nihon Telegraph and Telephone Corp.

Claims (7)

[Claims] 1. A multimedia conferencing apparatus for performing a conference communication between at least one moderator and a plurality of conference participants using multimedia information including audio information and video information, the moderator and the conference participant. A multimedia information input / output unit provided for each person, and detecting the utterance of the conference participant from the volume and duration of the voice information input by the multimedia information input / output unit, and by the moderator. Text information relating to the input of the conference participant input is detected, and the multimedia information input from the conference participant is stored together with the same link information as the text information input by the moderator. Multimedia information storage means, and multimedia information input from the conference participants based on the text information. A multimedia conferencing apparatus comprising: a multimedia information searching unit that searches and outputs from the multimedia information input / output unit. 2. A voice / voice that converts voice information input by the multimedia information input / output means into text information.
A text information conversion means is further provided, and the text information converted by the voice / text information conversion means is attached to the same link information as the link information and stored in the multimedia information storage means. Item 1. The multimedia conference device according to item 1. 3. The personal authentication means for specifying the conference participant who has spoken from the multimedia information input by the multimedia information input / output means, further comprising: The multimedia conference apparatus according to claim 1, wherein the multimedia information storage unit stores the same link information as the link information. 4. The multimedia conferencing apparatus according to claim 3, wherein the personal authentication unit identifies the conference participant who made the speech based on the characteristics of the voice information input by the multimedia information input / output unit. 5. The personal authentication means specifies the conference participant who has made a statement from the facial features of the conference participant based on the video information input by the multimedia information input / output means. Multimedia conferencing equipment. 6. The multimedia conference according to claim 1, wherein the multimedia information input / output unit, the multimedia information storage unit, and the multimedia information retrieval unit are connected to each other via a communication network. apparatus. 7. The multimedia information accumulating means, when detecting the speeches of a plurality of conference participants at the same time, adds different link information corresponding to each conference participant, and inputs from the conference participants. The multimedia conference apparatus according to claim 1, wherein the multimedia information is stored together with the text information input by the moderator.