JP2008124597A - Audio teleconference system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an audio teleconference system capable of dynamically changing speech communication partners. <P>SOLUTION: A management server 101 is stored with information of respective audio teleconference devices and individual information of respective users, and authenticates the respective users. A relay server 102 is a relay to connect the respective audio teleconference devices. When authenticating a user of an audio teleconference device, the management server 101 sets the audio teleconference device so as to be connected to the relay server 102. The user can specify a desired destination to which a speech is to be transmitted. When the user specifies the transmission destination, the relay server 102 specifies the audio teleconference device at the transmission destination that the user specifies and transmits an utterance speech to only the specified audio teleconference device. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an audio conference system, and more particularly to an audio conference system that can dynamically switch a call partner during a conference.

In recent years, a voice conference system that performs a voice conference (communication conference) at a plurality of points has become widespread. In the audio conference system, when a conference participant at each location speaks, audio is transmitted to all other locations. In this case, listeners at other points must determine who spoke from the characteristics of the voice. When a voice conference is performed at multiple points, it is difficult to specify a speaker. Accordingly, a communication terminal having a speaker notification function has been proposed (see, for example, Patent Document 1).
Japanese Patent Laid-Open No. 2006-1000096

  However, in the apparatus described in Patent Document 1, the content of a statement is transmitted to all points as described above. For example, in the case where a plurality of in-house persons and outside persons are in a meeting, there is a case where it is desired to temporarily consult only with in-house persons. The other party could not be switched.

  An object of the present invention is to provide an audio conference system capable of dynamically switching a call partner.

  The audio conference system according to the present invention is an audio conference system including a relay server and a plurality of audio conference apparatuses connected via the relay server, and the audio conference apparatus is a user of the audio conference apparatus. An authentication unit that authenticates a conference participant, a transmission / reception unit that transmits / receives information to / from the relay server, and a reception unit that receives an operation for designating a transmission destination of a message from the conference participant, wherein the relay server is connected Management table describing the conference participants authenticated by each voice conference device, and the voice information received from each voice conference device, and other voice conference devices described in the management table A transmission unit for transmitting to the relay server, wherein the transmission / reception unit of the audio conference apparatus transmits the designation information of the transmission destination of the message accepted by the reception unit to the relay server, When the transmission unit receives the designation information, the transmission unit refers to the management table, and receives the voice information received from the voice conference apparatus of the transmission destination described in the designation information and the voice conference apparatus that has received the designation information. The transmission destination selection process, which is a process for transmitting only to these voice conference apparatuses, is performed.

  In this configuration, the audio conference device includes an authentication unit that authenticates the conference participant. The relay server includes a management table for managing each audio conference device and authenticated conference participants. When the conference participant performs an operation of designating the transmission destination of the message, information indicating the transmission destination is transmitted to the relay server, and thereafter, the audio of the conference participant is transmitted only to the designated transmission destination. In addition, the voice of the designated transmission destination is transmitted only to the voice conference apparatus having the designated operation.

  According to the present invention, the transfer unit further receives the audio information received from the audio conference device of the transmission destination described in the designation information and the audio conference device that received the designation information in the transmission destination selection process. The voice volume is limited and transmitted to voice conference apparatuses other than these voice conference apparatuses.

  In this configuration, the relay server transmits the received audio information to the audio conference apparatus other than the designated transmission destination after limiting the volume.

  The present invention is further characterized in that the authentication unit authenticates a conference participant by biometric authentication.

  In this configuration, meeting participants are authenticated using biometric information such as fingerprints, voiceprints, and veins.

  In the present invention, the authentication unit further includes a reading unit that reads a recording medium in which a voice feature amount of the conference participant is recorded, and a voice analysis unit that extracts the voice feature amount of the conference participant, and the reading unit The conference participant is authenticated by comparing the voice feature value read from the recording medium with the voice feature value extracted by the voice analysis unit.

  In this configuration, a recording medium (for example, an IC card) that stores the audio feature amount of the conference participant is created in advance, and when the conference participant sets the IC card in the audio conference device, the audio feature amount is read out. The audio conference apparatus extracts the audio feature amount from the speech of the conference participant and authenticates the conference participant by comparing with the audio feature amount read from the IC card.

  The present invention is further characterized in that the accepting unit accepts an operation for designating a transmission destination by voice recognition.

  In this configuration, an operation for designating a transmission destination by voice recognition is accepted. For example, when a conference participant speaks the personal name or the like of another conference participant, the content of the speech is recognized and transmitted to the relay server as information indicating the transmission destination.

  According to the present invention, since the other party can be switched dynamically, for example, when a person in the company and a person outside the company are in a meeting, it is desired to temporarily consult only with the person in the company. It is suitable for cases.

  With reference to the drawings, a voice conference system according to an embodiment of the present invention will be described. FIG. 1 is a block diagram of an audio conference system according to this embodiment.

  The voice conference system includes a management server 101, a relay server 102, a voice conference device 111A, a voice conference device 111B, and a voice conference device 111C connected via the network 100.

  The management server 101 manages voice conference apparatuses connected to the network 100 and users of the voice conference apparatuses. The management server 101 stores information on each audio conference device and personal information of each user, and authenticates each user. The relay server 102 is a relay machine that connects the audio conference apparatuses, and connects the audio conference apparatuses by SSL communication. Each audio conference apparatus is connected via the relay server 102. When the user of the audio conference apparatus is authenticated, the management server 101 is set to connect the audio conference apparatus to the relay server 102.

FIG. 2 is a block diagram of the audio conference apparatus 111A. Note that the audio conference apparatus 111A, the audio conference apparatus 111B, and the audio conference apparatus 111C all have the same configuration and function.
The audio conference apparatus 111A includes a microphone 11, an amplifier 12, an A / D converter 13, a communication unit 14, a control unit 15, a display unit 16, a card reader / writer 17, an operation unit 18, a D / A converter 19, an amplifier 20, and A speaker 21 is provided.

The microphone 11 collects sound around the audio conference apparatus 111A.
The amplifier 12 amplifies the audio signal collected by the microphone 11.
The A / D converter 13 converts the analog audio signal amplified by the amplifier 12 into a digital format.

  The communication unit 14 has a network interface and connects the audio conference apparatus 111A to another apparatus via the network 100. In the present embodiment, the communication unit 14 is connected to the other audio conference apparatuses 111B and 111C via the network 100 and the relay server 102, and transmits and receives audio information. The communication unit 14 converts the audio signal input from the A / D converter 13 into audio information suitable for transmission / reception on the network, and transmits the audio information to another device. Also, audio information received from another device is converted into a digital audio signal and output to the D / A converter 19.

The D / A converter 19 converts a digital audio signal into an analog format.
The amplifier 20 amplifies the analog audio signal converted by the D / A converter 19.

The speaker 21 emits the audio signal amplified by the amplifier 20.
As described above, the audio conference apparatus 111A collects and transmits the utterance voice of the user of the own apparatus to the other apparatus, and receives and emits the utterance voice of the other apparatus.

The control unit 15 comprehensively controls the audio conference apparatus 111A. In addition, the voice analysis unit 151 and the comparison unit 152 are functionally realized.
The voice analysis unit 151 analyzes the voice signal input from the A / D converter 13 and extracts a voice feature amount (voice print). In addition, the voice analysis unit 151 performs voice recognition (extraction of speech content).
The comparison unit 152 inputs the voice feature amount extracted by the voice analysis unit 151 and registered information (including voice feature amount and personal information) described later from the card reader / writer 17 and compares them.

  The display unit 16 is composed of an LCD, and displays information on the connected audio conference device, personal information of the user, and the like during the conference.

  The operation unit 18 is a user interface for a user to perform an operation, and includes, for example, a plurality of push buttons and the like installed on the casing of the audio conference apparatus.

  The card reader / writer 17 records information on the IC card 50 and reads information recorded on the IC card 50. The IC card 50 stores the user's voice feature amount and personal information. The user registers the voice feature amount and personal information in the management server 101 in advance and issues an IC card 50.

  FIG. 3 is a diagram illustrating an example of registration and authentication. FIG. 2A is a diagram showing user registration and IC card 50 issuance. The user transmits a voice feature amount and personal information to the management server 101. The personal information is input from a registration terminal (not shown) connected to the management server 101. The voice feature amount is extracted from the voice inputted by the registration terminal (or the management server 101) by inputting its own voice from a microphone provided in the registration terminal. The management server 101 registers the received personal information and records it in association with the audio feature amount. The management server 101 issues a user ID and records the personal information and the voice feature amount on the IC card 50 as registered information.

  FIG. 5B is a diagram showing an example of user authentication. The user places the IC card 50 in the card reader / writer 17 of the audio conference apparatus 111A and speaks. The card reader / writer 17 reads the registered information recorded on the IC card 50 and inputs it to the comparison unit 152. The voice analysis unit 151 extracts a voice feature amount from a voice signal generated by the user's utterance and inputs the voice feature amount to the comparison unit 152. The comparison unit 152 compares the speech feature amount input from the speech analysis unit 151 with the speech feature amount included in the registered information input from the card reader / writer 17. When the comparison unit 152 determines that the compared audio feature amounts match (or approximate), the comparison unit 152 transmits the personal information included in the registered information to the management server 101. As a result, authentication is performed by the management server 101, and the audio conference apparatus 111A is connected to the relay server 102. The same operation is performed in the audio conference apparatus 111B and the audio conference apparatus 111C, and all the audio conference apparatuses are connected via the relay server 102.

  In the present invention, the management server 101 is not an essential component. When the comparison unit 152 determines that the compared audio feature amounts match (or approximate), the comparison unit 152 transmits the personal information included in the registered information to the relay server 102, and the relay server that has received the personal information includes the audio conference. The device 111A may be connected. The same operation is performed in the audio conference apparatus 111B and the audio conference apparatus 111C, and all the audio conference apparatuses are connected via the relay server 102.

  The relay server 102 has a management table for managing the connected audio conference device and each user during the conference. FIG. 4 is a diagram showing a management table. As shown in the figure, the relay server 102 records the name (IP address, unique name, etc.), user ID, personal name, department name, etc. of each audio conference device. These pieces of information are received from the management server 101. When the management server 101 is not used, these pieces of information are received from each audio conference device.

  The relay server 102 transmits information (IP address, unique name, etc.) of all connected audio conference apparatuses to the audio conference apparatus 111A, the audio conference apparatus 111B, and the audio conference apparatus 111C. Thereby, the information of the connected audio conference apparatus is displayed on the display unit 16 of each audio conference apparatus.

  Note that the relay server 102 may transmit user personal information (for example, name, department name, etc.) of each audio conference device to the audio conference device 111A, the audio conference device 111B, and the audio conference device 111C. In this case, the personal information of the connected user is displayed in each audio conference device.

Further, personal information may be displayed only when each user speaks as follows.
When the user speaks, the communication unit 14 of the audio conference apparatus 111 </ b> A transmits audio information to the relay server 102. At the same time, the voice analysis unit 151 extracts a voice feature amount from a voice signal generated by the user's utterance and inputs the voice feature amount to the comparison unit 152. The comparison unit 152 compares the speech feature amount input from the speech analysis unit 151 with the speech feature amount included in the registered information input from the card reader / writer 17. When the comparison unit 152 determines that the compared audio feature amounts match, the comparison unit 152 transmits the personal information included in the registered information to the relay server 102. The relay server 102 transmits the personal information together with the received audio information to other devices (the audio conference device 111B and the audio conference device 111C). The audio conference device 111B and the control unit 15 of the audio conference device 111C receive the audio information and the personal information from the relay server 102, emit the audio, and display the personal information on the display unit 16.

  Note that the comparison unit 152 compares the audio feature amount input from the audio analysis unit 151 with the audio feature amount included in the registered information input from the card reader / writer 17, and as a result, the audio feature amount matches. When it is determined not to do so, the control unit 15 displays a warning on the display unit 16, transmits error information to the relay server 102, and prevents the relay server 102 from transmitting voice information. In addition, the control unit 15 may be set not to transmit voice information to the communication unit 14.

Next, the transmission destination selection operation of the audio conference system will be described. This voice conference system can dynamically switch the connection of each voice conference apparatus 111.
FIG. 5 is a diagram showing the destination selection operation of the audio conference system. In the figure, the user 1A exists at the point a where the audio conference device 111A is installed, the user 1B and the user 1C exist at the point b where the audio conference device 111B is installed, and the audio conference device 111C is installed. The user 1D exists at the point c.

  Users 1 </ b> A to 1 </ b> D of each audio conference device 111 can freely select a transmission destination of the audio spoken by themselves. That is, it can be set so that voice information is transmitted only to a specific user and voice information is not transmitted to other users. FIG. 6A shows an example in which voices spoken by the user 1B and the user 1C are transmitted to the audio conference apparatus 111A and the audio conference apparatus 111C. In FIG. The example which the audio | voice which 1C uttered is transmitted only to the audio conference apparatus 111A is shown.

  When the user authentication shown in FIG. 3B is performed, the relay server 102 connects the audio conference device 111A, the audio conference device 111B, and the audio conference device 111C, and starts an audio conference. On the display unit 16 of each audio conference device, information (for example, an IP address) of the connected audio conference device is displayed. In addition, personal information (for example, name, department name, etc.) of the connected user is displayed.

  When each audio conference device is first connected, the audio information collected by each audio conference device is transmitted to all audio conference devices. That is, as shown in FIG. 5A, the voices spoken by the user 1B and the user 1C of the audio conference apparatus 111B are transmitted to the audio conference apparatus 111A and the audio conference apparatus 111C.

  During the meeting, the user 1B and the user 1C can see the display device 16 of the audio conference apparatus 111B and know the apparatus and user of the other party that is currently conducting the audio conference. Here, when the user 1B or the user 1C wants to temporarily hold the audio conference only with the user 1A during the conference, the operation unit 18 is used to set the audio to be transmitted only to the audio conference apparatus 111A. For example, the IP address and unique name of the audio conference apparatus 111A may be designated.

  When the user 1B or the user 1C uses the operation unit 18 to set to transmit audio only to the audio conference apparatus 111A, the audio conference apparatus 111B connects the relay server 102 with the audio conference apparatus 111A specified. Send specified information. When the relay server 102 receives the connection destination designation information, the relay server 102 thereafter transmits the audio information received from the audio conference apparatus 111B only to the audio conference apparatus 111A. Also, the audio information received from the audio conference apparatus 111A is transmitted only to the audio conference apparatus 111B. The audio information received from the audio conference apparatus 111C is transmitted to the audio conference apparatus 111A and the audio conference apparatus 111B, but may be discarded without being transmitted.

  For example, when the user 1A, the user 1B, and the user 1C are people of the same company (Company A) and only the user 1D is a person of another company (Company B), the confidential information of the Company A is used as the user 1A and the user 1B. , And a situation where the user 1C wants to have a conversation temporarily. The transmission destination selection operation of this embodiment is suitable for such a situation.

  Each user can also set the destination of voice information by designating a user who is conducting a voice conference instead of a voice conference device. The user 1B or the user 1C looks at the display unit 16 of the audio conference apparatus 111B and sets to transmit the audio only to the user 1A. For example, the name of the user 1A may be specified.

  When the user 1B or the user 1C uses the operation unit 18 to set to transmit audio only to the user 1A, the audio conference apparatus 111B transmits connection destination designation information designating the user 1A to the relay server 102. To do. The relay server 102 refers to the management table shown in FIG. 4 and sets the audio information to be transmitted only to the voice conference device of the user 1A, that is, the voice conference device 111A. Thereafter, the relay server 102 transmits the audio information received from the audio conference apparatus 111B only to the audio conference apparatus 111A. Also, the audio information received from the audio conference apparatus 111A is transmitted only to the audio conference apparatus 111B. The audio information received from the audio conference apparatus 111C may be transmitted to the audio conference apparatus 111A and the audio conference apparatus 111B, or may be discarded without being transmitted.

  In the above description, the example in which the user selects the transmission destination using the operation unit 18 has been described. However, the voice analysis unit 151 can also specify the transmission destination by voice by extracting the content of the utterance. For example, when the user 1 B speaks “transmission selection, Mr. 1A”, the voice analysis unit 151 performs voice recognition and transmits connection destination designation information designating the user 1 A to the relay server 102. Similarly, for example, when the user 1C speaks “transmission selection, voice conference apparatus 111A”, the voice analysis unit 151 performs voice recognition and transmits connection destination designation information designating the voice conference apparatus 111A to the relay server 102. To do.

  Although an example in which the relay server 102 does not transmit audio information has been described, other than the designated audio conference apparatus, the audio may be muted (volume level lowered) and transmitted. That is, in the example of FIG. 5B, the relay server 102 transmits the audio information received from the audio conference apparatus 111B to the audio conference apparatus 111A and also transmits to the audio conference apparatus 111C. However, the audio information transmitted to the audio conference apparatus 111C is transmitted after the volume level is lowered. As a result, the user 1D of the audio conference apparatus 111C cannot hear the content of the statement, and the situation is the same as when the audio information is not transmitted.

  In the situation of FIG. 5B, the user 1B or the user 1C can resume the conversation with the user 1D at any time. The user 1 </ b> B or the user 1 </ b> C is set to cancel the transmission selection using the operation unit 18. When the user 1B or the user 1C uses the operation unit 18 to set to cancel the transmission selection, the audio conference apparatus 111B transmits the cancellation information to the relay server 102. When the relay server 102 receives the release information, the relay server 102 transmits the audio information received from the audio conference apparatus 111B to the audio conference apparatus 111A and the audio conference apparatus 111C.

  Further, the user 1B and the user 1C can be set to cancel the transmission selection by voice. For example, when the user 1B speaks “transmission selection cancellation”, the voice analysis unit 151 performs voice recognition and transmits the cancellation information to the relay server 102. When the relay server 102 receives the release information, the relay server 102 transmits the audio information received from the audio conference apparatus 111B to the audio conference apparatus 111A and the audio conference apparatus 111C.

  As described above, the voice conference system according to the present embodiment can dynamically switch the call partner. Each user can easily switch the connection destination without ending the conference if he / she wants to talk only with specific users temporarily.

  In this embodiment, an example in which each user is authenticated by recording a voice feature amount on an IC card and comparing it with a speech voice from the user has been described. However, by using other biological information (fingerprint, vein, etc.) Authentication may be performed.

  Further, the recording medium for recording the voice feature amount and other biological information is not limited to the IC card. For example, a magnetic card or a medium such as a CD-ROM may be used. A portable storage device (a so-called USB memory or the like) may be used. In this case, the card reader / writer 17 may be a reading unit corresponding to each recording medium (a CD-ROM drive if the recording medium is a CD-ROM).

It is a block diagram which shows the structure of an audio conference system. It is a block diagram which shows the structure of an audio conference apparatus. It is a figure which shows the example of registration and authentication. It is a figure which shows a management table. It is a figure shown about the transmission destination selection operation | movement of an audio conference system.

Explanation of symbols

11-microphone 12-amplifier 13-A / D converter 14-communication unit 15-control unit 16-display unit 17-card reader / writer 18-operation unit 19-D / A converter 20-amplifier 21-speaker

Claims (5)

An audio conference system comprising a relay server and a plurality of audio conference apparatuses connected via the relay server,
The voice conference device
An authentication unit for authenticating a conference participant who is a user of the audio conference device;
A transmission / reception unit for transmitting / receiving information to / from the relay server;
A reception unit that accepts an operation for specifying a destination of a message from a conference participant;
With
The relay server is
A management table that describes the connected audio conference devices and conference participants authenticated by each audio conference device;
A transfer unit that transmits audio information received from each audio conference device to another audio conference device described in the management table;
The transmission / reception unit of the voice conference device transmits the designation information of the transmission destination of the message received by the reception unit to the relay server,
When the forwarding information of the relay server receives the designation information, the forwarding unit refers to the management table from the destination audio conference device described in the designation information and the voice conference device that has received the designation information. An audio conference system that performs a destination selection process that is a process of transmitting received audio information only to these audio conference apparatuses.   In the transmission destination selection process, the transfer unit receives the audio information received from the audio conference device of the transmission destination described in the designation information and the audio conference device that received the designation information, other than these audio conference devices. The audio conference system according to claim 1, wherein the audio conferencing apparatus transmits the audio with limited volume.   The voice conference system according to claim 1, wherein the authentication unit authenticates a conference participant by biometric authentication. The authentication unit is a reading unit that reads a recording medium that records audio feature amounts of conference participants;
A voice analysis unit that extracts voice features of conference participants,
The audio conference system according to claim 3, wherein the conference participant is authenticated by comparing the audio feature amount read from the recording medium by the reading unit and the audio feature amount extracted by the audio analysis unit.   The voice conference system according to claim 1, wherein the reception unit receives an operation for designating a transmission destination by voice recognition.

Images