JP2006246239A - System for processing speech signal of a plurality of loudspeakers, terminal device, server device, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide means for easily enabling realization of conversation only among special loudspeakers in a system for pronouncing, after combining speech sounds of a plurality of speakers. <P>SOLUTION: In a normal mode in which a handset 33 is mounted on a stand 34, a voice signal of a user 39 produced by a hands free set 32 is transmitted to the other terminal device 31 via a terminal device 31 and a server device 32. The voice signal of the user 39, produced by the hand set 33 is, however, transmitted to the other terminal device 31 via the terminal device 31 and the server device 32, in a hot line mode, in which the handset 33 is not mounted on the stand 34. In this case, the speech signal performed not to transmit speech of the user 39 to a listener is transmitted to the terminal device 31 which is not in the hot-line mode, while the server device 32 transmits the speech signal which is not subjected to any processing on the terminal device 31 which is in the hot-line mode. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an audio signal processing technique that enables a voice call between a plurality of speakers in different places.

There is a technology that enables a plurality of persons at locations away from each other to hold an audio conference using an acoustic device connected to a communication line. In the technology, a speaker's voice signal collected by each of the acoustic devices arranged at different locations is transmitted to the central device, mixed by the central device, and then transmitted to each acoustic device. As a document disclosing such a prior art, there is, for example, Patent Document 1.
Japanese Patent Laid-Open No. 11-127499

  By the way, there is a case where it is desired to have a conversation with a specific person during an audio conference. For example, in a company meeting where members of multiple departments participate, if you want to adjust opinions between members of the same department, the conversation during the opinion adjustment is heard by members of other departments participating in the audio conference That is not preferable.

  For example, in the case of the prior art disclosed in Patent Document 1, a person who wants to make a call with another member of the same department during an audio conference should respond by calling the member using a normal telephone. Can do. However, in that case, there is a problem that a conversation using a telephone is collected by a microphone of an audio device used for the audio conference, and may be heard by members of other departments participating in the audio conference. .

  In view of the above situation, an object of the present invention is to provide means for enabling a voice call between specific speakers to be realized safely and easily in a system that enables a voice call between a plurality of speakers. .

  In order to achieve the above object, the present invention relates to a plurality of terminal devices, and a first call device and a second communication device for inputting / outputting audio signals to / from the terminal devices. A communication device, an overall mixer that mixes audio signals received from each of the plurality of terminal devices and outputs the mixed signals to each of the plurality of terminal devices, and two or more specific terminal devices included in the plurality of terminal devices. An audio conferencing system comprising: one or more group mixers that mix the audio signals received from each of the two and output to each of the two or more specific terminal devices; First sounding means for converting sound into sound and sounding, and first sound collecting means for collecting the sound of the speaker, converting it into a sound signal, and outputting the sound signal. Change the audio signal A second sound generating means for generating sound and a second sound collecting means for collecting and converting a speaker's voice into a voice signal and outputting the same in the same housing, the second sound generating means and the second sound generating means. Each of the plurality of terminal devices is in a normal mode and a hot line mode, and is arranged in the housing so that the sound collecting means is located at the mouth and ear of the speaker. A selection means for selecting any one of the audio signals output from the overall mixer when the normal mode is selected by the selection means and the first sound collection means; If the connection between the first call device and the general mixer is configured to input the audio signal output from the general mixer, and the hotline mode is selected by the selection means, the group The second call device, the group mixer, and the like so that the audio signal output from the mixer is input to the second sounding means and the audio signal output from the second sound collecting means is input to the group mixer. And the first call device and the audio signal so that the audio signal output from the first sound collecting unit and the second sound collecting unit is not output to the overall mixer. There is provided a system comprising switching means for configuring a connection between each of the second call devices and the whole mixer.

  According to the voice conference system having such a configuration, the user can easily switch between the voice call with the unspecified party and the voice call with the specified party, and the user can perform the voice call with the specified party. Is not transmitted to a person other than the specific partner, and the confidentiality of the user's voice call is maintained.

  The present invention also provides an overall mixer that mixes audio signals received from each of a plurality of terminal devices and outputs the mixed signals to each of the plurality of terminal devices, and two or more specific terminal devices included in the plurality of terminal devices. A group mixer that mixes the audio signal received from each of the two and outputs the mixed audio signal to each of the two or more specific terminal devices, first sound generation means that converts the input audio signal into sound and produces the sound, and the speaker's voice A first call device comprising first sound collecting means for collecting and converting the sound signal into a voice signal, and second sounding means for converting the inputted voice signal into a sound and generating the sound and the voice of the speaker And a second sound collecting means for collecting and converting the sound into a voice signal and outputting the same in the same housing, and the second sound generating means and the second sound collecting means are respectively located at the mouth and the ear of the speaker. Arranged in the housing to A terminal device for inputting / outputting a voice signal to / from each of the handset-type second telephones, a selection unit for selecting either a normal mode or a hotline mode, and the selection unit When the normal mode is selected, the audio signal output from the overall mixer is input to the first sound generation means, and the audio signal output from the first sound collection means is input to the overall mixer. And when the hot line mode is selected by the selection means, an audio signal output from the group mixer is sent to the second sound generation means. When the connection between the second call device and the group mixer is configured to input the audio signal output from the second sound collecting means to the group mixer. Each of the first call device and the second call device prevents the audio signal output from the first sound collecting means and the second sound collecting means from being output to the overall mixer. And a switching unit that configures a connection between the mixer and the whole mixer.

  According to the terminal device having such a configuration, the above audio conference system can be realized using a general audio signal mixer and a communication device.

  In a preferred aspect, the terminal device further includes processing means for performing processing for missing or concealing a part of information included in the audio signal, and the switching means has the hot line mode selected by the selection means. In this case, the first communication device is configured such that an audio signal output from at least one of the first sound collection unit and the second sound collection unit is output to the overall mixer through processing by the processing unit. The processing means may be interposed between at least one of the second communication devices and the overall mixer.

  According to the terminal device of this aspect, since the user's voice is processed and transmitted to a person other than the specific partner during the voice call with the specific partner, the confidentiality of the user's voice call is maintained. At the same time, it is convenient because it is transmitted to a person other than the specific partner that some voice call is being made by the user.

  In another preferable aspect, the terminal device further includes processing means for performing processing for missing or concealing a part of information included in the audio signal, and the switching means selects the hot line mode by the selection means. If so, the overall mixer and the first sound output so that the audio signal received from the overall mixer is output to at least one of the first sounding means and the second sounding means after being processed by the processing means. The processing means may be interposed between at least one of the communication device and the second communication device.

  According to the terminal device of this aspect, since the voice of a person other than the specific partner is transmitted to the user during the voice call with the specific partner, the user makes a voice call with the specific partner. At the same time, it is convenient to know that a call is being made by a person other than the specific partner.

  The present invention also receives audio signal receiving means for receiving audio signals from each of a plurality of terminal devices, and mode selection data for instructing selection of either the normal mode or the hotline mode from one terminal device. When the mode selection data receiving means and the mode selection data receiving means receive the mode selection data instructing the selection of the normal mode, the voice signal received by the voice signal receiving means from the one terminal device is the plurality of terminals. When the mode selection data receiving means receives the mode selection data instructing selection of the hotline mode, the voice signal transmitting means receives the voice signal receiving means from the one terminal device. Voice signal transmitting means for transmitting the voice signal thus transmitted only to a specific terminal device included in the plurality of terminal devices. To provide over server equipment.

  According to the server device of this aspect, the user of the terminal device can easily switch between the voice call with the unspecified partner and the voice call with the specified partner only by transmitting the mode selection data. During the voice call with the other party, the user's voice is not transmitted to a person other than the specific party, and the confidentiality of the user's voice call is maintained.

  In a preferred aspect, the server device further includes processing means for performing processing for missing or concealing part of information included in the audio signal, and the mode selection data receiving means instructs mode selection to instruct selection of the hotline mode. When data is received, the processing means processes the voice signal received by the voice signal receiving means from the one terminal device, and the voice signal transmitting means sends the voice signal processed by the processing means. May be transmitted to a terminal device other than the specific terminal device.

  According to the server device of this aspect, since the user's voice is processed and then transmitted to a person other than the specific partner while the user of the terminal device is performing the voice call with the specific partner, the user's voice call This is convenient because the confidentiality of the user is maintained, and that a voice call by the user is transmitted to a person other than the specific partner.

  In another preferred embodiment, the server device further includes processing means for performing processing for missing or concealing part of information included in the audio signal, and the mode selection data receiving means instructs selection of the hot line mode. When receiving the mode selection data, the processing means processes the voice signal received from the terminal device other than the specific terminal device by the voice signal receiving means, and the voice signal transmitting means is processed by the processing means. May be configured to transmit the audio signal subjected to the above to the one terminal device.

  According to the server device of this aspect, while the user of the terminal device is performing a voice call with a specific partner, the voice of a person other than the specific partner is transmitted to the user in a processed state. Conveniently, it is possible to know that a call is being made by a person other than the specific party while making a voice call with the other party.

  The present invention further includes first sound generation means for converting an input sound signal into sound and generating the sound, and first sound collection means for collecting the sound of the speaker, converting the sound into a sound signal, and outputting the sound signal. 1 telephone apparatus and the second sound generating means for converting the input sound signal into sound and generating the sound and the second sound collecting means for collecting the sound of the speaker, converting it into a sound signal and outputting it. A handset-type second call device provided in the body and disposed in the housing such that the second sound generation means and the second sound collection means are located at the mouth and ear of the speaker, respectively. A terminal device for inputting / outputting audio signals to / from each of them, a selection unit for selecting either a normal mode or a hotline mode, and when the normal mode is selected by the selection unit, Send mode selection data instructing selection to the server When the hot line mode is selected by the selecting means, the mode selection data transmitting means for transmitting the mode selection data instructing selection of the hot line mode to the server device, and the normal mode is selected by the selecting means. The voice signal received from the first sound collecting unit is transmitted to the server device, and when the hot line mode is selected by the selecting unit, the voice received from the sound collecting unit of the second call device An audio signal transmitting means for transmitting a signal to the server apparatus; and an audio signal received from the server apparatus, and when the normal mode is selected by the selecting means, the received audio signal is sounded by the first call apparatus And when the hot line mode is selected by the selection means, the received voice signal is transmitted to the second call. Providing a terminal device, comprising an audio signal receiving means for outputting a sound generator location.

  According to the terminal device of this aspect, the user can easily switch between the voice call with the unspecified party and the voice call with the specified party through the server device only by transmitting the mode selection data. .

  The present invention further includes first sound generation means for converting an input sound signal into sound and generating the sound, and first sound collection means for collecting the sound of the speaker, converting the sound into a sound signal, and outputting the sound signal. 1 telephone apparatus and the second sound generating means for converting the input sound signal into sound and generating the sound and the second sound collecting means for collecting the sound of the speaker, converting it into a sound signal and outputting it. A handset-type second call device provided in the body and disposed in the housing such that the second sound generation means and the second sound collection means are located at the mouth and ear of the speaker, respectively. A terminal device for inputting / outputting audio signals to / from each of the first and second selection units for selecting either a normal mode or a hotline mode; and when the normal mode is selected by the selection unit, The audio signal received from the sound collecting means of the other terminal devices When the hot line mode is selected by the selection means, the audio signal received from the second sound collection means is transmitted only to a specific terminal device included in the other terminal devices. When the audio signal is received from the audio signal transmitting unit and one or more terminal devices included in the other terminal devices, and the normal mode is selected by the selecting unit, the received audio signal is A terminal apparatus comprising: an audio signal receiving unit that outputs to a sounding unit and outputs a received audio signal to the second sounding unit when the hotline mode is selected by the selecting unit To do.

  According to the terminal device of this aspect, the user can easily switch between the voice call with the unspecified partner and the voice call with the specified partner only by transmitting the mode selection data without going through the server device. In addition, the voice of the user is not transmitted to a person other than the specific partner during the voice call with the specific partner, and the confidentiality of the voice call of the user is maintained.

  In a preferred aspect, the terminal device further includes processing means for performing processing for missing or concealing part of information included in the audio signal, and when the hot line mode is selected by the selection means, the processing means Performs processing on an audio signal output from at least one of the first sound collecting means and the second sound collecting means, and the sound signal transmitting means outputs the sound signal processed by the processing means. You may comprise so that it may transmit to terminal devices other than the said specific terminal device.

  According to the terminal device of this aspect, since the user's voice is processed and transmitted to a person other than the specific partner while the user is performing the voice call with the specific partner, the confidentiality of the user's voice call is Is maintained, and it is convenient for the user to communicate that a voice call is being made to a person other than the specific partner.

  In another preferable aspect, the terminal device further includes processing means for performing processing for missing or concealing part of information included in the audio signal, and when the hotline mode is selected by the selection means, The audio signal receiving means outputs the audio signal received from the terminal device other than the specific terminal device to the processing means instead of outputting to the second sounding means, and the processing means receives the audio signal from the audio signal receiving means. After the output audio signal is processed, the processed audio signal may be output to the second sound generation unit.

  According to the terminal device of this aspect, since the voice of a person other than the specific partner is transmitted to the user while the user is making a voice call with the specific partner, Conveniently, it is possible to know that a call is being made by a person other than a specific party at the same time as the voice call.

  Moreover, in another preferable aspect, the server device or the terminal device may further include a processing degree changing unit that changes a degree of processing by the processing unit.

  According to the server device or terminal device of this aspect, in the sound obtained by reproducing the processed sound signal, the degree of transmission of the linguistic meaning content included in the sound signal before processing is determined according to the listener's environment. It can be adjusted in advance as necessary, or sequentially as necessary.

  The terminal device further includes a stand on which the second call device is placed, and the selection unit is disposed on the stand, while the second call device is placed on the stand. May be configured to be a hook switch that selects the normal mode and selects the hotline mode while the second call device is not placed on the stand.

  According to the terminal device of this aspect, the user can easily switch between a voice call with an unspecified partner and a voice call with a specific partner by raising and lowering the handset-type call device.

  The present invention also provides a program characterized by causing a computer to execute the same processing as that performed by the terminal device or server device.

  According to such a program, the above terminal device or server device can be realized using a computer.

[1. First Embodiment]
[1.1. Configuration of audio conference system]
FIG. 1 is a block diagram showing the overall configuration of an audio conference system 1 according to the first embodiment of the present invention. In the audio conference system 1, n (n is a plurality) users 19-k (k = 1 to n, the same applies hereinafter) can participate in the audio conference using each terminal set 10-k. The terminal set 10-k has a configuration (described later) in which a telephone means (not shown) is connected to the terminal device 11-k. The overall mixer 12 is a device that provides the audio signal of the overall conference by the user 19-k to the terminal device 11-k included in each terminal set 10-k, and receives the audio signal received from each of the terminal devices 11-k. Mix and output to each of the terminal devices 11-k.

  Further, in the present embodiment, each of the users 19-k belongs to one of m groups (m is a plurality), and other users belonging to the same group and voices using the terminal device 11-k. Can hold group meetings. Each of the group mixers 13-j (j = 1 to m, the same applies hereinafter) provides the audio signals of the group conference held in the m groups to the terminal devices 11-k used by the users 19-k in the groups. Device. The group mixer 13-j corresponding to the group j mixes the audio signal received from each of the terminal devices 11-k used by the user 19-k belonging to the group j, and each of the terminal devices 11-k belonging to the group j. Output to.

The terminal device 11-k includes an overall output terminal 111, an overall input terminal 112, a group output terminal 113, and a group input terminal 114. The overall mixer 12 includes an input unit 121 including an input terminal 1211-k and an output unit 123 including an output terminal 1231-k. The group mixer 13-j includes an input unit 131 including an input terminal 1311-i (i = 1 to x _j , the same applies hereinafter) and an output unit 135 including an output terminal 1351-i. Here, x _j is the number of users 19-k belonging to the group j.

The input terminals and output terminals of the terminal device 11-k, the overall mixer 12 and the group mixer 13-j are connected by a cable capable of transmitting an audio signal. In FIG. 1, the terminal device 11-2 and the whole when the terminal device 11-2 belongs to the first group (a group corresponding to the group mixer 13-1, hereinafter referred to as “group 1”). The connection between the mixer 12 and the group mixer 13-1 is illustrated. Actually, all the terminal apparatuses 11-k are connected to either the whole mixer 12 or the group mixer 13-j according to the following rules.
(A) The overall output terminal 111 of the terminal device 11-k and the input terminal 1211-k of the overall mixer 12.
(B) The overall input terminal 112 of the terminal device 11-k and the output terminal 1231-k of the overall mixer 12.
(C) The group output terminal 113 of the terminal device 11-k and the input terminal 1311-i of the group mixer 13-j.
(D) The group input terminal 114 of the terminal device 11-k and the output terminal 1351-i of the group mixer 13-j.

  Here, instead of connecting a cable between the input terminal and the output terminal, connect a transmitter that can transmit audio signals by radio waves to the output terminal, and connect a receiver that can receive audio signals by radio waves to the input terminals By doing so, you may make it perform wireless connection between an input terminal and an output terminal.

  FIG. 2 is a block diagram showing the configuration of the terminal set 10-k. However, in FIG. 2, “−k” to be added to the reference numerals of the respective components is omitted, and “−k” is omitted in the following description when it is not necessary to distinguish each of the terminal sets 10. . The terminal set 10 has a configuration in which a hands-free set 14 and a handset 15 that are two-way communication means are connected to a terminal device 11. Both the hands-free set 14 and the handset 15 are communication means that allow the user 19 to make a call with a person in a different place, but the hands-free set 14 receives the voices of all persons in the space in which it is placed. The user 19 can talk with the other party without lifting the hands-free set 14 because the voice of the other party is pronounced at a volume that can be collected and heard by all persons in the space. On the other hand, the handset 15 is a handset-type calling means in which the user 19 lifts and makes a call. When the user 19 is in use, the microphone is positioned at the mouth of the user 19 and the speaker is positioned at the ear of the user 19. A microphone and a speaker are arranged in the body. The handset 15 mainly collects the voice of the user 19 who is using the handset 15, and produces the voice of the other party at a volume that can be heard only by the user 19.

  The hands-free set 14 is a drive amplifier 142 that amplifies the level of the audio signal input from the entire input terminal 112 of the terminal device 11 to a speaker level, and a speaker that converts the audio signal output from the drive amplifier 142 into sound and generates a sound. 143, a microphone 144 that collects the voice of the user 19 and converts it into an audio signal, a microphone amplifier 145 that amplifies the audio signal input from the microphone 144 to a line level, and a drive amplifier for the audio signal input from the microphone amplifier 145 An echo canceller 141 which is a circuit for reducing echo and howling by adding a delayed and inverted phase to the audio signal output to 142 is provided.

  The configuration of the handset 15 is the same as the configuration of the handsfree set 14. That is, the handset 15 includes an echo canceller 151, a drive amplifier 152, a speaker 153, a microphone 154, and a microphone amplifier 155. However, as described above, the speaker 153 and the microphone 154 of the handset 15 are arranged in the same casing so as to be positioned at the ear and the mouth of the user 19 when the user 19 is talking, respectively. Unlike the handsfree set 14 that is not accompanied, the volume level of the speaker 153 of the handset 15 is lower than the volume level of the speaker 143 of the handsfree set 14, and the sound collection sensitivity of the microphone 154 of the handset 15 is that of the microphone 144 of the handsfree set 14. Lower than the sound collection sensitivity.

  The terminal device 11 is a device that establishes and disconnects the connection between the overall mixer 12 and any of the group mixers 13, the hands-free set 14 and the handset 15, and includes the above-described overall output terminal 111, overall input terminal 112, In addition to the group output terminal 113 and the group input terminal 114, a switch 115 and a handset that selectively establish one of a connection between the group input terminal 114 and the notification unit 117 and a connection between the group input terminal 114 and the handset 15 When a connection request signal is received from the switch 116 and the group input terminal 114 which selectively establish either the connection between the terminal 15 and the group output terminal 113 or the connection between the hands-free set 14 and the overall output terminal 111. User 19 is requested to connect by blinking lamp And it includes a notification unit 117 for knowledge. The terminal device 11 has a shape that functions as a mounting table for the handset 15, and is a hook switch having a mechanism that moves down when the handset 15 is placed on the terminal device 11 and moves up when the handset 15 is lifted from the terminal device 11. 118 is provided.

  The switch 115 and the switch 116 are configured to operate in conjunction with the upper and lower sides of the hook switch 118. In a state where the hook switch 118 is lowered (hereinafter referred to as “on-hook state”), the switch 115 disconnects the group input terminal 114 and the handset 15 and disconnects the group input terminal 114 and the notification unit 117. Establish. In the on-hook state, the switch 116 disconnects the connection between the handset 15 and the group output terminal 113 and establishes the connection between the handsfree set 14 and the overall output terminal 111. On the other hand, when the hook switch 118 is raised (hereinafter referred to as “off-hook state”), the connection between the group input terminal 114 and the notification unit 117 is disconnected, and the switch 115 is connected between the group input terminal 114 and the handset 15. Establish a connection. In the off-hook state, the switch 116 disconnects the connection between the handsfree set 14 and the overall output terminal 111 and establishes the connection between the handset 15 and the group output terminal 113.

  FIG. 3 is a block diagram showing the configuration of the overall mixer 12. The overall mixer 12 includes a mixing unit 122 in addition to the input unit 121 and the output unit 123 described above. The mixing unit 122 adds the audio signal input from each of the terminal devices 11-k via each of the input terminals 1211-k included in the input unit 121, and then performs level adjustment to obtain a one-sequence audio signal. Mixing is performed, and the audio signal generated by the mixing is delivered to the output unit 123. The output unit 123 outputs the audio signal received from the mixing unit 122 to each of the terminal devices 11-k via each of the output terminals 1231-k.

  FIG. 4 is a block diagram showing the configuration of the group mixer 13-j. However, in FIG. 4, “−j” to be added to the reference numerals of the components is omitted, and “−j” is omitted in the following description when it is not necessary to distinguish each of the group mixers 13. . The group mixer 13 includes a mixing unit 132, a connection request signal generation unit 133, and an unconnected detection unit 134 in addition to the input unit 131 and the output unit 135 already shown in FIG. Further, the output unit 135 outputs a signal output from either the mixing unit 132 or the connection request signal generation unit 133 to each of the output terminals 1351-i to the terminal device 11-k via the output terminal 1351-i. A switch 1352-i for switching between the two is provided.

  The mixing unit 132 adds the audio signals input from the terminal devices 11-k belonging to the group j corresponding to the group mixer 13-j via the input terminals 1311-i, and then performs level adjustment. As a result, the audio signal is mixed into one series of audio signals, and the audio signal generated by the mixing is delivered to the output unit 135. The connection request signal generation unit 133 generates a connection request signal and outputs it to the output unit 135. The connection request signal is a sound signal indicating a sound of a constant tone color and a constant pitch that is emitted at regular intervals, for example, “Puppu ...”. The connection request signal generation unit 133 always inputs a connection request signal to the output unit 135.

  The unconnected detector 134 is connected to each of the input terminals 1311-i, and the group output terminal 113 of the terminal device 11-k connected via each of the input terminals 1311-i is not connected to the handset 15. Detect that. As already described with reference to FIG. 2, the group output terminal 113 of the terminal device 11-k is disconnected from the handset 15 in the on-hook state by the switch 115, and established in the off-hook state. Maintained. The unconnected detection unit 134 determines whether or not each of the input terminals 1311-i is in an energized state, and determines that the connection with the handset 15 is disconnected if it is not in the energized state. Each on-hook state of 11-k is detected.

  The unconnected detection unit 134 does nothing when all the terminal devices 11-k connected to the group mixer 13-j are in the on-hook state. On the other hand, the unconnected detection unit 134 switches to the switch 1352-k corresponding to the input terminal 1311-k to which the terminal device 11-k in the on-hook state is connected while any of the terminal devices 11-k is in the off-hook state. On the other hand, an unconnected detection signal indicating an on-hook state is output. For example, if the terminal device 11-k connected to the input terminal 1311-3 is in an on-hook state, the unconnected detector 134 outputs an unconnected detection signal to the switch 1352-3.

  In the output unit 135, each of the switches 1352-i connects the connection request signal generating unit 133 to each of the output terminals 1351-i while the unconnected detection signal is input from the unconnected detection unit 134, While the unconnected detection signal is not input from the unconnected detection unit 134, the mixing unit 132 is connected to each of the output terminals 1351-i. As a result, when any one of the terminal apparatuses 11-k is in the off-hook state, the group mixer 13-j outputs a mixed audio signal to all the terminal apparatuses 11-k in the off-hook state and enters the on-hook state. A connection request signal is output to all the terminal apparatuses 11-k.

[1.2. Operation of the audio conference system]
Hereinafter, the operation of the audio conference system 1 will be described by taking as an example a case where a user 19-k (k-1 to n, where n = 8) performs an audio conference using the audio conference system 1. The users 19-k are in different rooms, and therefore the terminal sets 10-k are arranged in different rooms. For convenience of explanation, the user 19-1, the user 19-3, and the user 19-8 belong to the human resources department, the user 19-2, the user 19-5, and the user 19-7 belong to the general affairs department, and the user 19 -4 and user 19-6 belong to the planning department. The personnel department, the general affairs department, and the planning department are treated as group 1, group 2, and group 3, respectively, by the administrator of the audio conference system 1. Therefore, for example, the group output terminal 113 and the group input terminal 114 of the terminal device 11-1, the terminal device 11-3, and the terminal device 11-8 used by the user 19 belonging to the personnel department are the input terminal 1311 of the group mixer 13-1. -1 to 3 and output terminals 1351-1 to 135-3.

  Normally, the user 19-k places the handset 15-k of the terminal set 10-k used by the user 19-k on the terminal device 11-k. Therefore, hereinafter, the state of the terminal device 11 on which the handset 15 is placed, that is, the on-hook state is referred to as “normal mode”.

  When the terminal device 11-k is in the normal mode, a connection is maintained between the microphone amplifier 145 of the handsfree set 14 and the overall output terminal 111 by the switch 116 disposed in the terminal device 11-k, and the overall output terminal From 111, the audio signal of the user 19 -k collected by the microphone 144 of the handsfree set 14 is input to the overall mixer 12. On the other hand, the connection between the microphone amplifier 155 of the handset 15 and the group output terminal 113 is disconnected, and the audio signal of the user 19-k collected by the microphone 154 of the handset 15 is output to the group mixer 13-j. There is no.

  The audio signal output from the terminal device 11-k in the normal mode to the overall mixer 12 is mixed with the audio signal input from the other terminal device 11-k by the mixing unit 122 via the input unit 121 of the overall mixer 12. Then, the data is output to each of the terminal devices 11-1 to 8 through the output unit 123. The audio signal output from the overall mixer 12 is input to the handsfree set 14 via the overall input terminal 112 of the terminal device 11-k, converted into sound by the speaker 143, and pronounced.

  As a result of the operation of the audio conference system 1 as described above, for example, when the terminal device 11-3 is in the normal mode, the user 19-3 hands-free sets all the terminal devices 11-k that are currently in the normal mode. The sound obtained by mixing the sound collected by 14 can be heard via the hands-free set 14 of the terminal device 11-3.

  By the way, in the normal mode, the group input terminal 114 is connected to the notification unit 117 by the switch 115 arranged in the terminal device 11-k. Therefore, a signal output from the group mixer 13-j to the terminal device 11-k is input to the notification unit 117 of the terminal device 11-k. Hereinafter, taking the terminal device 11-k belonging to the group 1 as an example, the signal received by the terminal device 11-k from the group mixer 13-1 and the operation of the terminal device 11-k according to the signal will be described.

  When all the terminal devices 11-k belonging to group 1, that is, all of the terminal device 11-1, the terminal device 11-3, and the terminal device 11-8 are in the normal mode, the unconnected detection unit of the group mixer 13-1 134 determines that all the terminal devices 11-k are in the off-hook state, and does not output an unconnected detection signal to any of the switches 1352-1 to 1352-1. Accordingly, as a result of the switches 1352-1 to 135-3 establishing and maintaining the connection between the mixing unit 132 and the output terminals 1351-1 to 135-3, the audio signal output from the mixing unit 132 is transmitted to the terminal device 11-1 and the terminal device 11-. 3 and the terminal device 11-8. However, since the audio signal is not output from the terminal device 11-k to the group mixer 13-j in the normal mode as described above, the terminal device 11-1, the terminal device 11-3, and the terminal device 11- When all 8 are in the normal mode, the signal input to the group input terminal 114 of the terminal device 11-k is a signal indicating silence. When the notification unit 117 receives a signal indicating silence, the notification unit 117 does nothing.

  As described above, when all the terminal devices 11-k belonging to the same group are in the normal mode, the terminal device 11-k substantially exchanges audio signals with only the entire mixer 12, and the terminal device 11-k The user 19-k can make a call via the hands-free set 14 not only with other users 19-k in the group but also with users 19-k outside the group.

  Next, the operation of the terminal device 11-k when any one of the terminal devices 11-k belonging to the group 1 enters an off-hook state will be described. As an example, it is assumed that the terminal device 11-3 enters an off-hook state, and the terminal device 11-1 and the terminal device 11-8 remain in an on-hook state (normal mode). In this case, in the terminal device 11-3, the connection between the handsfree set 14 and the entire output terminal 111 is disconnected by the switch 116, and the connection between the handset 15 and the group output terminal 113 is established. As a result, the voice of the user 19-3 is collected by the microphone 154 of the handset 15 and output to the group mixer 13-1 as a voice signal. On the other hand, the audio signal of the user 19-3 is not output from the handsfree set 14 to the overall mixer 12.

  The audio signal output from the terminal device 11-3 to the group mixer 13-1 is input to the mixing unit 132 via the input unit 131 of the group mixer 13-1. The unconnected detector 134 of the group mixer 13-1 detects that the input terminal 1311-2 to which the terminal device 11-3 is connected is no longer in the on-hook state, and the input terminal 1311-1 and the input that are still in the off-hook state. An unconnected detection signal is output to the switch 1352-1 and the switch 1352-3 corresponding to the terminal 1311-3. As a result, the connection request signal output from the connection request signal generator 133 is input to the output terminal 1351-1 and the output terminal 1351-3, and the audio signal output from the mixing unit 132 is input to the output terminal 1351-2. Entered. That is, when any terminal apparatus 11-k belonging to the group enters an off-hook state, the group mixer 13-j outputs a connection request signal to the terminal apparatus 11-k in the normal mode and is in an off-hook state. For the terminal device 11-k, an audio signal obtained by mixing the audio signals of all the terminal devices 11-k in the off-hook state is output.

  Since the terminal device 11-3 is in an off-hook state, it receives an audio signal from the group mixer 13-1. In the terminal device 11-3, the connection between the group input terminal 114 and the notification unit 117 is disconnected by the switch 115, and the connection between the group input terminal 114 and the handset 15 is established. As a result, the audio signal input to the terminal device 11-3 is pronounced as sound from the speaker 153 of the handset 15. However, even in the off-hook state, the terminal device 11-3 receives an audio signal from the overall mixer 12 via the overall input terminal 112, and emits audio from the speaker 143 of the hands-free set 14. Accordingly, the user 19-3 listens to the voice of the user 19-k using the terminal device 11-k in the off-hook state among the voices of the user 19-k belonging to the same group through the handset 15, and the others. Of the user 19-k can be heard through the hands-free set 14.

  As described above, the audio signal is not output to the overall mixer 12 from the terminal device 11-k in the off-hook state, and the group corresponding to the group j to which the user 19-k using the terminal device 11-k belongs. An audio signal is output only to the mixer 13-j. Further, only the terminal device 11-k belonging to the group j is connected to the group mixer 13-j. Therefore, the voice of the user 19-k using the terminal device 11-k in the off-hook state is transmitted only to those who are in the off-hook state of the terminal device 11-k among other users 19-k belonging to the same group, It is not transmitted to other users 19-k. That is, according to the audio conference system 1, it is possible to easily establish a hotline that enables a call only between the users 19-k belonging to the same group. Therefore, hereinafter, the off-hook state is referred to as “hot line mode”.

  By the way, although the terminal device 11-1 and the terminal device 11-8 are used for the user 19-1 and the user 19-8 belonging to the group 1, since they are in the normal mode, the user 19-1 and the user 19-8 The audio signal is output to the overall mixer 12 via the hands-free set 14, and the audio signal input from the overall mixer 12 is sounded as audio via the hands-free set 14. However, since the terminal device 11-3 used by the user 19-3 belonging to the same group is in the hotline mode, the terminal device 11-1 and the terminal device 11-8 connect the group input terminal 114 from the group mixer 13-1. Via the connection request signal. In the terminal device 11-1 and the terminal device 11-8, the notification unit 117 receives the connection request signal via the group input terminal 114, and blinks the lamp. This blinking of the lamp notifies the user 19-k of the terminal device 11-k that another user 19-k belonging to the same group is trying to make a call only within the group or has already made a call. Is the operation. Accordingly, the notification unit 117 is not limited to the blinking of the lamp, and may perform the same notification to the user 19-k by various other methods such as the sound of a bell sound.

  For example, when the user 19-1 lifts the handset 15 from the terminal device 11-1 in response to the notification by the notification unit 117 of the terminal device 11-1, the terminal device 11-1 shifts from the normal mode to the hotline mode, The user 19-1 can hear the voices of the user 19-3 and the user 19 other than the user 19 via the hands-free set 14 at the same time that the user 19-3 talks with the user 19-3 via the handset 15. At this time, since the audio signal is input instead of the connection request signal from the group mixer 13-1 to the terminal device 11-1, the notification unit 117 stops the blinking of the lamp. Further, when the user 19-8 lifts the handset 15-8, the terminal device 11-8 shifts to the hotline mode, and the user 19-1, the user 19-3, and the user 19-8 can talk with each other. become able to.

  For example, when the user 19-1 finishes the call in the group and wants to return to the general conference with the other user 19-k, the user 19-1 places the handset 15 on the terminal device 11-1. As a result, the terminal device 11-1 returns to the normal mode, and the user 19-1 can talk to the user 19-k outside the group using the hands-free set 14.

  As described above, according to the audio conference system 1, a user can easily establish a hotline capable of making a call only with other users belonging to the same group during the entire conference, and shift to the group conference. Furthermore, it is possible to easily cancel the hotline and return to the general conference. And, users who have a group meeting using the hotline can hear the voice of the whole meeting at the same time as the voice of the group meeting, so it is important to discuss the whole meeting during the group meeting. There is no inconvenience such as listening to the contents.

  By the way, in the above description, the terminal set 10-k includes the handset 15 for the user 19-k to use for a call in the hotline mode, and switching between the normal mode and the hotline mode is performed by the mounting table (terminal) of the handset 15 It is configured to be performed by the switch 115 and the switch 116 interlocked with the hook switch 118 that operates in response to the raising and lowering from the device 11-k). Instead of such a configuration, for example, by combining a headset in which headphones and a microphone are integrated and an operation switch for the user 19-k to switch between the normal mode and the hotline mode, the terminal set 10- k may be realized.

  Further, instead of the handset 15 or the headset, a call system having a configuration similar to or similar to the handsfree set 14 may be used.

  However, when the handset 15 or the headset is used, the user 19-k can speak in the group conference with a low voice, and the voice of the group conference can be heard only by a person using the handset 15 or the headset. For example, the risk that the contents of the group meeting will be heard by another group in a nearby room is reduced. Further, when the operation of the switch 115 and the switch 116 is interlocked with the raising and lowering of the handset 15, the user 19-k performs a switching operation as compared with the case where the user 19-k switches between the normal mode and the hotline mode using an operation switch or the like. There is no need to perform this separately, so that it is possible to eliminate the inconvenience of forgetting the switching and erroneously speaking the contents to be spoken at the group meeting at the general meeting.

In addition, the audio conference system 1 may further include the following functions in order to ensure confidentiality of audio in the group conference.
(A) When starting a call in the hotline mode, user authentication is performed to confirm that the user 19-k is the correct user of the terminal device 11-k.
(B) The audio signal of the general conference in the normal mode and the audio signal of the group conference in the hotline mode are stored separately, and when the terminal device 11-k reproduces the audio signal of the group conference, the user 19- Identity authentication is performed to confirm that k is a correct user of the terminal device 11-k.
(C) An audio signal exchanged between the terminal device 11-k and the group mixer 13-j is encrypted at the time of output and decrypted at the time of input.

  In (a) and (b) above, as a method for authenticating the user, for example, the authentication device connected to the group mixer 13-j stores the user name and password of the user 19-k belonging to the group, and the user 19 Only when -k transmits the correct combination of the user name and password from the terminal device 11-k to the authentication device, a method of determining that the user is the correct user is conceivable. Also, instead of the user name and password, the authentication device stores the graphic data of the fingerprint of the user 19-k belonging to the group, the waveform data indicating the vein pattern, the voice data that can specify the voiceprint, and the like for the group meeting. You may make it determine whether it is a correct user by collating with those data of the user 19-k who is going to participate. When performing personal authentication using fingerprint graphic data, for example, it is convenient to place a scanner that scans the fingerprint on the part of the handset 15 touched by the user 19-k.

  In (b) above, for example, a storage device for storing the audio signal of the entire conference is connected to the entire mixer 12, and a storage device for storing the audio signal of the group conference is stored in each of the group mixers 13-j. When the audio signal of the storage device that is connected and stores the audio signal of the group meeting is used, the above-described personal authentication may be performed.

  In (c) above, each of the terminal devices 11-k and each of the group mixers 13-j is connected to an encryption device that encrypts and decrypts the audio signal, and the encryption device encrypts it before outputting the audio signal. And decoding after the input of the audio signal. The encryption method used by the encryption device may be any method such as a common key method and a secret key method.

[2. Second Embodiment]
In the audio conference system 1 described above, the user 19-k participating in the group conference can hear the audio in the entire conference as it is from the speaker 143 of the hands-free set 14. On the other hand, in the audio conference system 2 described below, the audio of the entire conference is generated after being processed from the terminal device 11-k of the user 19-k participating in the group conference. This process is a process for preventing the user 19-k participating in the group meeting from being distracted by the voice of the entire meeting more than necessary.

  In the audio conference system 1 described above, the audio of the user 19-k participating in any group conference is not included in the audio of the entire conference. On the other hand, in the audio conference system 2, the audio of the user 19-k participating in the group conference is processed and then mixed with the audio of the entire conference. This process is a process for preventing the user 19-k participating in the group meeting from understanding the remarks of the user 19-k participating in the group meeting.

  The configuration and operation of the audio conference system 2 are the same except for the configuration and operation of the terminal device as compared with the configuration and operation of the audio conference system 1, and therefore only the terminal device will be described below. Further, among the components of the audio conference system 2, the same or corresponding components as those of the audio conference system 1 are denoted by the same reference numerals as those in the audio conference system 1.

[2.1. Configuration of terminal device]
FIG. 5 is a block diagram showing a configuration of a terminal set 20-k (k = 1 to n, the same applies hereinafter) used in the audio conference system 2. The terminal set 20-k includes a terminal device 21-k, a hands-free set 14-k and a handset 15-k connected to the terminal device 21-k. However, in FIG. 5, “−k” to be added to the reference numerals of the components is omitted, and “−k” is omitted in the following description when it is not necessary to distinguish each of the terminal sets 20. . The terminal device 21 includes a switch 211 that selectively establishes one of a connection between the general input terminal 112 and the hands-free set 14 and a connection between the general input terminal 112 and the general audio signal processing unit 212. , An overall audio signal processing unit 212 that is inserted between the switch 211 and the hands-free set 14 and processes the audio signal input from the overall mixer 12; Accordingly, an overall audio signal processing level changing unit 213 is provided for changing the degree of processing of the audio signal by the overall audio signal processing unit 212.

  Further, the terminal device 21 replaces the switch 116 of the terminal device 11 with a switch 214 for disconnecting or establishing / maintaining the connection between the handset 15 and the group output terminal 113, the hands-free set 14, and the overall output terminal 111. A switch 215 that selectively establishes one of a connection between the switch 215 and the connection between the hands-free set 14 and the group audio signal processing unit 216, and a hand inserted between the switch 215 and the overall output terminal 111. A group audio signal processing unit 216 that processes an audio signal collected by the microphone 144 of the free set 14, an operation knob (not shown), and the like, and an audio signal generated by the group audio signal processing unit 216 according to the operation of the user 19. Is provided with a group audio signal processing degree changing unit 217 for changing the degree of processing for the.

  The switch 115, the switch 211, the switch 214, and the switch 215 arranged in the terminal device 21 are interlocked with the upper and lower sides of the hook switch 118, and in the normal mode (on-hook state) and the hotline mode (off-hook state), Establish, maintain or disconnect the connection.

(Normal mode)
Switch 115: Establishes and maintains a connection between the group input terminal 114 and the notification unit 117. The connection between the group input terminal 114 and the handset 15 is disconnected.
Switch 211: Establishes and maintains a connection between the general input terminal 112 and the hands-free set 14. The connection between the entire input terminal 112 and the entire audio signal processing unit 212 is disconnected.
Switch 214: Disconnects the connection between the handset 15 and the group output terminal 113.
Switch 215: Establishes and maintains connection between the hands-free set 14 and the overall output terminal 111. The connection between the hands-free set 14 and the group audio signal processing unit 216 is disconnected.
(Hotline mode)
Switch 115: establishes and maintains a connection between the group input terminal 114 and the handset 15. The connection between the group input terminal 114 and the notification unit 117 is disconnected.
Switch 211: Establishes / maintains connection between the overall input terminal 112 and the overall audio signal processing unit 212. The connection between the entire input terminal 112 and the hands-free set 14 is disconnected.
Switch 214: Establishes / maintains connection between handset 15 and group output terminal 113.
Switch 215: Establishes / maintains connection between the hands-free set 14 and the group audio signal processing unit 216. The connection between the hands-free set 14 and the overall output terminal 111 is disconnected.

  The overall audio signal processing unit 212 applies the audio signal input from the overall mixer 12 so that the audio of the overall conference does not disturb the user 19-k while the user 19-k is participating in the group conference. Processing is performed to reduce the amount of information that the audio signal has. The user 19-k does not get in the way of his / her participation in the group conference due to the voice of the general conference, for example, the general audio signal processing unit 212 to the extent that he / she cannot understand the content of the general conference with normal attention. The degree of processing is adjusted by operating the operation knob or the like of the overall audio signal processing level changing unit 213 so that the processing is performed.

As the overall audio signal processing unit 212, any type of processing means for reducing the amount of information contained in the audio signal can be adopted, and specific examples thereof include the following filters.
(A) A filter that reduces the level of an input audio signal. (The level of processing changed by the overall audio signal processing level changing unit 213 is the level of the audio signal.)
(B) A filter that amplifies a specific frequency band component of an input audio signal and reduces a specific frequency band component. (The degree of processing changed by the overall audio signal processing degree changing unit 213 is a specific frequency band range in which components are amplified or reduced and the degree of amplification or reduction.)
(C) A filter that lowers the sampling frequency of waveform data by thinning out samples when the input audio signal is waveform data obtained by digitally sampling audio. (The degree of processing changed by the overall audio signal processing level changing unit 213 is the sampling frequency.)
(D) A filter that lowers the quantization resolution when the input audio signal is waveform data obtained by digitally sampling audio. (The degree of processing changed by the overall audio signal processing level changing unit 213 is quantization resolution.)
(E) A filter that detects only the pitch change of the audio signal and converts it to a sound signal of a different tone color having the detected pitch change. (The degree of processing changed by the overall audio signal processing degree changing unit 213 is, for example, detection accuracy of pitch change.)
(F) A filter that detects only a change in volume of an audio signal and converts it to a sound signal of a different timbre having the detected change in volume. (The degree of processing changed by the overall audio signal processing level changing unit 213 is, for example, detection accuracy of volume change.)

  When the user 19-k is participating in the group conference, the group audio signal processing unit 216 prevents the content of the audio from being transmitted to the listener when the audio of the user 19-k is mixed with the audio of the general conference. The audio signal output from the hands-free set 14 to the entire mixer 12 is processed to reduce the amount of information that the audio signal has. The user 19-k can change the group voice signal processing level changing unit 217 to such an extent that his / her speech content cannot be heard by the user 19 participating in the general conference, that is, to the extent that the listener cannot understand the speech content with any attention. By operating the operation knob or the like of the group audio signal processing level changing unit 217, the processing level is adjusted so that the processing is performed.

  As the group audio signal processing unit 216, any type of processing means for reducing the amount of information included in the audio signal can be adopted, and specific examples thereof include, for example, the above-described (a) to (a) to the entire audio signal processing unit 212. The same type of filter as in (f) can be used. However, when the filters (a) to (f) are used for the group audio signal processing unit 216, the user 19-k increases the level of processing compared to the level of processing in the overall audio signal processing unit 212. In addition, it is necessary to operate an operation knob or the like of the group audio signal processing level changing unit 217.

[2.2. Operation of terminal device]
The operation of the terminal device 21-k in the normal mode is the same as the operation of the terminal device 11-k of the audio conference system 1 in the normal mode.

  When the terminal device 21-k is in an off-hook state in the hot line mode, an audio signal indicating the sound of the user 19-k collected by the microphone 154 of the handset 15 is sent to the group mixer 13-j via the group output terminal 113. The audio signal that is output and input from the group mixer 13-j via the group input terminal 114 is converted into sound by the speaker 153 of the handset 15 and is sounded, as in the terminal device 11-k. .

  However, unlike the terminal device 11-k, the terminal device 21-k converts the audio signal indicating the sound of the user 19-k collected by the microphone 144 of the hands-free set 14 into the group audio signal processing unit 216 in the hotline mode. The result of the processing by the above is output to the overall mixer 12 via the overall output terminal 111. In addition, an audio signal input from the overall mixer 12 via the overall input terminal 112 is subjected to processing by the overall audio signal processing unit 212 to be converted into sound by the speaker 143 of the hands-free set 14 and pronounced.

  As a result of the above operation, in the hotline mode, the user 19-k can participate in the group meeting without being deprived of attention to the contents of the discussion in the general meeting, and at the same time, some discussion is being performed in the general meeting. Can be confirmed at any time.

  Furthermore, the audio signal processed by the overall audio signal processing unit 212 is a case where the overall audio signal processing unit 212 is a filter of the type exemplified in the above (a) to (d) or a combination thereof. The sound that is pronounced by the user 19-k cannot understand the meaning and content of the user 19-k with normal attention, but if the user concentrates the attention, the sound is omitted so that the meaning and content can be understood. When the user 19-k wants to confirm the contents of the general meeting, the user 19-k does not bother to place the handset 15-k on the terminal device 21-k, but only moves the attention from the group meeting to the general meeting. .

  Further, in the hotline mode, the voice of the user 19-k is not mixed as it is with the voice of the entire conference, but is processed and mixed in a state in which the meaning content of the voice is not understood. 19-k can know that any one of the users 19-k has a group meeting using the hotline. Therefore, while the user 19-k of another group has a group meeting, an important decision is made until the group meeting is started in his group or the user 19-k of another group returns to the general meeting. It is possible to take measures such as not performing.

  By the way, in the audio conference system 2 described above, the terminal device 21 includes both the overall audio signal processing unit 212 and the group audio signal processing unit 216, but the terminal device 21 includes only one of them. Also good. When the terminal device 21 includes only the overall audio signal processing unit 212, the voice of the user 19-k is not output to the overall mixer 12 as in the audio conference system 1 in the hotline mode, but only to the audio of the overall conference. The group audio signal processing unit 216 performs processing. Further, when the terminal device 21 includes only the group audio signal processing unit 216, the audio of the entire conference is sounded as it is from the speaker 143 of the hands-free set 14 in the hot line mode and is output from the terminal device 21-k to the entire mixer 12. Only the voice to be processed is processed by the group voice signal processing unit 216.

  In the audio conference system 2 described above, the output destination of the overall audio signal processing unit 212 is the hands-free set 14, but the handset 15 may be the output destination. In that case, the audio signal of the entire conference processed by the entire audio signal processing unit 212 in the hotline mode is sounded as sound from the speaker 153 via the drive amplifier 152 of the handset 15, and the user 19-k The sound of both the group meeting and the general meeting can be heard from the speaker 153.

  In the audio conference system 2 described above, the input source of the audio signal to the group audio signal processing unit 216 in the hot line mode is assumed to be the hands-free set 14, and the output destination of the overall audio signal processing unit 212 is the hands-free set. However, the handset 15 may be the input source. That is, the switch 215 establishes the connection between the microphone amplifier 145 of the handsfree set 14 and the overall output terminal 111 in the normal mode, and the group audio between the microphone amplifier 155 of the handset 15 and the overall output terminal 111 in the hot line mode. Those connections are established so as to interpose the signal processing unit 216. In that case, the audio signal of the user 19-k collected by the microphone 154 of the handset 15 in the hotline mode is processed by the group audio signal processing unit 216 and output to the overall mixer 12. As a result, the above-described audio conference system 2 is processed. The same effect can be obtained.

[3. Third Embodiment]
Hereinafter, the audio conference system 3 will be described as a third embodiment of the present invention. The audio conference system 3 is an embodiment in which the present invention is realized by a terminal device and a server device connected to each other via a network.

[3.1. Configuration of audio conference system]
FIG. 6 is a block diagram showing the configuration of the audio conference system 3. The audio conference system 3 includes a plurality of terminal sets 30-k (k = 1 to n, the same applies hereinafter) and a server device 32 connected to each other via a network 35.

  The network 35 includes one or more relay devices interconnected by wire or wireless, and relays data between different communication devices. The network 35 may be an open network that does not limit users, such as the Internet, or may be an intranet, a LAN (Local Area Network) that uses a communication protocol other than the Internet protocol, or the like.

  The terminal set 30-k transmits an audio signal indicating the audio of the user 39-k participating in the audio conference to the server device 32, and an audio signal indicating the audio of the other user 39-k is synthesized from the server device 32. This is a call system for receiving a synthesized voice signal. The terminal set 30-k includes a terminal device 31-k, a hands-free set 32-k, a handset 33-k, and a stand 34-k connected to the terminal device 31-k. However, in FIG. 6, “−k” to be added to the reference numerals of the components is omitted, and “−k” is omitted in the following description when it is not necessary to distinguish each of the terminal sets 30. .

  The hands-free set 32 and the handset 33 have the same configurations and functions as the hands-free set 14 and the handset 15 in the audio conference system 1, respectively.

  The terminal device 31 includes an audio signal receiving unit 311 that receives an audio signal from the server device 32, a connection between the audio signal receiving unit 311 and the handsfree set 32, or a connection between the audio signal receiving unit 311 and the handset 33. A switch 312 that establishes either, a switch 313 that establishes either a connection between the handsfree set 32 and the audio signal transmission unit 314 or a connection between the handset 33 and the audio signal transmission unit 314, and an audio signal Is transmitted to the server apparatus 32, the mode selection data generating section 315 is configured to generate mode selection data indicating which one of the normal mode and the hotline mode is selected, and the mode selection data is transmitted to the server apparatus 32. And a mode selection data transmission unit 316 for transmitting to. The terminal device 31 may be realized, for example, by causing a general-purpose personal computer, PDA (Personal Digital Assistant), or the like to perform processing according to the application, or may be realized by a dedicated terminal device.

  The stand 34 includes a hook switch 341 having a mechanism that moves up and down in response to the raising and lowering of the handset 33, and the switch 312 and the switch 313 are configured to operate in conjunction with the vertical movement of the hook switch 341. Further, the mode selection data generation unit 315 can detect whether the hook switch 341 is located above or below. There are various methods for detecting the vertical position of the mode selection data generation unit 315 and the hook switch 341. For example, the mode selection data generation unit 315 and the hook switch 341 are electrically connected, and the hook switch 341 is The mode selection data generation unit 315 may detect the energized state so that the vertical position of the hook switch 341 can be detected by energizing only in the raised state.

  The stand 34 further includes a keypad 342 having keys corresponding to numbers “0” to “9”, for example. The keypad 342 sends a pressing signal corresponding to the pressed key to the mode selection data generation unit 315 in response to the pressing of the key by the user 39.

  The server device 32 receives a mode selection data receiving unit 321 that receives mode selection data from the terminal device 31-k, a storage unit 322 that stores the received mode selection data and the like, and an audio signal from the terminal device 31-k. An audio signal receiving unit 323 and a selection unit 324 that selects an audio signal to be delivered to each of the overall first mixing unit 325 and the group first mixing unit 326 from audio signals received from each of the plurality of terminal devices 31-k. And an overall first mixing unit 325 and a group first mixing unit 326 that mix the audio signal received from the selection unit 324.

  The server device 32 further includes an overall audio signal processing unit 327 for processing an audio signal generated by the mixing process by the overall first mixing unit 325, and an overall audio signal processing according to an operation of an administrator of the server device 32. An overall audio signal processing level changing unit 328 for changing the degree of processing of the audio signal by the unit 327, a group audio signal processing unit 329 for processing audio signals generated by the mixing processing by the group first mixing unit 326, A group audio signal processing degree changing unit 330 that changes the degree of processing of the audio signal by the group audio signal processing unit 329 according to an operation of the administrator of the server device 32, an overall first mixing unit 325, and a group audio signal processing unit 329. An overall second mixing unit 331 for mixing audio signals received from A group second mixing unit 332 that mixes audio signals received from the group first mixing unit 326, the entire audio signal processing unit 327, and the like, and an audio signal generated by mixing processing by the entire second mixing unit 331 are transmitted to the terminal device 31. And a group audio signal transmission unit 334 that transmits the audio signal generated by the group second mixing unit 332 to the terminal device 31.

  The server apparatus 32 uses a group j (j) to which a user 39-k who performs an audio conference by using the audio conference system 3 as a group of the group first mixing unit 326, the group second mixing unit 332, and the group audio signal transmission unit 334. = 1 to m (the same applies hereinafter), that is, only m. That is, the server device 32 includes a group first mixing unit 326-j, a group second mixing unit 332-j, and a group audio signal transmission unit 334-j corresponding to each of the plurality of groups j.

  The overall audio signal processing unit 327 is a component that performs a process on the audio signal received from the overall first mixing unit 325 to reduce the information amount of the audio signal, and is included in the terminal device 21 of the audio conference system 2. A function similar to that of the entire audio signal processing unit 212 is provided. The degree of processing of the audio signal by the overall audio signal processing unit 327 is indicated in advance by an audio signal input to the overall audio signal processing unit 327 by the overall audio signal processing degree changing unit 328 according to an operation by the administrator of the server device 32. The meaning content of the voice is adjusted to such an extent that it cannot be understood by a listener with normal attention in the voice obtained by reproducing the voice signal output from the whole voice signal processing unit 327.

  The group audio signal processing unit 329 is a component that performs a process for reducing the amount of information included in the audio signal with respect to the audio signal received from the group first mixing unit 326, and is included in the terminal device 21 of the audio conference system 2. A function similar to that of the group audio signal processing unit 216 is provided. The degree of processing of the audio signal by the group audio signal processing unit 329 is indicated by an audio signal input to the group audio signal processing unit 329 by the group audio signal processing degree changing unit 330 according to an operation by the administrator of the server device 32 in advance. The meaning content of the voice is adjusted to such an extent that the listener cannot understand the voice obtained by reproducing the voice signal output from the group voice signal processing unit 329, no matter how careful the listener is.

  The storage unit 322 stores a user database 3221 for storing data related to each of the users 39-k. FIG. 7 is a diagram illustrating the contents of the user database 3221. The user database 3221 includes a plurality of user data corresponding to each of the users 39-k. The user data includes a user ID (Identifier), a password, and a permission group ID as data items stored in advance.

  The user ID and password are notified to each of the users 39-k in advance, and are data for authenticating the user 39-k when the user 39-k participates in the voice conference using the terminal device 31-k. is there. The permitted group ID is a group ID of a group in which the user 39-k is permitted to participate in the group meeting. For example, the group ID “1” is the general affairs department, the group ID “2” is the human resources department, and so on. Each group ID indicates a specific group. When the user 39-k is permitted to participate in different group meetings, the permitted group ID item includes a plurality of group IDs.

  The user data includes a terminal ID, a selection mode, and a selection group ID as data items to be temporarily stored. The terminal ID is an identifier assigned in advance to the terminal device 31-k, and the server device 32 can identify the terminal device 31-k by the terminal ID in the network 35. The selection mode included in the user data is a mode in which the mode selection data received by the server device 32 from the terminal device 31-k is temporarily stored. The selected group ID is a group ID indicating the group of the group conference in which the user 39-k is currently participating. As will be described later, the server device 32 receives the selected group ID from the terminal device 31-k as additional data of mode selection data.

  While the communication connection is not established between the terminal device 31-k and the server device 32, the terminal ID, the selection mode, and the selection group ID are blank as shown in the first row of FIG. When the selection mode is “normal mode”, the user 39-k is participating in the general conference, and thus the selection group ID is blank.

[3.2. Operation of the audio conference system]
Hereinafter, the operation of the audio conference system 3 will be described by taking as an example the case where the user 39-1 participates in the audio conference using the audio conference system 3. Of the user data illustrated in FIG. 7, the data in the third row is user data corresponding to the user 39-1. When the user 39-1 does not participate in the audio conference, the data items of the terminal ID, the selection mode, and the selection group ID of the user data corresponding to the user 39-1 are blank.

  The user 39-1 operates the terminal device 31-1 with the handset 33 placed on the stand 34, and establishes a communication connection between the terminal device 31-1 and the server device 32. The server device 32 acquires the terminal ID of the terminal device 31-1 when establishing a communication connection with the terminal device 31-1. Now, it is assumed that the server device 32 has acquired the terminal ID “0015” from the terminal device 31-1.

  Subsequently, the user 39-1 operates the terminal device 31-1, inputs a user ID “suzuki008” and a password “2fg $ _p”, and transmits the data to the server device 32. When the server device 32 receives the user ID and password from the terminal device 31-1, the server device 32 searches for user data whose user ID and password data items in the user database 3221 (see FIG. 7) match the received data. In this case, the server device 32 obtains the user data in the third row as a search result, and stores “0015” obtained earlier as the terminal ID of the user data. If the user data including the received combination of user ID and password cannot be retrieved from the user database 3221, the server device 32 disconnects the established communication connection.

  When the communication connection is established, the mode selection data generation unit 315 of the terminal device 31-1 detects that the hook switch 341 of the stand 34-1 is lowered, and generates mode selection data “normal mode”. The generated mode selection data is transmitted from the mode selection data transmission unit 316 to the server device 32 and received by the mode selection data reception unit 321 of the server device 32. The mode selection data received by the mode selection data receiving unit 321 is stored in the user database 3221 as the selection mode of the user data retrieved previously. At this time, since the selected group ID is not attached to the mode selection data, the selected group ID in the third row of the user database 3221 is left blank.

  As a result, the user 39-1 can participate in the general conference using the audio conference system 3. In the on-hook state, the connection between the hands-free set 32 and the audio signal transmission unit 314 is established by the switch 313, and the connection between the handset 33 and the audio signal transmission unit 314 is disconnected. Therefore, when the user 39-1 speaks, the voice of the user 39-1 is collected by the microphone of the hands-free set 32, converted into a voice signal, amplified by the microphone amplifier, and then sent to the voice signal transmission unit 314. Delivered. The audio signal transmission unit 314 transmits the audio signal received from the hands-free set 32 to the server device 32 together with the terminal ID “0015” acquired previously.

  The audio signal receiving unit 323 of the server device 32 receives the audio signal from the terminal device 31-1 and passes it to the selection unit 324. Upon receiving the audio signal, the selection unit 324 searches for user data from the user database 3221 using the terminal ID “0015” accompanying the received audio signal as a search key, and the selection mode of the searched user data is “normal mode”. Is identified. In that case, the selection unit 324 hands over the received audio signal to the entire first mixing unit 325. Similar to the audio signal transmitted from the terminal device 31-1, the selection unit 324 hands over all the audio signals transmitted from the other terminal devices 31 from the normal mode to the entire first mixing unit 325.

  The overall first mixing unit 325 mixes the audio signal received from the selection unit 324 and delivers the generated audio signal to the overall audio signal processing unit 327 and the overall second mixing unit 331. The overall second mixing unit 331 receives the audio signal from the overall first mixing unit 325 and also receives the audio signal from the group audio signal processing unit 329. The audio signal received by the overall second mixing unit 331 from the group audio signal processing unit 329 is the meaning of the speech indicated by the audio signals of all the users 39-k participating in the group conference and further mixed. The content has been processed to the extent that it cannot be understood by the listener. The overall second mixing unit 331 mixes the audio signals received from the overall first mixing unit 325 and the group audio signal processing unit 329, and delivers the generated audio signal to the overall audio signal transmission unit 333.

  Upon receiving the audio signal from the entire second mixing unit 331, the overall audio signal transmission unit 333 extracts user data whose selection mode is “normal mode” from the user database 3221 and the terminal ID included in the extracted user data. The audio signal received from the entire second mixing unit 331 is transmitted to all the terminal devices 31-k specified by each. In this case, the entire audio signal transmission unit 333 also transmits an audio signal to the terminal device 31-1.

  The audio signal receiving unit 311 of the terminal device 31-1 receives the audio signal transmitted from the overall audio signal transmitting unit 333 of the server device 32. Since the terminal set 30-1 is in the on-hook state, the connection between the audio signal receiving unit 311 and the handsfree set 32 is established, and the connection between the audio signal receiving unit 311 and the handset 33 is disconnected. Therefore, the audio signal receiving unit 311 passes the received audio signal to the drive amplifier of the hands-free set 32, and the audio signal amplified by the drive amplifier is sounded as sound from the speaker.

  The sound generated from the speaker of the hands-free set 32 uses the voice of the user 39-k who is using the terminal set 30 in the normal mode (on-hook state) and the terminal set 30 in the hot line mode (off-hook state). The user 39-k's voice is processed and mixed. That is, the user 39-1 can hear the speech of the user 39-k participating in the general conference in the normal mode as a normal voice, and at the same time participates in the group conference of any group in the hotline mode. As for the utterances of the user 39-k, the voice processed so that the meaning content is not understood can be heard. As a result, although the user 39-1 cannot know the contents of the group meeting, the user 39-1 can participate in the general meeting while constantly confirming how active the discussion is in the group.

  As described above, the user 39-1 can participate in the group conference for which participation is permitted at any time during the participation in the general conference. In that case, the user 39-1 lifts the handset 33 of the terminal device 31-1 from the stand 34, operates the keypad 342 disposed on the stand 34, and inputs the group ID of the group conference desired to participate. As an example, it is assumed that the user 39-1 has input the group ID “8” indicating the external party. The keypad 342 sends the group ID “8” input by the user 39-1 to the mode selection data generation unit 315.

  When the user 39-1 lifts the handset 33, the mode selection data generation unit 315 detects that the hook switch 341 has been raised, and generates mode selection data “hotline mode”. After that, when the mode selection data generation unit 315 receives the group ID “8” from the keypad 342, the mode selection data generation unit 315 adds the received group ID “8” to the generated mode selection data “hotline mode” and the mode selection data transmission unit 316. To hand over. The mode selection data transmission unit 316 transmits the mode selection data received from the mode selection data generation unit 315 to the server device 32 together with the terminal ID “0015”.

  When the server device 32 receives the mode selection data from the terminal device 31-1 via the mode selection data receiving unit 321, it searches for user data from the user database 3221 (see FIG. 7) using the terminal ID “0015” as a search key, It is determined whether or not the group ID “8” added to the received mode selection data is included in the permitted group ID of the searched user data. In this case, since the group ID “8” is included in the permitted group ID of the retrieved user data, the server device 32 includes the received mode selection data “hotline” in the selected mode and selected group ID of the retrieved user data. “Mode” and group ID “8” are stored. If the group ID received from the terminal device 31-k is not included in the permitted group ID of the retrieved user data, the server device 32 does not perform the following process. As a result, unauthorized users 39-k are prevented from participating in group meetings.

  As a result, the user 39-1 can participate in the group conference using the audio conference system 3. In the off-hook state, the connection between the handset 33 and the audio signal transmission unit 314 is established by the switch 313, and the connection between the hands-free set 32 and the audio signal transmission unit 314 is disconnected. Therefore, when the user 39-1 speaks, the voice of the user 39-1 is collected by the microphone of the handset 33, converted into a voice signal, amplified by the microphone amplifier, and then delivered to the voice signal transmission unit 314. . The audio signal transmission unit 314 transmits the audio signal received from the handset 33 to the server device 32 together with the terminal ID “0015”.

  The audio signal receiving unit 323 of the server device 32 receives the audio signal from the terminal device 31-1 and passes it to the selection unit 324. Upon receiving the audio signal, the selection unit 324 searches for user data from the user database 3221 using the terminal ID “0015” accompanying the received audio signal as a search key, and the selection mode of the searched user data is “hotline mode”. And the selected group ID is “8”. In that case, the selection unit 324 passes the received audio signal to the group first mixing unit 326-8. Similarly to the audio signal transmitted from the terminal device 31-1, the selection unit 324 receives the audio signal transmitted from the other terminal device 31-k in the hot line mode, as the group first mixing unit 326. Deliver to j according to the selected group ID.

  The group first mixing unit 326-8 mixes the audio signal received from the selection unit 324, and delivers the generated audio signal to the group audio signal processing unit 329 and the group second mixing unit 332-8. The group second mixing unit 332-8 receives audio signals from the group first mixing unit 326-8 and also receives audio signals from the overall audio signal processing unit 327 and the group audio signal processing unit 329. The audio signal received by the group second mixing unit 332-8 from the general audio signal processing unit 327 is mixed with the audio of the user 39-k participating in the general conference, and further participates in the group conference by the mixed audio signal. The meaning content of the utterances of the user 39-k is processed so that it cannot be understood by the listener with normal attention.

  The audio signals received by the group second mixing unit 332-8 from the group audio signal processing unit 329 are generated by the other group second mixing units 332, that is, the group second mixing units 332-1 to 7-7 and 9 to m, respectively. The meaning content of the utterance indicated by the voice signal is processed so that the listener cannot understand it.

  The group second mixing unit 332-8 mixes the audio signals received from the group first mixing unit 326-8, the overall audio signal processing unit 327, and the group audio signal processing unit 329, and transmits the generated audio signal to the group audio signal transmission Delivered to part 334-8.

  Upon receiving the audio signal from the group second mixing unit 332-8, the group audio signal transmission unit 334-8 receives the audio signal from the user database 3221, and the user whose selection mode is “hot line mode” and whose selection group ID is “8”. Data is extracted, and the audio signal received from the group second mixing unit 332-8 is transmitted to all the terminal devices 31-k specified by each of the terminal IDs included in the extracted user data. In this case, the group audio signal transmission unit 334-8 transmits an audio signal to the terminal device 31-1.

  The audio signal reception unit 311 of the terminal device 31-1 receives the audio signal transmitted from the group audio signal transmission unit 334-8 of the server device 32. Since the terminal set 30-1 is in the off-hook state, the connection between the audio signal receiving unit 311 and the handset 33 is established, and the connection between the audio signal receiving unit 311 and the handsfree set 32 is disconnected. Therefore, the audio signal receiving unit 311 passes the received audio signal to the drive amplifier of the handset 33, and the audio signal amplified by the drive amplifier is sounded as sound from the speaker.

  The sound generated from the speaker of the handset 33 is obtained by processing the voice of the user 39-k using the terminal set 30-k in the normal mode (on-hook state) and in the hotline mode (off-hook state). Of the user 39-k using the terminal set 30-k, the voice of a person participating in a group meeting of a group other than the outside party is processed, and the terminal set in the hotline mode (off-hook state) This is a mix of the voices of the users 39-k who are using 30-k who are participating in a group meeting outside the negotiations. That is, the user 39-1 can listen to the speech of the user 39-k participating in the group conference in which he / she participates as a normal voice, and at the same time a user participating in the general conference in the normal mode. For the 39-k utterance, the voice is processed so that it cannot be heard with normal attention, and for the utterance of the user 39-k participating in the group meeting where he / she does not participate, what kind of caution is taken You can listen to audio that has been processed so that it cannot be heard.

  As a result, although the user 39-1 cannot know the contents of the general meeting and other group meetings, he / she always confirms how active discussions are made in those meetings, Can participate. As for the general meeting, the user 39-1 concentrates his / her attention from the group meeting to the general meeting so that the user can easily know the remarks in the general meeting without shifting from the hotline mode to the normal mode. Can be convenient.

  While the user 39-1 participates in the external group meeting as described above, the voice of the user 39-1 is not subjected to the processing by the group audio signal processing unit 329, and the group audio signal transmission unit 334-8 is processed. To the terminal devices 31 of all the users 39-k participating in the same group meeting, and transmitted to those users 39-k. On the other hand, after the speech of the user 39-1 is processed by the group audio signal processing unit 329 so that the content of the speech cannot be understood by the listener, the entire audio signal transmission unit 333 or the group audio signal transmission units 334-1-7 and 9 to m are transmitted to the terminal devices 31-k of all the users 39-k not participating in the group meeting other than the outside party, and transmitted to those users 39-k. As a result, the content of the remarks in the group meeting of the user 39-1 is not transmitted to the user 39-k who does not participate in the group meeting.

  When the user 39-1 leaves the group meeting and participates in the general meeting, the user 39-1 may simply place the handset 33 on the stand 34. As a result, the terminal set 30-1 is switched to the normal mode, and the mode selection data “normal mode” is transmitted from the terminal device 31-1 to the server device 32. As a result, the contents of the user database 3221 are updated, and the user 39-1 Is processed in the normal mode described above.

  In addition to outside parties, the user 39-1 is allowed to participate in group meetings with group IDs “2” and “10” (see the third row in FIG. 7). Therefore, the user 39-1 can participate in the group meeting corresponding to the group ID by inputting “2” or “10” using the keypad 342 while the handset 33 is lifted from the stand 34. it can. The operation of the audio conference system 3 in that case is the same as that already described for the group ID “8”.

  By the way, the terminal device 31-k is provided with a notification unit having a function similar to that of the notification unit 117 in the audio conference system 1, and the server device 32 is provided with a call signal transmission unit. The call signal transmission unit refers to the user database 3221. Then, while any user 39-k is participating in the group meeting, the terminal device 31-k of the user 39-k who is allowed to participate in the group meeting but is not participating is specified and specified. A call signal may be transmitted to the terminal device 31-k. When the terminal device 31-k receives the call signal from the server device 32, the terminal device 31-k prompts the user 39-k to participate in the group meeting by blinking the lamp by the notification unit.

  As in the case of the audio conference system 1, the audio conference system 3 includes other call means such as a headset instead of the handset 33, and instead of providing the stand 34 with the hook switch 341, for example, the user 39 -k However, the terminal device 31 or the stand 34 may be provided with an operation switch for switching between the normal mode and the hotline mode.

Similarly to the case of the audio conference system 1, the audio conference system 3 may further include the following functions in order to ensure confidentiality of audio in the group conference.
(A) The audio signal of the general conference in the normal mode and the audio signal of the group conference in the hotline mode are stored separately, and when the terminal device 31-k reproduces the audio signal of the group conference, the user 39- User authentication is performed to confirm that k is a correct user of the terminal device 31-k.
(B) The audio signal transmitted / received between the terminal device 31-k and the server device 32 is encrypted at the time of transmission and decrypted at the time of reception.

  In the audio conference system 3, the server device 32 may not include the group audio signal processing unit 329. In that case, it is natural that the voice of a certain group meeting is not transmitted as it is to the user 39-k who does not participate in the group meeting, and is not transmitted as a processed voice. Further, the server device 32 may not include the overall audio signal processing unit 327, and the overall first mixing unit 325 may directly deliver the audio signal to the group second mixing unit 332-j. In this case, the user 39-k participating in the group meeting can hear the voice of the whole meeting as it is. In other words, as long as the content of a statement in a group meeting is not transmitted to a person who has not participated in the group meeting, whether or not the voice signal is processed in the voice conference system 3 can be arbitrarily changed.

  In the terminal set 30 described above, the terminal device 31, the hands-free set 32, the handset 33, and the stand 34 are arranged in different housings and are connected to each other. It can be arbitrarily changed in which case the part is arranged. For example, the constituent parts of the terminal device 31 and the stand 34 may be arranged in the same casing in which the handset 33 can be placed, or the constituent parts of the terminal apparatus 31 and the handset 33 are arranged in the same handset-type casing. You may arrange in.

[4. Fourth Embodiment]
In the audio conference system 3 described above, selection processing, processing processing, mixing processing, and the like for the audio signals of all users 39-k are performed by the server device 32, and the terminal device 31-k receives the audio signals generated by itself. It is only necessary to transmit to the server device 32 and receive and reproduce the audio signal from the server device 32. Accordingly, there is an advantage that the performance of the entire system is hardly lowered even when the processing capability of the terminal device 31-k is low, whereas the performance of the entire system is lowered when the processing capability of the server device 32 is low. There is. The audio conference system 4 described below is a system that exhibits high performance even if a server device with low processing capability is used by distributing the processing load to terminal devices.

  Since the configuration and operation of the audio conference system 4 are common to the configuration and operation of the audio conference system 3 in many respects, only the differences between the audio conference system 4 and the audio conference system 3 will be described below. . Further, among the components of the audio conference system 4, the same or corresponding components as those of the audio conference system 3 are denoted by the same reference numerals as those in the audio conference system 3.

[4.1. Configuration of audio conference system]
FIG. 8 is a diagram showing the configuration of the audio conference system 4. The audio conference system 4 includes a plurality of terminal sets 40-k (k = 1 to n, the same applies hereinafter) and a server device 42 connected to each other via a network 35. The terminal set 40-k is used by the user 39-k. The terminal set 40-k includes a hands-free set 32-k, a handset 33-k, and a stand 34-k connected to the terminal device 41-k. However, in FIG. 8, “−k” to be added to the reference numerals of the components is omitted, and “−k” is omitted in the following description when it is not necessary to distinguish each of the terminal sets 30. .

  Similar to the terminal device 31 of the audio conference system 3, the terminal device 41 includes a mode selection data generation unit 315, a mode selection data transmission unit 316, an audio signal reception unit 311, and a switch 312. However, a mixing unit 416 is interposed between the audio signal receiving unit 311 and the switch 312. The terminal device 41 includes an overall audio signal processing unit 327, an overall audio signal processing level changing unit 328, a group audio signal processing unit 329, and a group audio signal processing level included in the server device 32 in the audio conference system 3. A change unit 330 is provided.

  Also, the terminal device 41 receives from the hands-free set 32, a switch 413 for establishing / maintaining or disconnecting the connection between the hands-free set 32 and the entire audio signal transmitting unit 414 and the entire audio signal processing unit 327. An overall audio signal transmission unit 414 that transmits audio signals to other terminal devices 41 and a group audio signal transmission unit 415 that transmits audio signals received from the overall audio signal processing unit 327 to other terminal devices 41 are provided. In addition, the terminal device 41 includes a mixing unit 416 that mixes a plurality of audio signals received from the audio signal receiving unit 311.

  Furthermore, the terminal device 41 establishes, maintains or disconnects the connection between the handset 33 and the in-group audio signal transmission unit 418 and the group audio signal processing unit 329, and the audio signal received from the handset 33. An intra-group audio signal transmission unit 418 that transmits to another terminal device 41 and an out-group audio signal transmission unit 419 that transmits the audio signal received from the group audio signal processing unit 329 to the other terminal device 41 are provided.

  In the terminal device 41, the operations of the switch 312, the switch 413, and the switch 417 are linked with the operation of the hook switch 341. The switch 312 establishes a connection between the mixing unit 416 and the hands-free set 32 in the on-hook state, and establishes a connection between the mixing unit 416 and the handset 33 in the off-hook state. The switch 413 establishes a connection between the hands-free set 32 and the entire audio signal transmitting unit 414 and the entire audio signal processing unit 327 in the on-hook state, and disconnects those connections in the off-hook state. In addition, the switch 417 disconnects the connection between the handset 33 and the intra-group audio signal transmission unit 418 and the group audio signal processing unit 329 in the on-hook state, and establishes these connections in the off-hook state.

  The terminal device 41 further includes a user data receiving unit 411 that receives user data updated from the server device 42, and a user that includes data having the same content as the user database 3221 that is always stored in the server device 42 according to the received user data. A storage unit 412 for storing the database 4121 is provided.

  The server device 42 includes a mode selection data receiving unit 321 and a storage unit 322 that stores a user database 3221 as with the server device 32 of the audio conference system 3. In addition, the server device 42 includes a user data transmission unit 421 that transmits the changed user data to all the terminal devices 41-k when the content of the user database 3221 is changed.

[4.2. Operation of the audio conference system]
Hereinafter, as an example, the operation of the audio conference system 4 when the user 39-1 participates in the audio conference using the audio conference system 4 will be described. The user 39-1 performs the same user authentication operation as in the audio conference system 3. With the operation, the terminal device 41-1 transmits mode selection data “normal mode” to the server device. The server device 42 receives the mode selection data and updates the user data in the user database 3221 with the received user data.

  When the user data stored in the user database 3221 is updated, the user data transmission unit 421 transmits the updated user data to all the terminal devices 41 that have established communication connections with the server device 42 at that time. Send to -k. The user data receiving unit 411 of the terminal device 41-k receives user data from the server device 42, and updates the user data in the user database 4121 with the received user data.

  In the normal mode (on-hook state), the voice of the user 39-1 is converted into a voice signal by the hands-free set 32 and delivered to the whole voice signal transmitting unit 414 and the whole voice signal processing unit 327. The overall audio signal transmission unit 414 extracts user data whose selection mode is “normal mode” from the user database 4121 (see FIG. 7), and all the terminal devices 41 specified by the terminal ID included in the extracted user data. The audio signal received from the hands-free set 32 is transmitted to -k. As a result, the voice of the user 39-1 is transmitted as it is to the user 39-k participating in the general conference.

  Also, the overall audio signal processing unit 327 performs processing on the audio signal received from the hands-free set 32 and passes it to the group audio signal transmission unit 415. The group audio signal transmission unit 415 extracts user data whose selection mode is “hotline mode” from the user database 4121, and for all the terminal devices 41-k specified by the terminal ID included in the extracted user data. The audio signal received from the overall audio signal processing unit 327 is transmitted. As a result, the user 39-k participating in one of the group meetings is in a state in which the voice of the user 39-1 is processed so that the listener cannot understand the meaning content with normal attention. Communicated.

  On the other hand, the audio signal receiving unit 311 receives audio signals from all the terminal devices 41-k and passes them to the mixing unit 416. The audio signal received by the audio signal receiving unit 311 in the normal mode includes an audio signal indicating the voice of the user 39-k participating in the general conference as it is and an audio signal of the user 39-k participating in the group conference. In contrast, the speech signal indicates that the meaning content has been processed to such an extent that it cannot be understood by the listener, regardless of the level of attention. The mixing unit 416 mixes these audio signals and delivers them to the handsfree set 32. The hands-free set 32 generates the sound signal received from the mixing unit 416 as sound. As a result, the user 39-1 can listen to the voice of the entire meeting as it is, and at the same time, can hear the voice of the group meeting in a state where the meaning of the group meeting cannot be understood but the presence or absence of a speech can be known. .

  When the user 39-1 lifts the handset 33 from the stand 34 and performs an operation of inputting the group ID “8” indicating the outside using the keypad 342, the mode selection is performed from the terminal device 41-1 to the server device 42. The data “hotline mode” is transmitted together with the group ID “8” input by the user 39-1. As a result, the user database 3221 of the server device 42 is updated, updated user data is transmitted from the server device 42 to all the terminal devices 41-k, and the user database 4121 of all the terminal devices 41-k is also transmitted. Updated. Then, the user 39-1 can participate in the group conference outside the negotiation in the hotline mode (off-hook state).

  In the hotline mode, the voice of the user 39-1 is converted into a voice signal by the handset 33, and delivered to the intra-group voice signal transmission unit 418 and the group voice signal processing unit 329. The intra-group audio signal transmission unit 418 extracts user data whose selection mode is “hotline mode” and whose selection group ID is “8” from the user database 4121 (see FIG. 7), and extracts the extracted user data. The voice signal received from the handset 33 is transmitted to all the terminal devices 41-k specified by the included terminal ID. As a result, the voice of the user 39-1 is transmitted as it is to the user 39-k participating in the group meeting outside the negotiations.

  In addition, the group audio signal processing unit 329 performs processing on the audio signal received from the handset 33 and passes it to the out-group audio signal transmission unit 419. The out-of-group audio signal transmission unit 419 extracts user data whose selected group ID is other than “8” from the user database 4121, and sends it to all the terminal devices 41-k specified by the terminal ID included in the extracted user data. On the other hand, the audio signal received from the group audio signal processing unit 329 is transmitted. As a result, for the user 39-k who has not participated in the group meeting outside the negotiations, the voice of the user 39-1 has been processed so that the meaning content cannot be understood by the listener with any attention. Communicated in

  On the other hand, the audio signal receiving unit 311 receives audio signals from all the terminal devices 41-k and passes them to the mixing unit 416. The audio signal received by the audio signal receiving unit 311 in the hotline mode includes an audio signal indicating the voice of the user 39-k participating in the group conference in which the user 39-1 is participating, and an entire conference. An audio signal indicating that the meaning content of the voice of the participating user 39-k is processed with a normal level of attention and cannot be understood by the listener, and the user 39-1 are participating. Included is an audio signal indicating that the voice of the user 39-k participating in a non-group meeting has been processed to such an extent that the listener cannot understand it even if it has any attention. Yes. The mixing unit 416 mixes these audio signals and delivers them to the handset 33. The handset 33 generates the sound signal received from the mixing unit 416 as sound. As a result, the user 39-1 can listen to the voice of the group meeting in which he / she is participating as it is, and at the same time can understand the presence / absence of speech although the meaning of the voice of the other group meeting cannot be understood. In addition, you can listen to the audio of the entire meeting without understanding the meaning of it with normal attention.

  As described above, also by the audio conference system 4, the user 39-k can move between the general conference and the group conference with a simple operation, and the speech in the group conference is mistakenly given to the other group participants. Inconveniences such as being heard can be prevented.

  By the way, you may add various deformation | transformation similar to the case in the audio conference system 3 with respect to the audio conference system 4. FIG. For example, the terminal device 41-k is not provided with the group audio signal processing unit 329 and the out-of-group audio signal transmission unit 419, and the voice of the user 39-k in the group conference is not given to the participant who has not participated in the group conference. The entire audio signal processing unit 327 and the group audio signal transmission unit 415 may not be provided, and the audio in the entire meeting may be transmitted as it is to all participants.

  Further, instead of updating the contents of the user database 4121 stored in each terminal device 41-k via the server device 42, each terminal device 41-k is a group for specifying mode selection data and a group meeting to participate in. The user database 4121 may be updated by transmitting the ID to another terminal device 41. In that case, the server apparatus 42 becomes unnecessary.

  Further, the terminal device 41 and the stand 34 may be arranged in the same housing, or the terminal device 41 and the handset 33 may be arranged in the same housing.

1 is a block diagram showing an overall configuration of an audio conference system according to a first embodiment of the present invention. It is the block diagram which showed the structure of the terminal set which concerns on 1st Embodiment of this invention. It is the block diagram which showed the structure of the whole mixer which concerns on 1st Embodiment of this invention. It is the block diagram which showed the structure of the group mixer which concerns on 1st Embodiment of this invention. It is the block diagram which showed the structure of the terminal set which concerns on 2nd Embodiment of this invention. It is the block diagram which showed the structure of the audio conference system which concerns on 3rd Embodiment of this invention. It is the figure which illustrated the contents of the user database concerning a 3rd embodiment of the present invention. It is the figure which showed the structure of the audio conference system which concerns on 4th Embodiment of this invention.

Explanation of symbols

  1 · 2 · 3 · 4 ··· Voice conference system 10 · 20 · 30 · 40 ··· Terminal set, ···················································· 12 Set, 15.33 ... Handset, 32.42 ... Server device, 34 ... Stand, 35 ... Network, 111 ... Overall output terminal, 112 ... Overall input terminal, 113 ... Group output terminal, 114 ... Group input terminal, 115.116 211, 214, 215, 312, 313, 413, 417, 1352 ... switch, 117 ... notification unit, 118/341 ... hook switch, 121/131 ... input unit, 122/132/416 ... mixing unit, 123/135 ... Output unit, 133 ... Connection request signal generation unit, 134 ... Non-connection detection unit, 141 and 151 ... Echo canceller 142, 152, drive amplifier, 143, 153, speaker, 144, 154, microphone, 145, 155, microphone amplifier, 212, 327, overall audio signal processing unit, 213, 328, overall audio signal processing level changing unit, 216, 329 ... Group audio signal processing unit, 217, 330 ... Group audio signal processing level changing unit, 311 ... Audio signal receiving unit, 314 ... Audio signal transmitting unit, 315 ... Mode selection data generating unit, 316, 323 ... Mode selection data transmission 321... Mode selection data receiving unit 322 412 Storage unit 324 Selection unit 325 Overall first mixing unit 326 Group first mixing unit 331 Overall second mixing unit 332 Group No. 2 mixing units, 333, 414 ... Whole audio signal transmission unit, 334, 415 ... Group audio signal transmission 342 ... Keypad, 411 ... User data receiver, 418 ... In-group audio signal transmitter, 419 ... Out-group audio signal transmitter, 421 ... User data transmitter, 1211, 1311 ... Input terminal, 1231,1351 ... Output Terminal, 3221/4121... User database.

Claims (11)

A plurality of terminal devices;
For each of the plurality of terminal devices, a first call device and a second call device that input and output audio signals to and from the terminal device;
An overall mixer that mixes audio signals received from each of the plurality of terminal devices and outputs to each of the plurality of terminal devices;
An audio conference system comprising: one or more group mixers that mix audio signals received from each of two or more specific terminal devices included in the plurality of terminal devices and output the signals to each of the two or more specific terminal devices And
The first call device includes first sound generation means for converting an input sound signal into sound and generating sound; first sound collection means for collecting a sound of a speaker, converting the sound into a sound signal, and outputting the sound signal; With
The second call device includes: a second sounding unit that converts an input voice signal into a sound and generates a sound; a second sound collecting unit that collects the voice of the speaker, converts the sound into a voice signal, and outputs the voice signal; Is provided in the same housing, and the second sounding means and the second sound collecting means are arranged in the housing so that the second sounding means and the second sound collecting means are located at the mouth and the ear of the speaker, respectively. ,
Each of the plurality of terminal devices is
A selection means for selecting either the normal mode or the hotline mode;
When the normal mode is selected by the selection means, the audio signal output from the overall mixer is input to the first sound generation means and the audio signal output from the first sound collection means is input to the overall mixer. And when the hot line mode is selected by the selection means, the audio signal output from the group mixer is transmitted to the first mixer. A connection between the second call device and the group mixer so that the audio signal input to the second sounding means and output from the second sound collecting means is input to the group mixer. The first call device and the second communication unit are configured so that audio signals output from the first sound collecting unit and the second sound collecting unit are not output to the overall mixer. System characterized in that it comprises a switching means for configuring each of the devices and the connection between the entire mixer. An overall mixer that mixes audio signals received from each of a plurality of terminal devices and outputs the mixed audio signals to each of the plurality of terminal devices;
A group mixer that mixes audio signals received from each of the two or more specific terminal devices included in the plurality of terminal devices and outputs the mixed audio signals to each of the two or more specific terminal devices;
A first call device comprising: first sound generation means for converting an input sound signal into sound and generating sound; and first sound collection means for collecting a sound of a speaker, converting the sound into a sound signal, and outputting the sound signal;
A second sound generating means for converting the input voice signal into a sound and generating the sound; and a second sound collecting means for collecting the voice of the speaker, converting the voice signal into a voice signal, and outputting the same. And a second handset-type second communication device arranged in the housing such that the two sounding means and the second sound collecting means are located at the mouth and ear of the speaker, respectively. A terminal device that inputs and outputs signals.
A selection means for selecting either the normal mode or the hotline mode;
When the normal mode is selected by the selection means, the audio signal output from the overall mixer is input to the first sound generation means and the audio signal output from the first sound collection means is input to the overall mixer. And when the hot line mode is selected by the selection means, the audio signal output from the group mixer is transmitted to the first mixer. A connection between the second call device and the group mixer so that the audio signal input to the second sounding means and output from the second sound collecting means is input to the group mixer. The first call device and the second communication unit are configured so that audio signals output from the first sound collecting unit and the second sound collecting unit are not output to the overall mixer. Terminal device; and a switching means for configuring each of the devices and the connection between the entire mixer. Processing means for performing processing for missing or concealing part of the information included in the audio signal;
When the hot line mode is selected by the selection unit, the switching unit processes the audio signal output from at least one of the first sound collection unit and the second sound collection unit by the processing unit. The processing means is interposed between at least one of the first call device and the second call device and the overall mixer so that the output is output to the overall mixer. The terminal device described in 1. Processing means for performing processing for missing or concealing part of the information included in the audio signal;
When the hot line mode is selected by the selection unit, the switching unit receives at least one of the first sounding unit and the second sounding unit after the sound signal received from the whole mixer is processed by the processing unit. The said processing means is inserted between the said whole mixer and at least one of the said 1st call apparatus and the said 2nd call apparatus so that it may be output to one side, The process means of Claim 2 characterized by the above-mentioned. Terminal device. Audio signal receiving means for receiving an audio signal from each of a plurality of terminal devices;
Mode selection data receiving means for receiving mode selection data instructing selection of either the normal mode or the hotline mode from one terminal device;
When the mode selection data receiving means receives mode selection data instructing selection of the normal mode, the voice signal receiving means transmits the voice signal received from the one terminal device to all of the plurality of terminal devices, When the mode selection data receiving means receives mode selection data instructing selection of a hotline mode, the audio signal transmitting means receives the audio signals received from the one terminal device by the audio signal receiving means. An audio signal transmitting means for transmitting only to a specific terminal device included in the terminal device. Processing means for performing processing for missing or concealing part of the information included in the audio signal;
When the mode selection data receiving means receives mode selection data instructing selection of a hotline mode, the processing means processes the audio signal received from the one terminal device by the audio signal receiving means, and The server apparatus according to claim 5, wherein the audio signal transmitting unit transmits the audio signal processed by the processing unit to a terminal device other than the specific terminal device. Processing means for performing processing for missing or concealing part of the information included in the audio signal;
When the mode selection data receiving means receives mode selection data instructing selection of a hotline mode, the processing means processes the voice signal received by the voice signal receiving means from a terminal device other than the specific terminal device. The server apparatus according to claim 5, wherein the audio signal transmitting unit transmits the audio signal processed by the processing unit to the one terminal device. A first call device comprising: first sound generation means for converting an input sound signal into sound and generating sound; and first sound collection means for collecting a sound of a speaker, converting the sound into a sound signal, and outputting the sound signal;
A second sound generating means for converting the input voice signal into a sound and generating the sound; and a second sound collecting means for collecting the voice of the speaker, converting the voice signal into a voice signal, and outputting the same. And a second handset-type second communication device arranged in the housing such that the two sounding means and the second sound collecting means are located at the mouth and ear of the speaker, respectively. A terminal device that inputs and outputs signals.
A selection means for selecting either the normal mode or the hotline mode;
When the normal mode is selected by the selection unit, mode selection data for instructing the selection of the normal mode is transmitted to the server device. When the hot line mode is selected by the selection unit, the hot line mode is selected. Mode selection data transmitting means for transmitting mode selection data to be instructed to the server device;
When the normal mode is selected by the selection unit, the audio signal received from the first sound collection unit is transmitted to the server device, and when the hot line mode is selected by the selection unit, the second Voice signal transmitting means for transmitting the voice signal received from the sound collecting means of the telephone device to the server device;
When the voice signal is received from the server device and the normal mode is selected by the selection unit, the received voice signal is output to the sound generation unit of the first call device, and the hot line mode is selected by the selection unit. And a voice signal receiving means for outputting the received voice signal to the sounding means of the second call device. A first call device comprising: first sound generation means for converting an input sound signal into sound and generating sound; and first sound collection means for collecting a sound of a speaker, converting the sound into a sound signal, and outputting the sound signal;
A second sound generating means for converting the input voice signal into a sound and generating the sound; and a second sound collecting means for collecting the voice of the speaker, converting the voice signal into a voice signal, and outputting the same. And a second handset-type second communication device arranged in the housing such that the two sounding means and the second sound collecting means are located at the mouth and ear of the speaker, respectively. A terminal device that inputs and outputs signals.
A selection means for selecting either the normal mode or the hotline mode;
When the normal mode is selected by the selection unit, the audio signal received from the first sound collection unit is transmitted to each of a plurality of other terminal devices, and the hot line mode is selected by the selection unit. A sound signal transmitting means for transmitting the sound signal received from the second sound collecting means only to a specific terminal device included in the plurality of other terminal devices;
When audio signals are received from one or more terminal devices included in the other plurality of terminal devices, and the normal mode is selected by the selection unit, the received audio signals are output to the first sound generation unit, A terminal device comprising: audio signal receiving means for outputting the received audio signal to the second sounding means when the hotline mode is selected by the selecting means. Processing means for performing processing for missing or concealing part of the information included in the audio signal;
When the hot line mode is selected by the selection unit, the processing unit processes an audio signal output from at least one of the first sound collection unit and the second sound collection unit, and The terminal device according to claim 9, wherein the signal transmission unit transmits the audio signal processed by the processing unit to a terminal device other than the specific terminal device. Processing means for performing processing for missing or concealing part of the information included in the audio signal;
When the hotline mode is selected by the selection means, the sound signal receiving means is configured to output the sound signal received from a terminal device other than the specific terminal device to the second sounding means instead of the processing means. The processing means, after processing the sound signal output from the sound signal receiving means, outputs the processed sound signal to the second sound generation means. Item 10. The terminal device according to Item 9.

Images