JP2014131096A - Sound controller, sound control method, and sound control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a sound controller performing control for outputting the voice of an other user, which canot be listened directly by a user in the same location, from a sound input/output device in an easy-to-listen voice, and to provide a sound control method and a sound control program.SOLUTION: A sound controller receives a sound signal from a sound input/output device and transmits the sound signal to an other sound controller, and transmits a sound signal received from the other sound controller to a plurality of sound input/output devices. The CPU of a sound controller receives the sound signal of sounds collected via the microphones of the plurality of sound input/output devices (S57). The CPU determines whether or not some of the plurality of sound input/output devices are grouped (S59). When receiving a sound signal from a specific sound input/output device, the CPU does not transmit a sound signal to at least one sound input/output device belonging to the same group as the specific sound input/output device, and transmits a sound signal to at least one sound input/output device not belonging to the same group as the specific sound input/output device.

Description

  The present invention relates to a sound control device, a sound control method, and a sound control program for controlling sound input / output in a sound input / output device.

  A system capable of performing a remote conference by transmitting and receiving sound signals between remote bases has been proposed. For example, Patent Literature 1 discloses a remote conference system including a multi-point control unit (MCU). In this remote conference system, the MCU receives sound signals collected by each of the plurality of video conference terminals from the plurality of video conference terminals. The MCU adds sounds based on the received signals and transmits the added sound signals to the MCUs installed at other points (hereinafter referred to as “other bases”). The MCU also receives signals from MCUs installed at other sites and transmits them to a plurality of video conference terminals. Each of the plurality of video conference terminals receives a signal from the MCU and outputs a sound based on the signal from the speaker. Each user of the plurality of video conference terminals can hear the voice uttered by the user at the other base.

Japanese Patent Laid-Open No. 11-331068

  In the remote conference system disclosed in Patent Document 1, each of a plurality of video conference terminals outputs a sound based on a signal received from an MCU at another base from a speaker. For this reason, for example, when the voices of users near each of a plurality of video conference terminals installed at the same site do not reach each other directly, for example, when the users are separated from each other, or between each user When there is an obstacle in the screen, the voices of the respective users are not output from the speakers, so that the respective users cannot hear each other's voices. On the other hand, for example, the MCU adds sounds based on signals received from a plurality of video conference terminals, and transmits them to MCUs installed at other bases, and simultaneously transmits them to the plurality of video conference terminals. Since each of them outputs the sound collected by the other video conference terminals installed in the same base from the speaker, the sound of each user is output from the speaker, and each user listens to each other's sound. be able to.

  However, when the voices of the respective users of a plurality of video conference terminals installed at the same site can be heard directly, the user can hear the voice that can be heard directly and the voice output from the speaker. For this reason, when there is a difference between the sound that can be heard directly and the sound output from the speaker, there is a problem that it becomes difficult for the user to hear the sound of other users.

  An object of the present invention is to provide a sound control device, a sound control method, and a sound control device that perform control to output other user's voice that cannot be directly heard by the user in the same site from a sound input / output device with a voice that is easy to hear. It is to provide a control program.

  The sound control device according to the first aspect of the present invention is a sound signal that is a sound signal collected from a plurality of sound input / output devices that collect sound through a microphone and output sound from a speaker. Received and transmitted to another sound control device, and the sound signal received by the other sound control device from a plurality of other sound input / output devices is received from the other sound control device. A sound control device for transmitting a signal to the plurality of sound input / output devices, wherein the sound signals collected through the microphones of the plurality of sound input / output devices are converted into the plurality of sound input / output devices; Receiving means for receiving from the apparatus, judging means for judging whether or not some of the plurality of sound input / output devices are grouped, and a part of the plurality of sound input / output devices judged to be grouped by the judging means Information that indicates multiple sound input / output devices Storage control means for associating as information indicating the output device and storing in the storage means, and sound signals received from the other sound control devices and the plurality of sound input / output devices are transmitted to the plurality of sound input / output devices. First sounding means, and when receiving a sound signal from a specific sound input / output device among the plurality of sound input / output devices, based on the information stored in the storage means, The sound signal is not transmitted to at least one sound input / output device belonging to the same group, and the sound signal is transmitted to at least one sound input / output device not belonging to the same group as the specific sound input / output device. Second transmitting means.

  According to the first aspect, when receiving the sound signal from the specific sound input / output device, the sound control device does not transmit the sound signal to the sound input / output devices belonging to the same group as the specific sound input / output device. The reason is that there is a high possibility that the users of the plurality of sound input / output devices belonging to the same group can directly hear the sound. As a result, the sound control device can prevent the sound that can be heard directly and the sound output from the speaker of the sound input / output device from being overlapped by the user. Therefore, even when there is a difference between the sound that can be heard directly and the sound that is output from the speaker, the user can easily hear the voices of other users. When the sound control device receives a sound signal from a specific sound input / output device, the sound control device transmits the sound signal to a sound input / output device belonging to a different group from the specific sound input / output device. Thus, even when the users of the plurality of sound input / output devices cannot directly hear each other, the respective users can hear each other's sound via the speaker of the sound input / output device.

  1st aspect WHEREIN: The control means which controls each of these sound input / output apparatus and outputs the reference | standard sound of a predetermined frequency and a predetermined volume from the said speaker is provided, The said receiving means is the said several sound input / output Receiving sound signals from a plurality of sound input / output devices other than any of the sound input / output devices that output the reference sound from the speaker, and the determining means includes a plurality of the sound received by the receiving means. A sound input / output device that transmits a sound signal of which the volume of the predetermined frequency is equal to or higher than a predetermined threshold among signals, and first determination means for determining that any one of the sound input / output devices is grouped, The storage control unit associates information indicating each of the sound input / output devices and the plurality of sound input / output devices determined to be grouped by the first determination unit, and stores the information in the storage unit. First memory control means for may be provided.

  When a sound with a predetermined frequency volume equal to or higher than a predetermined threshold is collected in a plurality of sound input / output devices, the sound input / output device that outputs the reference sound and the volume of the collected sound with the predetermined frequency are predetermined. Sound input / output devices exceeding the threshold value are grouped. The reason is that each user of these sound input / output devices may be able to hear the sound directly. As a result, the sound control apparatus can appropriately prevent the sound that can be heard directly and the sound output from the speaker from being duplicated and heard by the user. In addition, by outputting a reference sound of a predetermined frequency from any sound input / output device and determining whether to group based on this reference sound, the sound control device can be used even when there is noise other than the reference sound. Sound input / output devices can be appropriately grouped. Furthermore, by outputting a reference sound with a predetermined volume from any sound input / output device, the sound control device can determine whether to group by comparing the reference sound volume with a predetermined threshold. It can be simplified.

  In the first aspect, the judging means transmits a plurality of sound input signals transmitted from the plurality of sound signals received by the receiving means. A second determination unit configured to determine that the output devices are to be grouped, wherein the storage control unit associates information indicating the plurality of sound input / output devices determined to be grouped by the second determination unit; You may provide the 2nd memory | storage control means to memorize | store.

  A plurality of sound input / output devices are grouped when the tendency of the volume of sound collected by the sound input / output devices to change with time matches. The reason is that each user of a plurality of sound input / output devices may be able to hear the sound directly. As a result, the sound control apparatus can appropriately prevent the sound that can be heard directly and the sound output from the speaker from being duplicated and heard by the user. In addition, even when the volume of sound collected by the sound input / output device changes depending on the environment, a grouping of a plurality of sound input / output devices can be performed by making a judgment based on the tendency of the sound volume to change over time. Can be done appropriately.

  In the first aspect, when the plurality of sound input / output devices are connected via a wired line, the determination means includes a third determination unit that determines to group the plurality of sound input / output devices connected via the wired line. The storage control means associates information indicating a plurality of sound input / output devices connected via wires, determined to be grouped by the third determination means, and stores the information in the storage means; Control means may be provided. The reason why multiple sound input / output devices connected via wire are grouped is that there is a possibility that multiple sound input / output devices are close to each other. This is because it may be possible to hear directly. As a result, the sound control device can easily and quickly execute grouping of a plurality of sound input / output devices.

  In the first aspect, the determination unit may determine whether to group the plurality of sound input / output devices when a sound input / output device is connected. As a result, the sound control device can appropriately execute the grouping of newly connected sound input / output devices without omission.

  In the first aspect, the determination unit may determine whether to group the some of the plurality of sound input / output devices based on the sound signals received from the plurality of sound input / output devices at a constant period. . As a result, even when the connection state of a plurality of sound input / output devices changes, the sound control device can appropriately perform grouping based on the connection state of the sound input / output devices after the change.

  In the first aspect, the second transmission means is configured to determine the volume of the sound indicated by the sound signal received from the specific sound input / output device based on the information stored in the storage means. And changing the sound signal of the sound of the volume after the change based on at least one of the total number of the plurality of sound input / output devices belonging to the group, the other sound control device, and the at least one sound input / output It may be transmitted to the device. The sound input / output device that has received the sound signal changes the sound volume indicated by the sound signal based on at least one of the total number of groups and the total number of sound input / output devices belonging to the group. The volume of sound output from the speaker can be changed according to the number of groups and the number of sound input / output devices in the group. Therefore, the sound control device can balance the sound volume output from the sound input / output device.

  The sound control method according to the second aspect of the present invention includes a sound signal that is a sound signal collected from a plurality of sound input / output devices that collect sound through a microphone and output sound from a speaker. Received and transmitted to another sound control device, and the sound signal received by the other sound control device from a plurality of other sound input / output devices is received from the other sound control device. A sound control method for transmitting a signal to the plurality of sound input / output devices, wherein a sound signal of a sound collected via each microphone of the plurality of sound input / output devices is converted to the plurality of sound input / output devices. A reception step of receiving from a device; a determination step of determining whether or not to group some of the plurality of sound input / output devices; and a portion of the plurality of sound input / output devices determined to be grouped by the determination step Information indicating multiple sound input / output devices When the sound control signal is received from the other sound control device, the received sound signal is stored in the plurality of sound input / output devices. A first transmission step of transmitting to the other sound control device when the sound signal is received from a specific sound input / output device among the plurality of sound input / output devices. And the specific sound input / output without transmitting the sound signal to at least one sound input / output device belonging to the same group as the specific sound input / output device based on the information stored in the storage means. A second transmission step of transmitting the sound signal to at least one sound input / output device that does not belong to the same group as the device. According to the 2nd aspect, there can exist an effect similar to a 1st aspect.

  The sound control program according to the third aspect of the present invention is a sound signal that is a sound signal collected from a plurality of sound input / output devices that collect sound through a microphone and output sound from a speaker. Received and transmitted to another sound control device, and the sound signal received by the other sound control device from a plurality of other sound input / output devices is received from the other sound control device. A sound control program executed by a sound control device that transmits a signal to the plurality of sound input / output devices, wherein sound signals collected through the microphones of the plurality of sound input / output devices are collected. A reception step of receiving from the plurality of sound input / output devices, a determination step of determining whether or not some of the plurality of sound input / output devices are grouped, and grouping by the determination step Some determined to be multiple The information indicating the input / output devices is associated with each other as information indicating the sound input / output devices belonging to the same group, and the storage control step for storing the information in the storage means and the sound signal received from the other sound control device are received. A first transmission step of transmitting a sound signal to the plurality of sound input / output devices; and when a sound signal is received from a specific sound input / output device among the plurality of sound input / output devices, the received sound signal is The sound signal is transmitted to at least one sound input / output device belonging to the same group as the specific sound input / output device based on information transmitted to the other sound control device and stored in the storage means. And a second transmission step of transmitting the sound signal to at least one sound input / output device that does not belong to the same group as the specific sound input / output device. Make. According to the 3rd aspect, there can exist an effect similar to a 1st aspect.

1 is a diagram showing an outline of a sound control system 1. FIG. 3 is a block diagram showing an electrical configuration of a sound control device 16. FIG. 2 is a block diagram showing an electrical configuration of a sound input / output device 20. FIG. It is a flowchart of a 1st main process. It is a flowchart of a 1st grouping process. It is a flowchart of a 2nd grouping process. It is a flowchart of a 3rd grouping process. It is a flowchart of a weight determination process. It is a flowchart of the 2nd main process. It is a figure which shows the 1st table 441. FIG. It is a figure which shows the 1st table 441. FIG. It is a graph which shows the change of sound volume with time. It is a figure which shows the 1st table 441. FIG. It is a figure which shows the 2nd table 442. FIG. It is a figure which shows the 2nd table 442. FIG. It is a figure which shows the 2nd table 442. FIG.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The outline of the sound control system 1 will be described with reference to FIG. The sound control system 1 includes sound control devices 14 and 15 (hereinafter also collectively referred to as “sound control device 16”), sound input / output devices 21 to 27 (hereinafter collectively referred to as “sound input / output device 20”). And Personal Computers (PC) 11 and 12 (hereinafter collectively referred to as “PC 13”). The sound control device 14, the sound input / output devices 21 to 25, and the PC 11 are installed at the same site (hereinafter referred to as “first site 3”). The sound control device 15, the sound input / output devices 26 and 27, and the PC 12 are installed at a second site 4 different from the first site 3. In the vicinity of each of the sound input / output devices 21 to 27, users 31 to 37 (hereinafter collectively referred to as “user 30”) are respectively arranged. Note that the sound control device 16 and the sound input / output device 20 are allotted the same ID (hereinafter referred to as “device ID”).

  The sound control device 14 is connected to the PC 11 via a Universal Serial Bus (USB (registered trademark)). The sound input / output devices 21 and 22 are connected to the sound control device 14 via USB. The sound input / output devices 23 to 25 are connected to the sound control device 14 via wireless communication. The sound control device 14 and the sound input / output devices 21 to 25 can perform communication by USB or wireless. The sound control device 15 is connected to the PC 12 via the USB. The sound input / output devices 26 and 27 are connected to the sound control device 15 via the USB. The sound control device 15 and the sound input / output devices 26 and 27 can perform USB communication. The PCs 11 and 12 are connected to the Internet network 2, respectively. The PCs 11 and 12 can communicate with each other via the Internet network 2.

  Each of the sound input / output devices 21 to 25 collects sound via the microphone 60 (see FIG. 3). The sound input / output devices 21 to 25 transmit collected sound signals (hereinafter referred to as “sound signals”) to the sound control device 14 via USB or wireless. The CPU 41 (see FIG. 2) of the sound control device 14 receives sound signals from the sound input / output devices 21-25. The CPU 41 superimposes each sound based on the plurality of received sound signals. The CPU 41 transmits a sound signal of the superimposed sound (hereinafter referred to as “superimposed sound”) to the sound control device 15 via the PC 11, the Internet network 2, and the PC 12. The sound control device 15 transmits the received superimposed sound signal to the sound input / output devices 26 and 27. The sound input / output devices 26 and 27 each output a superimposed sound from the speaker 61 (see FIG. 3) based on the sound signal of the superimposed sound received from the sound control device 15. As a result, the users 36 and 37 can hear the voices uttered by the users 31 to 35 and the sounds in the first base 3.

  The sound input / output devices 26 and 27 transmit sound signals of sounds collected via the microphone 60 to the sound control device 15 via the USB. The CPU 41 of the sound control device 15 receives sound signals from the sound input / output devices 26 and 27 and superimposes the respective sounds based on the plurality of received sound signals. The CPU 41 transmits the superimposed superimposed sound signal to the sound control device 14 via the PC 12, the Internet network 2, and the PC 11. The sound control device 14 transmits the received superimposed sound signal to the sound input / output devices 21 to 25. The sound input / output devices 21 to 25 each output a superimposed sound from the speaker 61 based on the superimposed sound signal received from the sound control device 14. As a result, the users 31 to 35 can hear the voices uttered by the users 36 and 37 and the sound in the second base 4.

  As described above, the sound control system 1 performs an audio conference between a plurality of sites by transmitting and receiving sound signals between the sound control device 16 and the sound input / output device 20 installed at each of the plurality of sites. It is a system that can. In the sound control system 1, the sound input / output devices 20 can be scattered in a wide area in the base. As a result, the sound output from the speaker 61 of the sound input / output device 20 can be heard in a wide area within the base. In addition, the microphone 60 of the sound input / output device 20 can collect sound over a wide area in the base.

  The configuration of the sound control system 1 can be changed to a configuration other than that shown in FIG. For example, the sound control device 16 may be directly connected to the Internet network 2. The sound control devices 14 and 15 may directly communicate with each other via the Internet network 2.

  The electrical configuration of the sound control device 16 will be described with reference to FIG. The sound control device 16 includes a CPU 41. The CPU 41 is electrically connected to the ROM 42, RAM 43, flash memory 44, RF module 45, line interface (I / F) 47, USB I / F 48, and drive device 49. The ROM 42 stores a boot program, BIOS, OS, and the like. The RAM 43 stores a timer, a counter, and temporary data. The flash memory 44 stores a sound control program for the CPU 41. The flash memory 44 stores a first table 441 (see FIGS. 10, 11, and 13) and a second table 442 (see FIGS. 14 to 16). An antenna 46 is connected to the RF module 45. The RF module 45 converts the data received from the CPU 41 into a radio signal and outputs it to the antenna 46. Further, the RF module 45 converts a radio signal received via the antenna 46 into data and outputs the data to the CPU 41. The line I / F 47 is an interface element for performing communication via a line cable. The sound control device 16 can be connected to the sound input / output device 20 via a line cable to perform communication. A line cable having a well-known structure is used as the line cable, and a 4-pole cable is particularly used. A modular cable may be used instead of the line cable. The USB I / F 48 is an interface element for performing communication via USB. In addition, by performing communication based on the UAC (USB Audio Class) protocol via USB, not only transmission / reception of sound signals but also volume adjustment and mute control are performed.

  The drive device 49 reads information stored in the storage medium 491. An example of the storage medium 491 is a memory card. For example, when setting up the sound control device 16, the sound control program stored in the storage medium 491 is read by the drive device 49 and stored in the flash memory 44. The sound control program may be directly written in the flash memory 44 when the sound control device 16 is shipped. Further, the CPU 41 of the sound control device 16 may receive a sound control program via the Internet 2 and store it in the flash memory 44. In this case, the program is stored in a storage medium such as an HDD provided in a server (not shown) connected via the Internet network 2.

  The electrical configuration of the sound input / output device 20 will be described with reference to FIG. The sound input / output device 20 includes a CPU 51. The CPU 51 is electrically connected to the ROM 52, RAM 53, flash memory 54, RF module 55, line I / F 57, USB I / F 58, operation unit 59, microphone 60, and speaker 61. The ROM 52 stores a boot program, BIOS, OS, and the like. The RAM 53 stores timers, counters, and temporary data. The flash memory 54 stores a program for the CPU 51. The flash memory 54 stores the sound signal of the reference sound. The reference sound is a sound having different frequency characteristics for each of the sound input / output devices 21 to 27. A reference sound having a steep peak frequency is assigned to each of the sound input / output devices 21 to 27. The peak frequency of the reference sound assigned to each of the sound input / output devices 21 to 27 is a frequency width determined according to the total number of sound input / output devices 20 (for example, 100 Hz (20 units), 500 Hz (10 units)).・ 2000Hz etc. (5 units)).

  An antenna 56 is connected to the RF module 55. The line I / F 57 is an interface element for performing communication via a line cable. The sound input / output device 20 can also communicate with the sound control device 16 via a line cable. The USB I / F 58 is an interface element for performing communication via USB. The operation unit 59 is a push button capable of performing an input operation. The operation unit 59 includes a volume switch for volume adjustment and a push button for switching the mute function between valid / invalid.

  As shown in FIG. 1, at the first site 3, a barrier 5 that blocks sound transmission is between the sound input / output devices 21, 22, the sound input / output devices 23, 24, and the sound input / output device 25. Take the case of intervening as an example. Due to the barrier 5, the voices uttered by the users 31, 32 are not transmitted to the users 33 to 35, the voices uttered by the users 33, 34 are not transmitted to the users 31, 32, 35, and the voices uttered by the user 35 are the users 31-31. 34 is not transmitted. In addition, the superimposed sound which the sound collected through the microphone 60 of each of the sound input / output devices 26 and 27 of the second base 4 is output from the speaker 61 of the sound input / output devices 21 to 25 is output. The users 31 to 35 at the first base 3 cannot hear the sound of other areas separated by the barrier 5 through the speaker 61.

  On the other hand, for example, the CPU 41 of the sound control device 14 transmits to the sound control device 15 a sound signal of a superimposed sound in which respective sounds based on the sound signals received from the sound input / output devices 21 to 25 are superimposed. Suppose that it transmitted with respect to the sound input / output devices 21-25. In this case, superimposed sounds of a plurality of sounds collected through the respective microphones 60 of the sound input / output devices 21 to 25 are output from the speakers 61 of the sound input / output devices 21 to 25, and thus the users 31 to 35. Can hear the sound of other areas separated by the barrier 5 through the speaker 61.

  However, for example, when the user 31 utters, the users 31 and 32 are not separated by the barrier 5, so the user 32 directly listens to the user 31 's voice. At the same time, the user 32 listens to the sound of the user 31 included in the superimposed sound output from the speaker 61 of the sound input / output device 22. Here, from when the user 31 utters until the superimposed sound including the uttered sound is output from the speaker 61 of the sound input / output device 22, the transmission time and sound control device when the sound signal is transmitted through the USB A delay corresponding to the processing time for 14 to superimpose the sound occurs. For this reason, since the user 32 can hear the voice of the user 31 twice, the user 32 may be difficult to hear the voice of the user 31.

  Therefore, in the present embodiment, the CPU 41 of the sound control device 14 groups the sound input / output devices 21 to 25 installed at the first site 3 for each region where sound is easily transmitted. In the case of FIG. 1, the sound input / output devices 21 to 25 are grouped into a group 6 of sound input / output devices 21 and 22, a group 7 of sound input / output devices 23 and 24, and a group 8 of sound input / output devices 25. The

  The CPU 41 ensures that the superimposed sound output from the speakers 61 of the sound input / output devices 21 and 22 belonging to the group 6 does not include the sound collected via the microphone 60 of the sound input / output devices 21 and 22. A plurality of sounds based on the sound signals received from each of the sound input / output devices 23 to 25 are superimposed. The CPU 41 transmits the superimposed superimposed sound signal to the sound input / output devices 21 and 22. The superimposed sound output from the speaker 61 of the sound input / output devices 21 and 22 does not include the voices of the users 31 and 32. For this reason, the user 32 does not hear the voice of the user 31 twice. On the other hand, since the superimposed sounds include the voices of the users 33 to 35, the users 31 and 32 can hear the voices of the users 33 to 35 that are difficult to hear directly through the speaker 61.

  In addition, the CPU 41 performs sound input / output so that the superimposed sound output from the speaker 61 of the sound input / output device 25 belonging to the group 8 does not include the sound collected through the microphone 60 of the sound input / output device 25. A plurality of sounds based on the sound signals received from each of the devices 21 to 24 are superimposed. The CPU 41 transmits the superimposed superimposed sound signal to the sound input / output device 25. The superimposed sound output from the speaker 61 of the sound input / output device 25 does not include the voice of the user 35. For this reason, the user 35 does not hear the voice uttered by the user 35 via the speaker 61.

  In the above description, the case where the inside of the first base 3 is separated by the barrier 5 has been described as an example in order to make the explanation easy to understand. However, CPU41, for example, when the locations where the sound input / output devices 21 to 25 are installed are separated from each other, and the users 31 to 35 arranged in the vicinity of each other cannot hear each other directly, The sound input / output devices 21 to 25 can be appropriately grouped.

  The first main process (see FIGS. 4 to 8) and the second main process (see FIG. 9) executed by the CPU 41 of the sound control device 16 will be described with reference to FIGS. The first main process and the second main process are started when the CPU 41 reads out and executes the sound control program stored in the flash memory 44 when the power of the sound control device 16 is turned on. The CPU 41 executes the first main process and the second main process in parallel. Hereinafter, the first main process and the second main process executed by the CPU 41 of the sound control device 14 of the sound control system 1 will be specifically described with reference to FIG.

  The first main process will be described with reference to FIG. CPU41 accesses the timer for specifying the period which monitors the connection of the sound input / output device 20, and starts the update of a timer (S11). When the timer update is started, the timer is repeatedly updated at a predetermined cycle (for example, 1 ms). Based on the timer, the CPU 41 can specify the elapsed time since the start of the timer update in S11.

  The CPU 41 determines whether the sound input / output device 20 is connected to the sound control device 14 via either wired (USB and line cable) or wireless (S13). When the sound input / output device 20 is connected by wire or wirelessly (S13: YES), the CPU 41 acquires the device ID of the sound input / output device 20 connected by wire or wirelessly from the connected sound input / output device 20. To do. The CPU 41 stores the acquired device ID and information indicating the connection form (wired connection or wireless connection) in the first table 441 (see FIG. 10) (S15). Details will be described later. CPU41 advances a process to S17. On the other hand, when the sound input / output device 20 is not connected (S13: NO), the CPU 41 advances the process to S17.

  The CPU 41 determines whether the sound input / output device 20 is connected to the sound control device 14 as follows. The CPU 41 transmits connection confirmation data via wired and wireless. When the CPU 41 receives the connection response data returned from the sound input / output device 20 that has received the connection confirmation data via a wired connection, the CPU 41 determines that the sound input / output device 20 that has returned the connection response data is connected by a wired connection. Further, when the CPU 41 receives the connection response data via wireless, the CPU 41 determines that the sound input / output device 20 that has returned the connection response data is wirelessly connected.

  The CPU 51 of the sound input / output device 20 connected by wire or wireless starts to transmit a sound signal of the sound collected via the microphone 60 to the sound control device 14. As a result, the user 30 can enter a voice conference with another user 30.

  Note that the method for determining whether or not the sound input / output device 20 is connected to the sound control device 14 can be changed. For example, the sound input / output device 20 may repeatedly transmit the connection request data to the sound control device 14 via a wired or wireless connection after the power is turned on. When receiving the connection request data transmitted from the sound input / output device 20, the CPU 41 of the sound control device 14 may determine that the sound input / output device 20 that transmitted the connection request data is connected.

  In S17, the CPU 41 specifies the elapsed time since the update was started in S11 based on the timer, and determines whether the specified elapsed time is equal to or longer than a predetermined time (for example, 10 seconds) (S17). When the acquired elapsed time is less than the predetermined time (S17: NO), the CPU 41 returns the process to S13. On the other hand, when the specified elapsed time becomes equal to or longer than the predetermined time (S17: YES), the CPU 41 stops updating the timer started in S11. The CPU 41 executes processing for grouping the connected sound input / output devices 20 (first grouping processing, see FIG. 5) based on the first table 441 (see FIG. 10) (S19).

  The first table 441 will be described with reference to FIG. The first table 441 stores device IDs, connection forms, group IDs, and other device IDs belonging to the same group. The connection form is information indicating whether the sound input / output device 20 of the corresponding device ID and the sound control device 14 are wired or wirelessly connected. The group ID is an ID indicating each group. Hereinafter, the reference numerals assigned to the groups in FIG. 1 also indicate the group IDs of the respective groups. The other device ID is a device ID of another sound input / output device 20 belonging to the group to which the sound input / output device 20 of the corresponding device ID belongs. Note that at the start of the first grouping process (S19, see FIG. 4), the first table 441 includes the device IDs “21”, “22”, “23”, and “24” of the sound input / output devices 21 to 25, respectively. Only “25” and the connection form are stored.

  The first grouping process will be described with reference to FIG. The CPU 41 specifies the connection state (wired connection or wireless connection) of the sound input / output device 20 determined to be connected to the sound control device 14 in S13 (see FIG. 4) based on the connection form of the first table 441. . In the case of FIG. 1, since the sound input / output devices 21 and 22 are connected via USB, the device IDs “21” and “22” in the first table 441 are associated with information indicating wired connection, Since the input / output devices 23 to 25 are wirelessly connected, information indicating the wireless connection is associated with the device IDs “23”, “24”, and “25”.

  The CPU 41 groups the sound input / output devices 21 to 25 according to the connection form (S51). Specifically, the CPU 41 groups the sound input / output devices 21 and 22 connected in a wired manner into the same group (group 6), and the sound input / output devices 23 to 25 connected in a wireless manner in separate groups (groups). 7A, 7B, 7C). The CPU 41 stores the group IDs “6”, “7A”, “7B”, and “7C” of each group in the first table 441 in association with the device IDs “21” to “25” (S52). At this point, the sound input / output devices 23 and 24 are grouped into separate groups (groups 7A and 7B).

  The reason why the sound input / output devices 21 and 22 connected in a wired manner are grouped into the same group is highly likely that the sound input / output devices 21 and 22 connected in a wire connection are close to each other. This is because the voices uttered by 31 and 32 are likely to reach each other directly. On the other hand, the reason why the wirelessly connected sound input / output devices 23 to 25 are grouped into another group is that the positional relationship of the wirelessly connected sound input / output devices 23 to 25 is indefinite. Note that in the first table 441, IDs that combine numbers “7” and the letters “A”, “B”, and “C” as grouping IDs corresponding to the device IDs of the sound input / output devices 23 to 25 that are wirelessly connected. Is distinguished from the group ID “6” associated with the device IDs “21” and “22” of the sound input / output devices 21 and 22 connected by wire.

  The CPU 41 refers to the first table 441. The CPU 41 determines whether or not a device ID associated with information indicating wireless connection as a connection form is stored in the first table 441 (S53). When the device ID associated with the information indicating the wireless connection is not stored in the first table 441 (S53: NO), the CPU 41 ends the first grouping process, and the process is the first main process. Return to (see FIG. 4).

  In the case of the sound control system 1 of FIG. 1, since the sound control device 14 is wirelessly connected to the sound input / output devices 23 to 25, the device IDs “23”, “24”, and “25” of the first table 441 are wirelessly connected. Information indicating connection is associated as a connection form. When the device ID associated with the information indicating the wireless connection is stored in the first table 441 (S53: YES), the CPU 41 stores the device ID “23” associated with the information indicating the wireless connection. Select “24” and “25” one by one. The CPU 41 transmits instruction data to the sound input / output device 20 of the selected device ID in order to output the reference sound at a predetermined volume from the speaker 61 of the sound input / output device 20 of the selected device ID (S55). .

  When receiving instruction data from the sound control device 14, the CPU 51 of the sound input / output device 20 outputs the reference sound from the speaker 61 for a predetermined time (for example, 5 seconds) based on the sound signal of the reference sound stored in the flash memory 54. Let The output volume of the reference sound is set to a volume of conversation normally performed between the users 30 (for example, 60 dBSPL).

  Note that the frequency of the reference sound output from the speaker 61 according to the instruction data transmitted in S55 may be set within the audible range or outside the audible range. When the frequency of the reference sound is set within the audible range, the user 30 can hear the reference sound output from the speaker 61 of the sound input / output device 20. Note that while the reference sound is being output from the speaker 61 of the sound input / output device 20, the sound control device 14 is in a state in which the sound input / output device 20 is being grouped. For this reason, by setting the frequency of the reference sound within the audible range, it is possible to notify the user 30 that the sound control device 14 is performing the grouping process of the sound input / output device 20. On the other hand, when the frequency of the reference sound is set outside the audible range, it is possible to prevent the reference sound from being heard by the user 30, so that the user 30 hears a sound not directly related to the remote conference at the start of the audio conference. Can be prevented. Needless to say, the frequency of the reference sound is set within a frequency band in which the microphone 60 can collect sound.

  Of the sound input / output devices 20 excluding the sound input / output device 20 that outputs the reference sound from the speaker 61, the sound input / output device 20 that has collected the reference sound via the microphone 60 outputs the received reference sound signal. It transmits to the control apparatus 14. Similarly, the sound input / output device 20 that has collected sounds other than the reference sound via the microphone 60 also transmits a sound signal.

  The CPU 41 of the sound control device 14 receives the sound signal transmitted from the sound input / output device 20 for a predetermined time (for example, 5 seconds) when the reference sound is output from the speaker 61 (S57). When a plurality of sound input / output devices 20 are connected to the sound control device 14, the CPU 41 receives sound signals from the plurality of sound input / output devices 20 for a predetermined time. The CPU 41 compares the volume of the peak frequency of the reference sound output from the speaker 61 of the sound input / output device 20 that has transmitted the instruction data in S55 among the sounds based on the received sound signal with a predetermined threshold (S59). . For example, −10 dB to −20 dB is set as the predetermined threshold in the case of 0 dBSPL.

  The comparison between the volume of the peak frequency and the predetermined threshold is specifically performed as follows. The CPU 41 Fourier-transforms the sound based on the sound signal received for a predetermined time, and calculates the volume for each frequency component. CPU41 selects the volume of peak frequency among the calculated volumes. The CPU 41 compares the volume of the selected peak frequency with a predetermined threshold value.

  When the volume of the peak frequency is equal to or higher than the predetermined threshold (S59: YES), the CPU 41, as another device ID corresponding to the device ID of the sound input / output device 20 that outputs the reference sound, in the first table 441, The device ID of the sound input / output device 20 that has transmitted the sound signal of the sound whose volume is equal to or higher than the predetermined threshold is stored in association with each other (S61). As a result, the CPU 41 groups the sound input / output device 20 that has output the reference sound and the sound input / output device 20 that has received the reference sound at a volume equal to or higher than a predetermined threshold. CPU41 advances a process to S62. On the other hand, when the volume of the peak frequency is less than the predetermined threshold (S59: NO), the CPU 41 advances the process to S62.

  In the above description, the reason why the Fourier transform is performed in the volume comparison is that the received sound signal may include a sound signal of a sound other than the reference sound. The CPU 41 identifies the amplitude of the frequency of the reference sound from the result of the Fourier transform, and compares the volume corresponding to the identified amplitude with a predetermined threshold, thereby comparing the volume of the sound other than the reference sound with the predetermined threshold. , Preventing the grouping accuracy from deteriorating.

  In S62, if the CPU 41 receives a plurality of sound signals from the plurality of sound input / output devices 20 in S57, the CPU 41 determines whether the volume comparison processing has been performed for all of the plurality of sound signals (S62). When the comparison process is not performed for all of the volume levels of the plurality of sound signals (S62: NO), the CPU 41 returns the process to S59. The CPU 41 selects any one of the sound signals that have not been subjected to the volume comparison process, and repeats the process. On the other hand, when the volume comparison processing is performed for all of the plurality of sound signals received from the plurality of sound input / output devices 20 (S62: YES), the CPU 41 advances the processing to S63.

  In S63, the CPU 41 transmits the instruction data in S55 to all the wired and wirelessly connected sound input / output devices 20, or in other words, the reference sound from all the speakers 61 of the connected sound input / output devices 20. Is determined (S63). When the reference sound is not output from all the speakers 61 of the connected sound input / output device 20 (S63: NO), the CPU 41 returns the process to S55. The CPU 41 transmits the instruction data to any of the sound input / output devices 20 that have not transmitted the instruction data (S55), and repeats the process. On the other hand, when the reference sound is output from all of the connected sound input / output devices 20 (S63: YES), the CPU 41 advances the process to S65.

  For example, in FIG. 1, when the reference sound output from the speaker 61 of the sound input / output device 21 is collected via the microphone 60 of the sound input / output device 22, the volume of the collected sound increases. Therefore, in the first table 441, the device ID “22” is associated as another device ID corresponding to the device ID “21”. Similarly, when the reference sound is output from the speaker 61 of the sound input / output device 22, the volume of the sound collected through the microphone 60 of the sound input / output device 21 increases, so that the device of the first table 441 The device ID “21” is associated with the other device ID corresponding to the ID “22”.

  In addition, when the reference sound is output from the speaker 61 of the sound input / output device 25, the sound collected through any microphone 60 of the sound input / output devices 21 to 24 has a low volume. For this reason, the device ID “25” in the first table 441 is not associated with another device ID.

  In S65 of FIG. 5, the CPU 41 determines whether or not the correspondence relationship between the device ID of the first table 441 and the other device ID matches (hereinafter referred to as “match”) (S65). The method of judgment is as follows. For example, in the first table 441 of FIG. 10, another device ID “22” is associated with the device ID “21”, and another device ID “21” is associated with the device ID “22”. These mean that the sound input / output devices 21 and 22 belong to the same group. Furthermore, a common group ID “6” is associated with the device IDs “21” and “22”. Therefore, the other device IDs “22” and “21” corresponding to the device IDs “21” and “22” in the first table 441 are matched.

  On the other hand, for example, in the first table 441, it is assumed that other device IDs “21” and “23” are associated with the device ID “24”. This means that the sound input / output devices 21, 23, and 24 belong to the same group. However, the device ID “21” is associated with another device ID “22”, which means that the sound input / output devices 21 and 22 belong to the same group. Further, the device ID “23” is associated with another device ID “24”, which means that the sound input / output devices 23 and 24 belong to the same group. Further, different group IDs “6”, “7A”, and “7B” are associated with the device IDs “21”, “23”, and “24”. For this reason, the other device IDs corresponding to the device IDs “21”, “23”, and “24” in the first table 441 do not match each other.

  As shown in FIG. 5, when it is determined that the contents of the first table 441 do not match (S65: YES), the CPU 41 extracts the device ID that is determined not to match (S67). For example, in the case of the first table 441 in FIG. 10, among other device IDs “21” and “23” associated with the device ID “24”, “21” is associated with the device ID “21”. Although it does not match with the other device ID “22”, the other device ID “23” associated with the device ID “24” and the other device “24” associated with the device ID “23”. Is consistent. In this case, the CPU 41 extracts the device IDs “21” and “24” as device IDs that do not match. CPU41 returns a process to S55.

  The CPU 41 sequentially outputs the sound input / output devices 20 with the extracted device IDs “21” and “24” to the sound input / output devices 20 with the extracted device IDs “21” and “24” in order. The instruction data is transmitted (S55), and the grouping by the reference sound is repeated. When the contents of the first table 441 match (S65: NO), the CPU 41 modifies the group ID based on the device ID and other device IDs in the first table 441 (S69), and performs the first grouping process. End and return to the first main process (see FIG. 4).

  For example, as a result of repeating the grouping by the reference sound, in the first table 441 in FIG. 10, another device ID corresponding to the device ID “24” is changed from “21” “23” to “23”. . In this case, the device ID “23” is associated with the other device ID “24”, and the device ID “24” is associated with the other device ID “23”. It means that they belong to the same group. The device IDs “23” and “24” are associated with different group IDs “7A” and “7B”, but the sound input / output devices 23 and 24 are connected to each other via radio, so Even if the IDs are different, the sound input / output devices 23 and 24 may belong to the same group. For this reason, the contents of the first table 441 are consistent (S65: NO). In this case, the CPU 41 corrects the group IDs “7A” and “7B” associated with the device IDs “23” and “24” to the common “7” (S69). Further, the group ID “7C” corresponding to the device ID “25” is corrected to “8” (S69).

  The above grouping method can be changed. For example, in the case of the first table 441 in FIG. 10, among other device IDs “21” and “23” associated with the device ID “24”, “21” is associated with the device ID “21”. The other device ID “23” matched with the device ID “24” is matched with the other device ID “22”, and the other device “24” associated with the device ID “23”. Is not consistent. In this case, the contents of the first table 441 are matched by deleting another device ID “21” corresponding to the device ID “24”. In this way, the CPU 41 does not output the reference sound again from the speaker 61 of the sound input / output device 20, and deletes the other device ID “21” associated with the device ID “24”, thereby making the first table 441. The contents may be matched.

  As shown in FIG. 4, after the first grouping process (S19), the CPU 41 weights a plurality of sounds to be superimposed in the process of creating a superimposed sound based on the updated first table 441. The process of determining the weight of the weight (weight determination process, see FIG. 8) is executed (S20). Details of the weight determination processing will be described later. After the weight determination process, the CPU 41 uses the second table 442 created by the weight determination process (S20) as a creation method for creating a superimposed sound based on the sound signals received from the sound input / output devices 21 to 25. Switching is performed based on (see FIG. 14, described later) (S21). The outline is as follows.

  The CPU 41 creates a superimposed sound as a basis of a sound signal transmitted to the sound input / output devices 21 and 22 as follows. The CPU 41 specifies device IDs “21” and “22” associated with the group ID “6”. The CPU 41 receives sound signals received from the sound input / output devices 23 to 25 excluding the sound input / output devices 21 and 22 having the specified device IDs “21” and “22” among the sound input / output devices 21 to 25, and A plurality of sounds based on the sound signal received from the sound control device 15 are superimposed. In this way, the CPU 41 prevents the sound collected through the microphone 60 of the sound input / output devices 21 and 22 from being included in the superimposed sound. Similarly, the sounds based on the sound signals excluding the sound signals received from the sound input / output devices 20 included in the groups 7 and 8 are superimposed on the other groups 7 and 8 to create a superimposed sound.

  After switching the method of creating the superimposed sound (S21), updating of the timer for periodically monitoring the grouping of the sound input / output devices 20 is started (S23). When the timer update is started, the timer is updated at a predetermined cycle (for example, 1 ms). Based on the timer, the CPU 41 can specify the elapsed time since the start of the timer update in S23.

  The CPU 21 determines whether the sound input / output device 20 is newly wired or wirelessly connected (S25). When the sound input / output device 20 is newly connected (S25: YES), the CPU 41 acquires the device ID from the newly connected sound input / output device 20. The CPU 41 specifies the connection form (wired connection or wireless connection) of the newly connected sound input / output device 20. The CPU 41 associates the acquired device ID with information indicating the identified connection form, and stores it in the first table 441. The CPU 41 executes a process for grouping the newly connected sound input / output devices 20 (second grouping process, see FIG. 6) (S27).

  The second grouping process will be described with reference to FIG. The CPU 41 determines whether the sound input / output device 20 is newly connected by wire (S71). In the first table 441, when information indicating wired connection is associated as a connection form with the device ID of the newly connected sound input / output device 20, the newly connected sound input / output device 20 is wired. It is determined that they are connected (S71: YES). The CPU 41 groups the newly connected sound input / output devices 20 and updates the first table 441 (S88). Specifically, it is as follows.

  The CPU 41 determines whether there is a sound input / output device 20 connected by wire in addition to the sound input / output device 20 newly connected by wire, with reference to the first table 441. When there is another wired input / output device 20, the CPU 41 sets the group ID associated with the device ID of the sound input / output device 20 to the ID of the newly connected sound input / output device 20. Store in association with each other. Further, the CPU 41 stores the device ID of the other sound input / output device 20 associated with the same group ID as another device ID corresponding to the sound input / output device 20 newly connected by wire. Further, the CPU 41 adds the device ID of the sound input / output device 20 newly connected by wire to the other device ID corresponding to the device ID of the other sound input / output device 20. When there is no wired input sound input / output device 20 in addition to the newly connected sound input / output device 20, the CPU 41 sets a new group ID to the device ID of the newly connected sound input / output device 20. Associate. No other device ID is associated with the device ID of the newly connected sound input / output device 20.

  For example, when the device ID “28” of the sound input / output device 28 newly connected by wire is stored in the first table 441 in FIG. 10, the device ID “21” of the sound input / output devices 21 and 22 connected by wire. ”“ 22 ”is associated with the group ID“ 6 ”, so“ 6 ”is stored as the group ID corresponding to the device ID“ 28 ”. Also, “21” and “22” are stored as other device IDs corresponding to the device ID “28”. In addition, “28” is added to other device IDs corresponding to the device IDs “21” and “22”.

  The CPU 41 determines whether there is a wirelessly connected sound input / output device 20 in addition to the newly connected sound input / output device 20 with reference to the first table 441 (S89). When there is another wirelessly connected sound input / output device 20 (S89: YES), the CPU 41 performs processing in S55 (FIG. 5) in order to perform grouping with the wirelessly connected sound input / output device 20 as necessary. Go to step 5). On the other hand, when there is no other sound input / output device 20 connected wirelessly, that is, when all the sound input / output devices 20 including the newly connected sound input / output device 20 are connected by wire (S89: NO). The CPU 41 ends the second grouping process and returns the process to the first main process (see FIG. 4). Thus, by performing grouping based on the connection form, it is possible to reduce the processing load on the CPU 41 as compared with the case where the grouping process is performed based on the reference sound.

  On the other hand, as shown in FIG. 6, when a new sound input / output device 20 is wirelessly connected (S71: NO), the CPU 41 performs a reference from the speaker 61 to the newly wirelessly connected sound input / output device 20. Instruction data for outputting the sound a plurality of times (for example, 10 times) is transmitted (S73).

  When the CPU 51 of the sound input / output device 20 newly connected wirelessly receives instruction data from the sound control device 14, the CPU 51 outputs the reference sound from the speaker 61 based on the sound signal of the reference sound stored in the flash memory 54 for a predetermined time. Output minutes. The CPU 51 repeats outputting the reference sound a plurality of times at a predetermined interval (for example, 1 s). Of the sound input / output devices 20 excluding the sound input / output device 20 that outputs the reference sound from the speaker 61, the sound input / output device 20 that has collected the reference sound via the microphone 60 outputs the received reference sound signal. It transmits to the control apparatus 14. Similarly, the sound input / output device 20 that has collected sounds other than the reference sound via the microphone 60 also transmits a sound signal.

  The CPU 41 of the sound control device 14 receives the sound signal transmitted from the sound input / output device 20 for a predetermined time during which the reference sound is output from the speaker 61 (S75). The reception of the sound signal is repeated a plurality of times at predetermined intervals. When a plurality of sound input / output devices 20 are connected to the sound control device 14, the CPU 41 receives a sound signal from each of the plurality of sound input / output devices 20. The CPU 41 updates the first table 441 as follows based on the plurality of received sound signals.

  The CPU 41 selects a plurality of sound signals received from the specific sound input / output device 20 a plurality of times in order. CPU41 specifies the volume of the peak frequency of a reference sound from the sound based on the selected sound signal, and compares it with a predetermined threshold value (S77). The comparison between the volume of the peak frequency and the predetermined threshold is performed by the same method as the process in S59 (see FIG. 5). When the volume of the peak frequency exceeds a predetermined threshold (S77: YES), the CPU 41 updates a counter that accumulates the number of times that the volume exceeds the predetermined threshold for each sound input / output device 20 (S79). CPU41 advances a process to S81. On the other hand, when the volume is less than the predetermined threshold (S77: NO), the counter is not updated, and the CPU 41 advances the process to S81.

  The CPU 41 performs a volume comparison process for all of the plurality of sound signals received from the specific sound input / output device 20 a plurality of times, and determines whether or not the counter has been updated (S81). When the volume comparison process is not performed for all of the plurality of sound signals (S81: NO), the CPU 41 returns the process to S77. The CPU 41 repeats the sound volume comparison process based on the sound signal that has not been subjected to the sound volume comparison process among the plurality of sound signals. On the other hand, when the volume comparison process is performed for all of the plurality of sound signals (S81: YES), the CPU 41 advances the process to S83.

  In S83, the CPU 41 compares the counter with a predetermined number of times (for example, 7 times). If the counter is equal to or greater than the predetermined number of times (S83: YES), the CPU 41 is the device ID of the sound input / output device 20 that has output the reference sound in the first table 441, in other words, the sound input / output newly connected wirelessly The other device ID corresponding to the device ID of the device 20 is associated with the device ID of the sound input / output device 20 (hereinafter referred to as “transmitting device”) that has transmitted the sound signal of the sound whose counter has reached a predetermined number of times. Remember. Further, the CPU 41 stores a group ID associated with the device ID of the transmission device in association with the device ID of the sound input / output device 20 newly connected wirelessly. Further, the CPU 41 stores the device ID of the sound input / output device 20 newly connected wirelessly as another device ID corresponding to the device ID of the transmitting device (S85). As described above, the newly input and output sound input / output devices 20 are grouped into the same group as the transmission device. CPU41 advances a process to S87. On the other hand, if the counter is less than the predetermined number (S83: NO), the CPU 41 advances the process to S87.

  In S <b> 87, when the sound signal is received from the plurality of sound input / output devices 20 a plurality of times in S <b> 75, the CPU 41 performs a volume comparison process for all of the plurality of sound input / output devices 20. It is determined whether the update process has been completed (S87). When the volume comparison process based on the sound signal transmitted from any sound input / output device 20 and the update process of the first table 441 are not performed (S87: NO), the CPU 41 returns the process to S77. The CPU 41 repeats the volume comparison process and the first table 441 update process based on the plurality of sound signals received from the sound input / output device 20 a plurality of times. On the other hand, when the volume comparison process and the update process of the first table 441 have been performed for all of the plurality of sound input / output devices 20 (S87: YES), the CPU 41 ends the second grouping process, and performs the first process. Return to the main process (see FIG. 4).

  A case where the sound input / output device 28 having the device ID “28” is newly wirelessly connected will be described as an example, and will be specifically described with reference to the first table 441 in FIG. It is assumed that the sound input / output device 28 is installed in the region where the sound input / output device 25 is installed among the regions in the first base 3 separated by the barrier 5 (see FIG. 1) (arrows). 101, see FIG.

  When the sound input / output device 28 is newly wirelessly connected (S25: YES, see FIG. 10), the CPU 41 uses the information indicating the wireless connection as the connection form for the device ID “28” acquired from the sound input / output device 28. The association is stored in the first table 441. The CPU 41 executes the second grouping process (see FIG. 6) (S27). The CPU 41 transmits instruction data for outputting the reference sound from the speaker 61 a plurality of times to the sound input / output device 28 (S73, see FIG. 6).

  When receiving the instruction data from the sound control device 14, the CPU 51 of the sound input / output device 28 outputs the reference sound for a predetermined time from the speaker 61 a plurality of times. The sound input / output device 25 collects a reference sound via the microphone 60. The sound input / output devices 21 to 24 transmit the sound signals of the collected sounds to the sound control device 14.

  The CPU 41 of the sound control device 14 receives the sound signal transmitted from the sound input / output devices 21 to 25 a plurality of times. The CPU 41 compares the volume of the peak frequency of the sound based on each of the sound signals received a plurality of times from the sound input / output device 25 with a predetermined threshold (S77). Since the sound input / output device 25 directly collects the reference sound output from the speaker 61 of the sound input / output device 28 via the microphone 61, there is a possibility that the volume of the peak frequency may be a predetermined threshold value or more. High (S77: YES). The CPU 41 updates the counter corresponding to the sound input / output device 25 (S79). On the other hand, since the sound input / output devices 21 to 24 are blocked by the barrier 5 and cannot collect the reference sound via the microphone 60, the volume of the peak frequency is likely to be less than the predetermined threshold. (S77: NO). CPU41 does not update the counter corresponding to the sound input / output devices 21-24.

  When the CPU 41 performs the volume comparison process for all the sound signals received from the sound input / output devices 21 to 25 a plurality of times (S81: YES), the CPU 41 compares the counter with a predetermined number of times (S83). Since there is a high possibility that the counter corresponding to the sound input / output device 25 is equal to or greater than the predetermined number (S83: YES), the CPU 41 corresponds to the device ID “28” of the sound input / output device 28 in the first table 441. The device ID “25” of the sound input / output device 25 is stored in association with the other device ID. Further, the CPU 41 stores the group ID “8” associated with the device ID “25” in association with the device ID “28” as the group ID corresponding to the device ID “28”. Further, the CPU 41 stores the device ID “25” in association with the other device ID corresponding to the device ID “28”. Further, the CPU 41 adds the device ID “28” of the sound input / output device 28 newly wirelessly connected to the other device ID corresponding to the device ID “25” (S85).

  Note that after the first table 441 is updated in the second grouping process (S85), the CPU 41 may perform the same processes as the processes of S65, S67, and S69 (see FIG. 5) of the first grouping process. Good. That is, if the contents of the first table 441 do not match, the CPU 41 may output the reference sound again from the newly connected sound input / output device 20 a plurality of times. And CPU41 may match the content of the 1st table 441 by repeating the process of S75-S87.

  In addition, the reference sound output from the sound input / output device 20 newly connected in the second grouping process (see FIG. 6) may be a frequency outside the voice band (up to 3000 Hz). Further, the CPU 41 may cause the speaker 61 to output the reference sound during a time period when the sound related to the audio conference is not output from the speaker 61. The reason is as follows. In some cases, the sound input / output device 20 has an audio signal processing function such as an acoustic echo canceller function, and the acoustic echo canceller function is executed in a state where sound related to the audio conference is output from the speaker 61. In this case, the reference sound collected by the microphone 60 may be distorted or the band may be cut. Further, the echo suppressor function may be executed in a state where the sound input / output device 20 is equipped with an echo suppressor function and a sound related to the audio conference is output from the speaker 61. In this case, while the sound is output from the speaker 61, the sound of the microphone 60 is cut, so that there is a possibility that the reference sound cannot be detected. For this reason, by outputting the reference sound from the speaker 61 during the time when the sound related to the audio conference is not output from the speaker 61, the reference sound is distorted, the band is cut, or the reference sound is not collected. And the accuracy of grouping can be improved. In the second grouping process, the reference sound is output from the speaker 61 of the sound input / output device 20 a plurality of times, thereby further improving the grouping accuracy.

  As illustrated in FIG. 4, after the second grouping process (see FIG. 4), the CPU 41 weights a plurality of sounds to be superimposed in the process of creating a superimposed sound based on the updated first table 441. A process for determining the weights to be performed (weight determination process, see FIG. 8) is executed (S29). Details of the weight determination processing will be described later. After the end of the weight determination process, the CPU 41 returns the process to S25.

  On the other hand, when it is determined in S25 that the sound input / output device 20 is not newly wired or wirelessly connected (S25: NO), the CPU 41 uses the timer to calculate the elapsed time since the start of the update in S23. To identify. The CPU 41 determines whether the specified elapsed time has become an integral multiple of a predetermined time (for example, 20 seconds) (S31). If the specified elapsed time is not an integral multiple of the predetermined time (S31: NO), the CPU 41 determines whether the sound input / output device 20 in a wired or wireless connection state is disconnected (S37). When the CPU 41 continues to receive sound signals from the connected sound input / output device 20, the CPU 41 determines that the sound input / output device 20 is in a connected state (S37: NO). In this case, the CPU 41 returns the process to S25.

  On the other hand, when the state in which the sound signal cannot be received from the connected sound input / output device 20 continues for a predetermined time (for example, 30 seconds) or longer, the CPU 41 determines that the sound input / output device 20 is disconnected (S37: YES). The CPU 41 updates the first table 441 (S39). Specifically, the CPU 41 deletes the device ID of the disconnected sound input / output device 20 and the connection form, group ID, and other ID corresponding to the device ID from the first table 441. Further, when the device ID of the disconnected sound input / output device 20 is stored as another device ID of the first table 441, the CPU 41 has another device identical to the device ID of the disconnected sound input / output device 20. The ID is also deleted.

  As a result of updating the first table 441 in S39, the CPU 41 determines whether the sound input / output device 20 is wired or wirelessly connected (S41). When the sound input / output device 20 is connected (S41: YES), the CPU 41 weights a plurality of sounds to be superimposed in the process of creating a superimposed sound based on the updated first table 441. Is executed (weight determination process, see FIG. 8) (S42). Details of the weight determination processing will be described later. After the weight determination process, the CPU 41 returns the process to S25. On the other hand, when there is no sound input / output device 20 to be connected (S41: NO), the CPU 41 returns the process to S11.

  When the acquired elapsed time is an integral multiple of the predetermined time in S31 (S31: YES), the CPU 41 determines the installation position and connection of the sound input / output device 20 based on the information stored in the first table 441. A process (third grouping process, see FIG. 7) for periodically grouping the sound input / output devices 20 according to the change in form is executed (S33).

  The third grouping process will be described with reference to FIG. CPU41 starts reception of the sound signal transmitted from the sound input / output device 20 (S91). The CPU 41 starts updating a timer for receiving a sound signal transmitted from the sound input / output device 20 for a predetermined time (S93). When the timer update is started, the timer is updated at a predetermined cycle (for example, 1 ms). Based on the timer, the CPU 41 can specify the elapsed time since the start of the timer update in S93.

  CPU41 specifies the elapsed time after starting update by S93 based on a timer. The CPU 41 determines whether or not the specified elapsed time is equal to or longer than a predetermined time (for example, 1 second) (S95). When the specified elapsed time is less than the predetermined time (S95: NO), the CPU 41 returns the process to S95, and the reception of the sound signal is continued. When the specified elapsed time is equal to or longer than the predetermined time (S95: YES), the CPU 41 stops updating the timer started in S93. The CPU 41 stops receiving the sound signal (S96). Thus, the sound signal transmitted from the sound input / output device 20 is received for a predetermined time. When sound signals are transmitted from each of the plurality of sound input / output devices 20, the CPU 41 receives the plurality of sound signals transmitted from each of the plurality of sound input / output devices 20 for a predetermined time.

  When a sound signal is received from each of the plurality of sound input / output devices 20, the CPU 41 performs sound input / output device 20 based on the similarity of the sound based on each of the plurality of sound signals received for a predetermined time. The grouping is determined (S97). Hereinafter, with respect to the installation positions of the sound input / output devices 21 to 25 shown in FIG. 1, the sound is input to the region where the sound input / output device 25 is installed among the regions in the first base 3 separated by the barrier 5 (see FIG. 1). The case where the input / output device 28 is newly installed and the sound input / output device 23 moves to the area where the sound input / output devices 25 and 28 are installed (arrow 102) will be described as an example.

  FIG. 12 shows changes over time in the volume of sound based on sound signals received for a predetermined time from each of the sound input / output devices 21 to 25 and 28. CPU41 specifies the similarity of a sound by taking a cross correlation by a well-known method based on the waveform which shows a time-dependent change of a sound volume. When the correlation coefficient is a value close to “1” or “−1”, the CPU 41 may determine that there is a cross-correlation, and may determine that the tendency of change in volume is the same for both. On the other hand, when the correlation coefficient is a value close to “0”, the CPU 41 may determine that there is no cross-correlation and determine that the tendency of the volume change is different between the two. For example, in FIG. 12, the correlation coefficient of the waveform indicating the change over time in the volume of the sound based on the sound signals received from the sound input / output devices 21, 22, and 24 is close to “0”. There is no cross-correlation between them. For this reason, the CPU 41 is similar to the sounds based on the sound signals received from the sound input / output devices 21, 22, 24, that is, the sounds collected by the microphones 60 of the sound input / output devices 21, 22, 24. Judge not to. On the other hand, the correlation coefficient of the waveform indicating the temporal change in the volume of the sound based on the sound signal received from each of the sound input / output devices 23, 25, and 28 is close to “1”, and the mutual correlation between the waveforms. There is a correlation. For this reason, it is determined that the sounds based on the sound signals received from the sound input / output devices 23, 25, 28, that is, the sounds collected by the microphones 60 of the sound input / output devices 23, 25, 28 are similar to each other. Is done. The CPU 41 groups the sound input / output devices 23, 25, and 28 that have transmitted sound signals of sounds determined to be similar.

  In addition, when taking the cross correlation of the waveform of a sound volume change with time, it is preferable that the waveforms which show the time-dependent change of the sound volume based on different sound signals are synchronized. Waveform synchronization may be performed, for example, by correcting the time axis of the waveform based on the transmission delay time of the sound signal. For example, the CPU 41 corrects the time axis of the change over time in the volume of the sound based on the sound signal received from the sound input / output devices 21 and 22 connected by wire by the transmission delay time t1 (for example, 1 ms), and wirelessly connects. The time axis of the temporal change in the volume of the sound based on the sound signals received from the sound input / output devices 23 to 25 and 28 is corrected by the transmission delay time t2 (where t1 <t2, for example, 200 ms). Thus, both waveforms may be synchronized.

  As shown in FIG. 7, the CPU 41 determines whether or not the configuration of the group to which each of the sound input / output devices 21 to 25 and 28 belongs has been changed by the group determination in S97. When the group configuration is changed (S99: YES), the CPU 41 determines that the first table 441 needs to be updated. The CPU 41 updates the first table 441 based on the group determination result of S97 (S101). The CPU 41 ends the third grouping process and returns the process to the first main process (see FIG. 4). On the other hand, if the group configuration is not changed by the group determination of S97 (S99: NO), the first table 441 is not updated, the CPU 41 ends the third group process, and the process is the first main process (FIG. Return to 4).

  In the case of the specific example described above, the CPU 41 associates the common group ID “9” with the device IDs “23”, “25”, and “28” in the first table 441 of FIG. Further, the CPU 41 associates device IDs “25” and “28” as other device IDs corresponding to the device ID “23”, and device IDs “23” and “28” as other device IDs corresponding to the device ID “25”. And device IDs “23” and “25” are associated as other device IDs corresponding to the device ID “28”. Further, the CPU 41 deletes another device ID “23” corresponding to the device ID “24”.

  As shown in FIG. 4, after the third grouping process (S33) is completed, the CPU 41 determines whether the first table 441 has been updated by the third grouping process (S35). When the first table 441 has not been updated (S35: NO), the CPU 41 returns the process to S25. On the other hand, when the first table 441 is updated (S35: YES), the CPU 41 determines a weight when weighting a plurality of sounds to be superimposed in the process of creating a superimposed sound (weight determination process, FIG. 8). (Refer to step S29). After the end of the weight determination process, the CPU 41 returns the process to S25.

  The weight determination process will be described with reference to FIG. In the weight determination process, the CPU 41 adds the sound signal transmitted from the sound input / output device 20 belonging to the specific group to the superimposed sound that is the basis of the sound signal transmitted to the sound input / output device 20 belonging to the specific group. The sound based on the sound signal received from the sound input / output device 20 and the sound control device 15 is superimposed so that the sound based on the sound is not included. Further, the CPU 41 sets the sound to be superimposed so that the superimposed sound obtained by superimposing the sounds based on the sound signals received from the sound input / output devices 20 belonging to the respective groups becomes a sound with a balanced volume for each group. Weigh each one. Specifically, it is as follows. In the sound input / output devices 20 belonging to the same group, there is a high possibility that the sound signals of the same sound are collected via the microphone 60. For this reason, when sounds based on these sound signals are superimposed, the volume of the superimposed sound increases as the number of sound input / output devices 20 belonging to the group increases. For this reason, the CPU 41 determines the weight according to the number of the sound input / output devices 20 belonging to the group, and performs weighting with the determined weight for each of the sounds to be superimposed, so that the volume of the superimposed sound is uniform for each group. To be.

  The CPU 41 calculates a weight for weighting the sound to be superimposed (S111), and creates a second table 442 (see FIG. 14, described later) (S113). After the creation of the second table 442 is completed, the weighting process ends, and the CPU 41 returns the process to the first main process (see FIG. 4). The second table 442 is referred to when a superimposed sound is created by superimposing sounds based on sound signals in a second main process (see FIG. 9) described later.

  Hereinafter, with respect to the installation positions of the sound input / output devices 21 to 25 shown in FIG. 1, the sound is input to the region where the sound input / output device 25 is installed among the regions in the first base 3 separated by the barrier 5 (see FIG. 1). As an example, a case where the input / output device 28 is newly installed (arrow 101) and the sound input / output device 23 is moved to the area where the sound input / output devices 25 and 28 are installed (arrow 102) will be described. A case where the weight is calculated with reference to the first table 441 in FIG. 13 and the second table 442 in FIG. 14 is created will be specifically described.

  Since the sound input / output devices 21 and 22 belong to the group 6, the CPU 41 outputs the superimposed sound that is the basis of the sound signal transmitted to the sound input / output devices 21 and 22 to the sound input / output devices 23 to 25 and 28. The sound based on the sound signal received from the sound control device 15 and the sound based on the sound signal received from the sound control device 15 are superimposed on each other. Here, since the sound input / output devices 23, 25, 28 belong to the group 9, the sounds received by the sound input / output devices 23, 25, 28 via the microphone 60 are correlated with each other. Therefore, the CPU 41 outputs only the sound based on the sound signal received from any one of the sound input / output devices 23, 25, and 28 (for example, the sound input / output device 23) to each of the sound input / output device 24 and the sound control device 15. Is superimposed on the sound based on the sound signal received from, and a superimposed sound is created.

  Further, the CPU 41 specifies the total number of sounds to be superimposed. In the case of the sound control system 1 of FIG. 1, the number “2” obtained by subtracting “1” of the group 6 minutes from the total number “3” of the groups (groups 6, 7, 9) in the first base 3 is “3” obtained by adding the number “1” of the sound control devices 15 to be connected via this is the total number of sounds to be superimposed. The CPU 41 determines a weight “1/3” having the total number “3” of sounds to be superimposed in the denominator as a weight corresponding to each sound to be superimposed (S111).

  Since the sound input / output devices 23, 25, and 28 belong to the group 9, the CPU 41 outputs the superimposed sound that is the basis of the sound signal to be transmitted to the sound input / output devices 23, 25, and 28 to the sound input / output device 21. , 22, 24, and the sound based on the sound signal received from the sound control device 15. Here, since the sound input / output devices 21 and 22 belong to the same group 6, the CPU 41 outputs the sound signal received from either of the sound input / output devices 21 and 22 (for example, the sound input / output device 21). Only the sound based on it is superimposed on the sound based on the sound signal received from each of the sound input / output device 24 and the sound control device 15 to create a superimposed sound. Further, since the total number of sounds to be superimposed is “3” as in the case of transmitting a sound signal to the sound input / output device 21, the CPU 41 determines “1/3” as a weight corresponding to each sound to be superimposed. (S111).

  Since the sound input / output device 24 belongs to the group 7, the CPU 41 uses the sound input / output devices 21 to 23, 25, and the sound that are the basis of the sound signal transmitted to the sound input / output device 24 as sound. It is created by superimposing sounds based on the sound signal received from the control device 15. Here, the sound input / output devices 21, 22 belong to the same group 6, and the sound input / output devices 23, 25, 28 belong to the same group 9. The CPU 41 selects one of the sound input / output devices 21 and 22 (for example, the sound input / output device 21) (for example, the sound input / output device 21). The sound based on the sound signal received from 23) and the sound based on the sound signal received from the sound control device 15 are superimposed to create a superimposed sound. Further, since the total number of sounds to be superimposed is “3”, the CPU 41 determines “1/3” as the weight corresponding to each sound to be superimposed (S111).

  The CPU 41 creates a superimposed sound that is a basis of a sound signal transmitted to the sound control device 15 by superimposing sounds based on the sound signals received from the sound input / output devices 21 to 25 and 28. Here, the sound input / output devices 21, 22 belong to the same group 6, and the sound input / output devices 23, 25, 28 belong to the same group 9. The CPU 41 selects one of the sound input / output devices 21 and 22 (for example, the sound input / output device 21) (for example, the sound input / output device 21). The sound based on the sound signal received from 23) and the sound based on the sound signal received from the sound input / output device 24 are superimposed to create a superimposed sound.

  Further, the CPU 41 specifies the total number of sounds to be superimposed. In the case of the sound control system 1 in FIG. 1, the total number “3” of the groups (groups 6, 7, 9) in the first base 3 is the total number of sounds to be superimposed. The CPU 41 determines a weight “1/3” having the total number “3” of sounds to be superimposed in the denominator as a weight corresponding to each sound to be superimposed (S111).

  As shown in FIG. 14, in the second table 442, the device ID (transmission source device ID) of the sound input / output device 20 or the sound control device 15 that transmits the sound signal is associated with the weight for each device ID. Yes. When the weight is determined as described above, the weight “1/3” is associated with the device IDs “23”, “24”, and “15” with respect to the transmission destination device IDs “21” and “22”, respectively. The weights “0” are associated with the IDs “21”, “22”, “25”, and “28” (S113). This means that a weight “1/3” is applied to the sound volume based on the sound signals received from the sound input / output devices 23 and 24 and the sound control device 15, and the sound input / output devices 21, 22, 25, This means that the weight “0” is applied to the volume of the sound based on the sound signal received from each of the 28. Also, with respect to the transmission destination device IDs “23”, “25” and [28], the device IDs “21”, “24” and “15” are associated with the weight “1/3”, and the other device IDs “22”. The weight “0” is associated with each of “23” “25” “28” (S113). This applies a weight “1/3” to the sound volume based on the sound signals received from the sound input / output devices 21, 24 and the sound control device 15, and the sound input / output devices 22, 23, 25, This means that the weight “0” is applied to the volume of the sound based on the sound signal received from each of the 28.

  The second main process will be described with reference to FIG. The CPU 41 receives the sound signal transmitted from the sound input / output device 20 connected by wire or wirelessly for a predetermined time (S120). The CPU 41 receives the sound signal transmitted from the sound control device 15 for a predetermined time (S121). The CPU 41 refers to the second table 442 (see FIG. 14) and sequentially selects the transmission destination device ID (S123). The CPU 41 creates a superimposed sound as a basis of a sound signal to be transmitted to the sound input / output device 20 or the sound control device 15 of the selected transmission destination device ID as follows.

  The CPU 41 adjusts the volume of the sound to be superimposed by multiplying the volume of the sound based on the sound signal received in S120 and S121 by the weight corresponding to the transmission destination device ID selected in the second table 442. (S125). The CPU 41 creates a superimposed sound by superimposing sounds with adjusted volumes (S127). When the transmission destination device ID selected in S123 is the device ID of the sound input / output device 20 (S129), the CPU 41 uses the generated superimposed sound signal as the sound input of the transmission destination device ID selected in S123. The data is transmitted to the output device 20 (S131). The CPU 41 advances the process to S135. On the other hand, when the transmission destination device ID selected in S123 is the sound control device 15 (S129: NO), the CPU 41 sends the generated superimposed sound signal to the sound control device 15 selected in S123. Transmit (S133). The CPU 41 advances the process to S135.

  The CPU 41 determines whether all the transmission destination device IDs stored in the second table 442 have been selected (S135). When all the transmission destination device IDs are not selected (S135: NO), the CPU 41 returns the process to S123. The CPU 41 selects one of the transmission destination device IDs not selected in S123, and repeats the process. On the other hand, when all the transmission destination device IDs stored in the second table 442 are selected and the sound signal of the superimposed sound is transmitted (S135: YES), the CPU 41 returns the process to S120.

  For example, a case where a superimposed sound that is a basis of a sound signal transmitted from the CPU 41 to the sound input / output device 21 is created will be described as an example. The CPU 41 includes, in the second table 442, the sound input / output devices 23 and 24 having the device IDs “23”, “24”, and “15” in which the weight “1/3” is associated with the transmission destination device ID “21”, and The sound signal received from the sound control device 15 is selected from the sound signals received in S120 and S121. The CPU 41 multiplies the sound volume (represented as P, Q, and R, respectively) based on the selected sound signal by a weight “1/3”. The CPU 41 creates a superimposed sound by superimposing sounds to which weights are applied. When the volume of the superimposed sound is expressed as S, the relationship S = P / 3 + Q / 3 + R / 3 is established.

  As described above, the CPU 41 of the sound control device 16 does not transmit the sound signal received from the sound input / output device 20 to the sound input / output device 20 belonging to the same group as the sound input / output device 20. The reason is that there is a high possibility that the users 30 of the plurality of sound input / output devices 20 belonging to the same group can directly hear each other. As a result, the CPU 41 can prevent the user 30 from hearing the sound that can be heard directly and the sound output from the speaker 61 of the sound input / output device 20 overlapping. Therefore, even when there is a difference between the sound that can be heard directly and the sound that is output from the speaker 61, the user 30 can easily hear the sound of the other user 30.

  The CPU 41 transmits the sound signal received from the sound input / output device 20 to another sound input / output device 20 belonging to a group different from the sound input / output device 20. Accordingly, even when the users 30 of the plurality of sound input / output devices 20 cannot directly hear each other, the users 30 listen to each other's sounds via the speaker 61 of the sound input / output device 20. be able to.

  Further, when the volume of the reference sound collected by the sound input / output device 20 is equal to or higher than the predetermined threshold (S59: YES), the CPU 41 transmits the reference sound and the reference sound with the volume equal to or higher than the predetermined threshold. The sound input / output devices 20 that have received are grouped (S61). The reason is that, since the reference sound is transmitted between the plurality of sound input / output devices 20, the users 30 of the plurality of sound input / output devices 20 may be able to directly hear each other's voice. is there. As a result, the CPU 41 can appropriately prevent the user 30 from hearing the sound that can be heard directly and the sound output from the speaker 61 overlapping.

  The CPU 41 outputs a reference sound having a predetermined peak frequency from the sound input / output device 20 (S55, S73), and determines whether to group based on this reference sound (S59, S83). The CPU 41 can group the sound input / output devices 20 appropriately even when noise other than the reference sound is included in the sound signal by performing grouping based on the volume of the peak frequency of the reference sound. Furthermore, the CPU 41 can determine whether to group by simply comparing the volume of the reference sound and the predetermined threshold by outputting the reference sound from the sound input / output device 20 at a predetermined volume, thereby facilitating the determination.

  Further, the CPU 41 groups the sound input / output devices 20 when the tendency of the volume change of the sounds collected by the plurality of sound input / output devices 20 with each other coincides (S97). The reason is that common sounds are collected in the plurality of sound input / output devices 20, so that each user 30 of the plurality of sound input / output devices 20 can directly hear each other's voice. This is because there is a high possibility. Thus, the CPU 41 can appropriately prevent the sound that can be heard directly and the sound output from the speaker 61 from being heard by the user.

  In addition, even when the volume of the sound collected by the sound input / output device 20 changes depending on the environment, the CPU 41 makes a determination based on the tendency of the volume of the sound to change over time. Can be appropriately grouped.

  The CPU 41 can also group the sound input / output devices 20 without outputting the reference sound from the sound input / output device 20 (third grouping process). For this reason, the CPU 41 can group the sound input / output devices 20 without disturbing the progress of the audio conference executed in the sound input / output device 20.

  Further, the CPU 41 groups the sound input / output devices 20 connected to the sound control device 16 via a wire (USB or line cable). The reason is that such a sound input / output device 20 is likely to be installed close to each other, and it is highly possible that each user 30 of the sound input / output device 20 can directly hear the sound. . As a result, the CPU 41 can easily execute the grouping of the sound input / output devices 20.

  In addition, since the CPU 41 performs a grouping process every time the sound input / output device 20 is newly connected (first grouping process), the grouping of the newly connected sound input / output devices 20 is appropriately executed without omission. It becomes possible to do. Further, since the CPU 41 periodically performs the grouping process (second grouping process), even when the connection state of the sound input / output device 20 changes during the audio conference, the connection state of the sound input / output device 20 is accurately determined. And can be grouped.

  Further, the CPU 41 determines a weight based on the total number of groups (S111), and creates the second table 442. The CPU 41 applies a weight to the sound based on the sound signal received from the sound input / output device 20 and the other sound control device 15 to create a superimposed sound, so that the sound input / output device 20 is based on the sound signal. The volume of the sound output from the speaker 61 can be balanced.

  In addition, this invention is not limited to the above-mentioned embodiment, A various change is possible. In the above-described embodiment, the sound input / output device 20 may be directly connected to the PC 13. The function of the sound control device 16 may be realized by the PC 13. In this case, when an instruction for starting an application for functioning as the sound control device 16 is input, the CPU of the PC 13 reads out and executes the sound control program stored in the HDD, thereby executing the first main process and The second main process may be started.

  In the above-described embodiment, the CPU 41 transmits instruction data to cause the sound input / output device 20 to output a reference sound (S55, S73). When receiving the instruction data, the CPU 51 of the sound input / output device 20 outputs a reference sound via the speaker 61 based on the sound signal stored in the flash memory 54. On the other hand, the CPU 41 of the sound control device 16 may transmit a sound signal of a reference sound having a predetermined volume to the sound input / output device 20. The CPU 51 of the sound input / output device 20 may output a reference sound having a predetermined volume from the speaker 61 based on the received sound signal of the reference sound.

  The method of group determination (S97) in the third grouping process (see FIG. 7) can be changed to a method other than the method of taking the cross correlation. For example, the CPU 41 may periodically extract the volume from a waveform indicating a change over time in the volume of the sound based on the sound signal, and specify the tendency of increase / decrease with time of the extracted volume. CPU41 may group the sound input / output devices 20 which transmitted the sound signal of each sound into the same group, when the tendency of the increase / decrease accompanying the time change of a volume corresponds.

  The weight determination method in the weight determination process (see FIG. 8) can be changed. For example, the CPU 41 may determine the weight in the case of creating a superimposed sound that is the basis of the sound signal transmitted to the sound input / output devices 21 and 22 (group 6) as follows.

  The CPU 41 is connected to the number “2” obtained by subtracting “1” of the group 6 minutes from the total number “3” of the groups (groups 6, 7, 9) in the first base 3 through the Internet network 2. “3” obtained by adding the number “1” of 15 is calculated. The weight “1/3” having the calculated “3” in the denominator is determined as the first weight. Next, the CPU 41 determines a weight having the number of sound input / output devices 20 belonging to the group as a second weight for each group. For example, in the case of group 9, since a total of three sound input / output devices 20 (sound input / output devices 23, 25, and 28) are included, “1/3” is determined as the second weight corresponding to group 9. . Similarly, “1/1” is determined as the second weight corresponding to the group 7. Since the number of sound control devices 15 connected via the Internet 2 is one, “1/1” is determined as the second weight corresponding to the sound control device 15.

  The CPU 41 finally determines the weight by multiplying the determined first weight and second weight. Specifically, “1/3” (1/3 × 1/1) is finally determined as the weight corresponding to the sound input / output devices 24 belonging to the group 7. Further, “1/9” (1/3 × 1/3) is finally determined as the weight corresponding to the sound input / output devices 23, 25, and 28 belonging to the group 9. As a weight corresponding to the sound control device 15, “1/3” (1/3 × 1/1) is finally determined. The determined weight is stored in the second table 442 (see FIG. 15).

  Similarly, for example, the weight in the case of creating a superimposed sound that is the basis of the sound signal transmitted from the CPU 41 to the sound input / output devices 23, 25, and 28 (group 9) is determined as follows. The CPU 41 determines the first weight “1/3” in the same manner as described above. Next, since the group 6 includes a total of two sound input / output devices 20 (sound input / output devices 21, 22), the CPU 41 determines “½” as the second weight corresponding to the group 6. . “1/1” is determined as the second weight corresponding to the group 7, and “1/1” is determined as the second weight corresponding to the sound control device 15. The CPU 41 finally determines the weight by multiplying the determined first weight and second weight. Specifically, “1/6” (1/3 × 1/2) is finally determined as the weight corresponding to the sound input / output devices 21 and 22 belonging to the group 6. Further, the weight “1/3” (1/3 × 1/1) corresponding to the sound input / output devices 24 belonging to the group 7 and the weight “1/3” (1/3 ×) corresponding to the sound control device 15 are included. 1/1) is finally determined. As described above, the second table 442 shown in FIG. 15 is created.

  When the weight is determined as described above, only the sound collected through the microphone 60 of the specific sound input / output device 20 among the plurality of sound input / output devices 20 belonging to the same base is prevented from being emphasized. it can. For example, when the sound uttered by the user 31 arranged in the vicinity of the sound input / output device 21 is collected via the microphones 60 of the sound input / output devices 21 and 22 belonging to the group 6, the sound input / output device 21. However, the volume of the sound collected through the microphone 60 is larger than the volume of the sound collected through the microphone 60 by the sound input / output device 22. Here, as in the above-described embodiment, when only the weight corresponding to one of the sound input / output devices 21 and 22 belonging to the group 6 is determined (one of the weights is “1” and the remaining is “0”). ), The volume of the sound of the user 31 included in the generated superimposed sound may become extremely large or extremely small. On the other hand, in the above-described modification, since the weights corresponding to the sound input / output devices 21 and 22 are equally assigned, the sound volume of the user 31 included in the superimposed sound is averaged. In this way, the CPU 41 can prevent the sound volume of the specific user 30 included in the superimposed sound from becoming extremely large or small.

  In the above description, the weights are determined according to the total number of sound input / output devices 20 belonging to each base and the number of sound input / output devices 20 belonging to each group. However, the CPU 41 is based on other methods. The weight may be determined. For example, the CPU 41 may determine the weight based on the sound volume based on the sound signal transmitted from the sound input / output device 20. More specifically, the CPU 41 compares the volume of a plurality of sound signals received from each of the plurality of sound input / output devices 20 and belongs to the sound input / output device 20 that has transmitted a sound signal having a relatively low volume. The weight corresponding to the group may be reduced, and the weight corresponding to the group to which the sound input / output device 20 that has transmitted the sound signal having a relatively large volume belongs may be increased. In the sound input / output device 20 that has transmitted a sound signal having a relatively large volume, since there is a high possibility that the user 30 is speaking in the audio conference, the user who speaks in the audio conference is weighted as described above. The sound of 30 can be easily heard, and at the same time, the volume of noise other than the voice of the speaker can be reduced.

  Specifically, it is as follows. The sound volume based on the sound signals received from the sound input / output devices 21 and 22 belonging to the group 6 and the sound input / output device 24 belonging to the group 7 is based on the sound signals received from the other sound input / output devices 20. A case where the volume is relatively larger than the sound volume will be described as an example. In this case, there is a possibility that a conversation is being performed via the audio conference between the users 31 and 32 of the sound input / output devices 21 and 22 and the user 34 of the sound input / output device 24. Therefore, the CPU 41 determines the weight so that the sound volume based on the sound signals received from the sound input / output devices 21, 22, and 24 is increased in order to increase the volume of the conversational voice, and sets the second table 442. create.

  Specifically, the second table 442 shown in FIG. 16 is created. When compared with the second table of FIG. 15, the weight of the device ID “24” corresponding to the transmission destination device IDs “21” and “22” is changed to “1”. In addition, the weights of the device IDs “21” and “22” corresponding to the transmission destination device IDs “23”, “25”, “28”, and “15” are changed to “¼”, and the weight of the device ID “24” is “ It has been changed to “1/2”. Further, the weights of the device IDs “21” and “22” corresponding to the transmission destination device ID “24” are changed to “1/2”. In this way, the CPU 41 adjusts the respective weights so that the sum of the weights corresponding to the sound input / output devices 21, 22, and 24 that may have a conversation is “1”. The weights corresponding to the other sound input / output devices 20 may be maintained as they are. As a result, even when a conversation is started between other users 30, a superimposed sound obtained by superimposing the voices of the users 30 whose conversation has been started can be immediately generated and output from the speaker 61. It is possible to prevent the start portion from being interrupted and the sound output from being started in the middle of the conversation.

  As described above, when the weight is determined based on the volume of the sound based on the sound signal transmitted from the sound input / output device 20, the weight is determined so that the weight can be adjusted immediately in response to the change in the volume. The processing (see FIG. 8) is preferably executed frequently in a short cycle. Therefore, it is preferable that the period monitored in S31 of the first main process (see FIG. 4) is short. Note that when the CPU 41 receives the sound signal in the second main process (see FIG. 9) (S121), the CPU 41 compares the sound volumes based on the sound signals with each other, and transmits the sound signal having a relatively large volume. When the input / output device 20 is changed, the weight determination process may be executed. Further, when comparing the sound volumes based on the sound signals, the CPU 41 may identify the sound volume generated by the user 30 by performing a well-known sound detection process and compare the sound volumes. .

  The CPU 41 may not perform the grouping process based on the connection form (wired connection / wireless connection) in S53 and S71. Even in this case, the CPU 41 can appropriately group the sound input / output devices 20 by the grouping process (S61, S85) based on the volume based on the received sound signal. In addition, by performing the grouping process according to the connection form (wired connection / wireless connection) in S53 and S71, the CPU 41 reduces the processing load when, for example, all the sound input / output devices 20 are wired. Grouping can be performed.

  The CPU 41 may specify that a specific button (independent button) of the operation unit 59 of the sound input / output device 20 has been pressed by receiving a notification from the sound input / output device 20. When the sound input / output device 20 whose independent button is pressed is specified, the CPU 41 performs the first grouping process to prevent the sound input / output device 20 and other sound input / output devices 20 from being grouped into the same group. A third grouping process may be executed. That is, the CPU 41 may treat the sound input / output device 20 whose independent button is pressed as the sound input / output device 20 belonging to an independent group.

  The CPU 41 that performs the processes of S57, S75, and S91 corresponds to the “reception unit” of the present invention. The CPU 41 that performs the processes of S51, S59, S71, S77, and S97 corresponds to the “determination means” of the present invention. The CPU 41 that performs the processes of S52, S61, S79, S87, and S101 corresponds to the “storage control unit” of the present invention. The CPU 41 that performs the process of S131 corresponds to the “first transmission unit” of the present invention. The CPU 41 that performs the process of S133 corresponds to the “second transmission unit” of the present invention. The CPU 41 that performs the process of S55 corresponds to the “control unit” of the present invention. The CPU 41 that performs the process of S59 corresponds to the “first determination unit” of the present invention. The CPU 41 that performs the process of S61 corresponds to the “first storage control unit” of the present invention. The CPU 41 that performs the process of S97 corresponds to the “second determination unit” of the present invention. The CPU 41 that performs the processing of S101 corresponds to the “second storage control unit” of the present invention. The CPU 41 that performs the processes of S51 and S71 corresponds to the “third determination unit” of the present invention. The CPU 41 that performs the processes of S52 and S87 corresponds to the “third storage control means” of the present invention. The processes of S57, S75, and S91 correspond to the “reception step” of the present invention. The processing of S51, S59, S71, S77, and S97 corresponds to the “determination step” of the present invention. The processing of S52, S61, S79, S87, and S101 corresponds to the “storage control step” of the present invention. The process of S131 corresponds to the “first transmission step” of the present invention. The process of S133 corresponds to the “second transmission step” of the present invention.

1 sound control system 14, 15, 16 sound control device 20, 21, 22, 23, 24, 25, 26, 27, 28 sound input / output device 41 CPU
60 Microphone 61 Speaker 441 First table 442 Second table

Claims (9)

Collecting sound via a microphone, and receiving a sound signal that is a collected sound signal from a plurality of sound input / output devices that output sound from a speaker, and transmitting them to other sound control devices, The sound that is received by the other sound control device from the other sound input / output devices from the other sound control device, and the received sound signal is transmitted to the plurality of sound input / output devices. A control device,
Receiving means for receiving sound signals of sounds collected through the microphones of the plurality of sound input / output devices from the plurality of sound input / output devices;
Determining means for determining whether to group some of the plurality of sound input / output devices among the plurality of sound input / output devices;
Storage control means for associating information indicating a plurality of sound input / output devices determined to be grouped by the determination means as information indicating sound input / output devices belonging to the same group, and storing the information in storage means;
First transmission means for transmitting sound signals received from the other sound control devices and the plurality of sound input / output devices to the plurality of sound input / output devices;
When a sound signal is received from a specific sound input / output device among the plurality of sound input / output devices, at least one belonging to the same group as the specific sound input / output device is based on information stored in the storage means. Second transmitting means for transmitting the sound signal to at least one sound input / output device not belonging to the same group as the specific sound input / output device without transmitting the sound signal to one sound input / output device; A sound control apparatus comprising: Control means for controlling each of the plurality of sound input / output devices and outputting a reference sound having a predetermined frequency and a predetermined volume from the speaker;
The receiving means includes
Receiving sound signals from a plurality of sound input / output devices other than any of the sound input / output devices that output the reference sound from the speaker among the plurality of sound input / output devices;
The determination means includes
Among the plurality of sound signals received by the receiving means, a sound input / output device that transmits a sound signal having a volume of the predetermined frequency equal to or higher than a predetermined threshold, and any one of the sound input / output devices is grouped Provided with a first determination means for determining that
The storage control means
First storage control means for associating information indicating each of the sound input / output devices determined to be grouped by the first determination means and the plurality of sound input / output devices and storing the information in the storage means is provided. The sound control apparatus according to claim 1. The determination means includes
A second judgment is made to group a plurality of sound input / output devices that have transmitted a plurality of sound signals whose sounds have the same tendency of change over time among the plurality of sound signals received by the receiving means. With judgment means,
The storage control means
2. The second storage control means for associating information indicating the plurality of sound input / output devices determined to be grouped by the second determination means and storing the information in the storage means. Sound control device. The determination means includes
When a plurality of sound input / output devices are connected via a wired line, a third determination means for determining to group the plurality of sound input / output devices connected via a wired line is provided,
The storage control means
A third storage control means for associating pieces of information indicating a plurality of sound input / output devices that are determined to be grouped by the third determination means and connected via wires and storing the information in the storage means is provided. The sound control device according to claim 1. The determination means includes
5. The sound control device according to claim 1, wherein when the sound input / output devices are connected, it is determined whether to group the some of the plurality of sound input / output devices. 6. The determination means includes
5. The method according to claim 1, wherein it is determined whether to group the some of the plurality of sound input / output devices based on the sound signals received from the plurality of sound input / output devices at a constant period. The sound control device described in 1. The second transmission means includes
The total number of groups in which the volume of the sound indicated by the sound signal received from the specific sound input / output device is specified based on the information stored in the storage means, and a plurality of sound input / output devices belonging to the group And changing the sound signal of the sound having the changed volume to the other sound control device and the at least one sound input / output device. Item 7. The sound control device according to any one of Items 1 to 6. Collecting sound via a microphone, and receiving a sound signal that is a collected sound signal from a plurality of sound input / output devices that output sound from a speaker, and transmitting them to other sound control devices, The sound that is received by the other sound control device from the other sound input / output devices from the other sound control device, and the received sound signal is transmitted to the plurality of sound input / output devices. A control method,
Receiving a sound signal of a sound collected through each microphone of the plurality of sound input / output devices from the plurality of sound input / output devices;
A determination step of determining whether to group some of the plurality of sound input / output devices among the plurality of sound input / output devices;
A storage control step of associating pieces of information indicating a plurality of sound input / output devices determined to be grouped by the determination step as information indicating sound input / output devices belonging to the same group, and storing the information in a storage unit;
A first transmission step of transmitting the received sound signal to the plurality of sound input / output devices when a sound signal is received from the other sound control device;
When a sound signal is received from a specific sound input / output device among the plurality of sound input / output devices, the received sound signal is transmitted to the other sound control device and stored in the storage means Based on the information, the sound signal is not transmitted to at least one sound input / output device belonging to the same group as the specific sound input / output device, and at least one not belonging to the same group as the specific sound input / output device A sound control method comprising: a second transmission step of transmitting the sound signal to a sound input / output device. Collecting sound via a microphone, and receiving a sound signal that is a collected sound signal from a plurality of sound input / output devices that output sound from a speaker, and transmitting them to other sound control devices, The sound that is received by the other sound control device from the other sound input / output devices from the other sound control device, and the received sound signal is transmitted to the plurality of sound input / output devices. A sound control program executed by a control device,
Receiving a sound signal of a sound collected through each microphone of the plurality of sound input / output devices from the plurality of sound input / output devices;
A determination step of determining whether to group some of the plurality of sound input / output devices among the plurality of sound input / output devices;
A storage control step of associating pieces of information indicating a plurality of sound input / output devices determined to be grouped by the determination step as information indicating sound input / output devices belonging to the same group, and storing the information in a storage unit;
A first transmission step of transmitting the received sound signal to the plurality of sound input / output devices when a sound signal is received from the other sound control device;
When a sound signal is received from a specific sound input / output device among the plurality of sound input / output devices, the received sound signal is transmitted to the other sound control device and stored in the storage means Based on the information, the sound signal is not transmitted to at least one sound input / output device belonging to the same group as the specific sound input / output device, and at least one not belonging to the same group as the specific sound input / output device A sound control program for causing a computer of the sound control device to execute a second transmission step of transmitting the sound signal to the sound input / output device.

Images