JP6473203B1 - Server apparatus, control method, and program - Google Patents

Abstract

A server device, a control method, and a program capable of smoothly executing voice communication performed via a plurality of electronic devices are provided.
A server device that controls output of audio data from a plurality of electronic devices, a group determining unit that divides the plurality of electronic devices into at least a first group and a second group, and a first group. When the first electronic device to which the first electronic device belongs acquires audio data, the first electronic device is controlled so that the audio data is output from the second electronic device belonging to the second group, and the first electronic device belonging to the first group And an output control unit 36 that performs control so that the audio data is not output from other electronic devices.
[Selection] Figure 1

Description

  The present invention relates to a server device, a control method, and a program.

  Conventionally, a video teleconference system has been used as a means for communication between distant persons. For example, in a teleconference system, a communication control device equipped with a microphone, a speaker, etc. is installed in each remote conference room, and voice signals and image signals are transmitted and received by connecting offices with an IP dedicated line. It is a possible system.

  In this regard, Patent Document 1 describes a system that can implement telephone conferences connecting multiple points by introducing client software for telephone conferences into an information terminal such as a notebook personal computer (notebook PC).

JP 2000-077852 A

  However, in the telephone conference system described in Patent Document 1, when a voice conversation is performed between the conference room A and the conference room B using the notebook PCs held by the conference participants, the conference When a plurality of conference participants gathered in the room A make a call using their own notebook PCs, howling occurs between the voices of adjacent notebook PCs. In such a case, since the voice of the conference participant in the conference room A cannot be appropriately acquired and the voice of the conference participant in the conference room A cannot be appropriately provided to the conference room B, the conference room A and There was a problem that voice communication with the conference room B could not be performed smoothly.

  Therefore, the present invention has been made in view of the above, and an object of the present invention is to provide a server device, a control method, and a program that can smoothly execute voice communication performed via a plurality of electronic devices.

  A server device according to an aspect of the present invention is a server device that controls output of audio data of a plurality of electronic devices, and a group determination unit that divides the plurality of electronic devices into at least a first group and a second group; When the first electronic device belonging to the first group acquires audio data, the first electronic device is controlled so that the audio data is output from the second electronic device belonging to the second group, and belongs to the first group. An output control unit that controls the audio data not to be output from an electronic device other than the first electronic device.

  According to this aspect, when the server device divides a plurality of electronic devices into a plurality of groups and the first electronic device belonging to the first group among the plurality of groups acquires the sound data, the sound data is transferred to the second group. The first electronic device is controlled to be output from the second electronic device to which it belongs, and the audio data is controlled not to be output from an electronic device other than the first electronic device belonging to the first group. Therefore, since howling that occurs between a plurality of adjacent electronic devices can be sufficiently suppressed, voice communication performed via the plurality of electronic devices can be executed smoothly.

  According to the above aspect of the present invention, a server device, a control method, and a program capable of smoothly executing voice communication performed via a plurality of electronic devices are provided.

It is a figure which shows the network structure of the audio | voice communication system which concerns on embodiment of this invention. It is an example of the flowchart of the audio | voice data output control process performed in the audio | voice communication system which concerns on embodiment of this invention. It is a figure explaining an example of the audio | voice data output control process performed in the audio | voice communication system which concerns on embodiment of this invention. It is an example of the flowchart of the group determination process performed in the audio | voice communication system which concerns on embodiment of this invention. It is a figure explaining an example of the group determination process performed in the audio | voice communication system which concerns on embodiment of this invention. It is a figure explaining an example of the group determination process performed in the audio | voice communication system which concerns on embodiment of this invention. It is a figure explaining an example of the group determination process performed in the audio | voice communication system which concerns on embodiment of this invention. It is a figure explaining an example of the group determination process performed in the audio | voice communication system which concerns on embodiment of this invention. It is a figure explaining an example of the group determination process performed in the audio | voice communication system which concerns on embodiment of this invention.

  Embodiments of the present invention will be described below with reference to the drawings. However, the embodiment described below is merely an example, and there is no intention to exclude various modifications and technical applications that are not explicitly described below. In other words, the present invention can be implemented with various modifications (combining the embodiments, etc.) without departing from the spirit of the present invention. In the following description of the drawings, the same or similar parts are denoted by the same or similar reference numerals.

FIG. 1 is a diagram showing a network configuration of a voice communication system according to an embodiment of the present invention. As shown in FIG. 1, a voice communication system 1 includes, for example, an electronic device 10A~10D comprising the speaker 12A~12D and microphone 14A~14D, ADS (A udio D istribution S erver) 30 and (server) . Hereinafter, the electronic devices 10A to 10D are collectively referred to as the electronic device 10, the speakers 12A to 12D are collectively referred to as the speaker 12, and the microphones 14A to 14D are collectively referred to as the microphone 14.

  The voice communication system 1 includes, for example, a telephone conference system in which distant people communicate with each other using electronic devices owned by each person, but is not limited to this, and only voice using electronic devices. In addition, a video conference system capable of transmitting and receiving still images and moving images may be included.

  The electronic device 10 is, for example, a device that acquires sound with the microphone 14 and outputs sound from the speaker 12. The electronic device 10 is communicably connected to the ADS 30 via the communication network N. The communication network N may be a wired communication network or a wireless communication network. The electronic device 10 may include a communication interface for performing wired communication or wireless communication. In FIG. 1, the electronic device 10 is exemplified as a notebook personal computer. However, the electronic device 10 is not limited thereto, and may be a mobile terminal device such as a smartphone or a tablet terminal, or a desktop personal computer. It may be a terminal device. Moreover, there is no restriction | limiting in particular in the number of connection of the electronic device 10. Further, as described later, the electronic device 10 set as the host device needs to include at least one speaker 12 in order to execute the grouping process. However, the number of speakers 12 and microphones 14 included in each electronic device 10 is the same. There is no particular limitation.

  The ADS 30 is a device that controls output of audio data from the plurality of electronic devices 10. The ADS 30 communicates with each electronic device 10 via the communication network N, for example, divides each electronic device 10 into a plurality of groups, controls the state of the speaker 12 and the microphone 14 of each electronic device 10, Controls output of audio data of the electronic device 10. Note that the ADS 30 may be configured to control output of image data of each electronic device 10 in addition to audio data. In addition, there is no restriction | limiting in particular in the number of ADS30.

  The ADS 30 functionally includes a communication unit 31 that transmits and receives various types of information to and from each electronic device 10, a control unit 32 that controls various types of processing executed by the ADS 30, information for executing various types of processing, and execution results of various types of processing. And a recording unit 33 for recording. Note that the ADS 30 is configured by a server device or the like including a computer system, for example, and is implemented by a software program. For example, the program may be provided by being downloaded from outside the ADS 30 via a network, or provided by various information recording media that can be read by a computer such as a CD-ROM or a DVD-ROM. Also good.

  The group determination unit 34 divides the plurality of electronic devices 10 into a plurality of groups. For example, the group determination unit 34 groups the electronic device 10A and the electronic device 10B into the group X, and the electronic device 10C and the electronic device 10D into the group Y.

  The state control unit 35 controls the on state or the off state of the microphones 14 and the speakers 12 included in the plurality of electronic devices 10. Here, for example, the on state of the microphone 14 refers to a state where voice can be input, and the off state refers to a state where voice cannot be input. The on state of the speaker 12 refers to a state where sound can be output, and the off state refers to a state where sound cannot be output.

  The output control unit 36 controls output of audio data from the plurality of electronic devices 10 divided into a plurality of groups. The processing of the output control unit 36 will be described in detail with reference to FIGS.

  The recording unit 33 includes, for example, a group database (DB) 37 that records group information I1 indicating a group to which the electronic device 10 currently belongs or will belong, in association with each electronic device 10. Note that the recording unit 33 may be configured to record in the group DB 37 the group of the host device or the child device of the electronic device 10 in association with each electronic device 10.

  The recording unit 33 is, for example, a state management database (DB) 38 that records speaker state information I3 indicating the state of the speaker 12 included in the electronic device 10 and microphone state information I5 indicating the state of the microphone 14 in association with each electronic device 10. including.

<Audio data output control processing>
The overall flow of the audio data output control process executed in the audio communication system according to the embodiment of the present invention will be described with reference to FIGS. FIG. 2 is an example of a flowchart of audio data output control processing executed in the audio communication system according to the embodiment of the present invention.

(Step S1)
The group determination unit 34 illustrated in FIG. 1 divides the plurality of electronic devices 10 into a plurality of groups.

  FIG. 3 is a diagram illustrating an example of audio data output control processing executed in the audio communication system according to the embodiment of the present invention. As illustrated in FIG. 3, the group determination unit 34 illustrated in FIG. 1, for example, places the electronic device 10 </ b> A and the electronic device 10 </ b> B connected to the ADS 30 from one room separated by the wall W into the group X and the ADS 30 from the other room. The electronic devices 10C and 10D to be connected are grouped into a group Y. Here, the group X (first group) and the group Y (second group) will be described as an example as a plurality of groups, but the present invention is not limited to two groups, and may include three or more groups.

  Details of the flow of the group determination process will be described later with reference to FIGS.

(Step S3)
Returning to FIG. 2, the output control unit 36 shown in FIG. 1 is configured so that, for example, the microphone 14 </ b> A of the electronic device 10 </ b> A (first electronic device) belonging to the group X (first group) is, for example, electronic device. When the voice data including the voice of the user who operates 10A is acquired, the voice data is output from the second electronic equipment belonging to the group Y (second group) as an example of another group. The first electronic device is controlled so that audio data is not output from the electronic device 10B other than the electronic device 10A (first electronic device) belonging to the group X (first group).

  Specifically, the output control unit 36 controls the electronic device 10A so as not to transmit the audio data to the electronic device 10B other than the electronic device 10A belonging to the group X. For example, the output control unit 36 may control the electronic device 10A so that the audio data acquired by the electronic device 10A is not transmitted to the ADS 30 or other electronic devices.

  Further, even if the audio data is transmitted to the electronic device 10B other than the electronic device 10A belonging to the group X, the output control unit 36 controls the electronic device 10B so that the audio data is not output from the electronic device 10B. You may control. More specifically, even if the audio data is transmitted to the electronic device 10B, the audio data can be controlled not to be output by controlling the state of the speaker 12B included in the electronic device 10B to the off state.

  According to this configuration, when the server device divides the plurality of electronic devices 10 into the plurality of groups X and Y and the electronic device 10A belonging to the group X acquires the sound data, the sound data belongs to the group Y. The electronic device 10A is controlled so as to be output from the electronic device 10C which is a host device, and control is performed so that audio data is not output from the electronic device 10B other than the electronic device 10A belonging to the group X. Therefore, even if the microphones 14 of all the electronic devices 10 connected to the ADS 30 are controlled to be on, howling that occurs between a plurality of adjacent electronic devices 10 can be sufficiently suppressed. It is possible to smoothly execute voice communication performed via the network.

  The second electronic device may include both the group Y electronic device 10C and the electronic device 10D. That is, all the electronic devices in group Y receive audio data.

  According to this configuration, all of the electronic devices 10C and 10D in group Y receive audio data from the host device 10A in group X. Therefore, even if the host device is changed from the electronic device 10C to the electronic device 10D in the group Y, the electronic device 10D has already received the audio data, and the electronic device 10D becomes the host device and the electronic device 10D. When the speaker 12D is controlled to be in the on state, the electronic device 10D can smoothly output audio without requesting transmission of audio data.

<Group decision processing>
The group determination process executed in the voice communication system according to the embodiment of the present invention will be specifically described with reference to FIGS. FIG. 4 is an example of a flowchart of group determination processing executed in the voice communication system according to the embodiment of the present invention. FIG. 4 is a flowchart specifically showing the process of step S1 of FIG. FIG. 5 is an explanatory diagram when the first electronic device is connected to the ADS. In addition, various methods can be used to divide a plurality of electronic devices into a plurality of groups, but in the following, as an example, grouping is performed so that electronic devices in the same room among a plurality of electronic devices belong to the same group. The method to be described is explained.

(Steps S11 to S15)
As shown in FIG. 5, the first electronic device 10 </ b> A connects to the ADS 30. Here, the connection to the ADS 30 includes, for example, that a user operating the electronic device 10A logs into the voice communication system via the electronic device 10A. Next, the group determination unit 34 illustrated in FIG. 1 sets the electronic device 10 </ b> A as a host device of group X. Then, the state control unit 35 controls the microphone 14A included in the electronic device 10A set as the host device to the on state and the speaker 12A to the on state. As will be described later, the host device is controlled to turn on the speaker 12 in order to newly transmit a sound signal for determining a group of electronic devices to be connected to the ADS 30, and the response signal of the sound signal is newly transmitted. In order to receive from an electronic device connected to the ADS 30, the microphone 14 is controlled to be in an on state.

(Step S17)
The group determination unit 34 determines whether a new electronic device is connected to the ADS 30. If a new electronic device is connected to the ADS 30 (in the case of Yes), the process proceeds to step S19. If a new electronic device is not connected to the ADS 30 (in the case of No), the process proceeds to step S35. Note that the determination of whether a new electronic device is connected to the ADS 30 may be performed in another functional configuration in the ADS 30.

(Step S19)
6 and 7 are explanatory diagrams when the second electronic device is newly connected to the ADS. Here, a broken line W indicates a wall for partitioning the room, and the left side and the right side of the broken line W are different rooms. In particular, FIG. 6 is a diagram in the case where the second electronic device 10B is connected to the ADS 30 from the same room as the electronic device 10A that is the host device of group X. FIG. 7 is a diagram in the case where the second electronic device 10B is connected to the ADS 30 from a room different from the electronic device 10A that is the host device of group X.

  6 and 7, when the electronic device 10B is connected to the ADS 30 as a new electronic device, the state control unit 35 shown in FIG. 1 turns off the speaker 12B included in the electronic device 10B and turns on the microphone 14B. Control to the state. In order to prevent howling in relation to other electronic devices, the speaker 12B is turned off, and the microphone 14B is controlled to be turned on in order to appropriately receive the audio signal.

(Step S21)
As shown in FIGS. 6 and 7, the electronic device 10A, which is the host device of group X, transmits an inaudible sound as an audio signal (Pi ♪) for group determination of the electronic device 10B. For example, when a telephone conference or the like is performed, if an inaudible sound is used as an audio signal, the conference can be continued smoothly without interfering with the conference. Note that the audio signal is not limited to an inaudible sound, and may be an audible sound. The transmission of the audio signal may be performed within a predetermined period after a new electronic device is connected to the ADS 30 or may be executed at any other timing.

(Step S23)
The group determination unit 34 determines whether or not the electronic device 10B, which is a new electronic device, has received an audio signal for group determination. For example, when the electronic device 10B is newly connected to the ADS 30, the group determining unit 34 is based on the response signal from the electronic device 10B to the audio signal transmitted from the electronic device 10A that is the host device. Determines whether the audio signal has been received. The determination as to whether or not a new electronic device is connected to the ADS 30 may be executed in the electronic device 10 and the result may be transmitted to the ADS 30. If the electronic device 10B can receive the audio signal (Yes), the process proceeds to step S25. If the electronic device 10B cannot receive the audio signal (No), the process proceeds to step S31.

(Steps S25 to S29)
As illustrated in FIG. 6, when the electronic device 10B can receive the audio signal from the electronic device 10A, the group determination unit 34 determines that the electronic device 10B is the Host device of the group X that is the transmission source of the received audio signal. It is set as a child device for a certain electronic device 10A. The state control unit 35 controls the microphone 14B included in the electronic device 10B set as the group X child device to the on state and the speaker 12B to the off state. Then, the electronic device 10 </ b> A that is the host device shifts to the standby mode until a new electronic device is connected to the ADS 30. Then, the process returns to step S17.

(Steps S31 to S35)
On the other hand, as shown in FIG. 7, when the electronic device 10 </ b> B cannot receive the audio signal, the group determination unit 34 sets the electronic device 10 </ b> B as a host device of a group Y different from the group X. The state control unit 35 controls the microphone 14 </ b> B included in the electronic device 10 </ b> B set as the host device of group Y to the on state and the speaker 12 </ b> B to the on state. Then, the host device shifts to the standby mode until a new electronic device is connected to the ADS 30. Then, the process returns to step S17.

  In this way, every time a new electronic device is connected to the ADS 30, steps S17 and after are executed. Hereinafter, an example in which a third electronic device is connected will be described.

  FIG. 8 is an explanatory diagram when a new electronic device 10B is connected to the ADS 30 as a third unit. In the example of FIG. 8, since the electronic device 10B is connected to the ADS 30 from the same room as the electronic device 10A (because the distance between the electronic device 10A and the electronic device 10B is short), the audio signal of the electronic device 10A is received. Therefore, the group determination unit 34 sets the electronic device 10B as a child device for the electronic device 10A that is the host device of the group X that is the transmission source of the received audio signal.

  FIG. 9 is an explanatory diagram when a new electronic device is connected to the ADS as the fourth unit from the example shown in FIG. In the example of FIG. 9, the electronic device 10H is connected to the ADS 30 from a room different from the electronic device 10A and the electronic device 10C (because the electronic device 10H is separated from the electronic device 10A and the electronic device 10C). Since the audio signals of the electronic device 10A and the electronic device 10C cannot be received, the group determination unit 34 generates the electronic device 10H as a group Z different from the group X and the group Y, and sets the electronic device 10H as the group Z. Set as a Host device. Note that the same processing is performed when the fifth and subsequent electronic devices are connected to the ADS 30.

  According to this configuration, since the voice communication system automatically executes and manages grouping of electronic devices, it is not necessary for the user of the voice communication system to execute and manage the grouping, which is highly convenient for the user.

  In addition, since the voice communication system automatically controls the state of the microphone and the speaker included in the electronic device, it is not necessary for the user of the voice communication system to execute and manage the state of the microphone and the speaker, which is highly convenient for the user. .

<Other embodiments>
The above-described embodiments are for facilitating the understanding of the present invention, and are not intended to limit the present invention. The present invention can be changed / improved (for example, by combining the embodiments, omitting a part of the configuration of each embodiment) without departing from the spirit thereof, and the present invention includes equivalents thereof. It is.

  Various methods can be adopted as a method of dividing the plurality of electronic devices 10 into a plurality of groups. For example, grouping may be performed so that electronic devices with a short distance among a plurality of electronic devices 10 belong to the same group, or electronic devices in the same office among a plurality of electronic devices 10 belong to the same group. It may be grouped. Further, a group belonging to each of the plurality of electronic devices 10 may be assigned in advance, and grouping may be performed so as to belong to the assigned group. Furthermore, a plurality of electronic devices 10 may be grouped based on an instruction from the user at an arbitrary timing. Note that one or more electronic devices 10 among the plurality of electronic devices 10 once grouped may be changed to belong to another group.

  As described above, the group determination unit 34 illustrated in FIG. 1 sets the electronic device 10 that first belongs to a certain group as the host device, and then sets the electronic device 10 that next belongs to the group to the host. Although it may be set as a child device of the electronic device 10 which is a device, which electronic device is set as a host device or a child device of a certain group is not limited to the above example. For example, by setting in advance for each electronic device 10 which electronic device 10 becomes which group of Host device or Child device, each electronic device 10 is set as a Host device or a Child device based on the setting condition. It may be set. Note that the electronic device 10 once set as the host device may be changed to the child device at an arbitrary timing, or the electronic device 10 once set as the child device is changed to the host device at an arbitrary timing. Also good.

  Control of the on state or the off state of the microphone 14 and the speaker 12 included in the plurality of electronic devices 10 is performed at various timings. For example, when the electronic device 10 is connected to the ADS 30, the on state or the off state of the microphone 14 and the speaker 12 may be controlled. Moreover, when the electronic device 10 is set as a Host device or a Child device, or later, the on state or the off state of the microphone 14 and the speaker 12 may be controlled. It may be controlled at any other timing. Note that once the microphone 14 and the speaker 12 of the electronic device 10 are controlled to be on or off, the state of the microphone 14 and the speaker 12 may be changed by the user.

  The electronic device 10 may have the function of the ADS 30 illustrated in FIG. That is, one or more specific electronic devices among the plurality of electronic devices 10 may be configured to control the output of audio data of each electronic device 10 instead of the ADS 30.

  In the said embodiment, although the microphone 14 of all the electronic devices 10 is controlled to the ON state, it is not restricted to this structure. For example, the microphone 14 of the electronic device 10 receives a sound signal for determining a group during a predetermined period when the new electronic device 10 is connected to the ADS 30 and the group determination process for the electronic device 10 is executed. Although the microphone 14 is controlled to be in the on state during the period, the microphone 14 may be controlled to be in the off state when the period has elapsed. When the electronic device 10 is connected to the ADS 30 with respect to the microphone 14, the microphone 14 is set to the omnidirectional mode so as to easily receive the audio signal for group determination from the Host device, and the group determination is performed. After the processing, the beam forming mode may be set in order to make it easy to acquire a voice such as a user's voice.

  In the embodiments of the present invention, “part”, “apparatus”, and “system” do not simply mean physical means, but the functions of the “part”, “apparatus”, and “system”. Including the case where it is realized by software. Further, even if the functions of one “part”, “apparatus”, and “system” are realized by two or more physical means and apparatuses, two or more “parts”, “apparatus”, “system” The function may be realized by one physical means or apparatus.

10, 10A, 10B, 10C, 10D, 10H ... electronic devices, 12, 12A, 12B, 12C, 12D, 12H ... speakers, 14, 14A, 14B, 14C, 14D, 14H ... mics, 30 ... ADS ( A audio D istribution S erver), 34 ... group determining unit, 35 ... state control unit, 36 ... output control unit.

Claims (7)

A server device that controls output of audio data of a plurality of electronic devices,
A group determining unit that divides the plurality of electronic devices into at least a first group and a second group;
When the first electronic device belonging to the first group acquires audio data, the first electronic device is controlled so that the audio data is output from the second electronic device belonging to the second group, and the first An output control unit for controlling the audio data not to be output from an electronic device other than the first electronic device belonging to the group;
Bei to give a,
The group determination unit
Based on the response signal from the third electronic device to the audio signal transmitted from the first electronic device and the second electronic device when the third electronic device is newly connected to the server device, A server device that determines a group to which three electronic devices belong . A state control unit for controlling an on state or an off state of microphones and speakers included in the plurality of electronic devices;
The state control unit
The microphone and speaker included in the first electronic device are turned on,
The microphone and speaker included in the second electronic device are turned on,
Controlling a microphone included in an electronic device other than the first electronic device and the second electronic device to an on state and a speaker included in the electronic device to an off state;
The server device according to claim 1. The group determination unit
When the third electronic device receives the audio signal from the first electronic device, the third electronic device is assigned to the first group,
When the third electronic device receives the audio signal from the second electronic device, the third electronic device is assigned to the second group;
The server device according to claim 1 . The group determination unit
When both the first electronic device and the second electronic device do not receive the response signal from the third electronic device, the first electronic device and the second group including the third electronic device are different. Create groups,
The server device according to claim 1 . Audio signals from the first electronic device and the second electronic device are transmitted as inaudible sounds.
The server apparatus according to any one of claims 1-4. A control method for controlling output of audio data of a plurality of electronic devices,
Dividing the plurality of electronic devices into at least a first group and a second group;
When the first electronic device belonging to the first group acquires audio data, the first electronic device is controlled so that the audio data is output from the second electronic device belonging to the second group, and the first Controlling the audio data not to be output from an electronic device other than the first electronic device belonging to the group;
Only including,
In the step of dividing into the first group and the second group,
Based on the response signal from the third electronic device to the audio signal transmitted from the first electronic device and the second electronic device when the third electronic device is newly connected to the server device, A control method in which a group to which three electronic devices belong is determined . A computer that controls the output of audio data from multiple electronic devices.
A group determining unit that divides the plurality of electronic devices into at least a first group and a second group;
When the first electronic device belonging to the first group acquires audio data, the first electronic device is controlled so that the audio data is output from the second electronic device belonging to the second group, and the first An output control unit for controlling the audio data not to be output from an electronic device other than the first electronic device belonging to the group;
To function as,
The group determination unit
Based on the response signal from the third electronic device to the audio signal transmitted from the first electronic device and the second electronic device when the third electronic device is newly connected to the server device, 3 A program for determining a group to which an electronic device belongs .

Images