JP2006211504A - Conference terminal apparatus, conference system and computer program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To efficiently and effectively proceed with a conference among a plurality of bases. <P>SOLUTION: A conference control system installed on each of bases comprises a conference terminal apparatus 100. The conference terminal apparatus 100 controls proceedings of a conference according to a conference control program. The conference control program contains first and second selection algorithms, and a CPU 111 controls a selection section 130 and selects one of a plurality of microphones according to any one of the selection algorithms. Only audio signals corresponding to the selected microphone are inputted to a CODEC 140 and transmitted, as audio data, from a communication section 150 to the other bases. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a technical field of a conference terminal device, a conference system, and a computer program for performing a conference between a plurality of bases, for example.

  Various techniques of this type have been proposed (see, for example, Patent Document 1 or 2).

  According to the video conference system disclosed in Patent Document 1 (hereinafter referred to as the first prior art), the signal levels of audio signals from a plurality of microphones are compared to determine a microphone that is performing an audio input operation, By reading camera operation parameters corresponding to a microphone that is performing an input operation from a memory and controlling the operation of the video camera, it is possible to send an image suitable for the progress of the conference to the other party.

  Further, according to the communication conference terminal device disclosed in Patent Document 2 (hereinafter referred to as the second prior art), an audio signal larger than a predetermined level is amplified among audio signals input from a plurality of microphones. Since the gain of the variable gain amplifier is set to a large value, the voice signal of the main speaker can be emphasized, and the voice of the main speaker can be clearly heard at the other terminal.

JP-A-7-87470 JP-A-8-116353

  If there are multiple conference participants at each site, if these participants speak to the microphone at the same time, the voice transmitted to other places will be mixed, so no one can say It is a difficult task just to identify whether there is.

  In response to such a problem, the first and second conventional techniques specify the speaker based on the level of the audio signal. However, the size of the voice does not necessarily coincide with the magnitude of importance in the meeting, and the size of the voice is even unfair because of individual differences. That is, these conventional techniques have a technical problem that it is difficult to efficiently and effectively advance the conference.

  On the other hand, it is conceivable to manually select one audio signal from audio signals input from a plurality of microphones, and always transmit clear audio to other sites, but the selection work becomes complicated. It may hinder the smooth progress of the meeting.

  The present invention has been made in view of the above-described problems, for example, and it is an object of the present invention to provide a conference terminal device, a conference system, and a computer program that can efficiently and effectively advance a conference.

  In order to solve the above-described problem, the conference terminal device according to claim 1 is installed in association with (i) a participant of the conference at the base in order to hold a conference between the bases. A plurality of microphones each collecting sound and generating a sound signal corresponding to the collected sound; and (ii) a conference terminal device installed together with at least one speaker, wherein the plurality of microphones are arranged according to a predetermined type of algorithm. The voice data corresponding to the voice signal generated by the selected one microphone is generated from the selection means for selecting one microphone from the plurality of microphones and the plurality of voice signals corresponding to the plurality of microphones. Voice data generation means for performing the generation via a network with respect to other bases other than the local base among the plurality of bases Communication means for transmitting the received voice data and receiving the voice data generated at the other site via the network, and controlling the speaker so as to output the voice based on the received voice data And a control means.

In order to solve the above-described problem, the conference system according to claim 8 is installed at a base to hold a conference between a plurality of bases, and (i) is installed in association with a participant of the conference, A plurality of microphones for collecting sound and generating sound signals corresponding to the collected sound; (ii) at least one speaker; and (iii) a conference terminal device, wherein the conference terminal device is a predetermined type of algorithm. And selecting means for selecting one microphone from the plurality of microphones, and corresponding to the sound signal generated by the selected one microphone from the plurality of sound signals corresponding to the plurality of microphones. Voice data generating means for generating voice data, and the other bases other than the own base among the plurality of bases, through the network It transmits the voice data made, communication means for receiving the audio data generated in the other site via the network;
And control means for controlling the speaker so as to output sound based on the received sound data.

  In order to solve the above-described problem, a computer program according to a ninth aspect causes a computer system to function as the selection unit according to any one of the first to seventh aspects.

  In order to solve the above-described problem, a computer program according to claim 10 causes a computer system to function as the selection unit, the voice data generation unit, and the control unit according to any one of claims 1 to 7. To do.

<Embodiment of Conference Terminal Device>
In the embodiment of the conference terminal device of the present invention, in order to conduct a conference between a plurality of sites, (i) the conference terminal device is installed in association with the participants of the conference and collects sounds respectively. A plurality of microphones each generating a sound signal corresponding to the collected sound and (ii) a conference terminal device installed together with at least one speaker, wherein the meeting terminal device is selected from among the plurality of microphones according to a predetermined type of algorithm. Selection means for selecting one microphone and voice data generation means for generating voice data corresponding to the voice signal generated by the selected one microphone from the plurality of voice signals corresponding to the plurality of microphones. And the generated voice data via a network to other bases of the plurality of bases other than the own base A communication means for transmitting and receiving voice data generated at the other site via the network, and a control means for controlling the speaker so as to perform voice output based on the received voice data. It has.

  In the present invention, the "base" refers to one place for the conference, for example, including various meeting rooms in a company, office, hotel or school, a hall, or a home or outdoor space, It is a concept that includes all spaces in which a meeting can be held. The “conference” in the present invention refers to discussions, consultations, meetings, discussions, and the like that are performed among participants. The conference terminal device according to the present invention is installed together with a plurality of microphones and at least one speaker in order to conduct a conference between the plurality of sites.

  There is at least one participant at the base, and a plurality of microphones are installed in association with the participants. Here, “corresponding to a participant” means that there is some correspondence between the participant and the microphone. For example, the participant and the microphone are one-to-one, one-to-many, many-pair. One or many-to-many correspondence. Participants will speak as appropriate during the course of the conference. At this time, the participant's voice is collected by these microphones, and a voice signal corresponding to the collected voice is generated.

  According to the embodiment of the conference terminal device of the present invention, during the operation, a predetermined type of audio data is generated by the audio data generation means.

  Here, the “predetermined type of audio data” is a concept that collectively refers to data for transmitting an audio signal generated by a microphone at a local site to another site. This refers to digital audio data and the like generated via CODEC (COrder / DECorder) for use.

  The generated voice data is transmitted by communication means to another base via the network. On the other hand, the same operation is performed in the conference terminal device installed in another base, and the conference terminal device in the local site receives the voice data generated in the other base via the network. Is done.

  Here, the “network” according to the present invention is a network that accommodates each of conference terminals installed at a plurality of locations. For example, a communication network such as a LAN (Local Area Network) or a WAN (Wide Area Network) is used. Point to. These communication networks are constructed, for example, as a wired communication network including a part or all of a normal telephone line, an ADSL (Asymmetric Digital Subscriber Line), an ISDN line, an optical fiber, or a part as a wireless communication network. .

  The control means controls the speaker so as to output sound based on the received sound data. For example, when the audio data generation means includes the above-described CODEC, the audio data received as digital data is decoded and an analog audio signal is extracted. From the speaker, sound defined by the analog audio signal is output (sound emission). By performing such an operation at each site, the conference proceeds in a bidirectional manner.

  Here, particularly when there are a plurality of audio signals input to the conference terminal device via the microphone, the generated audio data usually includes all of them. Therefore, the sound finally emitted from the speaker is a mixture of the sounds of a plurality of participants. This makes it difficult to identify who is speaking among the participants.

  In addition, in such a case, noise (noise) generated for each input audio signal is aggregated in the audio data, so that the final noise level tends to be so large that it cannot be ignored. That is, the quality of the emitted sound is likely to deteriorate. As a result, smooth progress of the conference becomes difficult.

  Therefore, the embodiment according to the conference terminal device of the present invention solves the problem due to the action of the selection means and the voice data generation means.

  The “selecting means” according to the present invention is configured to be able to select one microphone from a plurality of microphones. At this time, the selection means performs the selection according to a predetermined type of algorithm. Here, the “predetermined type of algorithm” is any algorithm as long as it is an algorithm based on some rule that can significantly (appropriately) give the right to one of the participants. I do not care. Such an algorithm may be such an algorithm when it can be appropriately determined in advance experimentally, empirically, or by simulation.

  For example, when there is a participant corresponding to the facilitator (chairman) at the meeting, the microphone installed corresponding to the facilitator is selected with priority over the microphones corresponding to other participants. A simple algorithm may be used. Alternatively, in a conference held in a relatively free atmosphere such as brainstorming, an algorithm is used to equally select each of a plurality of microphones in order to give each participant the right to speak as much as possible. May be.

  The sound data generation means generates sound data corresponding to the sound signal generated by the selected one microphone from the plurality of sound signals corresponding to the plurality of microphones. Here, “audio data corresponding to an audio signal generated by one microphone” means audio data in which another audio signal (other than the selected one) is completely shut out, and the volume (level) of the other audio signal. This is a concept including a case in which the audio signal generated by the single microphone is dominant in the generated audio data.

  According to the embodiment of the conference terminal device of the present invention, since the audio data corresponding to one microphone is generated in this way, the quality of the sound finally emitted from the speaker is unlikely to deteriorate. Moreover, since the selection of the microphone is automatically performed by the selection means, it is comfortable. That is, the conference can be efficiently and effectively advanced.

  If such a selection is made manually, the same effect can be expected with respect to the sound quality, but it is difficult to always select an appropriate speech at an appropriate timing, which is extremely complicated. It is very uneconomical because it requires a dedicated worker. In that respect, the embodiment according to the conference terminal of the present invention is clearly advantageous.

  The above-described effect according to the present invention is more prominent when a plurality of microphones are installed at all of the plurality of sites, but a plurality of microphones are not necessarily installed at all the sites. There is no need to be. For example, when a conference is held between two sites, one microphone and one speaker may be installed at each site. Even in such a case, the effect of the present invention as described above is realized by the audio data transmitted from the other base. Therefore, in the above description, the voice data generated at another site received via the network is typically voice data corresponding to one selected microphone, but it is determined by a single microphone. This is to the effect that voice data generated from the generated voice signal may be used.

  In one aspect of the embodiment of the conference terminal device according to the present invention, the base includes (i) an imaging unit that captures an image of a subject and generates a video signal corresponding to the captured subject; and (ii) the subject. Display means for displaying the video according to the video data is further installed, and the conference terminal further includes video data generation means for generating video data of a predetermined type corresponding to the generated video signal, and the communication means further includes Transmitting the generated video data via the network to the other site and receiving the video data generated at the other site via the network from the other site; Further, the display unit is controlled to output a video based on at least one of the generated video data and the received video data.

  In this aspect, an imaging unit and a display unit are further installed at the base. Here, the “imaging means” according to the present invention is a concept generically referring to, for example, a digital camera, a digital video camera, or the like that can generate a video signal related to a subject. The “display means” according to the present invention is a device having a display screen for displaying an image, such as a plasma display, a liquid crystal display or a CRT (Cathode Ray Tube) display device having a large display area. Are preferably used. In this mode, the conference proceeds in a so-called “video conference” using these.

  Note that the subject imaged by the imaging means may be any subject as long as it is a subject relevant to the conference. For example, the scenery of the whole base may be sufficient, and each participant may be sufficient.

  The video data generating means generates a predetermined type of video data corresponding to the generated video signal. Here, the “predetermined type of video data” according to the present invention refers to, for example, data for transmitting a video signal at its own site to another site or a video based on the video signal at its own site as a display means of its own site For example, the former includes encoded and compressed data generated from a video signal via a video CODEC or the like. This video data is transmitted to another site via, for example, communication means. Also, the video data generated at the other base is received by the conference terminal device at the local base via the communication means.

  The control means controls the display means to perform video output based on the video data generated at the local site or other sites. Here, when the display means is controlled based on the video data of the local site, the video relating to the subject imaged by the imaging means at the local site is displayed on the display means. On the other hand, when the display is performed based on the video data of another base, for example, the video at the other base is displayed based on the video signal extracted from the received video data through the above-described video CODEC. Displayed on the means. These two types of videos may be displayed on a plurality of divided screens. Such a display mode of the display means may be freely determined by the action of the control means. According to this aspect, since a video is added in addition to audio, a visual effect can be given to the conference, which is extremely effective.

  In this aspect, the control means may further control the imaging means so that a participant corresponding to the selected one microphone becomes the subject.

  According to this aspect, when one microphone is selected by the selection unit, the control unit controls the imaging unit so that a participant corresponding to the microphone is captured. In this case, the video of the participant who speaks at the local site is displayed on the display means at the local site or at another site, and the audio and the video can be effectively combined. Therefore, it is possible to facilitate and facilitate the conference.

  Further, in one aspect of the embodiment of the conference terminal device of the present invention capable of controlling the display means, a predetermined type of identification data relating to the participant corresponding to the selected one microphone is generated. And further comprising identification data generating means, wherein the communication means further transmits the generated identification data to the other base via the network and from the other base to the other base via the network. The control unit further controls the display unit based on at least one of the generated identification data and the received identification data.

  According to this aspect, the identification data generation means generates identification data related to the participant corresponding to the selected microphone. This identification data is transmitted to another site via a network, for example, by communication means.

  Here, the control means controls the display means based on at least one of the generated identification data and the identification data received from another base. If it is the former, visual information corresponding to the identification data of the speaker at its own base is displayed, and if it is the latter, visual information corresponding to the identification data of the speaker at another base is displayed. In any case, added value is given to the display contents, and the conference can be performed more effectively.

  Here, the “predetermined type of identification data” is not limited in any way as long as it is data for identifying the participant, such as the name of the participant and the department to which the participant belongs. Any information that can add value to the conference is suitable.

  In another aspect of the embodiment of the conference terminal device of the present invention, a plurality of the algorithms are prepared in advance according to the form of the conference, and the selection means is one of the plurality of prepared algorithms. To select the one microphone.

  According to this aspect, a plurality of algorithms for selecting a microphone are prepared in advance according to the form of the conference. Here, the “conference form” is a concept that widely includes elements that characterize the conference such as the size, type, or nature of the conference. Therefore, according to this aspect, it is possible to easily use an appropriate algorithm each time, and it is possible to hold a conference more efficiently and effectively.

  In this aspect, the plurality of prepared algorithms may include an algorithm that cyclically selects each of the plurality of microphones.

  Here, “cyclically selecting” in the present invention means selecting one microphone in accordance with a predetermined or irregularly determined order among at least some of the plurality of microphones. It is a concept. At this time, the weighting of the time during which one microphone is selected may be equal to or different from each other. However, typically, it represents that each microphone is selected fairly with equal weighting.

  For example, when one of a plurality of algorithms is such an algorithm, each of the plurality of microphones is cyclically selected, so that the processing can be relatively light and the microphones can be regarded as fair or fair. Can be selected. Therefore, it is particularly effective when the speaking rights of the participants are substantially equal.

  In this aspect, the plurality of prepared algorithms may include an algorithm that selects each of the plurality of microphones according to a priority given to each of the plurality of microphones in advance.

  For example, in this case, since the priority is set in advance for each microphone, each microphone, that is, each participant corresponding thereto, can be differentiated from each other. For example, it is possible to easily select a microphone corresponding to a participant who is in the position of coordinating a conference such as a chairperson or a chairman. Note that such priority may be given as, for example, the length of the selected period, or may be given as the frequency of selection. Moreover, the parameter which prescribes | regulates a priority may be set freely before the meeting start or during a meeting.

According to this aspect, it is possible to select a microphone adapted to the size, type, or nature of the conference, and the conference can be performed more smoothly.
<Embodiment of conference system>
An embodiment according to the conference system of the present invention is installed at a base to hold a conference between a plurality of bases, and (i) is installed in association with a participant of the conference, collects sound, and A plurality of microphones for generating audio signals corresponding to the collected sound; (ii) at least one speaker; and (iii) a conference terminal device, wherein the conference terminal device is configured to perform the plurality of Audio data corresponding to the audio signal generated by the selected one microphone is generated from selection means for selecting one microphone from among the microphones and the plurality of audio signals corresponding to the plurality of microphones. The voice data generation means and the generated voice data over the network to other bases other than the local base among the plurality of bases. Communication means for transmitting voice data and receiving voice data generated at the other site via the network, and control means for controlling the speaker to perform voice output based on the received voice data It comprises.

According to the embodiment of the conference system of the present invention, it is possible to hold a conference efficiently and effectively between a plurality of sites by the interaction between the conference terminal device, the microphone and the speaker as described above.
<First Embodiment of Computer Program>
The first embodiment according to the computer program of the present invention causes a computer system to function as any one of the above selection means.

  According to the first embodiment of the computer program of the present invention, the computer program can be read into a computer system from a recording medium such as a ROM, CD-ROM, DVD-ROM, and hard disk that stores the computer program and executed. Alternatively, if the computer program is executed after being downloaded to a computer system via, for example, communication means, the selection means in the embodiment of the conference terminal device of the present invention described above can be made relatively simple. It is feasible.

Incidentally, the first embodiment according to the computer program of the present invention can also adopt various aspects in response to the various aspects of the embodiment according to the conference terminal apparatus of the present invention described above.
<Second Embodiment of Computer Program>
The second embodiment according to the computer program of the present invention causes a computer system to function as any one of the selection means, the sound data generation means, and the control means.

  According to the second embodiment of the computer program of the present invention, the computer program can be read into a computer system from a recording medium such as a ROM, CD-ROM, DVD-ROM, and hard disk that stores the computer program and executed. Alternatively, if the computer program is executed after being downloaded to a computer system via a communication means, for example, the selecting means, the voice data generating means in the embodiment of the conference terminal device of the present invention described above And the control means can be realized relatively easily.

  Incidentally, the second embodiment according to the computer program of the present invention can also adopt various aspects in response to the various aspects of the embodiment according to the conference terminal apparatus of the present invention described above.

  These effects and other advantages of the present invention will become apparent from the embodiments described below.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

<1: First embodiment>
<1.1: Configuration of Example>
First, the outline of the conference system according to the first embodiment of the present invention will be described with reference to FIG. FIG. 1 is a conceptual diagram of the conference system 10.

  In FIG. 1, a conference system 10 is a system for conducting a conference via a network 20 between a plurality of bases A, B, and C.

  The base A, the base B, and the base C are, for example, conference rooms that exist at locations away from each other, and the network 20 is a data communication network such as a LAN or WAN that connects these bases. The network 20 may be partly or wholly configured as a wired or wireless communication network.

  Next, the details of the base will be described with reference to FIG. FIG. 2 is a schematic diagram of the base A. In the figure, the same reference numerals are assigned to the same portions as those in FIG. 1, and the description thereof is omitted. Further, in this embodiment, the base A, the base B, and the base C have the same configuration, and therefore, the description of the base A is also performed simultaneously with the description of the base A.

  In FIG. 2, the site A has a plurality of participants A1, A2 and A3, and further a conference control system 10A is installed. The conference control system 10A is an example of the “conference system” according to the present invention, which includes a plurality of microphones (hereinafter, referred to as “microphones” as appropriate) MA1, MA2 and MA3, a speaker SPA, and the conference terminal device 100.

  Participants A1, A2 and A3 are participants of the conference at the site A, respectively. Each participant is assigned a microphone MA1, MA2, and MA3, respectively. The microphones MA1, MA2, and MA3 collect sound of the participants A1, A2, and A3, respectively, and can generate sound signals corresponding to the collected sounds. It is an example. The speaker SPA is an example of a “speaker” according to the present invention configured to be able to emit a sound related to a conference under the control of the control unit 110 described later.

  The conference terminal device 100 is an example of a “conference terminal device” according to the present invention, which includes a control unit 110, connection ports 121, 122, and 123, a selection unit 130, a CODEC 140, and a communication unit 150.

  The control unit 110 includes a CPU (Central Processing Unit) 111, a ROM (Read Only Memory) 112, and a RAM (Random Access Memory) 113.

  The CPU 111 is a control unit that controls the operation of the conference terminal device 100. The ROM 112 is a non-volatile memory in which a conference control program executed in the conference terminal device 100 is stored. The RAM 113 is a volatile memory for temporarily storing data generated in the process in which the conference terminal device 100 executes the conference control program.

  The connection ports 121, 122, and 123 are input interfaces that are electrically connected to the microphones MA1, MA2, and MA3, respectively. The audio signal generated in each microphone is input to the conference terminal device 100 via each connection port.

  The selection unit 130 is configured to be able to select one connection port among the connection ports 121, 122, and 123 according to the conference control program, and together with the control unit 110, the “selection unit” of the present invention. It serves as an example.

  The CODEC 140 is an example of an “audio data generation unit” according to the present invention configured to be able to convert an analog audio signal input via the selection unit 130 into a digital signal.

  The communication unit 150 transmits various data input from the control unit 110 and the CODEC 140 via the network 20 to other bases (here, the base B and the base C), and is transmitted from other bases via the network 20. This is an example of the “communication means” according to the present invention configured to be able to receive the various data at its own base (here, the base A).

<1.2: Operation of the embodiment>
<1.2.1: Progress of meeting>
Next, with reference to FIG. 2, the progress of the conference at the site A will be described.

  The CPU 111 controls the progress of the conference by executing the conference control program stored in the ROM 112 to control the operation of each unit described above of the conference terminal device 100.

  At site A, participants A1, A2 and A3 speak appropriately. When a speech is made, the sound is collected by the corresponding microphones MA1, MA2 and MA3. The collected sound is converted into a sound signal in each microphone and input to the conference terminal device 100 via the connection ports 121, 122, and 123 corresponding to each microphone.

  Originally, the audio signal input to the conference terminal device 100 is converted into audio data that is digital data by the CODEC 140, and transmitted to the conference terminal device in another base via the communication unit 150. In addition, audio data at other locations is received via the communication unit 150. The CPU 111 temporarily stores the received audio data in the RAM 113 and converts the audio data into an audio signal again via the CODEC 140. The CPU 111 inputs the converted audio signal to the speaker SPA. In this way, the sound at another base is emitted from the speaker SPA. The conference proceeds by performing the same operation at each site.

  Here, when a plurality of participants speak at the same time, a plurality of audio signals are input to the conference terminal device 100, and the audio data generated by the CODEC 140 is audio data in which they are mixed. This makes it difficult to specify who is speaking at the site A at other sites. Furthermore, since appropriate noise is generated at the time of generating the audio signal in each microphone, the noise in the audio data in which they are collected becomes large, and the audio data is likely to deteriorate.

  Therefore, in the conference terminal device 100, the selection unit 130 selects any one of the plurality of microphones MA1, MA2, and MA3, so that the audio signal that is always input to the CODEC 140 is limited to one. . Specifically, the selection unit 130 is controlled by the CPU 111 so as to ignore an input signal from a connection port corresponding to a microphone other than the selected microphone. Therefore, the number of audio signals input to the CODEC 140 is limited to one, and the conference always proceeds based on the voice of one speaker at each site. Note that the method used when the selection unit 130 selects one microphone is not particularly limited as long as the above-described effect is ensured. For example, by interposing a variable attenuator between each connection port and the selection unit 130 and increasing the signal attenuation amount other than the selected one, one audio signal is substantially input to the CODEC 140. The power supply other than the selected one may be simply cut off.

  On the other hand, the selection unit 130 selects a connection port according to a plurality of selection algorithms set in advance in a conference control program executed by the CPU 111. This selection algorithm is an algorithm optimized in accordance with the purpose, scale, or nature of the conference, and one of a plurality of algorithms is selected in advance by a participant or the like.

<1.2.2: Details of selection algorithm>
Next, the details of the selection algorithm will be described with reference to FIGS. FIG. 3 is a flowchart of the first selection algorithm, and FIG. 4 is a flowchart of the second selection algorithm.

  In FIG. 3, first, it is determined whether or not there is an audio input to the microphone MA1 (step A10). Whether or not there is an audio input to the microphone MA1 is determined according to whether or not the level of the audio signal input to the connection port 121 is equal to or higher than a predetermined value. The predetermined value is set to an appropriate level in advance experimentally, empirically, or by simulation.

  When the microphone MA1 has a voice input (step A10: YES), the CPU 111 controls the selection unit 130 to select the connection port 121 (step A11). Here, “selecting” a connection port means that processing for outputting only the input from the connection port to the CODEC 140 is executed. That is, in the present embodiment, the audio signal input from the connection port that is not selected does not affect the progress of the conference. From the time when the connection port 121 is selected in step A11, only the audio signal output from the microphone MA1 is input to the CODEC 140, and the audio input to the microphone MA1 is emitted at other sites.

  When the connection port 121 is selected, the CPU 111 determines whether or not there is an audio input to the microphone MA1 (step A12). When the microphone MA1 has a voice input (step A12: YES), that is, when the voice input to the microphone MA1 is continued, the CPU 111 stands by until a predetermined standby time elapses (step A13). In this standby period, the state where the microphone MA1 is selected continues. Note that the length of the waiting period is set to an appropriate value in advance by experiment, experience, simulation, or the like.

  When the standby period elapses, the CPU 111 returns the process to step A12 again, and determines whether or not there is an audio input to the microphone MA1. As described above, the CPU 111 repeats step A12 and step A13 as long as the voice input to the microphone MA1 is continued. During the period when these are loop-processed, an audio signal corresponding to the audio of the participant A1 (audio input to the microphone MA1) is input to the CODEC 140.

  On the other hand, when it is determined in step A10 or step A12 that there is no voice input to the microphone MA1 (when step A10 or step A12 is “NO”), the CPU 111 determines whether or not there is a voice input to the microphone MA2. Step A14).

  When the microphone MA2 has a voice input (step A14: YES), the CPU 111 controls the selection unit 130 to select the connection port 122 (step A15), and again determines whether there is a voice input to the microphone MA2 (step A16). ). Here, when the voice input to the microphone MA2 is continued (step A16: YES), the CPU 111 stands by until a predetermined elapsed time elapses (step A17). When the predetermined standby time has elapsed, the CPU 111 returns the process to step A16, and again determines whether or not there is a voice input to the microphone MA2. Then, as long as the voice input to the microphone MA2 is continued, Step A16 and Step A17 are repeated, and a voice signal corresponding to the voice of the participant A2 (voice inputted to the microphone MA2) is inputted to the CODEC 140.

  On the other hand, when it is determined in step A14 or step A16 that there is no audio input to the microphone MA2 (when step A14 or step A16 is “NO”), the CPU 111 determines whether or not there is an audio input to the microphone MA3 ( Step A18).

  When the microphone MA3 has a voice input (step A18: YES), the CPU 111 controls the selection unit 130 to select the connection port 123 (step A19), and again determines whether there is a voice input to the microphone MA3 (step A20). ). Here, when the voice input to the microphone MA3 is continued (step A20: YES), the CPU 111 stands by until a predetermined elapsed time elapses (step A21). When the predetermined standby time has elapsed, the CPU 111 returns the process to step A20, and again determines whether or not there is an audio input to the microphone MA3. Then, as long as the voice input to the microphone MA3 continues, Step A20 and Step A21 are repeated, and a voice signal corresponding to the voice of the participant A3 (the voice inputted to the microphone MA3) is inputted to the CODEC 140.

  When it is determined in step A18 or step A20 that there is no voice input to the microphone MA3 (when step A18 or step A20 is “NO”), the CPU 111 returns the process to step A10 again, The steps are repeated.

  As described above, the first selection algorithm is an algorithm for selecting the participant A1, the participant A2, and the participant A3 fairly and cyclically. For example, there is a speech rank among the participants such as brainstorming. It is an effective algorithm when there is no such thing.

  Next, the details of the second selection algorithm will be described with reference to FIG. In FIG. 4, parts that are the same as those in FIG. 3 are given the same reference numerals, and descriptions thereof are omitted.

  The second selection algorithm shown in FIG. 4 is obtained by deleting step A16, step A17, step A20, and step A21 in FIG.

  That is, if there is no voice input to the microphone MA2 in step A14, or if the connection port 122 is selected in step A15, the process proceeds to step A18. Similarly, if there is no voice input to the microphone MA3 in step A18, or if the connection port 123 is selected in step A19, the process returns to step A10. A series of processing from step A10 to step A13 is executed in the same manner as the first selection algorithm.

  In the second selection algorithm, even if the connection port 122 is selected in Step A15, if the microphone MA3 has an audio input, the selected connection port is immediately switched to the connection port 123. Similarly, even if the connection port 123 is selected, if there is an audio input to the microphone MA1, the selected connection port is immediately switched to the connection port 121. Only when the connection port 121 is selected, the selection of the connection port 121 is continued as long as sound is input to the microphone MA1.

  That is, the participant A1 is given higher priority than the participant A2 and the participant A3. Such an algorithm is an effective algorithm for a meeting in which a facilitator such as a chairperson (that is, corresponding to the participant A1) exists and at least a part of the participants has a ranking in speech. Yes.

  In the first selection algorithm according to FIG. 3, when the elapsed time according to step A17 and step A21 is set to “zero” or an extremely small value corresponding thereto, the voice input to the microphone MA2 is momentarily interrupted. If there is an input to the microphone MA3, the selection is switched to the microphone MA3, and an algorithm similar to the second selection algorithm according to FIG. 4 can be realized. In this case, if the waiting time is configured to be externally input in the conference terminal device 100, such control can be easily realized by setting the elapsed time corresponding to the connection port 122 and the connection port 123 short. It is also possible to do. In this case, it is possible to easily set an appropriate elapsed time for each participant according to the priority level or the importance level of the speech, and to form an optimal algorithm for each conference.

  Next, these two types of algorithms will be described visually with reference to FIG. FIG. 5 is a chart showing the time course of the selected microphone.

  In FIG. 5, “audio input level” is a level obtained by binarizing an audio signal generated in each microphone, and takes either “H” or “L”. The “H” level represents that the corresponding microphone has a voice input, and the “L” level represents that the corresponding microphone has no voice input. The “selection result” represents a selection result by the selection unit 130 and is equivalent to the type of the audio signal input to the CODEC 140. That is, during the period indicated as “Mic OO”, an audio signal corresponding to the input audio to the microphone OO is input to the CODEC 140. Note that the period indicated as “(microphone OO)” indicates a state in which no sound is input to any microphone, and only a microphone is selected.

  In FIG. 5, when the first algorithm is followed, the microphone selection result is switched to microphone MA1 at time T0, microphone MA2 at time T2, microphone MA3 at time T5, and microphone MA1 at time T8. In other words, the selected microphone is not switched during a period in which sound input to the selected microphone is continued (period in which the sound input level is “H”). Therefore, the speaker (speech regarded as a speaker at another base) is switched in a generally long cycle.

  On the other hand, when the second selection algorithm is followed, microphone MA1 at time T0, microphone MA2 at time T2, microphone MA3 at time T3, microphone MA1 at time T4, microphone MA3 at time T6, and microphone MA1 at time T8 are selected. The result switches. That is, regarding the microphone MA2 and the microphone MA3, even if voice input is being performed, if there is a voice input from another microphone, the microphones are switched. Therefore, the speaker is switched in a short surrounding as a whole.

  As described above, according to the conference terminal device 100 according to the present embodiment, the algorithm is appropriately switched according to the scale, purpose, or nature of the conference, so that any type of conference can be efficiently and effectively performed. It is possible to proceed to. Therefore, the conference can be efficiently and effectively advanced by the conference control system 10A.

<2: Second embodiment>
In the first embodiment, the case where the conference terminal device according to the present invention is applied to an audio conference has been described. However, the conference terminal device according to the present invention is also effective in a conference including video. To do. The second embodiment of the present invention will be described below.

<2.1: Overview of the second embodiment>
FIG. 6 is a schematic diagram of the site A according to the second embodiment of the present invention. In the figure, the same reference numerals are assigned to the same parts as in FIG.

  In FIG. 6, a conference control system 10AA is installed at the site A instead of the conference control system 10A in FIG. The conference control system 10AA is another example of the “conference system” according to the present invention, which is different in configuration from the conference control system 10A in that the camera 30 and the display device 40 are provided.

  The camera 30 is, for example, a digital video camera, and is an example of an “imaging unit” according to the present invention configured to be able to photograph a meeting at the site A. The camera 30 includes a tripod, a movable attachment, an attachment drive unit, and the like (all not shown). The camera 30 is fixed to a tripod, and is configured to be able to freely change the subject as the movable attachment is driven by the attachment drive unit to rotate three-dimensionally. A control signal for driving the attachment driving unit is transmitted from the control unit 110.

  The display device 40 is, for example, a relatively large display device such as a plasma display device, and the screen unit 41 is configured to be able to display a video related to a conference held between bases according to the present invention. It is an example of “display means”. A video display signal related to a video to be displayed on the screen unit 41 is input from the camera 30 and the control unit 110.

  On the other hand, in the conference terminal device 100, personal information of the participants A1, A2, and A3 (that is, an example of “identification data” according to the present invention) can be registered in advance. Such registration of personal information is executed via input means (not shown) such as a keyboard and a mouse, for example. The “personal information” described here includes a name, age, department, title, etc., and widely defines information that can be used as a reference for the conference. The registered personal information is stored in the RAM 113. Separately, the location information of the participant A1, the participant A2, and the participant A3 is also registered in the conference terminal device 100. The registered position information is also stored in the RAM 113. Note that the position information stored in the present embodiment means that the camera 30 is fixed to a tripod and the camera 30 is located at a position where the participant A1 can be imaged in a state where a basic composition (a composition overlooking the base A) is set. Is the amount of change in the control amount when the button is moved (an operation such as pan, tilt, or zoom is performed). However, when the camera 30 is equipped with a positioning system such as GPS (Global Positioning System), the absolute position of each participant may be used.

<2.2: Detailed Operation of Camera 30 and Display Device 40>
Next, operations of the camera 30 and the display device 40 in this embodiment will be described with reference to FIG. In the present embodiment, the conference control program executed by the control unit 110 includes a video control program for controlling the camera 30 and the display device 40, respectively. The operations of the camera 30 and the display device 40 are controlled according to this video control program. Note that the base B and the base C adopt the same configuration, so that a so-called “video conference” is realized between these bases.

  The camera 30 basically takes a bird's-eye view image of the site A in accordance with the basic composition described above. A video signal (video signal) related to this video is input to the display device 40 and the CODEC 140. The CODEC 140 encodes and compresses the input video signal. That is, the CODEC 140 combines the audio CODEC function according to the first embodiment and the video CODEC function according to the present embodiment, and functions as an example of the “video data generation unit” according to the present invention. It is configured.

  The video data code-compressed by the CODEC 140 (that is, an example of “video data” according to the present invention) is transmitted from the communication unit 150 to another site. On the other hand, video data relating to videos taken at other sites is received via the communication unit 150 and input to the CODEC 140. The video data at other sites input to the CODEC 140 is decoded into a video signal that can be displayed by the display device 40, and is temporarily stored in the RAM 113 and input to the display device 40.

  On the other hand, the video signal input from the camera 30 to the display device 40 is directly input with respect to the video of the local site. Therefore, in this case, the camera 30 also functions as another example of the “video data generation unit” according to the present invention.

  Further, the CPU 111 reads out a data file (material data) of application software as a conference material from the RAM 113, generates a video signal that can be displayed by the display device 40, and inputs the video signal to the display device 40. That is, the display device 40 is input with three types of video signals: a video signal at the local site (base A), a video signal at another site, and a video signal related to the material data.

  Here, with reference to FIG. 7, the detail of the screen part 41 in the display apparatus 40 is demonstrated. FIG. 7 is a schematic diagram of the screen unit 41.

  In FIG. 7, the screen section 41 is divided into a total of four screens, a main screen 41a, a sub screen 41b, a sub screen 41c, and an identification information screen 41d.

  A material video based on the material data is displayed on the main screen 41a. Participants in the conference discuss based on the material video displayed on the main screen 41a.

  On the sub screen 41b, an image of the local site is displayed. This is a video that is displayed based on a video signal related to the local site that is directly input from the camera 30.

  On the sub screen 41c, images of other bases are displayed. This is a video displayed based on a video signal obtained via the CODEC 140 from the video data obtained at another location obtained via the communication unit 150. The identification information screen 41d will be described later.

  On the other hand, in the process of executing the conference control program, the CPU 111 selects a speaker based on the above selection algorithm. Here, in the present embodiment, the CPU 111 is configured to be able to capture the participant corresponding to the currently selected microphone with the camera 30 and display it on the sub screen 41 b in the screen unit 41.

  Specifically, the CPU 111 reads position information corresponding to the selected connection port (equivalent to a microphone or a participant) from the RAM 113, generates a control signal corresponding to the read position information, and generates the camera 30. Send to. The control signal is a signal generated in accordance with the above-described change amount of the control amount, and is a signal for changing the composition of the camera 30 from the basic composition to the selected participant.

  Based on this control information, the camera 30 drives the attachment drive unit to change the composition of the camera 30 to a composition corresponding to the participant who is currently speaking. Thus, the participant currently selected (speaking) is displayed on the screen unit 41b.

  Further, the CPU 111 controls the operation of the camera 30 and simultaneously reads out personal information corresponding to the currently selected participant from the RAM 113. The CPU 111 generates a display signal for displaying the read personal information on the identification information screen 41 d and inputs it to the display device 40. The display device 40 displays the personal information of the participant currently selected on the identification information screen 41d based on the display signal related to the personal information. This state is shown on the identification information screen 41d in FIG. The read personal information is also transmitted to other bases via the communication unit 150. At other sites, the video of the speaker at the site A is displayed on the sub-screen 41c based on the transmitted personal information.

  As described above, in the conference control system 10AA according to the second embodiment, it is possible to hold a more fulfilling conference with audio and video. At this time, the camera 30 is very effective because it is controlled so that the participant who is always speaking is photographed in conjunction with the selection result of the sound (microphone). Further, since the personal information of the selected participant can be displayed, it is possible to make the conference proceed more smoothly. That is, it is possible to easily and efficiently hold a conference between a plurality of bases.

  The present invention is not limited to the above-described embodiments, and can be changed as appropriate without departing from the spirit or concept of the invention that can be read from the claims and the entire specification. The conference system and the computer program are also included in the technical scope of the present invention.

It is a conceptual diagram of the conference system which concerns on 1st Example of this invention. It is a schematic diagram of one base in the conference system of FIG. It is a flowchart of the 1st selection algorithm regarding the conference control program performed by the conference terminal device in the conference control system of FIG. It is a flowchart of the 2nd selection algorithm regarding the conference control program performed by the conference terminal device in the conference control system of FIG. It is a chart showing the time course of the microphone selected about each algorithm of FIG.4 and FIG.5. It is a mimetic diagram of one base concerning the 2nd example of the present invention. It is a schematic diagram of the screen part in the display apparatus with which the conference control system of FIG. 6 is equipped.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Conference system, 10A ... Conference control system, 10AA ... Conference control system, 20 ... Network, 30 ... Camera, 40 ... Display device, 100 ... Conference terminal device, 110 ... Control part, 121, 122, 123 ... Connection port , 130 ... selection unit, 140 ... CODEC, 150 ... communication unit, SPA ... speaker, MA1, MA2, MA3 ... microphone, A1, A2, A3 ... participants.

Claims (10)

In order to conduct a conference between a plurality of bases, (i) installed in association with the participants of the conference at the bases, respectively collecting voices and generating voice signals corresponding to the collected voices. A conference terminal device installed together with a plurality of microphones and (ii) at least one speaker,
Selecting means for selecting one microphone from the plurality of microphones according to a predetermined type of algorithm;
Voice data generating means for generating voice data corresponding to the voice signal generated by the selected one microphone from the plurality of voice signals corresponding to the plurality of microphones;
Communication that transmits the generated voice data via a network to other bases other than the own base among the plurality of bases and receives the voice data generated at the other bases via the network Means,
And a control means for controlling the loudspeaker so as to perform voice output based on the received voice data. The base further includes (i) an imaging unit that captures an image of the subject and generates a video signal corresponding to the captured subject, and (ii) a display unit that displays an image related to the subject,
The conference terminal further comprises video data generating means for generating a predetermined type of video data corresponding to the generated video signal,
The communication means further transmits the generated video data to the other base via the network and receives the video data generated at the other base via the network from the other base. ,
The conference according to claim 1, wherein the control means further controls the display means to perform video output based on at least one of the generated video data and the received video data. Terminal equipment. The conference terminal device according to claim 2, wherein the control unit further controls the imaging unit such that a participant corresponding to the selected one microphone becomes the subject. Further comprising identification data generating means for generating a predetermined type of identification data related to the participant corresponding to the selected one microphone;
The communication means further transmits the generated identification data via the network to the other base and receives identification data generated at the other base via the network from the other base. ,
The conference terminal device according to claim 2, wherein the control unit further controls the display unit based on at least one of the generated identification data and the received identification data. A plurality of algorithms are prepared in advance according to the form of the conference,
5. The conference terminal device according to claim 1, wherein the selection unit selects the one microphone according to one of the plurality of prepared algorithms. 6. The conference terminal device according to claim 5, wherein the plurality of prepared algorithms include an algorithm that cyclically selects each of the plurality of microphones. The conference algorithm according to claim 5, wherein the plurality of prepared algorithms include an algorithm for selecting each of the plurality of microphones according to a priority given in advance to each of the plurality of microphones. Terminal device. Installed at a base for a conference between a plurality of bases, (i) Installed in association with the participants of the conference, and collects voice and generates a voice signal corresponding to the collected voice A plurality of microphones, (ii) at least one speaker, and (iii) a conference terminal device,
The conference terminal device is:
Selecting means for selecting one microphone from the plurality of microphones according to a predetermined type of algorithm;
Voice data generating means for generating voice data corresponding to the voice signal generated by the selected one microphone from the plurality of voice signals corresponding to the plurality of microphones;
Communication that transmits the generated voice data via a network to other bases other than the own base among the plurality of bases and receives the voice data generated at the other bases via the network Means,
And a control means for controlling the speaker so as to output audio based on the received audio data.   A computer program for causing a computer system to function as the selection means according to any one of claims 1 to 7.   A computer program that causes a computer system to function as the selection unit, the voice data generation unit, and the control unit according to any one of claims 1 to 7.

Images