JP2007312146A - Video conference system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a video conference system or the like in which the speech of a main speaker can be more clearly caught even when another person speaks during the speech of the main speaker. <P>SOLUTION: The video conference system is constituted of terminals 1 respectively arranged on a plurality of positions and a video conference control apparatus 2 for communicating with the plurality of terminals 1. In the system, one terminal 1 is selected from the plurality of terminals 1 on the basis of a prescribed program, time required to start compression of voice data inputted from the selected terminal is made longer than a predetermined time, time required to start compression of voice data inputted from a terminal other than the selected terminal is made shorter than the prescribed time, or both processing are simultaneously performed, voice data inputted from the plurality of terminals 1 are compressed on the basis of the time required to start the compression or the prescribed time, the compressed voice data are decompressed, and the decompressed voice data are added to each other and outputted to respective terminals 1. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a video conference system, and more particularly to a video conference system that is connected to many terminal devices and focuses on audio control.

  Conventionally, a video conference system encodes and multiplexes an image captured by a camera or the like and audio input by a microphone and transmits the encoded and multiplexed data to a partner terminal device via a communication line, and the receiver terminal device multiplexes them. The separated signal is separated, decoded, and reproduced from a monitor or a speaker.

  When a conference is performed by connecting terminal devices arranged at three or more points, a multi-point video conference control device (hereinafter referred to as “MCU”) is temporarily transmitted from each terminal device (hereinafter referred to as “terminal”). The image data and audio data of each terminal are processed by the MCU and transmitted to each terminal again. At that time, the image data is reduced and images for a plurality of terminals are displayed on one screen, and the image of one terminal is controlled to be displayed in a fixed or switched manner. The audio data received from each terminal is added by a mixer and distributed to each terminal.

  In addition, when a conference is held by connecting terminals arranged at three or more points, an audio level is detected and a main algorithm is determined based on a predetermined algorithm in order to select a terminal to be synthesized and displayed. A method of determining a speaker and displaying an image of the main speaker is common.

  Further, for example, Patent Document 1 discloses a client device connected to the Internet and provided with audio input / output means and image input / output means, a control server for controlling connection / disconnection of a video conference by these client devices, and a client. An image server that collects images from the device and distributes the audio to the client device; an audio server that collects audio from the client device and distributes the audio to the client device; and when audio data is transmitted to each client device, An audio server configured to add sound image localization information and transmit it to each client device, and each client device reproduces the received sound so that the sound image position is in accordance with the sound image localization information, and the sound A playback device has been proposed.

  In Patent Document 2, the voice signals of the individual speakers collected by a plurality of microphones are mixed by a voice signal mixer, the mixed voice signal is transmitted to an output signal switch, and the sound of the voice signal is also transmitted. The pressure level is measured with multiple sound pressure level measuring devices, the microphone with the highest sound pressure is identified by the maximum sound pressure level microphone decision device, and the control signal indicating the microphone number is output via the transmission line And a speaker corresponding to the microphone having the maximum sound pressure level is selected from among a plurality of speakers according to the control signal by the output signal switch, and the mixed sound signal is given to the speaker. A video conference sound image localization apparatus for reproducing the mixed audio signal has been proposed.

JP 2001-036881 A Japanese Patent Application Laid-Open No. 08-140068

  However, in the conventional video conference system and the like, there is a problem that when another person speaks while the main speaker speaks, the voice is added, making it difficult to hear the main speaker.

  Therefore, the present invention has been made in view of the problems in the conventional video conference system described above, and even if another person speaks during the speech of the main speaker, the speech of the main speaker can be clarified more clearly. An object is to provide a video conference system that can be heard.

  In order to achieve the above object, the present invention provides a video conference system that includes a terminal disposed at each of a plurality of points and a video conference control device that communicates with the plurality of terminals. One terminal is selected from among the terminals based on a predetermined program, and the time until compression of audio data input from the selected terminal is started is extended from the predetermined time, or the selected terminal The time until the compression of audio data input from a terminal other than the predetermined time is shortened from the predetermined time, or both of them are performed simultaneously, and the time until the changed compression starts or the predetermined time And compressing the voice data input from the plurality of terminals, decompressing the compressed voice data, adding the decompressed voice data, and outputting to each of the terminals .

  According to the present invention, a terminal of a main speaker such as a chairperson is selected from the plurality of terminals based on a predetermined program, and compression of voice data input from the selected terminal is performed. The time until the start of voice data is extended from a predetermined time, or the time until compression of voice data input from a terminal other than the selected terminal, that is, another speaker, is shortened from a predetermined time. Or both of them can be performed simultaneously, so that the auditory sound field of the voice of the main speaker such as the chairperson can be positioned ahead of the other speakers, and the voice of the main speaker Since the rising portion can be made larger than the rising portion of other speakers and the consonant of the main speaker's voice can be emphasized, the main speaker's voice can be easily heard.

  In the video conference system, audio data input from each of the plurality of terminals can be made uniform to a predetermined volume. As a result, even when the voice of the main speaker is low and the voice of other speakers is high, the voice of the main speaker can be easily heard.

  In addition, the present invention is a program for controlling a video conference system including a terminal disposed at each of a plurality of points and a video conference control device that communicates with the plurality of terminals. Selecting one terminal based on a predetermined program and extending the time until compression of audio data input from the selected terminal is longer than a predetermined time, or selecting the terminal The time until compression of audio data input from a terminal other than the received terminal is shortened from a predetermined time, or both of these steps are performed at the same time, and the modified compression is started. Compressing audio data input from the plurality of terminals based on time or a predetermined time; decompressing the compressed audio data; and decompressing the audio Characterized in that it is constituted by a step of adding and outputting over data to each terminal.

  According to the present invention, as described above, by using the video conference system control program, a terminal of a main speaker such as a chairperson is selected from the plurality of terminals based on a predetermined program. The time until the compression of the voice data input from the selected terminal is selected is extended from a predetermined time, or the compression of the voice data input from a terminal other than the selected terminal is started. Time can be shortened from the predetermined time, or both of them can be performed at the same time, so that the auditory sound field of the voice of the main speaker such as the chairperson can be positioned ahead of other speakers. In addition, the rising part of the voice of the main speaker can be made larger than the rising part of the other speakers, and the consonant of the main speaker's voice can be emphasized. Hear It can be easy to take to become.

  The video conference system control program may include a step of equalizing audio data input from each of the plurality of terminals to a predetermined volume. As a result, even when the voice of the main speaker is low and the voice of other speakers is high, the voice of the main speaker can be easily heard.

  In addition, the present invention is a video conference control device that communicates with a terminal disposed in each of a plurality of terminals, and a selection unit that selects one terminal from the plurality of terminals based on a predetermined program; The time until compression of the voice data of the terminal selected by the selection means is extended from a predetermined time, or the time until compression of voice data of a terminal other than the selected terminal is started is set to a predetermined time. A compression start time changing unit that shortens the time or both of them simultaneously, and a time until compression of the audio data input from the plurality of terminals is changed by the compression start time changing unit, or Compression means for compressing based on a predetermined time, addition means for adding the audio data compressed by the compression means, and the audio data added by the addition means to each terminal To characterized in that it is constituted by an output means for force.

  According to the present invention, as described above, by using the video conference control device, a terminal of a main speaker such as one chairperson is selected from the plurality of terminals based on a predetermined program. Until the compression of the audio data input from the selected terminal is extended from a predetermined time or until compression of the audio data input from a terminal other than the selected terminal is started. Can be shortened from the predetermined time, or both of them can be performed simultaneously, so that the auditory sound field of the main speaker's voice can be positioned ahead of other speakers. In addition, the rising part of the main speaker's voice can be made larger than the rising part of other speakers, and the consonant of the main speaker's voice can be emphasized, so that the main speaker's voice can be heard. Make easy It becomes possible.

  In the video conference control apparatus, audio data input from each of the plurality of terminals can be made uniform to a predetermined volume. As a result, even when the voice of the main speaker is low and the voice of other speakers is high, the voice of the main speaker can be easily heard.

  As described above, according to the present invention, when the main speaker is speaking, even if another speaker speaks, the video conference system that makes it possible to clearly hear the voice of the main speaker, etc. Etc. can be provided.

  Next, embodiments of the present invention will be described with reference to the drawings.

  The video conference system according to the present invention is roughly composed of a plurality of terminals 1 (1A to 1D) and a video conference control device 2 communicating with the plurality of terminals 1.

  The video conference control device 2 measures the audio levels of the audio inputs 101 to 104, determines the terminal 1 to be the main speaker based on the determined algorithm, and sets the information (main speaker information) 300 as the attack time. Based on the level comparison unit 10 transmitted to the unit 30 and the main speaker information 300 from the level comparison unit 10, the attack time set in the compressor units 21 to 24 (the time until the compressor units 21 to 24 start compression) ) Is determined and set, and voice inputs 101 to 104 are input, so that the voice level of each terminal 1 becomes uniform, and according to the attack time setting from the attack time setting unit 30 Each of the compressor units 21 to 24 performs compression, and the addition unit 40 adds the audio data compressed by the compressor units 21 to 24. That.

  The attack time setting unit 30 sets the attack time to be longer (for example, about 100 m / s) for the terminal 1 as the main speaker, and shorter (for example, about several m / s) for the terminals 1 other than the main speaker. Provided to do.

  The terminal 1 can use a videophone or the like that is generally used.

  Next, the operation of the video conference system according to the present invention will be described with reference to the drawings.

  The level comparison unit 10 measures the voice level and duration of the voice inputs 101 to 104, and for example, “determines that the speaker is the main speaker when the voice level exceeds a predetermined voice level and continues for a certain period of time”. The terminal 1 of the main speaker is determined based on such a predetermined algorithm, and the information (main speaker information 300) is transmitted to the attack time setting unit 30.

  The audio inputs 101 to 104 are also input to the compressor units 21 to 24. When the compressor units 21 to 24 receive an input exceeding a predetermined input level (threshold level) as shown in FIG. The amplifier is provided with a characteristic for attenuating the output level. By setting the same threshold level in each of the compressor units 21 to 24, the difference in the audio level of each terminal 1 can be reduced.

  3A shows the magnitudes of the audio signals 201 to 204 input to the compressor units 21 to 24, and FIG. 3B shows the magnitudes of the audio signals 401 to 404 output from the compressor units 21 to 24. With this function, for example, even when the speaker of another terminal 1 speaks with a louder voice while the main speaker speaks, the voice level of the other speaker 1 can be suppressed. Can be easily heard.

  As shown in FIG. 4, the compressor units 21 to 24 have a function of changing the time (attack time) from when the threshold level is exceeded until the compression starts (attack time setting information 501 to 504). . 5A to 5C show output waveforms depending on the attack time when a test tone is input. FIG. 5A shows an input waveform, FIG. 5B shows an output waveform when the attack time is short, and FIG. 5C shows an output waveform when the attack time is long. When the compressed sound level is amplified to the level of the original sound, the rising portion of the sound is relatively emphasized, and the rising time in which the attack time is longer is longer. Therefore, when a human word is input, a longer attack time emphasizes the rising part of the word, that is, the consonant part.

  Further, by emphasizing the rising part of the sound using a compressor, the audible sound field can be localized further forward. For example, at the production site of a music CD, in order to prevent the vocals from being buried in the sound of the musical instrument in the back, as shown in FIG. 6, there is a method in which the sound field is localized forward by applying a compressor with a long attack time to the vocals. Generally used (FIG. 6A). Also in the present invention, the rising portion of the main speaker's voice is emphasized from other speakers, thereby creating a sound field localization as if the main speaker is speaking one step ahead (Fig. 6 (b)).

  The compressed audio signals 401 to 404 output from the compressor units 21 to 24 are added by the adding unit and transmitted to each terminal 1. At that time, the voice of the main speaker is reproduced with the rising portion emphasized more than the voice of the other terminal 1, so that the main speaker becomes the sound field localization as if it came out one step ahead of the other person, and the main story Person's voice becomes easier to hear.

  The embodiment shown in FIG. 1 shows a case where a plurality of participants speak in an equivalent position. For example, there is a pre-determined chairman, and the remarks of the chairman are remarks from other participants. It is necessary to prioritize the speech of a specific speaker over others, such as when a lecturer and a student participate in a lecture format and the speech of the lecturer takes precedence over the speech of the student The present invention can be applied to such applications. In that case, the level comparison unit 10 is not necessary, and the speaker terminal to be prioritized may be identified and notified to the attack time setting unit 30. Since the subsequent operation is the same as that of the above-described embodiment, the description thereof is omitted.

It is a block diagram which shows the whole structure of one Embodiment of the video conference system concerning this invention. It is a figure which shows the basic operation | movement of the compressor part in this invention. It is a figure which shows the operation result of the compressor part in this invention, (a) shows the level of the audio | voice signal input into a compressor part, (b) shows the level of the audio | voice signal output from a compressor part. It is a figure which shows the attack time of the compressor part in this invention. It is a figure which shows the difference in operation | movement by the difference in the attack time of the compressor part in this invention, (a) shows the input level to a compressor part, (b) is from a compressor part in case an attack time is short. An output waveform is shown, (c) shows the output waveform from the compressor part in case the attack time is long. It is a figure which shows the sound field localization at the time of using a compressor, (a) shows the sound field localization when a compressor is used in the music CD production site, (b) is in the video conference system of the present invention. Indicates sound field localization.

Explanation of symbols

1 (1A to 1D) Terminal 2 Video conference control device 10 Level comparison unit 21 to 24 Compressor unit 30 Attack time setting unit 40 Addition unit 101 to 104 Input audio signals 201 to 204 Input signal to compressor unit 300 Main speaker information 401 ~ 404 Output signal from compressor section 501 ~ 504 Attack time setting information

Claims (6)

A video conference system composed of terminal devices respectively disposed at a plurality of points, and a video conference control device communicating with the plurality of terminal devices,
One terminal device is selected from the plurality of terminal devices based on a predetermined program,
The time until the compression of the audio data input from the selected terminal device is started longer than a predetermined time, or the compression of the audio data input from a terminal device other than the selected terminal device is started. To shorten the time until the predetermined time, or both of them at the same time,
Based on the time until the changed compression is started or a predetermined time, the audio data input from the plurality of terminal devices is compressed,
Decompress the compressed audio data;
The video conference system, wherein the decompressed audio data is added and output to each of the terminal devices.   The video conference system according to claim 1, wherein audio data input from each of the plurality of terminal devices is equalized to a predetermined volume. A program for controlling a video conference system composed of a terminal device arranged at each of a plurality of points and a video conference control device communicating with the plurality of terminal devices,
Selecting one terminal device from the plurality of terminal devices based on a predetermined program;
The time until the compression of the audio data input from the selected terminal device is started longer than a predetermined time, or the compression of the audio data input from a terminal device other than the selected terminal device is started. Reducing the time until the predetermined time from the predetermined time, or performing both of these simultaneously,
Compressing audio data input from the plurality of terminal devices based on a time until the changed compression is started or a predetermined time; and
Decompressing the compressed audio data;
A video conference system control program comprising: adding the decompressed audio data and outputting the sum to each terminal device.   The video conference system control program according to claim 3, further comprising the step of equalizing audio data input from each of the plurality of terminal devices to a predetermined volume. A video conference control device that communicates with a terminal device arranged at each of a plurality of points,
Selection means for selecting one terminal device based on a predetermined program from the plurality of terminal devices;
The time until the compression of the audio data of the terminal device selected by the selection means is extended from a predetermined time or the time until the compression of the audio data of the terminal device other than the selected terminal device is started Compression start time changing means for shortening the time from a predetermined time or both of them simultaneously,
Compression means for compressing audio data input from the plurality of terminal devices based on a time until the compression started by the compression start time changing means or a predetermined time;
Adding means for adding the audio data compressed by the compression means;
A video conference control apparatus comprising: output means for outputting the audio data added by the adding means to each terminal device.   6. The video conference control apparatus according to claim 5, further comprising a volume leveling means for leveling audio data input from each of the plurality of terminal devices to a predetermined volume level.

Images