JP3178509B2 - Stereo audio teleconferencing equipment - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a stereo audio / video conference apparatus, and more particularly to a stereo audio / video conference apparatus for generating pseudo stereo audio from monaural audio.

[0002]

2. Description of the Related Art Conventionally, this type of stereo audio / video conference apparatus has been conventionally used in a video conference apparatus in order to obtain more realism of a conference, as shown in, for example, Japanese Patent Application Laid-Open No. 5-3567. It is used to realize stereophonic audio of a video conference device that is a monaural target.

FIG. 4 is a block diagram showing an example of a conventional stereo audio / video conference apparatus. The apparatus includes a video input / output unit 101 including an imaging camera and a display, a video codec 102 for encoding / decoding a video signal, and a multi-input / output unit for performing a signal switching operation.
A demultiplexer 103, a network interface 104 for connecting the network to the entire apparatus, delays 105a and 105b connected to the multi-demultiplexer 103, and audio codecs 106a and 106a for encoding and decoding audio signals. 10
6b, audio output units 108a and 108b including a microphone and the like, and the audio codec 10
6a, 106b and audio output units 108a, 108b
Switches 110a, 110 interposed between
b, an end-end signal control unit 111 connected to the multi-demultiplexer 103, an end-network signal control unit 112 connected to the network interface 104, an end-end signal control unit 111 and an end-to-end signal control unit. System control unit 1 connected to network signal control unit 112
09.

Next, the operation will be described. Switch 1
10a and 110b are switched by a user operation. When the changeover switches 110a and 110b are at the positions indicated by solid lines in FIG.
When the changeover switch 110a is switched from the state indicated by the solid line to the position indicated by the dotted line in the figure, the audio output sections 108a and 108b are connected to the audio codec 106b, and the state indicated by the solid line. Switch 1
When 10b is switched to the position indicated by the dotted line in the figure, both audio output units 108a and 108b are connected to the audio codec 106a.

Further, the multi-demultiplexer 103
Transmits the audio data input by the audio input units 107a and 107b in a communication frame, and separates the plurality of audio data embedded in the received communication frame into individual audio data. Output to the audio codecs 106a and 106b.

The above changeover switches 110a, 110
When the communication frame is sent from the other party when b is at the position of the solid line, the communication frame is processed by the multi-demultiplexer 103, and one audio data portion is passed through the audio codec 106a to the audio output unit. The audio data is sent to the audio output unit 108b via the audio codec 106b.

Here, one audio data is a write (R)
If the other one of the audio data is left (L),
The received sound will be heard as stereo sound, and the sense of presence will be further enhanced. Furthermore, if one voice data is a conference voice and the other voice data is its interpreted voice, the conference voice is output from the audio output unit 108a and the interpreted voice is output from the audio output unit 108b. become. Therefore, when the interpreter wants to listen to the interpreted voice, the audio output unit 108b may be used.
By operating the changeover switches 110a and 110b, the conference audio is output to the audio output units 108a and 108b.
8b, or the interpreted voice can be output from both of the audio output units 108a and 108b.

[0008]

In this conventional stereo audio / video conference apparatus, an audio codec for encoding and decoding audio is generally expensive due to the use of a special integrated circuit and the like. Is required for two channels, that is, two times, so that there is a problem that the apparatus becomes extremely expensive.

An object of the present invention is to provide an inexpensive stereo audio / video conference apparatus.

[0010]

According to the present invention, based on the pan head direction information indicating the direction of the pan head directed to the speaker of the video conference transferred from the tele tele conference apparatus, the other tele conference apparatus can transmit the video data. A sound field generation device that generates a stereo sound signal from a monaural sound signal transferred and decoded by the sound decoding device is provided, and the stereo sound signal generated by the sound field generation device is converted into a left and right sound signal. A stereo audio / video conference apparatus characterized by performing stereo reproduction with a speaker is obtained.

Further, according to the present invention, the sound field generating device variably attenuates the input monaural audio signal based on the pan head direction information, and the input monaural audio signal. A left channel attenuator that variably attenuates the audio signal of the camera based on the camera platform direction information; a right channel delay element that variably delays the input monaural audio signal based on the camera platform direction information; And a left channel delay element for variably delaying the monaural audio signal based on the camera platform direction information.

[0012]

Embodiments of the present invention will be described in detail with reference to the drawings.

The stereo audio conference apparatus according to the present invention receives the monaural audio of the other video conference apparatus decoded by the audio decoder (3 in FIG. 1) based on the pan head direction information received from the other video conference apparatus. A sound field generating device (4 in FIG. 1) for generating a pseudo stereo sound, and a speaker (5-R in FIG. 1) for reproducing the pseudo stereo sound generated by the sound field generating device (4 in FIG. 1). And 5-L).

Another feature is that the camera platform of the other party's video conference device can be remotely controlled. More specifically, a pan head operating device that outputs pan head operation information to remotely control the pan head of the partner video conference device while knowing the pan head direction information indicating the current position of the head of the partner video conference device ( 1) of FIG. 1 is included.

Another feature is that the camera platform can be controlled by an operation from the other party's video conference device and an operation from the own video conference device. Specifically, a head control device (see FIG. 1) that receives head operation information from the other party's video conference device and operation information from the own head operation means (16 in FIG. 2) and outputs head direction information. 8) and a video camera (FIG. 1) that operates based on the pan head direction information output from the pan head control device (8 in FIG. 1).
12) and a camera platform (9 in FIG. 1) provided with a microphone (14 in FIG. 1).

A pseudo stereo sound can be generated from the monaural sound and the pan head direction information transferred from the other party's video conference device. Therefore, since the sound field localization reproduced in the direction of the camera platform of the other party's video conference device is biased, it is possible to hold a video conference with a rich sense of reality.

According to the operation of the video conference participant, the head operation device transfers the head operation information to the head control device of the partner video conference device. Therefore, one of the video conference devices can remotely control the platform of the other video conference device.

[0018] The information of the operation of the video conference participant and the pan head operation information received from the partner video conference device are received, and the pan head direction information is output to the pan head. Therefore, not only can the head be remotely controlled from the remote video conference device, but also the video conference participants of the local video conference device can be controlled.

Now, regarding the embodiment of the present invention,
More specifically, with reference to FIG. 1, the video conference device 1 is an entire device for realizing a video conference. The network 15 connects the video conference devices 1 between remote locations to realize a video conference. The video camera 12 outputs a captured image signal. The image encoding device 11 receives the captured image signal output from the video camera 12, encodes the captured image signal, and outputs the encoded captured image signal to the multiplexing device 2. The microphone 14 outputs an input audio signal. The audio encoding device 13 receives an input audio signal output from the microphone, encodes the input audio signal, and outputs the encoded audio signal to the multiplexer 2. The image decoding device 6 receives the encoded captured image signal received from the other party's video conference device from the multiplexing device 2, performs decoding, and outputs a reproduced image signal. The display 7 receives the reproduced image signal output from the image decoding device and displays the video of the other party. The audio decoding device 3 receives the encoded audio signal received from the other party's video conference device from the multiplexing device 2, performs decoding, and outputs a reproduced audio signal. The sound field generation device 4 receives the reproduced audio signal output from the audio decoding device 3 and the pan head direction information received from the partner video conference device, and outputs a stereo-converted audio signal. The right speaker 5-R reproduces a stereo right audio signal output by the sound field generation device 4. The left speaker 5-L reproduces the stereo left audio signal output by the sound field generation device 4.
The pan head controller 8 receives the pan head operation information received from the other party's teleconference device, and outputs pan head direction information by the pan head operation information and the own pan head means provided in the pan head controller 8.
The camera platform 9 includes a video camera 12 and a microphone 14, and rotates based on camera platform direction information output by the camera platform controller 8. The head operation device 10 receives the head direction information received from the other party's video conference device, and outputs head operation information for operating the head of the other party's video conference device. The multiplexing device 2 includes an encoded captured image signal output from the image encoding device 11, an encoded audio signal output from the audio encoding device 13, and pan head operation information output from the pan head operating device 10. And the pan head direction information output from the pan head control device 8, and synthesizes signals. The synthesized signal is transferred to the other party's video conference device via the network 15. At the same time, a combined signal received from the other party's video conference device via the network 15 is input, and the encoded audio signal, the encoded captured image signal, the pan head operation information, and the pan head direction information are input. And output.

Next, the operation of FIG. 1 will be described.

A picked-up image signal picked up and output by the video camera 12 is input to the image encoding device 11. The captured image signal is encoded by the image encoding device 11, and the encoded captured image signal is input to the multiplexer 2. At the same time, an input audio signal collected and output by the microphone 14 is input to the audio encoding device 13. The input audio signal is encoded by the audio encoding device 13, and the encoded audio signal is similarly input to the multiplexer 2.

The head operation device 10 receives the head direction information transmitted by the head control device of the partner video conference device, and transmits the head direction information to the multiplexing device 2.
, And, after knowing the direction of the camera platform of the other party's video conference device, outputs the platform operation information to the multiplexer 2 for operating the camera platform of the other party's video conference device.

The head control device 8 receives the head operation information transmitted by the head operation device of the partner video conference device.
Then, as shown in FIG. 2, based on the own head operation means 16 provided in the head control device 8 and the received head operation information, the head direction information is transmitted to the head 9 and the multiplexing device 2. Output to The camera platform 9 rotates the camera platform 9 based on the camera platform direction information output from the camera platform controller 8. The camera platform 9 is provided with a video camera 12 and a microphone 14, and rotates together with the camera platform 9.

The multiplexing device 2 includes an encoded captured image signal input from the image encoding device 11, an encoded audio signal input from the audio encoding device 11, and a cloud input from the pan head operating device. The platform operation information and the platform direction information input from the platform controller are multiplexed and transmitted to the partner video conference device via the network 15.

On the other hand, the multiplexing device 2 demultiplexes the data received from the other party's video conference device via the network 15, and sends the captured image signal encoded by the image decoding device 6 to the audio decoding device 3. The encoded audio signal is transmitted to the pan head control device 8 by the pan head operation signal, and the sound field generation device 4
The head direction signal is output to the camera head operating device 10 and the camera head operating device 10, respectively.

The image decoding device 6 multiplexes the decoded imaged video signal received from the other party's video conference device into the multiplexing device 2.
And decode the video. The decoded video signal is displayed on the display 7. That is, an image captured by the video camera of the other party's video conference device is displayed.

The audio decoding device 3 inputs the decoded audio signal received from the other party's video conference device from the multiplexer 2, and decodes the audio. The decoded audio signal is output to the sound field generation device 4.

The sound field generation device 4 inputs the audio signal decoded by the audio decoding device, and at the same time, inputs the head position information of the other party received from the other party's video conference device and input from the multiplexer 2. The sound field generating device 4 generates a pseudo stereo sound signal based on the sound signal and the pan head direction information. The pseudo-stereo sound signal output from the sound field generation device 4 is reproduced by the right speaker 5-R and the left speaker 5-L. That is, the sound collected by the microphone of the other party's video conference device is reproduced as pseudo stereo sound.

FIG. 2 is a block diagram for explaining the operation of the camera platform control device 8. Referring to FIG. 2, the pan head control device 8
Normally, the pan head operation means 16 provided in the pan head control device 8 outputs the pan head direction information to the pan head 9 of the own video conference device. Then, the camera platform 9 faces the direction φ of the speaker.
Here, when the pan head operation information transmitted by the pan head operation device of the partner video conference device is input from the multiplexing device 2, the pan head operation information is output to the pan head 9 as pan head direction information.
That is, the camera platform 9 can be controlled by both the camera platform operating device 16 and the camera platform operating device of the partner video conference device. Further, the pan head operation information is output to the pan head 9 at the same time as the pan head operation information is also output to the multiplexing device 2 and transmitted to the partner video conference device.

FIG. 3 is a block diagram for explaining the operation of the sound field generating device 4. Referring to FIG. 3, the variable attenuator 4ZR
Adjusts the audio level of the right channel. Variable attenuator 4
ZL adjusts the audio level of the left channel. The variable delay element 4DR adjusts the audio delay time of the right channel.
The variable delay element 4DL adjusts the audio delay time of the left channel.

Next, the operation of FIG. 3 will be described.

The audio signal decoded by the audio decoder 3 is input to the sound field generator 4. The input audio signal is divided into two channels. Now, on the right channel side, the variable attenuator 4ZR and the variable delay element 4DR
Attenuation and delay are added. Similarly, also on the left channel side, the variable attenuator 4ZL and the variable delay element 4DL provide
Attenuation and delay are added. Here, the variable attenuator 4ZR,
The variable amounts of the variable delay element 4DR, the variable attenuator 4ZL, and the variable delay element 4DL are transmitted by the other party's video conference device,
It is determined by the camera platform direction information input from the multiplexing device 2. And the variable attenuator 4ZR variable delay element 4DR
The audio signal attenuated and delayed by is reproduced by the speaker 5-R, and the audio signal attenuated and delayed by the variable attenuator 4ZL and the variable delay element 4DL is reproduced by the speaker 5-L. .

Here, for example, when the pan head direction information φ is 0 degree, the attenuation amounts of the variable attenuators 4ZR and 4ZL are both 0,
If the delay amounts of the variable delay elements 4DR and 4DL are both set to 0, the sound image localization of the sound reproduced by the speakers 5-R and 5-L is located at the center of the speaker, and the camera platform of the partner video conference device faces forward. Can be determined from the sound image localization, and a sense of reality can be obtained. When the pan head direction information φ is α degrees to the right, the attenuation by the variable attenuator 4ZR is set to + Zα, the attenuation by the variable attenuator 4ZL is set to 0, and the variable delay element 4D is set.
If the delay amount due to R is set to + Dα and the delay amount of the variable delay element 4DL is set to 0, the sound image localization of the sound reproduced by the speakers 5-R and 5-L shifts to the right, and the camera platform of the other party's video conference device It can be judged from the sound image localization that it is facing the right side, and a sense of reality can be obtained. Conversely, if the pan head direction information φ is β degrees to the left, the attenuation by the variable attenuator 4ZR is set to 0, the attenuation by the variable attenuator 4ZL is set to + Zβ, and the delay by the variable delay element 4DR is set to 0, If the delay amount of the variable delay element 4DL is set to + Dβ, the sound image localization of the sound reproduced by the speakers 5-R and 5-L shifts to the left, and the camera platform of the other party's video conference device faces the left. Judgment can be made from sound image localization, and a sense of reality can be obtained.

[0034]

As described above, according to the present invention, pseudo stereo sound is generated and reproduced from monaural sound based on the direction of the camera platform of the partner video conference apparatus. Since only one channel is required for the audio encoder and decoder, the apparatus is inexpensive.

[Brief description of the drawings]

FIG. 1 is a diagram showing an embodiment of the present invention.

FIG. 2 is a diagram illustrating an operation of the camera platform control device according to the embodiment of the present invention.

FIG. 3 is a diagram illustrating an operation of the sound field generation device according to the embodiment of the present invention.

FIG. 4 is a block diagram showing an example of a conventional stereo audio video conference device.

[Explanation of symbols]

 REFERENCE SIGNS LIST 1 video conference device 2 multiplexer 3 audio decoder 4 sound field generator 4ZR, 4ZL attenuator 4DR, 4DL delay element 5-R right channel speaker 5-L left channel speaker 6 image decoding device 7 display 8 pan head Control device 9 Camera platform 10 Camera platform operating device 11 Image encoding device 12 Video camera 13 Audio encoding device 14 Microphone 15 Network 16 Own platform operating means 106a Audio codec 106b Audio codec 107a Audio input unit 107b Audio input unit 108a Audio output Unit 108b audio output unit 109 system control unit 110a changeover switch 110b changeover switch

Claims (2)

(57) [Claims] 1. A teleconference device having a video camera mounted thereon and indicating a direction of a pan head facing a speaker of a video conference.
A sound field generation device for generating a stereo sound signal from a monaural sound signal transferred from the other party's video conference device and decoded by a sound decoding device, based on the transferred pan head direction information; A stereo audio teleconference device wherein stereo audio signals generated by a sound field generation device are stereo-reproduced by left and right speakers. 2. The stereo audio teleconferencing device according to claim 1, wherein the sound field generation device variably attenuates the input monaural audio signal based on the pan head direction information. A left channel attenuator that variably attenuates the input monaural audio signal based on the camera platform direction information; and a right channel variably delays the input monaural audio signal based on the camera platform direction information. A stereo audio video conference apparatus comprising: a channel delay element; and a left channel delay element that variably delays the input monaural audio signal based on the pan head direction information.