JPH0410742A - Remote conference equipment - Google Patents

Abstract

PURPOSE:To automatically obtain an independent sound image assigned position control signal different in each conference terminal equipment every conference session by simultaneously informing subscriber's registered numbers from a node equipment 1 to respective conference terminal equipments and allowing each conference terminal equipment to form a sound image assigned position control signal corresponding to the position of a self-number included in the subscriber's registered numbers. CONSTITUTION:The subscriber's registered numbers are simultaneously informed from the node equipment 1 to respective conference terminal equipments 3 and each equipment 3 determines its sound image assigned position control signal corresponding to the position of the self-number included in the registered numbers. The sound image assigned position control signal is sent to the node equipment 1 simultaneously with a sound signal sent from the equipment 3 by speed-dividing a digital line. The equipment 1 logically processes the sound image assigned position control signals obtained from each equipment 3 and sends the processed signal to equipments 3 other than the transmitting source together with the sound signal. The equipments 3 receiving the control signal set up the sound image on the position corresponding to the signal. Consequently, the sound image forming position of a sender can be set up in each conference.

Description

DETAILED DESCRIPTION OF THE INVENTION [Industrial Field of Application] The present invention is used for remote conference calls between a plurality of conference terminal devices interconnected via a conference call line. In particular, it relates to sound image localization control in remote conference calls.

The present invention (in a remote conference device in which a node device and a plurality of conference terminal devices are connected via a digital line,
The node device broadcasts the subscriber registration number to each conference terminal device, and the conference terminal device determines the sound image localization control signal according to the position of its own number included in the subscriber registration number. This allows the sound image position of each speaker to be set for each speaker.

[Conventional technology]

As a remote conference device, ``Delephone Conference'' by NTT's service has been put into practical use in Japan. Regarding the technical content of "phone conference", please refer to Ishi J et al., "Voice Conference Communication System J, N'TT Research and Practical Application Report, Vol.
5) is explained in detail.

This document describes two types of calling methods: a sequential calling method and a batch calling method.

FIGS. 6 and 7 illustrate the calling sequence shown in the aforementioned document. FIG. 6 shows a sequential calling method, and FIG. 7 shows a batch calling method.

In a remote conference device, a plurality of conference terminal devices are connected to one node device via a telephone network, and a call is made via this node device.

In the case of the sequential calling method, the host who convenes the conference calls the conference terminal devices of the conference participants from the conference terminal device (conference convening terminal) by calling each subscriber's telephone number in order. When a conference starts, the node device adds the voices of each speaker and broadcasts the added audio signals to the conference terminal devices (conference convening terminal and conference participating terminal) of each conference participant. distribute.

In the case of the batch calling method, the host registers the subscriber numbers of the conference terminal devices of all conference participants in the node device, and calls each conference terminal device all at once from the node device at a certain time.

Furthermore, ``How to Use a Teleconference System'', Business Communication, Vol. 24, No. 7, 1987, describes how to use a teleconference transmitting device.

This document describes not only how to use a handset type telephone, but also a loudspeaker type telephone that allows multiple people to talk at the same time, and a configuration consisting of a plurality of speakers with microphones arranged on one table. However, multiple speakers in this case simply distribute the received audio signal and
This is to ensure that the listeners can hear it evenly.

However, in all of the voice communication forms of the teleconference devices that have been put into practical use, the voice of the speaker is generated from a single loudspeaker or receiver. For this reason, there was a drawback that it was difficult to tell who was the speaker unless the person had a distinctive voice.

In order to eliminate this drawback, it is being considered to connect a line to each destination in a ``telephone conference'' and prepare a loudspeaker or a hearing receiver for each destination.

In this way, since the location of the loudspeaker generated is different for each speaker, it becomes possible to easily identify the speaker. However, there was a drawback that the line cost and the economical efficiency of the device were impaired.

Also, Shimada, Suzuki, “Ground identification sound image generation method for multi-point audio conference communication system”, Journal of the Institute of Electronics, Information and Communication Engineers, No. J70.
- Volume B, No. 9 (September 1987) describes a method of generating sound images at different positions for each ground using sound image localization control signals. In this paper, the code format shown in the table is used as the sound image localization control signal.

That is, the conference terminal device that has become the speaker transmits the sound image localization control signal assigned to that device along with the audio signal. The audio signals and sound image localization control signals from each conference terminal device are then sent to the node device. The node device logically processes the sound image localization control signal and transmits the audio signal and the sound image localization control signal to the conference terminal device on the listener side.

On the receiving side, based on the sound image localization control signal, the sound is generated at sound image positions divided by direction in advance.

In this way, it is possible to generate a sound image as if the conference participants were seated around one table. Since the sound image localization control signals shown in the table are code sequences that are orthogonal to each other, logical processing is simple even when there are multiple speakers.

However, in the current analog telephone network, each conference terminal device is connected by a single line in the telephone band of 0.3 to 3.4 kHz, so it is necessary to send out-of-band signals such as to the ground or to identify the caller. In this case, the audio band must be divided, which causes deterioration of audio quality. However, it is thought that this drawback can be solved by using a digital line of 15DN (digital service integration wJ).

[Problem to be solved by the invention]

However, even if a different sound image localization control signal is used for each conference terminal device, if the required sound image localization control signal is assigned to each conference terminal device in advance, the sound image position for each conference terminal device will be fixed. . For example, if different terminal devices participate depending on the conference, the sound image position may be biased depending on the configuration of the participants.

Further, when the conference organizer changes, even if it is desired to place the conference organizer's sound image in the center, the sound image position cannot be changed unless some measure is taken at each conference terminal device.

SUMMARY OF THE INVENTION An object of the present invention is to solve the above problems and provide a remote conference device that can set the sound image generation position of a speaker for each conference.

[Means to solve the problem]

In the remote conference device of the present invention, mutually different subscriber registration numbers are assigned to a plurality of conference terminal devices, and the node device
When a conference is held, the conference terminal device includes broadcast notification means for notifying subscriber registration numbers of all conference terminal devices participating in the conference to all the conference terminal devices, and the conference terminal device receives the subscription information notified from the broadcast notification device. The present invention is characterized in that it includes means for generating a sound image localization control signal in accordance with the position of one's own number included in the user registration number.

When there is a request to add a conference terminal device different from the conference terminal devices participating in the conference during a conference, the broadcast notification means is configured to notify the conference terminal devices already participating in the conference by adding the conference terminal device other than the conference terminal device participating in the conference. Means for notifying the subscriber registration number of the terminal device, and notifying the other conference terminal device of the subscriber registration number of that device and the subscriber registration number of each of the conference terminal devices already participating in the conference. can include.

The broadcast notification means also participates in the conference during the conference. The present invention may include means for notifying the subscriber registration number of the conference terminal device that requested the withdrawal to other conference terminal devices participating in the conference when there is a request to leave the conference from the conference terminal device.

When a heterogeneous conference terminal device that cannot transmit a sound image localization control signal is connected, the node device performs sound image localization control in accordance with the position of the number of the heterogeneous conference terminal device included in the subscriber registration number notified from the broadcast notification means. means for generating a signal; audio detection means for detecting the presence or absence of an audio signal from the different type of conference terminal device; It is desirable to include means for processing the information as follows.

[For production]

The node device broadcasts the subscriber registration number to each conference terminal device, and the conference terminal device determines a sound image localization control signal according to the position of its own number included in the subscriber registration number. This sound image localization control signal is simultaneously sent to the node device by dividing the speed of the digital line when transmitting the audio signal from the conference terminal device. The node device logically processes the sound image localization control signal from each conference terminal device and sends it to conference terminal devices other than the transmission source together with the audio signal. The conference terminal device that receives the sound image localization control signal along with the audio signal localizes the sound image at a position corresponding to the sound image localization control signal.

Since the sound image localization control information is generated from the subscriber registration numbers of all the conference terminal devices participating in the conference, the sound image position of each conference terminal device can be set according to the configuration of the conference participants and the conference organizer. In particular, since the sound image localization control signal is determined according to the order of subscriber registration numbers sent from the node device,
It is possible to realize the speaking positions as if the speakers were seated around the table in an order corresponding to that order.

〔Example〕

FIG. 1 is a block diagram showing a remote conference device according to an embodiment of the present invention, FIG. 2 is a block diagram showing details of a node device, and FIG. 3 is a block diagram showing details of a conference terminal device.

This device includes a plurality of conference terminal devices 3 and a node device 1 connected to the plurality of conference terminal devices 3 via a line of a digital network 2. In this embodiment, the digital network 2 is an 15DN, and communication is performed using each channel of B and D. Therefore, the node device 1 is equipped with a D channel network control circuit 12 and a B channel terminal control circuit 16, and the conference terminal device 3 is equipped with a D channel network control circuit 12 and a B channel terminal control circuit 16. It includes a channel network control circuit 31 and a B channel terminal control circuit 39. A D channel group 11 is connected to the D channel network control circuit 12 of the node device 1, and a B channel group 15 is connected to the B channel terminal control circuit 16.

The conference terminal device 3 includes a sound image localization control signal storage circuit 36 as a means for sending the sound image localization control signal together with the audio signal.
, a voice detection circuit 37 and a gate circuit 38.

The node device 1 includes a logic processing circuit 18 and a B channel terminal control circuit 16 as means for logically processing sound image localization control signals arriving from a plurality of conference terminal devices 3 and notifying each conference terminal device 3 of the result.

Here, the feature of this embodiment is that different subscriber registration numbers are assigned to a plurality of conference terminal devices 3, and when a conference is held, the node device 1 manages all the conference terminal devices 3 participating in the conference. A conference participant storage circuit 13, a broadcast circuit 14, and a coincidence detection circuit 1 serve as broadcast notification means for notifying all the conference terminal devices 3 of the subscriber registration number.
7, the conference terminal device 3 includes an own terminal number storage circuit 32 as means for generating a sound image localization control signal corresponding to the position of the own number included in the subscriber registration number notified from the broadcast notification means. , a coincidence detection circuit 33, a counter 34, and an encoding table storage circuit 35.

The node device 1 also includes an analog network control circuit 19 to which a different type of conference terminal device that cannot transmit a sound image localization control signal can be connected.
and a subscriber registration number storage circuit as a means for generating a sound image localization control signal corresponding to the position of the number of the dissimilar conference terminal device included in the subscriber registration number notified from the broadcast notification means for the connection. 20, comprising a coincidence detection circuit 21, a counter 22, an encoding table storage circuit 23, and a sound image localization control signal storage circuit 24, and an audio detection circuit 25 for detecting the presence or absence of an audio signal from the heterogeneous conference terminal device; A gate circuit 26 is provided as means for processing the sound image localization control signal output from the detection circuit 25 as a sound image localization control signal from the different type of conference terminal device.

Here, various signal formats that form the basis of the present invention will be explained.

FIG. 4 shows the frame format of the basic service of 15ON, and also shows the frame format of CITT (International Telegraph and Telephone Consultative Committee) Recommendation It, 221, which divides and uses the 54 kbps frame format.

There are two types of 15ON basic service lines: information line B and information control line. For general household use, 64
It is thought that a 28+D channel with two kbps information lines and one 16 kbps information control line will become popular. In addition to this combination of lines, 54k
A combination of 23 bps information lines and one information control line and a combination of 24 54 kbps information lines are being considered. FIG. 4 shows the case of 2B+D. Three channels are multiplexed within a 2B+D frame, and the 54kbps B channel is based on CCITT Recommendation 1.
．． 43() and 1.431,
In addition, CCITT recommendation H1221 (G, 722) specifies a speed division of 64 kbps. This regulation uses only one 64 kbps digital line to simultaneously transmit not only voice but also digital image signals and data signals. At this time, the 64 kbps channel transmits octets (8 bits are one constituent unit) at 3 kHz. In Fig. 4, 80 octets are considered as one transmission unit, and these are shown as being octet multiplexed. Of the octets, 7 bits are used for the voice channel and the 8th bit is used for other purposes as the service channel.

The service channel is divided into three parts, as shown in FIG. The first is a frame alignment signal RAS, which is composed of multi-frames in which a basic frame pattern of 8 bits is alternately generated for each frame of the service channel. The second is a bit allocation signal BAS, which defines various communication modes. The third is C to the application channel, which can be used for digital service communication having a transmission rate of 6.4 kbps or less.

The operation of this embodiment will be explained with reference to FIGS. 1 to 3 again.

When a conference terminal device 3 convenes a conference (hereinafter referred to as a "meeting convening terminal"), the conference terminal device 3 calls the node device 1 and calls the conference terminal device 3 (hereinafter referred to as "conference convening terminal") to participate in the conference. The subscriber registration number of the participating terminal (referred to as "participating terminal") and the date and time of the conference will be notified. This notification is transmitted to the D channel network control circuit 12 of the node device 1, and the subscriber registration numbers are stored in the conference participant storage circuit 13 in order.

When the designated conference date and time arrives, the node device 1 sends each conference terminal device 3 via the D channel according to the subscriber registration number stored in the conference participant storage circuit 13.
(meeting convening terminal and conference participating terminal). At this time, the broadcast circuit 14 broadcasts all the subscriber registration numbers stored in the conference participant storage circuit 13 to each conference terminal device 3 .

Subsequently, the node device 1 changes its operation mode to the B channel mode and performs communication via the B channel terminal control circuit 16. At this time, the coincidence detection circuit 17 detects whether the subscriber registration number received from the conference convening terminal and the conference participating terminal through the service channel in the B channel matches the subscriber registration number stored in the conference participant storage circuit 13. Find out if it is. If they do not match, the broadcast circuit 14 once again broadcasts all subscriber registration numbers to the conference convening terminal and conference participating terminals via the D channel or B channel service channel. If they match, the conference call is started after confirming the terminal information type and number.

In the conference call phase, each of the conference convening terminal and the conference participating terminal transmits a sound image localization control signal in the code format shown in the table above along with an audio signal when transmitting a call. The node device 1 distributes audio signals and sound image localization control signals from individual terminals to terminals other than the transmission source class. At this time, the sound image localization control signal from each terminal is not distributed to each terminal as it is, but is distributed after being subjected to logical processing by the logic processing circuit 18. This is because there is no need to send the sound image localization control signal to the transmitter's terminal when a plurality of terminals become speakers at the same time. This can be configured with ○R and NOR logic circuits. Details are given in the paper by Masaru Shimada.

When there is a request to add a conference terminal device 3 other than the conference convening terminal and conference participating terminal during the conference, the information is sent to D.
The subscriber registration number is supplied to the D channel network control circuit 12 via the channel, and the subscriber registration number is additionally stored in the conference participant storage circuit 13. The additional request may be generated by the conference convening terminal, the conference participating terminal, or the conference terminal device 3 that newly attempts to participate. When the subscriber registration number is additionally stored in the conference participant storage circuit 13, the broadcast circuit 14 registers the subscriber of the other conference terminal device 3 for the conference convening terminal and the conference participating terminal that have already participated in the conference. The registration number is notified, and the conference terminal device 3 is notified of the subscriber registration number of the device and the subscriber registration numbers of the conference convening terminal and the conference participating terminal.

When a conference participating terminal requests to leave the conference during the conference, the information is supplied to the D channel network control circuit 12 via the D channel, and the subscriber registration number of that terminal is deleted from the conference participant storage circuit 13. be done. At this time, the circulation circuit 14 notifies each terminal participating in the conference of the deleted subscriber registration number or the remaining subscriber registration number. This allows each terminal to recognize the terminated terminal.

The node device 1 also has a D channel function and a B channel service channel when the conference terminal device is a dissimilar conference terminal device that cannot transmit sound image localization control signals, such as a subscriber to an analog public network or an analog dedicated network. Since there is no analog network control circuit 19, the analog network control circuit 19 is used. Convocation of a meeting via an analog network can also be input from a telephone dial. Here, for the sake of simplicity, a case will be described in which a meeting is convened from the 15DN.

If the conference participant registration number stored in the conference participant storage circuit 13 is a subscriber accommodated by an analog network, the number is read from the conference participant storage circuit 13 and stored in the subscriber registration number storage circuit 20. Store.

Then, the analog network control circuit 1
Connection processing is performed via 9.

Thereafter, when the broadcast circuit 14 notifies all conference participants of the subscriber registration number, the coincidence detection circuit 21 compares the output signal of the broadcast circuit 14 with the contents stored in the subscriber registration number storage circuit 20. do. Further, the counter 22 detects which number of the subscriber registration numbers output by the broadcast circuit 14 the stored content of the subscriber registration number storage circuit 20 matches. One code stored in the encoding table storage circuit 23 is selected from the count value of the counter 22 and the output of the coincidence detection circuit 21. The encoding table storage circuit 23 stores codes used as sound image localization control signals as a table, and by specifying an address using the count value of the counter 22 at the time when the coincidence detection circuit 21 detects a coincidence, the encoding table storage circuit 23 stores codes used as sound image localization control signals. A corresponding sound image localization control signal can be obtained. This signal is stored in the sound image localization control signal storage circuit 24.

When a terminal connected via this analog network becomes a speaker, its voice signal is sent to the voice detection circuit 25 via the analog network control circuit 19. When the audio detection circuit 25 detects an audio signal, it makes the gate circuit 26 conductive, and
The signal stored in the sound image localization control signal storage circuit 24 is sent to the B channel terminal control circuit 16. This signal is further transmitted to the logic processing circuit 18 and processed in the same way as the sound image localization control signal from other terminals.

In the conference terminal bag W3, the D channel network control circuit 31 performs call setting control using the I5DN layer 3 communication.

The own terminal number storage circuit 32 stores a subscriber registration number specified in advance for the terminal, and the match detection circuit 33 compares this number with the subscriber registration number arriving from the node device 1.

When the two numbers match, the counter 3 at that time
From the count value of 4, it is possible to know which conference participant you are. Therefore, the code of the sound image localization control signal corresponding to that order is selected from the encoding table storage circuit 35. The configuration and storage contents of the encoding table storage circuit 35 are the same as those of the encoding table storage circuit 23 of the node device 1. The code output from the encoding table storage circuit 35 is stored in the sound image localization control signal storage circuit 36.

When an audio signal is generated in the conference terminal device 3, the audio detection circuit 37 detects the signal, controls the gate circuit 38,
The signal stored in the sound image localization control signal storage circuit 36 is
The signal is supplied to the channel terminal control circuit 39. The B-channel terminal control circuit 39 inserts the audio signal into the B-channel audio channel, inserts the sound image localization control signal into the B-channel service channel, and sends the signal to the node device 1 . The B-channel terminal control circuit 39 also outputs a sound image localization control signal received from the node device 1 via the B-channel service channel for sound image localization in its own terminal.

FIG. 5 shows a call setup procedure for a conference call using the call setup procedure in layer 3 of the I5DN. Of this procedure, (a) is the call setup phase using the D channel, c),
(C) and (d) show communication by the B channel, and (e) shows the release phase by the D channel. Further, (b) shows a service channel control information communication start phase, (C) a conference call phase, and (d) a service channel control information communication end phase.

For call setup and release via D channel, CCI
It is specified in TT Recommendations 1.430 and +431, and furthermore, a detailed explanation of the invention is provided in "Illustrated 1sDN - Multipurpose Ink Face", supervised by Noguchi and written by Suzuki, published by Ohm Corporation. However, a new "call termination" phase is required in which the node device broadcasts all the subscriber registration numbers of the conference participants to the conference convening terminal and the conference participating terminal. This information transfer function can be realized by either the D channel or the B channel, but here it is realized by the D channel.

For B channel communication, CCI within 54kbps
After synchronizing the service channels in TT Recommendation H.221, terminal information type/number messages are transmitted from each conference terminal device to the node device. This message indicates the type of terminal, indicating the functional configuration, such as whether the audio is in the 3.4KFLZ band, 7KFLZ band, or other encoding system, and whether it communicates audio and images simultaneously, and the type of terminal that is broadcast from the node. Contains the sound image localization control signal of each conference terminal device converted from the registered subscriber registration number. Following this, terminal information type/number confirmation is sent from the node device to the conference terminal device. This is for subscriber registration number, sound image localization control signal, and confirmation of participating terminals.

After this, the conference call will begin.

During the conference call phase, a sound image localization signal corresponding to the speaker is mutually transmitted simultaneously with the audio signal. The present invention
This article concerns the call setup connection and release signal system and the method of providing sound image localization control signals, and the method of adding and distributing acoustic signals and the sound image localization processing method uses the methods shown in the above-mentioned documents, so they will not be described here. The explanation will be omitted.

When the conference convenor wishes to end the conference call, the conference convenor terminal transmits the subscriber registration number and disconnection signal to the node device via the service channel.

In response, the node device sends a release signal to all conference participating terminals and the conference convening terminal, and disconnects the B channel connection between the node device and each conference terminal device.

Furthermore, if a terminal participating in a conference wishes to leave the conference during the conference, the terminal device transmits the subscriber registration number and a disconnection signal to the node device. The node device transmits the subscriber registration number of the conference terminal device to be left and a disconnection signal to all other conference terminal devices.

At the same time, B
Disconnect channel connection.

Furthermore, if there is a new conference terminal device that wishes to participate during the conference, the above-mentioned D channel operation is repeated,
Broadcast notification of the subscriber registration number of the conference terminal device added at the end of the call is made to other conference terminal devices.

In the above embodiments, a case has been described in which a plurality of conference terminal devices are connected to each other via one node device.

On the other hand, the present invention can be similarly implemented in a digital dedicated line in which a node device is also provided on the terminal side, if a D channel or a channel equivalent thereto exists.

Further, the basic service of IS[ltl has two B channels, and the present invention can be implemented in the same way even when transmitting an image using one of the B channels.

〔Effect of the invention〕

As described above, the remote conference device of the present invention can automatically obtain independent sound image localization control signals that are different from each other for each conference terminal device each time a conference is held.

Therefore, the conference terminal device on the receiving side can generate a sound image at a different location for each speaker based on the sound image localization control signal, which has the effect of making it possible to recognize the speaker.

[Brief explanation of the drawing]

FIG. 1 is a block diagram showing a remote conference device according to an embodiment of the present invention. FIG. 2 is a block diagram showing details of the node device. FIG. 3 is a block configuration diagram showing details of the conference terminal device. FIG. 4 is a diagram showing the frame format. FIG. 5 is a diagram showing a call setting procedure. FIG. 6 is a sequence diagram of a conventional sequential calling method. FIG. 7 is a sequence diagram of a conventional example--batch read method. 1... Node device, 2... Digital network, 3...
Conference terminal device, 11...D channel group, 12.31.
...D channel network control circuit, 13...conference participant storage circuit, 14...broadcast circuit, 15...B channel group,
16.39...B channel terminal control circuit, 17.21
．． 33... Match detection circuit, 18... Logic processing circuit,
19...Analog network control circuit, 20...Subscriber registration number storage circuit, 22.34...Counter, 23, 35
... Encoding table storage circuit, 24.36 ... Sound image localization control signal storage circuit, 25.37 ... Audio detection circuit, 26.38 ... Gate circuit, 32 ... Own terminal number storage circuit . Patent Applicant: Nippon Telegraph and Telephone Corporation Agent: Patent Attorney: Nao Takashi Ide 15DN Frame Format Figure 4

Claims (1)

[Claims] 1. The conference terminal device includes a plurality of conference terminal devices and a node device connected to the plurality of conference terminal devices via a digital line, and the conference terminal device sends out a sound image localization control signal along with an audio signal. In the remote conference device, the node device includes means for logically processing a sound image localization control signal arriving from the plurality of conference terminal devices and notifying each conference terminal device, wherein the plurality of conference terminal devices include: Different subscriber registration numbers are assigned to each other, and the node device includes broadcast notification means for notifying all the conference terminal devices of the subscriber registration numbers of all the conference terminal devices participating in the conference when the conference is held. , A remote conference device characterized in that the conference terminal device includes means for generating a sound image localization control signal in accordance with the position of the subscriber's number included in the subscriber registration number notified by the broadcast notification means. .