JP2000023131A - Multi-spot video conference system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a picture easy to watch without including any screen composed by multi-spot video conference communication controllers which are arranged around in the partial screen of the screen composed by the controller which is arranged at the center, for example, by detecting positions where plural controllers are arranged by a single composition instruction part and suppressing screen composing processing to screen composing control parts in the controllers which are arranged around in a multi-spot video conference system. SOLUTION: A single composing instruction part 15 is provided respectively in a master MCU 40 and slave MCU 41. Besides, the single composing instruction part in the master MCU 40 instructs the composition of screens to a screen composition processing part 7 and the single composition instruction part in the slave MCU 41 instructs a single screen to the screen composition processing part. Thus, a single screen is outputted to the master MCU 40 without composing any pictures. Therefore, no composite screen is included in the screen composed by the screen composition processing part in the master MCU 40 and the screen is made easy to watch.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multipoint video conference system comprising a plurality of video conference terminals and a multipoint video conference communication control device for controlling the plurality of video conference terminals. The present invention relates to a multipoint video conference system capable of appropriately controlling a screen between conference communication control devices.

[0002]

2. Description of the Related Art FIG. 7 is a block diagram of a conventional multipoint videoconference system comprising two multipoint videoconference communication control devices (hereinafter abbreviated as MCU (Multipoint Control Unit)). In the figure, reference numerals 30 and 31 denote Ms for controlling a plurality of video conference terminals to realize a multipoint video conference.
The MCU 31 has the same configuration as the MCU 30. Reference numeral 2 denotes a conference operation unit which is operated by, for example, an operator (not shown) to set a multipoint video conference, 3 denotes an ISDN line corresponding unit, 4 denotes a demultiplexing unit, 5 denotes an audio-video bus, and 6 denotes a conference. A control processing unit, 7 is a screen synthesis processing unit, 8 is an audio processing unit, 9 is a control bus, and 10 is a line bus. Reference numeral 13 denotes an MCU connection instruction unit, and reference numerals 20 to 2n denote video conference terminals.

Next, the operation will be described. Conference operation unit 2
Notifies the MCUs 30 and 31 (specifically, the conference control processing unit 6) of information such as the holding time of the multipoint video conference specified by the operator and the participating video conference terminals. The ISDN line corresponding unit 3 connects the MCU 30 or 31 to the video conference terminals 20 to 2n via a digital line such as an ISDN line, and exchanges multiplexed data such as video and audio. The demultiplexing unit 4 separates and multiplexes data such as video and audio from the video conference terminals 20 to 2n. The audio / video bus 5 exchanges data separated into video, audio, and the like between the demultiplexing unit 4, the screen synthesis processing unit 7, and the audio processing unit 8.

A conference control processing unit 6 communicates with a plurality of video conference terminals 20 to 2n via the ISDN line corresponding unit 3 or the demultiplexing unit 4, and performs video control such as screen synthesis and audio addition processing. Perform conference control. Further, the screen synthesizing processing unit 7 receives the instruction from the conference control processing unit 6 and
Screen synthesis of 0 to 2n is performed, and the voice processing unit 8 performs voice decoding / coding processing and voice addition according to an instruction from the conference control processing unit 6. The control bus 9 is connected to the conference control processing unit 6 and the ISD
Control signals are exchanged among the N-line corresponding unit 3, the demultiplexing unit 4, the audio processing unit 8, and the screen synthesis processing unit 7. Also,
The line bus 10 exchanges multiplexed data such as video and audio between the ISDN line corresponding unit 3 and the demultiplexing unit 4.

[0005] FIG. 8 is an operation sequence diagram when a multipoint video conference is held in the configuration shown in FIG. 7 by calling the MCU from the video conference terminal side (hereinafter referred to as a MeetMe conference system). In the operation according to FIG.
0 is connected to the video conference terminal 20, and the MCU 31 is connected to the video conference terminal 21. Also, the M-C connection instructing unit 13 is activated when the conference holding time comes.
CU is the master MCU, MCUs that are not are slave MCs
Called U. Here, the MCU 30 is a master MCU,
The MCU 31 is a slave MCU.

Next, the operation of holding a multipoint video conference using the MeetMe conference system will be described. In FIG. 8, for example, the operator specifies a conference holding time, a video conference terminal to participate in the conference, and the like from the conference operation unit 2. The conference operation unit 2 sets up a multipoint video conference based on the designated conditions and outputs a conference holding request to the MCUs 30 and 31. The MCUs 30 and 31 output a conference holding response to the conference operating unit 2 in response to the input meeting holding request. The MCUs 30 and 31 internally secure necessary resources such as the ISDN line corresponding unit 3 and the demultiplexing unit 4 when the conference is held.

[0007] When the conference time is reached, the master MCU
The inter-MCU connection instructing unit 13 outputs a connection request with the slave MCU 31 to the conference control unit 6. The conference control processing unit 6 that has received the connection request from the inter-MCU connection instruction unit 13 outputs a midway call request to the slave MCU 31. Note that this midway call request is originally a request for the MCU to call a video conference terminal participating in the multipoint video conference, but is used here for connection between the MCUs. As a result, the master MCU 30 establishes connection with the slave MCU 31 in a sequence as shown in FIG. Hereinafter, the connection operation between the master MCU 30 and the slave MCU 31 will be described with reference to FIG.

[0008] First, the master MCU 30
A call setting request is output to U31. On the other hand, when the slave MCU 31 determines that the connection with the master MCU 30 is possible, the slave MCU 31 outputs the connection to the master MCU 30. Thereby, the call connection between the master MCU 30 and the slave MCU 31 is completed.

Next, the master MCU 30 and the slave MCU
31 (specifically, the demultiplexing unit 4 shown in FIG. 7),
For example, International Standard ITU-T Recommendation H. Synchronization establishment / capability exchange operation is performed to achieve frame synchronization as specified by H.221 and match the multiplex format of data such as video, audio, and control data. When this synchronization establishment / capability confirmation operation is completed, the master MCU 30
1 and outputs an MCU connection notification. The slave MCU 31 that has received the MCU connection notification outputs an MCU connection confirmation to the master MCU 30. Further, the master MCU 30 that has input the MCU connection confirmation outputs a conference holding instruction to the slave MCU 31.

[0010] Further, the slave M which has input the conference holding instruction
The CU 31 outputs a conference holding response to the master MCU 30 and enters a conference start waiting state. Further, the master MCU 30 that has received the conference holding response outputs a conference start instruction to the slave MCU 31 to start a conference. The slave MCU 31 that has input the conference start instruction is the master MCU 30.
Outputs the meeting start response to As a result, the master MCU
30 and the slave MCU 31 are connected, and the master M
Video, audio, data, and the like used for the conference can be exchanged between the CU 30 and the slave MCU 31.

In addition, the video conference terminal 20 that should participate in the multipoint video conference, when the conference holding time comes, becomes the master MC.
The call setting is output to U30. The master MCU 30 that has input the call setting from the video conference terminal 20
When it is determined that the connection is possible with 0, the connection is output. Thereby, the call connection between the master MCU 30 and the video conference terminal 20 is completed. Next, between the master MCU 30 and the video conference terminal 20, a sequence from synchronization establishment / capability exchange to a conference start response is performed.

In addition, the video conference terminal 21 that should participate in the multipoint video conference enters the slave M at the conference holding time.
The call setting is output to the CU 31. The slave MCU 31 that has received the call setting from the video conference terminal 21 outputs the connection when it determines that the connection with the video conference terminal 21 is possible. Thereby, the call connection between the slave MCU 31 and the video conference terminal 21 is completed. Next, between the slave MCU 31 and the video conference terminal 21, synchronization establishment / capability exchange is performed.
The sequence up to the meeting start response is performed.

With the above operation, the master MCU 30 and the slave MCU 31, the master MCU 30 and the video conference terminal 20, and the slave MCU 31 and the video conference terminal 21 are connected to each other, and a multipoint video conference is held. In FIG. 7, only one video conference terminal 20 is connected to the master MCU 30 and one video conference terminal 21 is connected to the slave MCU 31, but the number of connected MCUs and video conference terminals is usually large. FIG. 9 is a configuration diagram of a conventional multipoint video conference system configured using three MCUs and six video conference terminals.

In the drawing, reference numerals 1a to 1c denote MCU 30
MCUs 22 to 25 having the same configuration as the above are, for example, video conference terminals having the same configuration as the video conference terminal 20. In FIG. 9, the MCU 1a is a master MCU, MC
U1b and 1c are slave MCUs. In the configuration of FIG. 9, the master MCU 1a establishes connection with the slave MCUs 1b and 1c in the same sequence as in FIG. When the conference holding time comes, the video conference terminals 20 and 21 connect to the master MCU 1a, the video conference terminals 22 and 23 connect to the slave MCU 1b, and the video conference terminals 24 and 25 connect to the slave MCU 1c in the same sequence as in FIG.

Next, the operation of the MCU during a conference will be described with reference to FIG. The conference control processing unit 6 outputs a terminal participation signal (not shown) to the screen composition processing unit 7 when the video conference terminal participates in the conference, and the screen composition processing unit 7 that has received the terminal participation signal The video of the conference terminal is included in a composite screen (not shown). Further, when a predetermined video conference terminal speaks during the conference, the conference control processing unit 6 sends the speaker to the screen synthesis processing unit 12 based on the speaker notification signal (not shown) from the audio processing unit 8. A notification signal is output, and the screen synthesis processing unit 7 performs screen synthesis processing (speaker enlarged display, display with speaker frame, and the like) according to the conference. When the participating teleconference terminal leaves, the conference control processing unit 6 instructs the screen synthesizing processing unit 7 to delete the image of the departed teleconference terminal from the synthesized screen by a terminal leaving signal.

[0016]

The conventional multipoint video conference system is configured as described above, and has the following problems. (1) In the multipoint video conference system in which a plurality of MCUs are connected as shown in FIG. 7, when the screen composition processing units 7 create composite screens with each other, for example, as shown in FIG. There is a problem that the screen may be unsightly, because the screen includes a screen that has been changed.

(2) For example, in the multipoint video conference system as shown in FIG. 9, when the video conference terminals 24 and 25 to be connected to the slave MCU 1c are not connected together, the master MCU 1a transmits the video from the slave MCU 1c. If the images are combined, there is a problem that a meaningless image is combined and the screen becomes unsightly.

The present invention has been made to solve the above problems, and a first object of the present invention is to provide a multipoint video conference system capable of performing appropriate screen composition.

[0019]

A multipoint video conference system according to the present invention is provided in each of the multipoint video conference communication control devices, and is a screen synthesis processing unit for synthesizing an image from a connected video conference terminal. And a single combining instructing unit that detects an arrangement position of a plurality of multipoint videoconference communication control devices and suppresses a screen combining process to a screen combining control unit in a multipoint videoconference communication control device arranged therearound. It is provided with.

Further, the multipoint video conference system according to the next invention provides a multipoint video conference communication control device mainly arranged with an MCV instruction unit for outputting an MCV command for outputting an input video to a terminal connected thereto. When the synthesized video synthesized by the screen synthesizing processing unit in the multi-point video conference communication control device disposed at the center is output to the surrounding multi-point video conference communication control device, M output from the MCV instruction unit is output.
The CV command is added.

Further, in the multipoint video conference system according to the next invention, in the multipoint video conference communication control device arranged around, the MIZ command for notifying that there is no connected video conference terminal can be output. And the multi-point video conference communication control device arranged at the center includes the M
An MIZ processing unit is provided to suppress the synthesis of video from the multipoint video conference communication control device to which the IZ command has been input.

[0022]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiment 1 Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a configuration diagram of a multipoint video conference system according to Embodiment 1 of the present invention. The same reference numerals as in FIG. 7 denote the same or equivalent functions, and a description thereof will be omitted. In the figure, 40 and 41 are MCUs, and 15 is a single combining instruction unit. FIG. 2 is an operation flowchart of the single composition instructing unit 15.

Next, the operation will be described. In the configuration of FIG. 1, the MCU 40 is a master MCU and the MCU 41 is a slave MCU. The slave MCU 41 has the same configuration as the master MCU 40. Master M
The video conference terminals 20 and 21 are connected to the CU 40, and the video conference terminal 22 (not shown) is connected to the slave MCU 41.
23 are connected. For example, master MCU4
When the MCU connection instruction unit 13 of 0 inputs a conference holding request from the conference operation unit 2, it outputs the conference holding request to the single combining instruction unit 15 as it is.

In step ST1 of FIG. 2, the single composition instructing unit 15 that has input the request to hold a conference notifies the conference control processing unit 6 of the request to hold a conference, and proceeds to step ST7. In ST2, it is determined whether or not there is an MCU to be connected by referring to the command content (not shown) of the input conference holding request. If there is an MCU to be connected, ST3; if not, ST3.
Move to 4. In ST3, it is determined whether or not the own MCU is the master MCU, and if it is the master MCU, the process proceeds to ST4.
If not, the process proceeds to ST5. In ST4, a compositing instruction request is output to the screen compositing processing unit 7, and the operation is terminated. In ST5, a single instruction request is output to the screen compositing processing unit 7, and the operation is terminated.

Thus, when a multipoint video conference is held by the MCUs 40 and 41, the master MCU 40
Of the slave MCU 41 and the videoconference terminals 20 and 21 to combine the images of the slave MCU 41 and the videoconference terminals 20 and 21.
1. Output to each of the video conference terminals 20 and 21. Further, the screen synthesis processing unit 7 of the slave MCU 41 selects one of the images from the video conference terminals 22 and 23 based on the speaker notification signal from the conference control
Output to the CU 40 and the video conference terminals 22 and 23.

In this way, in a multipoint video conference using a plurality of MCUs, the screen combining processing unit 7 other than the master MCU does not perform the screen combining, so that the partial screen of the combined screen as shown in FIG. This eliminates the inclusion of a screen synthesized by the MCU, and makes it possible to prevent the screen from becoming unsightly.

However, in the first embodiment, the slave MC
The video of any one of the video conference terminals 22 and 23 selected based on, for example, a speaker notification signal from the conference control unit 6 is output to the video conference terminals 22 and 23 connected to the U41. The composite image by the composite processing unit 12 is not output. In the second embodiment, a configuration of a multipoint video conference system capable of outputting a composite image from the master MCU 40 to the video conference terminals 22 and 23 will be described.

Embodiment 2 FIG. It is a block diagram of the multipoint video conference system by Embodiment 2 of this invention, and the same code | symbol as FIG. 1 shows the same or equivalent function, and abbreviate | omits description. In the figure, 50 and 51 are MCUs,
16 is based on the midway call request from the inter-MCU connection instructing unit 13 and instructs the demultiplexing unit 4 on the slave MCU side to the international standard ITU-T Recommendation H.16. MCV (Multipo
int Command Visualization) This is an MCV instruction unit that requests transmission of a command. Also, MCU51 is MCU50.
It has the same configuration as

The MCV command is a command by which a video conference terminal participating in a multipoint video conference requests the MCU to distribute its own video signal to other video conference terminals participating in the conference. It is. The MCU that has received the MCV command must end the speaker switching based on the voice detection up to that time, and distribute the video from the video conference terminal that has received the MCV to other video conference terminals that participate in the same conference. As a result, for example, the master MCU
The slave MCU that has input the command outputs the composite video from the master MCU to a video conference terminal connected to another slave MCU. That is, here, the MCV command is used as a command that enables output of a composite video from the master MCU to a terminal connected to the slave MCU.

Next, the operation will be described. In the configuration of FIG. 3, the MCU 50 is a master MCU and the MCU 51 is a slave MCU. Also, the master MCU 50 includes:
The video conference terminals 20 and 21 connect, and the slave MCU 5
1 is connected to video conference terminals 22 and 23 (not shown). FIG. 4 is an operation flowchart of the MCV instruction unit 16. For example, MCU 30 and M shown in FIG.
In order for the master MCU 50 and the slave MCU 51 to perform the same sequence from the call setting to the CU 31 to the conference start response, the MCU connection instruction unit 13 of the master MCU 50
The midway call request is output to the CV instruction unit 16.

In step ST6, the MCV instructing unit 16 which has input the halfway calling request from the inter-MCU connection instructing unit 13 outputs the halfway calling request input to the single combining instructing unit 15 as it is.
Move to T7. In ST7, it is determined whether or not the call destination of the input midway call request is a slave MCU. If the call destination calls the slave MCU, the process proceeds to ST8, and if not, the operation is terminated. The MCV instruction unit 16
In step ST8, the process waits for completion of connection with the slave MCU. When the connection with the slave MCU is completed (for example, when a conference start response is returned from the slave MCU), the process proceeds to ST9.

In ST9, an MCV transmission request command is output to the demultiplexing unit 4 connected to the slave MCU, and the operation ends. As a result, the demultiplexing unit 4 that has received the MCV transmission request command from the MCV instruction unit 16
An MCV transmission request command is output to the screen synthesis processing unit 12 on the slave MCU side via the demultiplexing unit 4 on the CU side.

As a result, for example, the screen composition processing unit 12 of the slave MCU 51
3, a composite video from the master MCU 50 is output, and a multipoint video conference system with improved operational efficiency is realized.

Embodiment 3 FIG. 5 is a configuration diagram of a multipoint video conference system according to Embodiment 3 of the present invention. The same reference numerals as in FIG. 3 denote the same or equivalent functions, and a description thereof will be omitted. In the figure, 60 and 61 are MCUs,
17 is, for example, from a slave MCU to an international standard ITU-T recommendation H.17. MIZ (Multipoint Indicat 230)
ion Zero communication), the terminal M outputs a terminal leaving notification to the screen composition processing unit 7 so as to delete the video signal from the slave MCU from the screen composition.
It is an IZ processing unit. The MCU 61 has the same configuration as the MCU 60.

The MIZ command means that, for example, when a multipoint video conference is being performed with one MCU, only one video conference terminal is connected and no video or audio to be transmitted exists. Command to notify the video conference terminal connected to the international standard ITU
-T Recommendation H. 230. Here, the master MCU receiving the MIZ command from the slave MCU
Detects that the video conference terminal has become absent under the slave MCU, deletes the video signal from the slave MCU from the screen composition, and
It is used for the purpose of preventing an unsightly screen from being displayed without synthesizing meaningless video data transmitted from U.

Next, the operation will be described. In the configuration of FIG. 5, the MCU 60 is a master MCU and the MCU 61 is a slave MCU. Also, the master MCU 60 has
The video conference terminals 20 and 21 connect, and the slave MCU 6
1 is connected to video conference terminals 22 and 23 (not shown). FIG. 6 is an operation flowchart of the MIZ processing unit 17. For example, when a multipoint video conference is being held, when both the video conference terminals 22 and 23 connected to the slave MCU 61 are disconnected, the slave M
The conference control processing unit 6 of the CU 61 sends the MIZ to the master MCU 60 via the demultiplexing unit 4 connected to the master MCU 60.
Output a command.

When one of the video conference terminals 22 and 23 connects to the slave MCU 61 again, the slave MC
The conference control processing unit 6 of U61 outputs a cancel MIZ command to the master MCU 60 via the demultiplexing unit 4 connected to the master MCU 60. With this, the master MC
When the MIZ processing unit 17 in the U60 receives some command from the demultiplexing unit 4 connected to the slave MCU 61, the process proceeds to ST10. Also, the MIZ processing unit 17
ST when the command input at T10 is a MIZ command
11. In the case of a cancel MIZ command, the process proceeds to ST12, and in the case of another command, the operation ends.

In step ST11, the MIZ processing unit 17 outputs a terminal leaving notification to the screen synthesizing processing unit 12 and ends the operation.
In ST12, a terminal participation notification is output to the screen synthesis processing unit 12, and the operation is terminated. As a result, the screen synthesis processing unit 12 of the MCU 60 determines that the MCU
If the video from MCU 60 is removed from the composite screen and a terminal participation notification is input, the video from MCU 60 is inserted into the composite screen. By this means, when there is no terminal connected to the slave MCU, the slave MCU is added to the composite video in the master MCU.
The present invention can provide a multi-point video conference system that can suppress the image synthesis from the user and create an easy-to-view synthesized screen.

[0039]

According to the present invention, in a multipoint video conference system, a single combining instruction unit detects an arrangement position of a plurality of multipoint video conference communication control devices, and a multipoint video conference arranged around the multipoint video conference communication control device. Since the screen synthesis processing is suppressed by the screen synthesis control unit in the communication control device, for example, the multipoint television set arranged around the partial screen of the screen synthesized by the multipoint video conference communication control device arranged at the center The screen synthesized by the conference communication control device is not included, so that an easy-to-view screen can be obtained.

According to the next invention, the multipoint videoconference system has a multipoint videoconference communication control centered on an MCV instruction unit for outputting an MCV command for outputting an input video to a terminal connected thereto. The MCV output from the MCV instructing unit is provided when the synthesized video synthesized by the screen synthesizing processing unit in the multi-point video conference communication control device arranged in the center is output to the surrounding multi-point video conference communication control device. Since the command is added, it is possible to output the synthesized video synthesized by the screen synthesis processing unit in the multi-point video conference communication control device located at the center to the video conference terminal connected to the surrounding multi-point video conference communication control device. This has the effect of improving the operational efficiency of the system.

Further, according to the next invention, the multipoint videoconference system uses the MIZ command for notifying that there is no connected videoconference terminal in the multipoint videoconference communication control device arranged in the surroundings. Enable output,
Since the multi-point video conference communication control device arranged at the center is provided with the MIZ processing unit for suppressing the synthesis of the video from the multi-point video conference communication control device inputting the MIZ command, the multi-point television conference control device arranged at the center is provided. The video from the multipoint video conference communication control device, which is arranged around and has no video conference terminal to be connected to, is synthesized with the composite video created by the conference communication control device, so that an easy-to-view screen can be obtained.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of a multipoint video conference system according to Embodiment 1 of the present invention.

FIG. 2 is an operation flowchart of a single combining instruction unit shown in FIG. 1;

FIG. 3 is a configuration diagram of a multipoint video conference system according to Embodiment 2 of the present invention.

FIG. 4 is an operation flowchart of an MCV instruction unit shown in FIG. 3;

FIG. 5 is a configuration diagram of a multipoint video conference system according to Embodiment 3 of the present invention.

6 is an operation flowchart of the MIZ processing unit shown in FIG.

FIG. 7 is a configuration diagram of a conventional multipoint video conference system composed of two multipoint video conference communication control devices.

8 is an operation sequence diagram in the case of holding a multipoint video conference by a method of calling an MCU from the video conference terminal in the configuration of FIG. 7;

FIG. 9 is a configuration diagram of a conventional multipoint video conference system configured using three multipoint video conference communication control devices and six video conference terminals.

FIG. 10 is an explanatory diagram showing a problem of a conventional multipoint video conference system.

[Explanation of symbols]

2 Conference operation unit 3 ISDN line corresponding unit 4 Demultiplexing unit 5 Audio / video bus 6 Conference control processing unit 7 Screen synthesis processing unit 8 Audio processing unit 9 Control bus 10 Line bus 13 MCU connection instruction unit 15 Single synthesis instruction unit 16 MCV instruction unit 17 MIZ processing unit 20, 21,... 2n Video conference terminal 40, 41, 50, 51, 60, 61 Multipoint video conference communication control unit (MCU)

Claims (3)

[Claims] 1. A multipoint video conference in which a plurality of multipoint video conference communication control devices are radially connected and a multipoint video conference is held by a plurality of video conference terminals connected to the plurality of multipoint video conference communication control devices. In the system, provided in each of the multipoint video conference communication control device,
A screen synthesizing processing unit for synthesizing an image from a connected video conference terminal; detecting a position of the plurality of multipoint video conference communication control devices; A multipoint video conference system, comprising: a single combination instructing unit that suppresses screen combination processing for a combination control unit. 2. A multi-point video conference communication control device, which is provided at an MCV instruction unit which outputs an MCV command for outputting an input video to a terminal connected thereto, and which is disposed at a center, and which is disposed at the center. 2. An MCV command output by an MCV instructing unit when a synthesized image synthesized by a screen synthesizing processing unit in the device is output to a surrounding multipoint video conference communication control device.
Multipoint video conference system according to the paragraph. 3. A multipoint video conference communication control device arranged in the periphery, capable of outputting a MIZ command for notifying that there is no video conference terminal to be connected, and being arranged at the center. 3. The apparatus according to claim 1, further comprising: an MIZ processing unit configured to suppress synthesis of a video from the multipoint video conference communication control device that has input the MIZ command. 4. Multipoint video conference system.