JP3189869B2 - Multipoint video conference system - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multipoint video conference system, and more particularly to a video conference system having a function of identifying and controlling an image synthesized by a conference participant.

[0002]

2. Description of the Related Art Hitherto, as a multipoint video conference system, for example, one described in Japanese Patent Application Laid-Open No. 61-32683 is known. In this multipoint video conference system, an image of a participating conference room is synthesized and transmitted to a conference terminal to grasp the atmosphere of the entire conference by the image, and for example, one image in the participating conference room is enlarged. It is displayed so that a clear image can be seen.

FIG. 3 is a block diagram showing an example of a conventional multipoint video conference system.

Referring to FIG. 3, conference terminal 2a is connected to line 10
A multiplexed signal in which video, audio, and data are multiplexed is transmitted and received to / from the multipoint video conference control device 1 via 20a. Similarly, the conference terminals 2b, 2c, and 2d transmit and receive multiplexed signals to and from the multipoint video conference controller 1 via lines 1020b, 1020c, and 1020d, respectively.

In the multipoint video conference controller 1, the line interface section 11 separates the multiplexed signal transmitted from the conference terminals 2a to 2d into video, audio, and data, and converts the video signal into a video processing section 14, an audio signal. Is sent to the audio processing unit 13 and the control signal (data) is sent to the control unit 12 via the lines 1114, 1113, and 1112, respectively. In addition, the line interface unit 11 receives the lines 1114, 1 from the video processing unit 14, the audio processing unit 13, and the control unit 12.
Signals transmitted via 113 and 1112 are multiplexed and transmitted to conference terminals 2a to 2d.

The control unit 12 has lines 1112 and 131
2 receives a control signal transmitted through the
3 and the video processing unit 14 are controlled.

[0007] The video input from the video input device (not shown) of the conference terminals 2a to 2d is subjected to synthesizing or switching processing in the video processing unit 14 of the multipoint video conference control device 1, and is transmitted to the conference terminals 2a to 2d. Is done. Video processing unit 1
4 is determined by a control signal from the control unit 12. For example, when a request for enlarging and displaying an image of the conference terminal 2b is made by a control signal transmitted from the conference terminal 2a, a video switching signal or a composite control signal is transmitted from the control unit 12 to the video processing unit 14, and the conference terminal 2a Process the video to be sent to the requested format.

When the form of video is changed not by a control signal from the conference terminal but by an audio signal, the audio signal input from the audio input device of each of the conference terminals 2a to 2d is converted to a multipoint video conference control device 1. For example, the voice processing unit 13 detects the speaker and notifies the control unit 12 of the speaker. As a result, a control signal is sent from the control unit 12 to the video processing unit 14, and processing such as enlargement of the speaker image is performed.

[0009]

By the way, in the conventional multipoint video conference system, the synthesized information of the video synthesized by the multipoint video conference controller is not notified to the conference terminal.
Since the video synthesizing process is performed in the multipoint video conference control device, there is a problem that it is not possible for the conference terminal to identify which video on the synthesized screen is video of which conference terminal.

[0010] Further, in the conventional multipoint video conference system, when controlling the composite screen from the conference terminal, it is not possible to perform an operation with a visual user interface using the displayed composite screen.

[0011] It is an object of the present invention to provide a multipoint video conference system which can identify each partial video of a video synthesized by the multipoint video conference control device at a conference terminal.

Another object of the present invention is to provide a multipoint video conference system that realizes a visual user interface using information of an identified composite image.

[0013]

According to the present invention, at least three video conference terminals and a multipoint conference control system for controlling a communication conference between the video conference terminals according to video signals, audio signals, and data. A multipoint videoconference system having a videoconference control device, wherein the multipoint videoconference control device identifies the videoconference terminal device and obtains first identification information; A second identification unit that identifies a state of the combined screen to obtain second identification information when the combined screen is generated, and the video conference terminal device includes the first and the second. Screen information generating means for generating screen information based on the identification information, and a screen information adding means for receiving the synthesized screen as a received image and adding the screen information to the received image to generate a screen information added image Multipoint video conference system is obtained, wherein the bets are provided. For example, the state of the composite screen is a video conference terminal device constituting each partial video and the position and form of the partial video.

The first and second identification information are shared between the video conference terminal device and the multipoint video conference control device, and by displaying the screen information added image on the video terminal device. Display means is provided for displaying the first and second identification information on the composite screen.

[0015] Further, the video conference terminal device includes a generation unit that generates control information of a conference and a composite screen by associating the received image information combined with the screen and the screen information added by the video conference terminal device, The multi-point video conference control device includes a transmission unit that transmits control information to the multi-point video conference control device. The multi-point video conference control device performs control for performing conference control and composite screen control based on the control information from the video conference terminal device. Means are provided.

[0016]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described below with reference to the drawings.

The image input processing unit shown in FIG. 1 is provided in the conference terminals 2a to 2d shown in FIG. Referring to FIG. 1, control unit 21 processes control information transmitted from multipoint video conference control device 1 via line 1121, and sends a control signal of information to be displayed on the conference terminal to screen information generation unit 22. Send. Further, the control unit 21 transmits a control signal to the multipoint video conference control device 1 via the line 1121 to control the conference state and the screen composition state.

The screen information generating section 22 generates screen information to be added to the received image by a control signal for controlling the screen display received via the line 2122, and outputs the screen information.
Send to 4.

The image decoding unit 23 decodes the encoded image information received via the line 1123, and transmits the decoded image information to the screen information adding unit 24. The screen information adding unit 24 has a line 232
4 is added to the screen information received via the line 2224 to the received image information received via the line 4 and transmitted to the image output unit 25. The image output unit 25 displays the received image information to which the screen information received via the line 2425 is added on the user screen.

The conference terminal controller shown in FIG. 2 is provided in the conference terminals 2a to 2d shown in FIG. 3, and the multipoint video conference controller controller shown in FIG. 2 is replaced with the controller 12 shown in FIG. Used. With reference to FIGS. 2 and 3, the control unit of the multipoint video conference control device includes a control signal transmitting / receiving unit 121.
And the control signal transmitting / receiving unit 121 is connected to the line 102
0, the control signal transmission / reception unit 2 in the conference terminals 2a to 2d
11 transmits and receives control information to and from the video processing unit 1
4. A process of transmitting and receiving control information among the voice processing unit 13, the terminal identification unit 122, the synthesis state control unit 123, and the conference state control unit 124 is performed.

The terminal identification unit 122 determines information for identifying each of the conference terminals participating in the conference, and transmits the information to the control signal transmission / reception unit 121. The synthesis state control unit 123 is connected to the line 1
A control signal for processing the video processing unit 14 is transmitted via 231, and information indicating the synthesis state is transmitted to the control signal transmitting / receiving unit 121. The conference state control unit 124 is connected to the line 12
The conference status information, that is, speaker information, chair terminal information, and the like, are transmitted and received to and from the control signal transmission / reception unit 121 via the communication terminal 41.

Referring to FIGS. 1 and 2, in the conference terminal control unit, control signal transmitting / receiving unit 211 is connected to line 1020.
, Control information is transmitted and received to and from the control signal transmitting and receiving unit 121 of the multipoint video conference control device 1 via the control unit. Perform processing.

The display control section 212 transmits a control signal for controlling the image information generation section 22 to the control signal transmission / reception section 211 based on the control information received via the line 2121. The control information generation unit 213 transmits a control signal for performing conference control to the control signal transmission / reception unit 211 via the line 2131.

Next, the operation will be described.

Referring to FIGS. 1 to 3, in the multipoint video conference control device 1, the image processing unit 14 performs a screen synthesizing process in accordance with a control signal from the control unit 12, and outputs the result via the line interface 11 and the line 1020. Conference terminal 2
(Subscript omitted). At this time, the synthesis state control unit 123 generates the state of the screen synthesis, that is, information indicating the identification of the conference terminal whose screen is synthesized and the synthesis mode.

In the synthesizing state control unit 123, the video processing unit 14
Is transmitted to the control signal transmission / reception unit as well as the information indicating the screen composition state. Since the information indicating the screen composition state is transmitted to the conference terminal by the control signal transmitting / receiving unit 121, the conference terminal can identify the configuration of the received composite image.

At this time, the information indicating the synthesized state to be transmitted is information indicating the recognition of the conference terminal to be displayed and the area on the screen where the conference terminal is displayed. As the information representing the area on the screen, for example, the upper left coordinate information of the area and the information on the number of pixels in the vertical and horizontal directions, the information representing the boundary of the area, are commonly recognized between the conference terminal and the multipoint video conference controller. There is information indicating a screen synthesis pattern.

The conference control information generated by the conference state control section 124 is transmitted to the control information transmission / reception section 121 and further transmitted to the conference terminal. Since the conference terminal has received the information indicating the previous synthesized screen state, the state represented by the conference control information can be displayed on the screen of the conference terminal.

For example, when terminal identification information indicating the current speaker is transmitted from the conference state control unit, the control unit 21 of the conference terminal determines which area of the screen is the current speaker based on this information. The display control unit 212 can display information for identifying the speaker on the screen on the screen. Since the information on this screen is generated by the screen information generation unit 22 of the conference terminal, the conference terminal can arbitrarily control display / non-display. Further, the identification information to be displayed includes a frame display of the speaker's video area, a mark display in the area, and the like.

As the identification information of the conference terminal determined by the terminal identification section 122, a number uniquely determined for each conference terminal is used. By using this identification number, a conference terminal can be specified in common between the multipoint video conference control device 1 and the conference terminals 2a to 2d.

The terminal identification section 122 has a function of associating the identification information of each conference terminal with the identification number in addition to the identification number of the conference terminal. The associated identification information is transmitted to the conference terminal via the control signal transmission / reception unit 121.
The display control unit 212 can display the identification of each partial video on the screen of the conference terminal by using the received identification information and the information indicating the state of the screen combination in combination. The identification associated with the identification number of the conference terminal includes the location name of the conference terminal, the names of participants participating in the conference, and the like.

The control information generation unit 213 generates a control signal for performing a conference control based on the information indicating the screen composition state, based on display information on the conference terminal screen controlled by the display control unit 212 and signal input from the user. .

For example, in the area where one conference terminal is displayed on the composite screen, an identification having a meaning of designating the conference terminal is displayed, and the identification is sequentially displayed on another conference terminal by a signal input from the user. Control to move to the selected area.

Further, since the displayed identification corresponds to the identification of a specific conference terminal, a conference control signal for designating a specific terminal can be generated using an interface on the screen.

For example, in the case of performing control such that a partial screen in the composite screen is designated and enlarged, the user displays an identification on the screen of the conference terminal, moves to an area desired to be enlarged, and makes a request for enlargement. As a result, the control information generating unit 213 generates a control signal indicating the conference terminal identification number corresponding to the identification on the screen and a request to enlarge the screen, and the control signal transmitting / receiving unit 211.
Is transmitted to the multipoint video conference control device 1 via.

[0036]

As described above, according to the present invention, the state of the screen composition is shared between the conference terminal and the multipoint video conference controller, and the conference state is notified using the common identification information. In addition, the state of the conference control can be displayed on the composite screen received by the conference terminal, so that the state of the conference can be visually recognized.

Further, in the present invention, since the multipoint video conference controller sends information indicating the screen state together with the identification of each partial image, each of the partial images on the synthesized screen is sent to the conference terminal side. There is an effect that the identification of the partial video can be displayed, and the synthesized screen state can be easily recognized.

Further, in the present invention, since the screen information to be displayed on the conference terminal and the information on the received composite screen state are associated with each other, the identification number of the conference terminal with which the screen has been composited can be specified. Using the synthesized screen information, it is possible to control the conference with a user interface that is easy to understand visually.

In addition, in the present invention, the display of the additional information relating to the composite screen is performed independently by each conference terminal. Therefore, when displaying the additional information relating to the composite screen on the screen of the conference terminal, the display form and There is also an effect that display / non-display can be selected for each conference terminal.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating an example of an image output processing unit of a conference terminal used in a multipoint video conference system according to the present invention.

FIG. 2 is a block diagram showing an example of a conference terminal control unit and a control unit of a multipoint video conference control device used in the multipoint video conference system according to the present invention.

FIG. 3 is a block diagram for explaining a conventional multipoint video conference system.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Multipoint video conference control apparatus 2a-2d Conference terminal 11 Line interface part 12 Control part 13 Audio processing part 14 Video processing part 21 Control part 22 Screen information generation part 23 Image decoding part 24 Screen information addition part 25 Image output part 121 Control signal transmission / reception unit 122 Terminal identification unit 123 Combination state control unit 124 Conference state control unit 211 Control signal transmission / reception unit 212 Display control unit 213 Control information generation unit

Claims (6)

(57) [Claims] 1. A multipoint television having at least three videoconference terminal devices and a multipoint videoconference control device for performing communication conference control between the videoconference terminal devices in accordance with video signals, audio signals, and data. In the conference system, the multipoint video conference control device is configured to identify the video conference terminal device and obtain first identification information, and a first identification unit that combines the video signals to generate a composite screen. Second identification means for identifying the state of the composite screen to obtain second identification information, wherein the video conference terminal generates screen information based on the first and second identification information. Screen information generating means for receiving the synthesized screen as a received image and adding the screen information to the received image to generate a screen information added image. Multipoint video conference system. 2. The multi-point video conference system according to claim 1, wherein the state of the composite screen is a video conference terminal device constituting each partial video and the position and form of the partial video. Point video conference system. 3. The multipoint video conference system according to claim 2, wherein said first and second identification information are shared between said video conference terminal device and said multipoint video conference control device. A multipoint video conference system characterized by comprising means. 4. The multi-point video conference system according to claim 3, wherein the video conference terminal displays the screen information-added image to display the first and second identification information on the composite screen. A multipoint video conference system comprising a display means for displaying on the top. 5. The multi-point video conference system according to claim 3, wherein the video conference terminal device performs a conference by associating the received image information combined with the screen and the screen information added by the video conference terminal device. And a generating means for generating control information of the composite screen, and a transmitting means for transmitting the control information to the multipoint videoconference control device. 6. The multipoint video conference system according to claim 5, wherein the multipoint video conference control device includes control means for performing conference control and composite screen control based on control information from the video conference terminal device. A multi-point video conference system, which is provided.