JPH0630337A - Plural video synthesis method - Google Patents

Abstract

PURPOSE:To provide the method for displaying a proper reduced synthesis picture onto a display screen independently of the number of video conference rooms taking part in a video conference. CONSTITUTION:Plural video signals from plural video conference rooms 11-18 are received by a video signal matrix 18, in which video signals are subjected to connection processing and video synthesizers 8, 9 generate a synthesized picture, the synthesized video signal is distributed to plural display devices 16, 17 by distributers 13, 14 or other video signal matrix to display the synthesis video of specific combination.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to means for enabling simultaneous viewing of images in each video conference room when a video conference is held between video conference rooms at three or more points using a multipoint connection device.

[0002]

2. Description of the Related Art FIG. 4 is a diagram for explaining a conventional method of reducing and combining a plurality of images. Reference numeral 1 denotes a video conference room group, and in this example, it is assumed that there are eight video conference rooms 1 ₁ to ₁₈ . Reference numeral 2 is a video camera installed in each video conference room, and images A, B, C, D, E, F, G, respectively.
Shoot H and send it out. Reference numeral 3 denotes a display, which displays an image from the partner video conference room. A multi-point connection device 4 has a function of connecting a part or all of the video conference rooms of the video conference room group 1 via a transmission line 5.
The connection information indicating which video conference room is connected to perform the video conference is transmitted from the connection information transmission device 6 to the multipoint connection device 4, and the multipoint connection device 4 is connected between the video conference rooms based on the received connection information. Perform connection processing.

The multipoint connection device 4 receives a video signal from each connected video conference room 1. This video signal is encoded by the codec existing in each video conference room. Each video conference room 1 received by the multipoint connection device 4
The video signal from is switched and controlled by the multipoint connection device 4, transmitted to each video conference room 1, and displayed on the display 3. Therefore, in each video conference room, an image of the video conference room of an arbitrary ground can be switched and viewed. Since the video signal transmitted from the multipoint connection device 4 to each video conference room 1 at a time is the video signal for one video conference room, the video images of the video conference rooms in all the ground cannot be viewed at the same time. As a method to view multiple ground images at the same time,
There is the following method of reducing and synthesizing a plurality of images to form one screen.

Reference numeral 7 denotes a decoder group, which is a multipoint connection device 4
Each video signal received from each video conference room 1 is received from the multipoint connection device 4 and decoded. The video signal decoded by the decoder group 7 is connected to the video reduction / synthesis devices 8 and 9. The image reduction / combination devices 8 and 9 process the received image signals, respectively, reduce the display size to 1/2 in each of the vertical and horizontal directions, and the images of the four video conference rooms are in the first to fourth quadrants of the display position on the display. Are arranged so as to be arranged in a single video signal. Coders 11 and 12 code the video signals of the video reduction / synthesis devices 8 and 9. The video signals encoded by the coders 11 and 12 are distributed by the distributor 1.
It is distributed by 3 and 14 and transmitted to each video conference room 1 via the transmission line 15. The connection processing between the distributors 13 and 14 and the video conference room to which the video is transmitted is performed by the distributor 1.
3 and 14 perform. Connection information that determines to which video conference room the distributors 13 and 14 transmit the video is transmitted from the connection information transmitter 6 to each distributor.

Numerals 16 and 17 are displays for receiving and displaying the image reduction / combination screen in each video conference room.
In each video conference room, three displays 3, 16, and 17 are arranged as shown in FIG. The images displayed on the displays 16 and 17 are divided into four and displayed. For example, when all eight TV conference rooms 1 are connected by the multipoint connection device 4, as shown in FIG. A, B, C, and D of the video of 1 are displayed in the second quadrant, the first quadrant, the third quadrant, and the fourth quadrant of the display 16, and E, F, G, and H of the video of the video conference room 1 are displayed. Is displayed in the second quadrant, the first quadrant, the third quadrant, and the fourth quadrant of the display 17. Since the connection relationship between the input terminals of the image reduction / combination devices 8 and 9 and the output terminal of the multipoint connection device 4 is fixed, a fixed video conference room image is displayed at each position of the displays 16 and 17.

In the above example, when the video conference room is held using the equipment capable of reducing and combining the images in the video conference room at the eight points, there is no problem if the video conference is always held at the eight points. Of the conference room 1, for example, 1 ₁ , 1 ₂ ,
When holding a video conference in which only four video conference rooms of 1 ₅ and 1 ₈ participate, there is a problem that an appropriate display cannot be made.
In this case, as shown in FIG.
Four reduced images are dispersed and displayed at eight display positions of 7. Since the images of the four video conference rooms are displayed, it is easier to see them on one display, and operating two displays wastes power.

Further, the system having the configuration of FIG. 4 utilizes the multipoint connection device 4 to, for example, one of the video conference rooms 1.
Video conference I in 4 video conference rooms 1 ₁ , ₂ 1, ₁₅ and 1 ₆
At the same time, another video conference II was held in four video conference rooms 1 ₃ , 1 ₄ , 1 ₇ , and 1 _{8 and} a distributor 13 was used in the video conference rooms participating in video conference I. When the video reduced composite screen is transmitted using the distributor 14 to the video conference room participating in the video conference room II, the reduced composite screen in each video conference room is displayed as follows. It becomes like 8. That is, the video conference room participating in the video conference I includes the video images C and D of the video conference room participating in the video conference II, and the video images E of the video conference room participating in the video conference I. Video that does not include F is displayed, and video E and F of the video conference room participating in video conference I are displayed in the video conference room participating in video conference II.
However, there is a drawback that a fatal result is displayed in which an image including the image No. and an image not including the images C and D of the video conference room participating in the video conference II is displayed.

[0008]

SUMMARY OF THE INVENTION The present invention solves the above-mentioned drawbacks of the prior art, and when the number of video conference rooms participating in a video conference is small, or a single multipoint connection device is used for a plurality of video conference rooms. It is an object of the present invention to provide a means for displaying an appropriate reduced composite screen even when holding a video conference.

[0009]

A feature of the present invention for achieving the above object is that a plurality of video signals from a plurality of video conference rooms are received by a video signal matrix and connection processing is performed by the video signal matrix. An image synthesizing screen is created for an image signal by an image synthesizing device, and the synthesized image signal is distributed to a plurality of displays by a distributor or another image signal matrix to display a specific combined image.

[0010]

The video signal matrix has a function of performing connection processing for outputting a video signal input to any input terminal to any output terminal. The video signal of the fixed video conference room is connected to each input terminal of the video signal matrix, but by performing the connection processing of the video signal matrix based on the connection information of the multipoint connection device 1, the video conference to be held can be held. Get a suitable reduced composite screen.

[0011]

FIG. 1 is a diagram for explaining an embodiment of the present invention. For convenience of explanation, a case where a video conference is held using eight video conference rooms will be described. The image reduction / combination device will be described using a device that combines four images.

In FIG. 1, reference numeral 1 is a video conference room group,
It is assumed that there are 8 video conference rooms 1 ₁ to ₁₈ . Reference numeral 2 is a video camera installed in each video conference room, and photographs and sends images A, B, C, D, E, F, G, and H, respectively. Reference numeral 3 denotes a display, which displays an image from the partner video conference room. A multi-point connection device 4 has a function of connecting a part or all of the video conference rooms of the video conference room group 1 via a transmission line 5. For information on which video conference room is connected to hold a video conference,
It is transmitted from the connection information transmission device 21 to the multipoint connection device 4, and the multipoint connection device 4 performs a connection process between the video conference rooms based on the received information. The multipoint connection device 4 receives a video signal from each connected video conference room 1.

Reference numeral 18 denotes a video signal matrix, which is connected between the decoder 7 and the video reduction / synthesis devices 8 and 9 for reducing and synthesizing four images. Video signal matrix 18
The function of is a video switching that outputs a video signal input to an arbitrary input terminal to an arbitrary output terminal. FIG. 2 shows a configuration example of the video signal matrix 18. In FIG. 2, 19 is an input terminal group and 20 is an output terminal group. The line connected to the input terminal and the line connected to the output terminal intersect, and an intersection switch group 22 is arranged at each intersection. By closing the intersection switch appropriately, the input terminal group 19
Video signal input to any input terminal of the output terminal group 20
The output can be controlled to be output to any output terminal.

The connection information for connecting the intersection switches of the video signal matrix 18 is the connection information transmitting device 2
1 to the video signal matrix 18. The video signal matrix 18 receives the connection information from the connection information transmitting device 21, and controls the connection in accordance with the connection state of the video conference room connected by the multipoint connection device 4. For example,
When all the video conference rooms of the video conference room group 1 are connected by the multipoint connection device 4 for making one conference, the connection information transmitting device 21 is connected for all the video conference rooms to make one conference. The information indicating that it is being transmitted is transmitted to the video signal matrix 18. When the video signal matrix 18 receives information indicating that all video conference rooms are connected to hold one conference, the signal input to the input terminal 19 ₁ is input to the output terminal 20 ₁ and input to the input terminal 19 _2. signal to the output terminal 20 _2, a signal input to ... input terminal 19 _r to the output terminal 20 _r, the process of connecting the signal input to ... input terminal 19 ₈ to the output terminal 20 ₈ To do. The video reduction / synthesis devices 8 and 9 are video signal matrix 18
The video signal is received from and the video reduced composite screen is created.
Coders 11 and 12 code the output video signals of the video reduction / synthesis devices 8 and 9. The video signals encoded by the coders 11 and 12 are distributed by the distributors 13 and 14 and transmitted to the respective video conference rooms 1 via the transmission path 15. The distributors 13 and 14 perform the connection processing between the distributors 13 and 14 and the video conference room to which the video is transmitted. The connection information that determines which video conference room the distributors 13 and 14 transmit the video to is transmitted from the connection information transmitter 21 to each distributor. The video transmitted from the distributor is displayed on the displays 16 and 17 in the video conference room.

The displays 16 and 17 are controlled by controlling the video signal matrix 18 and the distributors 13 and 14 so that, for example, all the video conference rooms of the video conference room group 1 are set to 1
When the connection for holding a conference is made by the multipoint connection device 4, A, B, and
C and D are the second quadrant, the first quadrant, and the third quadrant of the display 16.
It is displayed in the quadrant and the fourth quadrant, and E, F, G, and H of the video in the video conference room 1 are displayed in the second quadrant and the first quadrant of the display 17.
Display in the quadrant, the third quadrant, and the fourth quadrant.

[0016] Also, for example, _one one of the TV conference room 1,
Video conference I is held in 4 video conference rooms of 1 ₂ , 1 ₅ , and ₁₆ and at the same time, another video conference II is held in 4 video conference rooms of 1 ₃ , 1 ₄ , 1 ₇ , and ₁₈ and video conferences are held. The video reducing / combining screen is transmitted to the video conference room participating in I by using the distributor 13, and the video reducing / compositing screen is used in the video conference room participating in Video conference room II by using the distributor 14. When transmitting the screen, the connection information transmission device 21 transmits the connection information for this connection to the multipoint connection device 4, and also transmits the A, B, E, and F images to the image reduction / combination device 8. In addition, the video signal matrix 18 sends connection information to the video signal matrix 18 so that the video signal matrix 18 controls the connection so as to send C, D, G, and H videos, and the distributor 13 sends the connection information to the TV. Conference room 1 ₁ , 1 ₂ , 1 ₅ , 1 ₆
In addition, the distributor 14 has the video conference rooms 1 ₃ , 1 ₄ , 1 ₇ , and 1 _8.
The connection information for making the connection is transmitted to each distributor.

Upon receiving this connection information, the video signal matrix 18 receives the signal input to the input terminal 19 ₁ at the output terminal 20 ₁ , the signal input to the input terminal 19 ₂ at the output terminal 20 ₂ and the input terminal 19 1. _The signal input to ₃ is output terminal 20 ₅ , the signal input to input terminal 19 ₄ is output terminal 20 ₆ , the signal input to input terminal 19 ₅ is output terminal 20 ₃ , and the input terminal 19 ₆ is input. the input signal to the output terminal 20 _4, the output terminal 20 ₇ was inputted to the input terminal 19 ₇ signal, performs processing for connecting the input to the input terminal 19 ₈ signal to the output terminal 20 _8.

The video output signal of the video reduction / combination device 8 is sent to the video conference II in the video conference room participating in the video conference II.
The video output signal of the video reducing / synthesizing device 9 is transmitted to the video conference / combining room participating in the video reducing / synthesizing device 8. Is controlled to transmit the video of the video conference room participating in the video conference II, so that the video of A, B, E, and F is displayed on the display 16 in the video conference room participating in the video conference I. 2nd quadrant, 1st quadrant,
You can see the reduced composite screens displayed in the 3rd and 4th quadrants, and in the video conference room participating in the video conference II, the images C, D, G, and H are displayed in the second quadrant of the display 17, respectively. , The first composite quadrant, the third composite quadrant, and the fourth composite quadrant can be viewed.

In the case of conducting a video conference of another combination, if the connection processing corresponding to the combination is performed in the video signal matrix 18 and the distributors 13 and 14, the video of all the video conference rooms participating in the video conference concerned. Can be seen, and the image of the video conference room not participating in the video conference can be prevented from being displayed.

In the above, the connection information transmitted from the connection information transmitting device 21 to the multipoint connection device 4 and the distributors 13 and 14 is input to the connection information transmitting device 21 in advance. This input is performed by directly operating the connection information transmitting device or remotely operating via a communication line. Alternatively, the operator of the video conference device in the host video conference room that convenes the video conference transmits information on which video conference is connected to the multipoint connection device 4 to hold the video conference, and the information is transmitted to the multipoint. It may be transmitted from the connection device 4 to the connection information transmission device. In this case, it is not necessary to transmit the connection information from the connection information transmitting device to the multipoint connection device 4. The connection information input to the connection information transmission device is, for example, the telephone number or the connection time given to the video conference room device in the video conference room to be connected. Based on the received connection information, the multipoint connection device 4 and the distributors 13 and 14 call the video conference device in the video conference room to be connected and perform a series of connection processing.

The connection information transmitted from the connection information transmission device 21 to the video signal matrix 18 is the telephone number given to the video conference device in the video conference room to be connected, like the connection information transmitted to the distributors 13 and 14. It may be the number of the intersection corresponding to the video conference room to be connected. In the case of the telephone number of the video conference device to be connected, in the video signal matrix 18, it is converted into a signal indicating which intersection switch is to be closed, and the required intersection switch is closed. When transmitting the number of the intersection, the connection information transmitting device 21 correspondingly converts the information of the video conference room to be connected into the information of the intersection of the video signal matrix 18 to be closed.

FIG. 3 is a diagram for explaining another embodiment of the present invention. In FIG. 3, the connection information of the video conference room connected by the multipoint connection device 4 is the video conference room which is one of the videoconference room groups 1 from the host videoconference room for convening a conference to the multipoint connection device 4. Sent to.

The video signal matrix 18 receives the connection information that the multipoint connection device 4 has received from the host video conference room from the multipoint connection device 4 via the control line 23, and the television connected by the multipoint connection device 4. Connection control is performed according to the connection status of the conference room. For example, video conference room group 1
If all the video conference rooms are connected to each other by the multipoint connection device 4, the multipoint connection device 4 confirms that all the video conference rooms are connected for one conference. The represented information is transmitted to the video signal matrix 18. The distributors 13 and 14 also receive the connection information corresponding to the connection state from the multipoint connection device 4 via the control lines 24 and 25, and perform the connection processing with the video conference room. Others are the same as in the case of FIG.

In the above description, when the connection information transmitted from the multipoint connection device 4 to the video signal matrix 18 is information indicating to which video conference room the video reduction combined screen is transmitted, in the video signal matrix 18, The required intersection switch is closed by converting into a signal indicating which intersection switch is to be closed. After converting into the intersection information to be closed of the video signal matrix in the multipoint connection device 4,
The connection information may be sent from the multipoint connection device 4 to the video signal matrix 18.

In the above description, the distributors 13 and 14 have an example having a function of performing a connection process between these distributors and a TV conference room to which a video is transmitted from the distributors. When a dedicated line is used for the transmission line 15, a distributor having no connection processing function can be used.

In the above description, each distributor 13 and 14 has a function of receiving one video and branching it into a plurality of video signals. However, both distributors are integrated to form a video signal matrix with a plurality of inputs and a plurality of outputs. You may make it work.

In the above example, the images reduced and synthesized by the image reduction and synthesis devices 8 and 9 are encoded and then transmitted to the respective video conference rooms via the distributors 13 and 14 and the transmission line 15. For example, when transmitting via a local transmission line,
It is also possible to transmit the output signals of the image reduction / synthesis devices 8 and 9 as analog signals to the display device for viewing without encoding.

In the above, the video signal matrix 18
Is disposed between the decoder 7 and the video reduction / combining devices 8 and 9, but may be disposed between the multipoint connection device 4 and the decoder 7. It is also possible to use the multipoint connection device 4 provided with the function of outputting the video of the arbitrary TV conference room received by the multipoint connection device 4 to the arbitrary video output terminal of the multipoint connection device 4. Since the multipoint connection device 4 also has the function of the video signal matrix 18, it is not necessary to separately connect the video signal matrix 18.

In addition, in the above, when there are eight video conference rooms, when there are two video reduction / synthesis devices and two distributors,
Although the case where each of the video signal matrix 18 has eight input / output terminals has been described, it goes without saying that the present invention can be applied to the case of other numbers.

Further, in the above, the multipoint connection device 4 receives the coded video signal from the video conference room, takes out the signal received from the multipoint connection device 4 and decodes it by the decoder, and the decoded video is imaged. The matrix 18, the video reduction / combining device performs connection processing, further encodes, and then transmits to the video conference room by the distributor. However, video signals that are not coded from other than the video conference room are video signal matrixes. The present invention can also be applied to a case where the image data is received by 18, reduced and synthesized by the image reduction and synthesis devices 8 and 9, and distributed by the distributors 13 and 14 to display a reduced combination image of a specific combination on a plurality of displays.

In the above, the image reduction / synthesis devices 8 and 9 are used.
Describes a screen that is divided into four and displays a maximum of four video images on one screen. However, for example, three video images are displayed on one screen, and nine video images are displayed on one screen. It may be a device for reducing and synthesizing images other than the four images, such as a device for performing. Also, when synthesizing, it does not reduce,
A method of deleting a screen portion may be used, or a method of combining without reducing or deleting may be used.

[0032]

According to the present invention, it is possible to create an arbitrary combination of composite screens by the function of the video signal matrix 18.
Also, the combined screens can be transmitted only to the necessary TV conference room by the functions of the distributors 13 and 14. Therefore, by using the method of the present invention, even when a plurality of video conferences are simultaneously held by one multipoint connection device, the composite video of all the video conference rooms participating in the video conference is the video conference. The video of the video conference room is not mistakenly transmitted to the video conference room that is not related to the video conference.

[Brief description of drawings]

FIG. 1 is a diagram for explaining an embodiment of the present invention.

FIG. 2 is a diagram showing a configuration of a video signal matrix.

FIG. 3 is a diagram of another example for explaining the embodiment of the present invention.

FIG. 4 is a diagram illustrating a conventional multiple image reduction / synthesis method.

FIG. 5 is a diagram showing an arrangement example of displays in each video conference room.

FIG. 6 is a diagram showing a display example.

FIG. 7 is a diagram showing a display example.

FIG. 8 is a diagram showing a display example in which an incorrect image is displayed.

[Explanation of symbols]

 1 Video Conference Room Group 2 Video Camera 3 Display 4 Multipoint Connection Device 5 Transmission Line 6 Connection Information Transmission Device 7 Decoder 8, 9 Video Reduction / Composition Device 11, 12 Coder 13, 14 Distributor 15 Transmission Line 16, 17 Display 18 Video Signal matrix 19 Input terminal 20 Output terminal 21 Connection information transmitter 22 Crossing switch 23, 25 Control line

Claims (2)

[Claims] 1. A plurality of video signals are received by a video signal matrix, a composite screen is created by a video synthesizing device for the video signals subjected to connection processing by the video signal matrix, and the synthesized video signals are distributed or distributed. A method for synthesizing a plurality of images, characterized in that a composite image of a specific combination is displayed by being distributed to a plurality of displays by a video signal matrix. 2. When a multi-point connection device is used to hold a video conference between three or more points, the multi-point connection device multi-points the encoded video signal received from the video conference device at each point. In a multiple video composition method that takes out from the connection device and decodes it with a decoding device, and creates a video signal that combines multiple videos with the video composition device, add a video switching function to any part of the front part of the video composition device, The video distribution function is installed, and the video switching function and the video distribution function are controlled according to the state of the video conference connected by the multipoint connection device, and the selection or display of the video to be transmitted and displayed in each video conference room A method for synthesizing a plurality of images, characterized in that the position is controlled.