JP3097736B2 - Multi-screen transmission type multi-point video conference system - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention is mainly applied to a video conference and selectively edits image data from a plurality of video conference terminals connected at a multipoint by a multipoint video conference controller (MCU). The present invention relates to a multi-screen transmission type multi-point video conference system.

[0002]

2. Description of the Related Art Conventionally, a multi-point video conference system of this type is a tool for talking while viewing each other's images. Video and audio are transmitted to each other,
When a video conference is conducted by connecting video conference terminals at three or more locations, a multipoint video conference controller (MCU) is used, and the participating video conference terminals are starred by the multipoint video conference controller (MCU). It is common to adopt a configuration in which they are connected in a shape.

In such a multipoint video conference system, a multipoint video conference controller (MCU) collects video and audio of participating video conference terminals (hereinafter, appropriately referred to as terminal stations), and as if sitting in a conference room. It functions so as to distribute video and audio as if it were in the air.

That is, a multipoint video conference controller (MC)
In U), the operation is performed such that the sound of the participating terminal station is mixed and transmitted to the other participating terminal stations, and the image of the participating terminal station that has spoken last is transmitted to the other participating terminal stations. Many forms are adopted.

[0005] In particular, regarding the video, in addition to the method of preferentially transmitting the video of the speaker, the method of determining the chair terminal station and selecting the video to be transmitted by the terminal station, and the method of individually receiving the video at each terminal station A method of determining a terminal station is also employed.
In addition, since a method of selecting and transmitting a single screen does not provide a sense of realism, a method of reducing the images at the terminal stations at a plurality of participating points and synthesizing them into one screen and transmitting the screen is also adopted. Further, a method is also adopted in which a material or the like is transmitted as a supplementary image as a still image, stored in a frame memory of a partner terminal station, and a user switches between a moving image and a still image to display.

Incidentally, as a well-known technique related to such a video conference system and transmission of image data required for the video conference system, a multipoint video conference system disclosed in JP-A-7-30875 and JP-A-6-70040 are disclosed. , A display mode changing method in a multipoint video conference system disclosed in Japanese Patent Application Laid-Open No. 6-6472, a multipoint video conference transmission system disclosed in Japanese Patent Application Laid-Open No. Hei 6-6472,
Multi-point video conference control device disclosed in Japanese Patent Application Laid-Open No. 4-72887, multi-point video conference system disclosed in Japanese Patent Application Laid-Open No. 4-40790, control device for a video conference system disclosed in Japanese Patent Application Laid-Open No. 4-40790, A multipoint video conference control device disclosed in JP-A-2-5690.

[0007] Also, United States Pat
In ent, Patent Number 4,51
6,156 "TERECONFERNING M
ETHOD AND SYSTEM ”, Patent
Number 4,650,929 "COMMUNI
CATION SYSTEM FOR VIDEOCO
NFERENCING ", Patent Number
4,965,819 "VIDEO CONFERE
NCING SYSTEM FOR COUNTROO
M AND OTHER APPLICATION
S ", PatentNumber 4,995,071
VIDEO CONFERENCE INSTAL
LATION ”and the like.

[0008]

In the case of the above-mentioned conventional multipoint video conference system, for example, in order to increase the sense of reality when reducing and synthesizing the screen at the terminal station at the participating point and distributing it to the terminal station at each point. A method is employed in which the size of image data from a speaker at a specific terminal station is displayed larger than the image data between terminal stations at other points (between partners) (for example, Japanese Patent Laid-Open No. 4-407 described above).
However, according to such a method, the display size of image data at a point other than image data at a terminal station at a point to be brought up is reduced, Alternatively, there is a problem that the image is difficult to see because the image is overwritten on the screen to be brought up.

In the case of a conventional multipoint video conference system, for example, when screen data of a terminal station at a participating point is reduced and synthesized and distributed to terminal stations at other points, the screen is displayed as the number of terminal points increases. As the size becomes smaller, the image data of the terminal station at each point (that is, the images of the participants) become difficult to see, or when a single image is switched and used, the image data at the terminal station at another participating point is used. There is also a problem that (that is, the video of the participant) becomes invisible.

The present invention has been made in order to solve such problems, and its technical problems are remarks, broadcast switching,
A multi-screen transmission system that can minimize the difficulty of viewing image data due to conference control such as selection of the receiving party, and can develop a plurality of types of display screens to enable a comfortable conference with a reasonably easy-to-view screen. A point-to-point video conference system is provided.

[0011]

According to the present invention, a plurality of video conference terminals connecting a plurality of points m (where m is a natural number and m ≧ 3) and a plurality of video conference terminals among the plurality of video conference terminals are provided. In a multipoint video conference system including a multipoint video conference controller (MCU) in which a plurality of image data encoded from participating terminals are collected, the multipoint video conference controller (MCU) converts a plurality of image data into A plurality of decoding means for respectively decoding, and image data corresponding to n points (where n is a natural number and m ≧ n) out of those decoded at a plurality of points m of a plurality of image data Is selected and output as a plurality of types of selected and edited image data, or the plurality of points m of the plurality of image data are respectively
The image data corresponding to the n-point is selected and edited from among the data decoded at step n, and the selected and edited image data is output as different types from each other. Alternatively, at the plurality of points m of the plurality of image data, Either reduce and combine the decoded data to generate a combined screen, or select and edit one piece of image data from a part of the plurality of pieces of image data decoded at the plurality of points m. And a plurality of editing means for reducing and synthesizing a plurality of image data decoded at the plurality of points m of the plurality of image data to generate a synthesized screen; Multi-screen transmission comprising multiplexing means for outputting multiplexed image data multiplexed by attaching identification codes in units and encoding means for outputting multiplexed image encoded data obtained by encoding the multiplexed image data Formula multipoint Bi-conference system is obtained.

According to the present invention, on the other hand, a plurality of video conference terminals connecting a plurality of points m (where m is a natural number and m ≧ 3) and a participating terminal out of the plurality of video conference terminals are used as codes. And a multi-point video conference system (MCU) that collects a plurality of image data in a multi-point video conference system.
CU) is composed of a plurality of decoding means for respectively decoding a plurality of image data, and n points (where n is a natural number m
.Gtoreq.n), or selectively edit and output a plurality of types of selected and edited image data, or select one of the plurality of image data decoded at the plurality of points m. The image data corresponding to the n-th point is selectively edited and the selected and edited image data is output as different types from each other, or the plurality of pieces of the image data decoded at the plurality of points m are reduced and synthesized. To generate a composite screen, or select and edit one piece of image data from a part of the plurality of pieces of image data decoded at the plurality of points m. A plurality of editing means for reducing and synthesizing a plurality of image data decoded at the plurality of points m to generate a composite screen, and a plurality of types of selected and edited image data are encoded with identification codes respectively. Selection A multi-screen transmission multipoint video conference comprising a plurality of encoding means for outputting encoded image data and a multiplexing means for outputting multiplexed image encoded data obtained by multiplexing a plurality of selectively edited image encoded data. The system is obtained.

[0013] On the other hand, according to the present invention, in any of the above multi-screen transmission type multi-point video conference systems, the plurality of video conference terminals include: decoding means for decoding multiplexed image encoded data; Identification code extracting means for extracting an identification code from the decoded image encoded data, and separating means for separating and outputting the decoded multiplexed image encoded data as a plurality of image data using the identification code And a multi-screen transmission type multi-point video conference system having the following.

[0014]

In the multi-screen transmission type multi-point video conference system according to the present invention, encoded image data from a plurality of video conference terminals (terminal stations) is transmitted to a multi-point video conference controller (MC).
U), where it is decoded by a plurality of decoding means and input to a plurality of editing means. In these editing means, a plurality of decoded image data are partially selectively edited, including screen synthesis, and output as a plurality of types of selectively edited image data. The selected and edited image data is multiplexed on a frame basis by the multiplexing means, encoded by the encoding means, and transmitted to each video conference terminal.

On the other hand, in each video conference terminal, the multiplexed image coded data transmitted from the multipoint video conference control unit (MCU) is decoded by the decoding means, and then the identification code added to the frame by the identification code extraction means. A code is extracted, and the decoded multiplexed image encoded data is separated and output as a plurality of image data before being multiplexed by using the identification code by the separating means.

[0016]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

FIG. 1 is a block diagram showing a basic configuration of a multipoint video conference control unit (MCU) which is a main part of a multiscreen transmission type multipoint video conference system according to an embodiment of the present invention.

This multipoint video conference controller (MCU)
Is a plurality of (four) video conference terminals α, β, γ connected to a plurality of points m (where m is a natural number and m ≧ 3, but here, m = 4). , Δ, a plurality of (four) coded image data are collected from the participating terminals and transmitted.

A multipoint video conference controller (MCU)
A plurality (four) of decoding means 1a to 1d for respectively decoding a plurality of image data, and n points (where n is one of n) among those decoded at a plurality of points m (= 4) of these image data Is a natural number and m ≧ n), a plurality (two) of editing means 2a and 2b for selectively editing image data and outputting a plurality of types (here, two types) of selected and edited image data; Multiplexing means 3 for outputting multiplexed image data obtained by multiplexing a plurality of types of selected and edited image data by attaching identification codes in frame units, and outputting multiplexed image encoded data obtained by encoding the multiplexed image data Encoding means 4
And

Of these, a plurality (two) of editing means 2a,
Reference numeral 2b denotes image data corresponding to n points (that is, image data corresponding to some points) from those decoded at a plurality of points m (= 4) of a plurality of (four) image data. Selectively edit and output the selected and edited image data as different types from each other.
) Of the image data decoded at a plurality of points m (= 4) are reduced and synthesized to generate a synthesized screen, or a part (one) of the image data is One image data is selected and edited from the data decoded at the plurality of points m (= 4), and the other part (one) has a plurality of points m (= It functions by either reducing or synthesizing the data decoded in 4) to generate a synthesized screen.

For this reason, a plurality (two) of editing means 2a,
Reference numeral 2b denotes a screen synthesizing means 6a and 6b for reducing and synthesizing a plurality of (four) input image data to create one synthesized screen, and one of the input decoded image data. Output to the screen combining means 6a, 6b, and selecting means 5a, 5b for selecting one of the input decoded image data or the combined image data created by the screen combining means 6a, 6b. 5b.
Here, the editing means 2a and 2b can select the three functions described above. However, if the editing means 2a and 2b can output different types of selected and edited image data, the editing means 2a and 2b specify any one of the functions, or select any one of the functions. Or a combination of the above.

That is, the multipoint video conference controller (M
In the CU), the decoding means 1a to 1d need the number m of video conference terminals accommodated in the apparatus, and the editing means 2a and 2b need the number of image data to be multiplexed. The configuration shown in FIG. 1 illustrates a case where four video conference terminals α, β, γ, and δ are connected at four points at multiple points and two types of screens are multiplexed. The multipoint video conference controller (MCU) together forms a multi-screen transmission type multipoint video conference system.

The operation of the multipoint video conference controller (MCU) will be described below. First, when the encoded image data from the video conference terminals α, β, γ, and δ are transmitted to the decoding units 1 a to 1 d, the decoding units 1 a to 1 d
Then, the image data is decoded and all of them are transmitted to the editing means 2a and 2b, respectively.

The editing means 2a comprises a selecting means 5a and a screen synthesizing means 6a, and the editing means 2b comprises a selecting means 5b and a screen synthesizing means 6b. As for the editing means 2a, the decoded image data from the decoding means 1a and 1b is input to the selection means 5a, and a part of them is selected and input to the screen synthesizing means 6a. The screen synthesizing unit 6 a thins out the input decoded image data in the vertical and horizontal directions, synthesizes a plurality of thinned images to create one synthesized screen, and outputs it to the selecting unit 5. . The selecting unit 5a selects one of the image data from the decoding unit 1a and the synthesized image from the screen synthesizing unit 6a, and outputs the selected image data to the multiplexing unit 3 as selected and edited image data. The editing unit 2b also outputs selected and edited image data of a different type from the editing unit 2a to the multiplexing unit 3 in the same procedure.

The multiplexing means 3 multiplexes the selected and edited image data from the editing means 2a and 2b on a frame basis.
For example, when multiplexing the selected edited image data from the editing units 2a and 2b, for example, the editing unit 2a
And the image of the selection means 2b is transmitted to the odd frame, and the image data is output to the encoding means 4 alternately. At this time, each frame is output as multiplexed image data to the encoding unit 4 while adding an identification code for identifying whether the frame belongs to the editing unit 2a or the editing unit 2b. I do. The encoding means 4 encodes the input multiplexed image data into multiplexed image encoded data, and transmits the multiplexed image data to each of the video conference terminals α, β, γ, δ.

FIG. 2 is a block diagram showing a basic configuration of a multipoint video conference controller (MCU) which is a main part of a multiscreen transmission type multipoint video conference system according to another embodiment of the present invention.

This multipoint video conference controller (MCU)
Are decoding means 11a-11b and editing means 12a, 1
2b, the editing means 12a is composed of the selecting means 15a and the screen synthesizing means 16a, and the editing means 12b is composed of the selecting means 15b and the screen synthesizing means 16b. However, in this case, a plurality of (two) codes for outputting encoded data of the selected edited image, in which a plurality of types (two types) of the selected edited image data are respectively added with identification codes and encoded. Multiplexing means 14a and 14b, and multiplexing means 13 for outputting multiplexed image coded data obtained by multiplexing the selected and edited image coded data, so that the coding is performed before the multiplexing is performed. I have.

That is, the multipoint video conference control unit (MCU) in this case, after the selected and edited image data output from the editing means 12a to 12b is once encoded by the encoding means 14a and 14b, 14, and multiplexed as one multiplexed image coded data by each video conference terminal α,
are transmitted to β, γ, and δ.

FIG. 3 shows a video conference terminal α, β, γ, which constitutes a multi-screen transmission type multipoint video conference system in combination with the multipoint video conference controller (MCU) shown in FIGS.
FIG. 3 is a block diagram showing a basic configuration of δ.

The video conference terminals α, β, γ, and δ are provided with decoding means 21 for decoding multiplexed image coded data from a multipoint video conference control unit (MCU), and decoding of multiplexed image coded data. Identification code extracting means 22 for extracting an identification code from the coded image, and separating means 23 for restoring the decoded multiplexed image coded data as a plurality of image data using the identification code and separating and outputting the image data It is made up of

That is, in the video conference terminals α, β, γ, and δ, the multiplexed image coded data transmitted from the multipoint video conference controller (MCU) is decoded by the decoding means 21.
At this time, the identification code added at the time of multiplexing by the multipoint video conference control unit (MCU) is extracted by the identification code extracting means 22 and input to the separating means 23. The separating unit 23 separates the multiplexed image for each frame using the extracted identification code and outputs (image output) as a plurality of image data.

FIG. 4 is a block diagram showing a specific configuration of a multipoint video conference controller (MCU) which is a main part of a multiscreen transmission type multipoint video conference system according to another embodiment of the present invention. . FIG. 5 is a block diagram showing a specific configuration of a video conference terminal which forms a multi-screen transmission type multi-point video conference system together with the multi-point video conference controller (MCU). It should be noted that the multi-screen transmission type multi-point video conference system can be applied to the case where the use conditions are different, and therefore, the operation for each mode will be described below.

First, a multipoint video conference controller (MC)
The case where the image data to be multiplexed and transmitted from U) is only a video (single image) of each point (one use condition) will be described.

In the case of a multipoint conference, the multipoint videoconference control unit (MCU) detects the speaker for the image data to be transmitted to each multipoint videoconference terminal (terminal station), and the chairperson station performs the conference. A form in which the operation is collectively controlled is often used.
For example, when used in schools and the like, the lecturer's image is usually broadcasted to the student, but in a multipoint conference where the student needs to speak in questions etc., the operation form described below is used. Can be taken.

That is, the multipoint video conference terminals α to
The encoded image data from θ is decoded by decoders (DEC1 to DEC8) 31a to 31h as decoding means, and selectors 32a and 32
b. When the conference is operated in a lecture mode, image data from the video conference terminal α, which is usually a lecturer, is selected by the selector 32a and sent to the multiplexing unit 34 as multiplexing means. When the image to be transmitted to each terminal station is only the instructor terminal station, that is, the video conference terminal α, the control CPU 35 does not perform the multiplexing by the multiplexing unit 34 but directly performs an encoder (COD) 36 as an encoding unit. The video (image data) of the instructor station (video conference terminal α) is transmitted to the video conference terminals β to θ which are the attending stations via.

At this time, the attending station (video conference terminal β-
When a request is made to the instructor station from θ), the instructor station gives permission to the requester to the multipoint video conference controller (MCU) in a predetermined manner. At this time, the utterance permission detecting unit 37 notifies the control CPU 35 of the terminal to which the utterance is permitted. Control CPU 35 receiving this
Sends a video (image data) of a terminal (for example, a video conference terminal γ) permitted to speak to the multiplexing unit 34,
It controls the selector 32b.

As a result, the selector 32a selects the lecturer station (video conference terminal α), and the selector 32b selects the speech permission station (video conference terminal γ). . At this time, an identification code (a code indicating whether the frame is an image of the lecturer station or an image of the speaking permission station) is added to each image frame. The image multiplexed by the multiplexing unit 34 is encoded by an encoder (C
OD) 36 and transmitted to other terminal stations.

On the other hand, on the terminal station side, the multiplexed image encoding decoded by the decoder (DEC) 41 as decoding means is based on the identification code extracted by the identification code extracting circuit 42 as identification code extracting means. After being separated into an instructor station image and a speech permission station image by a separation circuit 43 as separation means, and converted into analog signals by D / A converters 44a and 44b, respectively, the image is monitored in a display form as shown in FIG. It is displayed on each of 45a and 45b.

Accordingly, in each of the other participating terminal stations (video conference terminals β, δ, ε, ζ, η, θ), the communication between the lecturer station (video conference terminal α) and the speaking station (video conference terminal γ) is performed. Both images can be viewed at the same time, and the exchange between them can be checked at once without complicated image switching.

Such a multipoint video conference can be applied not only to a lecture mode but also to a normal video conference operation mode.
For example, there may be cases where a specific station is selected and received while watching a speaker or a broadcast source, or a normal moving image is viewed on one screen and a document is viewed on the other screen.

Next, a multipoint video conference controller (MC)
A case will be described in which the image data to be multiplexed and transmitted from U) is only a combined screen obtained by reducing and combining the video at each point (under other use conditions).

When a composite screen is used in a multipoint conference, the number of surface screens increases as the number of participating points increases, and as a result, the screen size per point decreases. Here, in order to prevent such a situation, when the number of points increases, a plurality of combined screens are multiplexed and transmitted, and control is performed so as to combine the screens in larger division units.

That is, the multipoint video conference terminals α to
The encoded image data from θ is decoded (DEC1
~ DEC8) After being decoded by 31a ~ 31h,
The signals are input to the selectors 32a and 32b.

Here, if the number of participating points is small (for example, four points or less), each point (teleconference terminals α to
The image data from δ) is screen-synthesized by the screen synthesizing unit 33a under the control of the control CPU 35, becomes a four-screen split synthesized screen, and is input to the selector 32a.
5 is input. Here, when multiplexing is not particularly necessary, it is encoded as it is by the encoder (COD) 36 and transmitted to the video conference terminals α to δ.

If the number of participating locations is large (for example, eight locations), the control CPU 35 activates the two screen synthesizing units 33a and 33b and activates each of the locations (video conference terminals α to).
θ), for example, as screen synthesis at four points, the screen synthesis unit 33 a
C4) The picture synthesizing unit 33b converts the decoded image data (related to the video conference terminals ε, ζ, η, θ) from the decoders (DEC5 to DEC8) 31a to 31d.
The decoded image data (related to the video conference terminals ε, ζ, η, and θ) from e to 31h are screen-synthesized. Each synthesized screen is input to the multiplexing unit 34 via the selectors 32a and 32b, and is field-multiplexed alternately with even frames and odd frames. At this time, an identification code (a code indicating whether the frame is a combined image by the screen combining unit 33a or a combined image by the screen combining unit 33b) is added to each image frame. The image multiplexed by the multiplexing unit 34 is encoded by an encoder (COD) 36 and transmitted to each terminal station.

On the other hand, on the terminal station side, processing is performed in the same manner as described above, and two types of composite screens are simultaneously displayed on the respective monitors 45a and 45b as in the display form shown in FIG. You.

Therefore, in such a case, the conventional multipoint video conference control unit (MCU) displays the images of the eight locations on a nine-screen split composite screen. Since the display is performed as sheets, the division size is large and easy to see.

Incidentally, as the display form of such a composite screen, for example, various display variations V1 to V4 as shown in FIG. 8 can be considered.

Further, a multipoint video conference controller (MC
A case will be described in which image data to be multiplexed and transmitted from U) is a mixture of video (single image) at each point and a composite screen obtained by reducing and combining the video at each point (under different use conditions).

As a method of operating the multipoint conference, a method of broadcasting the image of the speaker is generally used. Here, the following operation mode can be employed.

That is, the multipoint video conference terminals α to
The encoded image data from θ is decoded (DEC1
~ DEC8) After being decoded by 31a ~ 31h,
The signals are input to the selectors 32a and 32b.

The decoded image data from each participant is screen-synthesized by the screen synthesis unit 33a,
When the speaker detection unit 38 detects a speaker while being input to the multiplexing unit 34 via 2a, information indicating the speaker is transmitted to the control CPU 35. Here, the control CPU 35
Selects the terminal station of the speaker by the selector 32b,
Output to the multiplexing unit 34. For example, if the video conference terminal ζ speaks, the multiplexing unit 34 receives the synthesized screen of the image data for the video conference terminals α to θ generated by the screen synthesis unit 33a from the selector 32a, and simultaneously, The video of the selected speaker, that is, the video conference terminal ζ is being transmitted. At this time, the screen combining unit 33a is controlled by the control CPU 35, so that the image of the speaker station (video conference terminal ζ) can be removed from the combined screen and another participant's image can be inserted.

The outputs of the selectors 32a and 32b are multiplexed by the multiplexing unit 34. At this time, each image frame is provided with an identification code (whether the frame is a synthesized image by the screen synthesizing unit 33a or from the decoder 31f). Are added to the image. The image multiplexed by the multiplexing unit 34 is encoded by an encoder (COD) 36 and transmitted to each terminal station.

On the other hand, on the terminal station side, processing is performed in the same manner as described above, and two types of composite screens (speaker station) are displayed on the respective monitors 45a and 45b as shown in the display form of FIG. Image of the video conference terminal あ る, and a composite image of the video conference terminals α to θ as participating terminal stations)
Are displayed at the same time.

Therefore, by using a plurality of forms of screens here, it is possible to operate a conference, for example, displaying the whole view of the conference on one screen as a composite screen and displaying the speaker and the chairperson on the other screen. Therefore, a more realistic TV conference can be held.

[0056]

As described above, according to the multi-screen transmission type multi-point video conference system of the present invention, the image processing in the multi-point video conference control unit (MCU) is provided with a selective editing function. Since the number of screens and the amount of information of image data to be transmitted are increased to make it closer to a real conference, and complicated image switching is reduced, the realism of the conference can be increased. In addition, the image data is transmitted in a plurality of types to transmit the image data in a larger size than in transmitting one type of composite screen, and the size of the composite screen is increased. This makes it easier to see the screen with respect to the composite screen. That is, according to the multi-screen transmission type multi-point video conference system, a plurality of types of display screens are transmitted by the multi-point conference control and the terminal station develops the display screens on a plurality of display screens. In addition to minimizing the difficulty of viewing image data through conference control such as switching and selection of the receiving party, the conference can proceed smoothly with a sense of reality on a screen that is reasonably easy to view by deploying multiple types of display screens. You can do it.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a basic configuration of a multipoint video conference control unit (MCU) which is a main part of a multiscreen transmission type multipoint video conference system according to an embodiment of the present invention.

FIG. 2 is a block diagram showing a basic configuration of a multipoint video conference control unit (MCU) which is a main part of a multiscreen transmission type multipoint video conference system according to another embodiment of the present invention.

FIG. 3 is a block diagram showing a basic configuration of a video conference terminal which forms a multi-screen transmission type multi-point video conference system in combination with the multi-point video conference control device (MCU) shown in FIGS. 1 and 2;

FIG. 4 is a block diagram showing a specific configuration of a multipoint video conference control unit (MCU) which is a main part of a multiscreen transmission type multipoint video conference system according to another embodiment of the present invention.

5 is a multipoint video conference controller (MC shown in FIG. 4).
FIG. 2 is a block diagram showing a specific configuration of a video conference terminal that forms a multi-screen transmission type multipoint video conference system in combination with U).

FIG. 6 illustrates a screen display form in a video conference terminal under one use condition of the multi-screen transmission type multipoint video conference system shown in FIGS. 4 and 5;

FIG. 7 illustrates a screen display form in a video conference terminal under another use condition of the multi-screen transmission type multipoint video conference system shown in FIGS. 4 and 5;

FIG. 8 shows a display variation of a composite screen relating to a screen display mode in the video conference terminal under another use condition described in FIG. 7;

FIG. 9 illustrates a screen display mode in a video conference terminal under another use condition of the multi-screen transmission type multipoint video conference system shown in FIGS. 4 and 5;

[Explanation of symbols]

1a to 1d, 11a to 11d, 21 Decoding means 2a, 2b, 12a, 12b Editing means 3, 13 Multiplexing means 4, 14a, 14b Encoding means 5a, 5b, 15a, 15b Selection means 6a, 6b, 16a, 16b Screen synthesis means 22 Identification code extraction means 23 Separation means 31a to 31h, 41 Decoder (DEC, DEC1 to DEC1)
DEC 8) 32a, 32b Selectors 33a, 33b Screen synthesis unit 34 Multiplexing unit 35 Control CPU 36 Encoder (COD) 37 Speaking permission detection unit 38 Speaker detection unit 42 Identification code extraction circuit 43 Separation circuit 44a, 44b D / A converter 45a , 45b monitor

──────────────────────────────────────────────────続 き Continued on the front page (58) Field surveyed (Int.Cl. ⁷ , DB name) H04N ^7/ 14-7/15 H04N ^7/ 24-7/68 H04M 3/56

Claims (3)

(57) [Claims] 1. A plurality of points m (where m is a natural number and m ≧
3), and a multipoint video conference controller (MCU) for collecting a plurality of encoded image data from participating terminals among the plurality of video conference terminals. In the multipoint video conference system, the multipoint video conference control device (MCU) decodes the plurality of image data, and decodes the plurality of image data at the plurality of points m. N points (where n is a natural number and m
.Gtoreq.n), or selectively edit and output a plurality of types of selected and edited image data, or select one of the plurality of image data decoded at the plurality of points m. The image data corresponding to the n-th point is selectively edited and the selected and edited image data is output as different types from each other, or the plurality of pieces of the image data decoded at the plurality of points m are reduced and synthesized. To generate a composite screen, or select and edit one piece of image data from a part of the plurality of pieces of image data decoded at the plurality of points m. A plurality of editing means for reducing and synthesizing a plurality of image data decoded at the plurality of points m to generate a combined screen; and attaching an identification code to the plurality of types of selected edited image data in frame units. Multiplexing Characterized by comprising multiplexing means for outputting multiplexed image data, and encoding means for outputting multiplexed image encoded data obtained by encoding the multiplexed image data. Conference system. 2. A plurality of points m (where m is a natural number and m ≧ m)
3), and a multipoint video conference controller (MCU) for collecting a plurality of encoded image data from participating terminals among the plurality of video conference terminals. In the multipoint video conference system, the multipoint video conference control device (MCU) decodes the plurality of image data, and decodes the plurality of image data at the plurality of points m. N points (where n is a natural number and m
.Gtoreq.n), or selectively edit and output a plurality of types of selected and edited image data, or select one of the plurality of image data decoded at the plurality of points m. The image data corresponding to the n-th point is selectively edited and the selected and edited image data is output as different types from each other, or the plurality of pieces of the image data decoded at the plurality of points m are reduced and synthesized. To generate a composite screen, or select and edit one piece of image data from a part of the plurality of pieces of image data decoded at the plurality of points m. A plurality of editing means for reducing and synthesizing a plurality of image data decoded at the plurality of points m to generate a synthesized screen; and encoding the plurality of types of selected and edited image data by attaching identification codes thereto. Elected A plurality of encoding means for outputting edited image encoded data, and multiplexing means for outputting multiplexed image encoded data obtained by multiplexing the plurality of selected edited image encoded data. Screen transmission type multipoint video conference system. 3. The multi-screen transmission type multi-point video conference system according to claim 1, wherein the plurality of video conference terminals include: a decoding unit configured to decode the multiplexed image encoded data; Identification code extracting means for extracting the identification code from the decoded encoded image data, and separating the decoded multiplexed image encoded data as a plurality of image data using the identification code. A multi-screen transmission type multi-point video conference system, comprising: a separation unit for outputting.