JP2002290940A - Video conference system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve a problem that real time property is damaged and a flexible connection form is difficult in the case of performing a video conference of a large scale through a narrow band LAN because data to be communicated are large in a television conference system based on ITU-T recommendation. SOLUTION: Terminals 1 transmit multimedia data obtained by encoding video/sound data by MPEG-4 and MP4 formats to a server device 3, which streaming-distributes the multimedia data to all the terminals connected to the video conference system. The terminals 1 decode the multimedia data from the device 3 to the video/sound data. An H.320 terminal 31 and an H.323 terminal 33 can hold an MPEG-4 style video conference system by intermediating conversion processors 33 and 35 provided with the function of an MPEG-4 terminal.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video conference system for performing a video conference by mutually connecting remote locations.

[0002]

2. Description of the Related Art In recent years, with the development of communication technology, a video conference system has been developed in which video conferences are connected to each other between multiple remote locations. Such a video conference system is widely used as a form compliant with the ITU-T recommendations. Specifically, H.264, which is recommended by the ITU-T as an international standard for video conference systems, is used. 320
(Specifies general video conference terminals such as ISDN) and H.264. 32
3 (H.320 terminal, H.323 terminal) conforming to ISDN 3 (specifying a video conference terminal such as an IP network)
Alternatively, video and audio are transmitted and received between other terminals on the IP network by call control (H.225) and communication control (H.245) to realize a video conference.

In order to realize a conventional video conference system for performing a video conference between multiple points, a multipoint control unit (MCU: Multi) for connecting and managing terminals between the multiple points.
-Point Control Unit). The MCU manages the terminals connected to the video conference system, and notifies each terminal of information on all terminals connected to the MCU device, so that each terminal can determine the transmission destination of video data and audio data. It is configured to transmit and receive information and video and audio data.

[0004] In recent years, in response to a request to expand the connection mode of the video conference system, the ISDN interface and the L
By installing a gateway that carries an AN interface and performs each protocol conversion between an ISDN network and an ISDN network, H.264 is used. 320 terminal and H.320. A video conference can be held with the H.323 terminal.

As an example of such a conventional video conference system, an H.264 connected to an ISDN network is used. H.320 terminal connected to the LAN. A multipoint video conference system with the H.323 terminal will be described with reference to FIG.

[0006] H. The H.323 terminal 101 is connected to a LAN. The 320 terminal 102 is connected to the ISDN and to the LAN via the gateway device 103. Further, an MCU device 104 for managing connection of a multipoint terminal for performing a video conference is connected to the LAN.

H. In order to participate in the video conference system, the H.323 terminal 101 sends the MCU device 104 via the LAN.
Request a connection including the information of the terminal. The MCU device 104 is an H.264 device. When the connection of the H.323 terminal 101 is permitted, the information of the terminal is managed, and H.323 is connected to all currently connected terminals. It notifies that the H.323 terminal 101 has been connected together with the information of the terminal. By this processing, the H.264 / E. 323 terminal 10
1 can hold a video conference.

[0008] H. 320 terminal 102 is H.320 terminal. 32
As with the three terminals, a connection request including the information of the own terminal is made.
H. From the H.320 terminal 102, H.320 The request is transmitted to the gateway device 103 in the H.320 format, and the gateway device 103 transmits the request to the H.320 format. The conversion to the H.323 format requests the MCU device 104 to connect. The connection permission process is performed by the reverse route. Like the H.323 terminal 101, H.323 is assigned to all currently connected terminals. 320 terminal 1
02 is notified together with the information of the terminal. By this processing, the H.264 / E. The 320 terminal 102 can also hold a video conference.

[0009] The video conference system connected in this manner conforms to the ITU-T recommendations and is based on the H.264 standard. By transmitting and receiving H.323 data, a video conference is held.

[0010]

In such a video conference system, a video conference is held in conformity with the ITU-T recommendations. Therefore, the gateway device 103 and the MCU device are controlled in accordance with the ITU-T recommendations. 104 must be used, and a video conference cannot be held unless a device or the like compliant with these ITU-T recommendations is used.

In order to comply with the ITU-T recommendation, the connection form, procedure, data format, and the like must be followed, so the connection form is restricted. When a large-scale video conference is performed, real-time performance is impaired, and it is difficult to construct an efficient video conference system.

At present, MPEG is used as a high data compression means.
MPEG-4, MP3, etc., which have a much higher compression ratio than the data format of the conventional video conference system.
If a video conference can be performed using data of 4 or MP3, a real-time video conference can be performed even on a LAN with a narrow bandwidth, and a more flexible connection form can be achieved. Therefore, realization of such a video conference system is desired.

[0013]

SUMMARY OF THE INVENTION In order to solve the above-mentioned problems, the present invention provides a video conference system having a server device for managing connection and communication of the video conference system, and a plurality of terminals connected to the server device. Wherein the terminal has a video input device for inputting video data, an audio input device for inputting audio data, and a transmission processing unit for transmitting the video data and audio data to the server device, and the server device A connection management unit that manages terminals connected to the video conference system, a speaker selection management unit that selects a speaker and sends a selection signal, and all video data and audio data distributed from the plurality of terminals and A distribution processing unit that performs streaming distribution of the selection signal to all terminals managed by the connection management unit, and further includes the server device A video output device that displays video data distributed from the server device, a speaker selection processing unit that selects audio data corresponding to the speaker from the selection signal and the audio data distributed from the server device, and a speaker selection unit. And an audio output device that outputs the audio data selected by the processing unit.

Further, in a video conference system having a server device for managing connection and communication of the video conference system and a plurality of terminals connected to the server device, the terminal includes a video input device for inputting video data. An audio input device for inputting audio data, an encoding processing unit for encoding the video data and audio data into video compression data and audio compression data (hereinafter referred to as “multimedia data”), respectively, A transmission processing unit that transmits to the server device, the server device manages a terminal connected to the video conference system, and the connection management unit connects all multimedia data transmitted from the plurality of terminals. A distribution processing unit for performing streaming distribution to all terminals managed by the management unit; A decoding unit for decoding the compressed video data and compressed audio data distributed from the server device into video data and audio data, respectively, and a video output device for outputting the video data decoded by the decoding processing unit And an audio output device that outputs the audio data.

In this case, either the terminal or the server device has a speaker selection management unit for selecting a speaker and transmitting a selection signal together with MP3 data, and the terminal is configured to perform the selection based on the selection signal. It is desirable to have a speaker selection processing unit that selects MP3 data corresponding to the speaker and sends only the MP3 data to the decoding processing unit.

Further, one of the terminal and the server device has a speaker selection management section for selecting a speaker and transmitting a selection signal together with MP3 data, and the server device is configured to output the selection signal based on the selection signal. It is desirable to have a speaker selection processing unit that selects MP3 data corresponding to the speaker and streams only the MP3 data.

Further, the video compression data is MPEG-4
Preferably, the compressed audio data is MP3 data.

Further, in a video conference system having a server device for managing connection and communication of the video conference system, a server device employing a first encoding system and a first terminal employing a first encoding system. And, a second terminal adopting a second encoding method, and a conversion processing device for mutually converting between the first encoding method and the second encoding method, the first terminal is a video A video input device for inputting data,
An audio input device for inputting audio data, an encoding processing unit for encoding the video data and audio data into video compression data and audio compression data (hereinafter referred to as “multimedia data”), respectively, A transmission processing unit for transmitting to the device, a decoding processing unit for decoding multimedia data distributed from the server device into video data and audio data, respectively, and the video decoded by the decoding processing unit. A video output device that outputs data, and an audio output device that outputs the audio data, wherein the server device is a connection management unit that manages the first terminal connected to a video conference system and the conversion processing device And connecting all the multimedia data and the selection signal transmitted from the plurality of terminals to the connection The second terminal has a video input port for inputting video data, an audio input port for inputting audio data, and a video data port. , An audio output port for outputting audio data, and an input / output process for converting video and audio data input / output at the port to a second encoding system and inputting / outputting data to / from the conversion processing device. The conversion processing device has a function of mutually converting an encoding method of data transmitted from the server device or the second terminal and transmitting the data to the other. .

In this case, any one of the first terminal, the second terminal and the server device has a speaker selection management unit for selecting a speaker and transmitting a selection signal together with voice data or MP3 data. Preferably, the conversion processing device includes a speaker selection processing unit that selects MP3 data corresponding to the speaker based on the selection signal and transmits only the MP3 data to the decoding processing unit.

Further, any one of the first terminal, the second terminal and the server device has a speaker selection management section for selecting a speaker and transmitting a selection signal together with MP3 data, The apparatus has a speaker selection processing unit that selects MP3 data corresponding to the speaker based on the selection signal and distributes only the MP3 data by streaming.

The compressed video data is MPEG-4.
Preferably, the compressed audio data is MP3 data.

[0022]

Next, a first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing an example of a connection form of a video conference system (MPEG-4 system) according to the present invention. Multiple MPs on LAN
Terminals 1 and 2, which are EG-4 terminals, and a server device 3 that performs connection and communication control of a video conference system are connected. Although a plurality of MPEG-4 terminals are actually connected on the LAN, only two MPEG-4 terminals will be described as an example for convenience.

As shown in FIG. 2, the terminals 1 and 2 are provided with a video input device 4 for capturing a video from a camera or the like and a video encoding device for compressing (encoding) the video captured by the video input device 4 into MPEG-4. A processing unit 5 for transmitting the MPEG-4 data encoded by the encoding processing unit 5 to the server device 3 via the LAN;
4, a data transmission processing unit 6, an audio input device 7 for capturing audio from a microphone or the like, an encoding processing unit 8 for compressing (encoding) audio captured by the audio input device 7 into MP3, and an MP3 M encoded in
M to transmit P3 data to server device 3 via LAN
A P3 data transmission processing unit 9;
MPEG-4 data reception processing unit 13 for receiving MPEG-4 data sent from the LAN via the LAN and sending it to the next processing unit, and MPEG-4 data sent from the MPEG-4 data reception processing unit 13 Processing unit 12 that decodes the video data into image data, a video output device 11 that displays the video decoded by the decoding processing unit 12 on a display or the like, MP3 data and video conference transmitted from the server device 3 via the LAN. MP3 data reception processing unit 17 that receives a selection signal for selecting the speaker and sends it to the next processing unit, and a speaker that selects MP3 data from the speaker terminal based on the selection signal and sends it to the next processing unit Selection processing unit 1
6, a decoding processing unit 15 for decoding the MP3 data selected by the speaker selection processing unit 16 into audio data, and an audio output device 14 for outputting the audio decoded by the decoding processing unit 15 to a speaker or the like. A connection management unit 18 for performing a connection process to the video conference system; an operation unit 19 for operating the connection management unit 18 and the like;
L for interfacing data and MP3 data (hereinafter referred to as “multimedia data”) with a LAN.
And an AN interface 10.

Here, MPEG-4 refers to a high-efficiency video and audio coding scheme for communication such as the Internet, and differs from MPEG-2 in the compression method and communication means.
It is characterized in that the compression ratio is about 10 times higher than that of PEG-2. MP3 (MPEG-1 Audio)
Layer 3) is MPEG-, a video compression technology.
1 means a voice compression technique, which is currently the voice compression means having the highest compression rate.

In the present embodiment, the video and the audio are recorded in MPEG-4
Data and MP3 data are transmitted and received separately. This will be described later, while all video data is displayed, while audio data selects only audio data from the speaker and outputs audio data to the audio output device 14. In order to output to a speaker or the like, it is divided, encoded, and transmitted and distributed.

As shown in FIG. 3, the server 3 includes a LAN interface 20 for interfacing with a LAN, and an M for receiving MPEG-4 data among multimedia data.
A PEG-4 reception processing unit 21; an MPEG-4 data distribution processing unit 22 for distributing the MPEG-4 data received by the MPEG-4 reception processing unit 21 to all terminals connected to the video conference system; MP3 within
An MP3 reception processing unit 23 that receives data, an MP3 data distribution processing unit 24 that distributes MP3 data received by the MP3 reception processing unit 23 to all terminals connected to the video conference system, and a video conference is being held. Meanwhile, on a screen (not shown) of the server device 3, an operation unit 29 for selecting which terminal has the right to speak, and a selection signal designating the terminal selected by the operation unit 29 are sent to all terminals. And a speaker selection management unit 30 for distribution.

Further, the connection management unit 25 stores an IP address (hereinafter, “IP address”) of a terminal connected to the video conference system.
Address), an access permission list 27 having identification information such as an IP address of a terminal that can participate in the video conference system, and a connection permission list 27 that can be used when communicating with the video conference system. Communication information such as a bit rate and a frame rate (hereinafter referred to as “communication information”) is set, and the data setting management unit 28 manages the set communication information for each terminal.

In the present embodiment, the speaker is selected by the operation unit 29 of the server device 3. However, the selection method may be another generally known method, or a similar method may be used at another terminal by a similar method. It is also possible to make a person selection.

Next, as an operation of this embodiment, a case where the terminal 1 and the terminal 2 hold a video conference will be described with reference to FIG.

The terminal 1 sends a connection request signal to the server 3 to participate in the video conference. When the server device 3 receives the connection request signal from the terminal 1, the connection management unit 25 uses the connection terminal IP address management unit 26, the access permission list 27 and the data setting management unit 28 to limit the number of connection terminals and permit video conference participation. Check the presence or absence of multimedia data and the setting status of multimedia data.

First, regarding the limitation of the number of connected terminals, the connected terminal IP address management unit 26 uses the IP address of the terminal currently connected.
Since the addresses are managed, the number of connected terminals is compared with the number of allowed terminals. If the number of connected terminals has reached the number of allowed terminals, a connection disapproval signal is sent to terminal 1 and the connection request is discarded. I do. If the number of terminals permitted for management has not been reached, it is next determined whether or not permission to participate in the video conference has been granted.

Since the access permission list 27 has, as a list, the IP addresses of the terminals that can participate in the video conference system, it is determined whether the IP address of the terminal 1 is included in the list and must be included. For example, it is determined that participation in the video conference is not permitted, and a connection non-permission signal is sent to the terminal 1 to discard the connection request. If it is included in the list, the multimedia data setting status is checked next.

Since the data setting management unit 28 sets communication information that can be communicated, the data setting management unit 28 allows the data setting management unit 28 based on the communication information of the terminal 1 communication included in the connection request signal from the terminal 1. It is determined whether or not the communication capability is within the communication capability range. If the communication capability is exceeded, a connection rejection signal is sent to the terminal 1 to discard the connection request. When the communication capability is not exceeded, a connection permission signal is transmitted to the terminal 1 for the first time, and the IP address and communication information of the terminal 1 are transmitted to the connection management unit 2.
Record in 5.

The terminal 1 recognizes that the connection management unit 18 has connected to the video conference system by receiving the connection permission signal from the server device 3, and thereby the terminal 1 can participate in the video conference system. .

The terminal 2 also performs the same connection processing as the terminal 1 to participate in the video conference.

Next, the operation during the holding of the video conference will be described.

The terminal 1 having received the connection permission captures video data from a camera or the like with the video input device 4 and captures audio data from a microphone or the like with the audio input device 7. Upon receiving the video data captured by the video input device 8, the encoding processing unit 5 converts the video data to MPEG-4 codec software using MPEG-4 codec software or the like.
The data is encoded and transmitted to the MPEG-4 data distribution processing unit 6.

On the other hand, when the encoding processing section 8 receives the audio data captured by the audio input device 7, the encoding processing section 8 converts the audio data into an MP3 codec software or the like.
3 and transmits it to the MP3 data distribution processing unit 9.

The encoding units 5, 8
Analyzes the status of the other encoding process, delays one encoding according to the encoding process with the longer delay, and synchronizes the MPEG-4 data distribution processing units 6 and M
It is transmitted to the P3 data distribution processing unit 9.

MPEG-4 data transmission processing unit 6 and MP
The 3 data transmission processing unit 9 sets the server 3 as each transmission destination, and transmits the multimedia data to the server device 3 via the LAN.

When the server 3 receives the multimedia data through the LAN interface 20, the MPEG-4 data of the multimedia data is sent to the MPEG-4 data reception processing unit 21, and the MP3 data is sent to the MP3 data reception processing unit 23. Sent to This multimedia data is stored in the MPEG-4 data distribution processing unit 2 as it is.
2 and the MP3 data distribution processing unit 24,
-4 The data distribution processing unit 22 and the MP3 data distribution processing unit 24 each set the IP address of the terminal registered in the connection terminal IP address management unit 26 of the connection management unit 25 as the destination of the received multimedia data. , L
Multicast (streaming) distribution to the LAN via the AN interface 20. Thus, the server device 3 does not process the received multi-dia data,
Multimedia data transmitted from all terminals connected to the video conference system
Streaming distribution to AN. Thereby, the real-time property in the server device 3 is remarkably improved.

During the video conference, the server 3
, A speaker is recognized from a display device (not shown), and the speaker is selected by the operation unit 29. The speaker selection management unit 30 checks the terminal corresponding to the speaker selected by the operation unit 29, and distributes the selection signal specifying the speaker along with the MP3 data from the MP3 data distribution processing unit 24 by streaming. .

When the multimedia data is distributed by streaming from the server device 3, the terminals 1 and 2 connected to the video conference system determine whether or not the data is addressed to the own terminal via the LAN interface 10 and determine whether the data is addressed to the own terminal. If the data is, the multimedia data is fetched.

The MPEG-4 data of the received multimedia data is received by the MPEG-4 data reception processing unit 13, and the MP3 data and the selection signal are received by the MP3 data reception processing unit 17. The decoding processing unit 12
MPEG received by the MPEG-4 data reception processing unit 13
When the MPEG-4 data is received, the MPEG-4 data is decoded into video data by the MPEG-4 codec software or the like and transmitted to the video output device 11. At this time, a video output control processing unit (not shown) that performs processing of the display screen for the video conference and the like displays image data from each terminal along the display setting screen for the video conference set in the own terminal. Process as follows. That is, in the present embodiment, the image data (MPEG-4
The data is distributed without any processing, and is displayed in a preset video conference display format for the first time at the terminal itself. Examples of the display include equal division, display of only the speaker, and increase of the speaker to make the others equally divided.

On the other hand, when the MP3 data reception processing unit 17 transmits the received MP3 data and the selection signal to the speaker selection processing unit 16, the speaker selection processing unit 16 receives the MP3 data from the terminal corresponding to the speaker based on the selection signal. Only the data is selected and transmitted to the decoding processing unit 15. Decoding processing unit 1
5 receives the MP3 data selected by the speaker selection processing unit 16, decodes the MP3 data into audio data using MP3 codec software or the like, and transmits the audio data to the audio output device 14. Here, the MP corresponding to the speaker
The reason why only the three data are transmitted to the decoding processing unit 15 and decoded is that when all the MP3 data is decoded, the processing load reduces the real-time property in the video conference, and therefore, corresponds to the minimum required speaker. This is for decoding only the MP3 data.

Each of the decoding units 12, 1
Numeral 9 analyzes the status of the other decoding process, delays one of the decoding processes in accordance with the decoding process with the longer delay, and transmits them to the video output device 11 and the audio output device 14 while synchronizing the two. ing.

The video data and the audio data thus decoded are displayed on a display device such as a display by the video output device 11, and the audio output device 14 outputs audio to a speaker or the like.

By performing such processing, a video conference can be held between the terminals 1 and 2.

Next, a second embodiment according to the present invention will be described. In the first embodiment, a video conference system between MPEG-4 terminals has been described. 3
A video conference system including 23 terminals will be described.

FIG. 5 is a diagram showing a connection form of the video conference system according to the second embodiment. This video conference system includes a server device 3, a terminal 31 which is an MPEG-4 terminal, H.323-compliant H.323 323 terminal 3
4, MPEG-4 format and H.264. A conversion processing device 33 for performing conversion between the H.323 format and the H.323 format is connected via a LAN.

The configurations of the server device 3 and the terminal 31 are the same as those of the server device 3 and the terminals 1 and 2 described in the first embodiment, and a description thereof will be omitted.

H. The H.323 terminal 32, as shown in FIG.
A video input port 41 for inputting video from a video or the like, an audio input port 42 for inputting audio from a microphone or the like, a video output port 43 for displaying a video on a display or the like,
An audio output port 44 for outputting audio to a speaker or the like;
H. connection between these ports and the LAN. A video / audio input / output processing unit 45 for performing input / output processing of H.323 format data.

As shown in FIG. 6, in the present embodiment, the conversion processing device 33 is connected to the MPEG-4 terminal 47 and the H.264 terminal. 323 terminal 46 is shown, but the following MP
The function of the EG-4 terminal 47 and H.264. It is sufficient to have the function of the H.323 terminal 46.

The conversion processing device 33 has a 323 terminal 46
The video output port 36 and the audio output port 37 of the MPEG-4 terminal 47 are connected to the video input device 4 and the audio input device 7 of the MPEG-4 terminal 47, respectively. . 323
Video input port 34 and audio input port 35 of terminal 46
Is connected to In addition, H. H.323 terminal and MPEG
Since the configuration of the -4 terminal is the same as described above, the description here is omitted.

Next, the operation of the present embodiment is described as follows. The case where the H.323 terminal 32 and the terminal 31 hold a video conference will be described with reference to FIG.

First, the terminal 31 and the conversion processing unit 32
Since the (MPEG-4 terminal part) participates in the video conference, the connection management unit 18 makes a connection request to the server device 3, and the terminal 3 performs the same processing as in the first embodiment.
1 and the conversion processing device 35 are connected to the video conference system. As a result, the conversion processing device 35 enters a state in which multimedia data can be transmitted to the server device 3, and also receives a distribution from the server device 3.

After that, H. The H.323 terminal 32 is substantially connected to the video conference system by performing connection processing with the conversion processing device 33 connected to the video conference system.

Next, the operation during the holding of the video conference is shown in FIG.
This will be described with reference to FIG. FIG. 8 is a flowchart showing the operation in the conversion processing device 33.

H. When the 323 terminal 32 captures video data from a camera or the like with the video input / output 36 and captures audio data from a microphone or the like with the audio input / output device 37, the video / audio input / output processing device 45 converts the captured data into digital data. H. 323 format and LA
N via the H.N. The H.323 data is transmitted to the conversion processing device 33.

In the conversion processing device 33, the H.264 input via the LAN is used. The H.323 data is converted to multimedia data, and the multimedia data is transmitted to the server.
Specifically, the input / output processing device 40 communicates with the H.264 via the LAN.
H.323 terminal 32 When H.323 data is received, the H.323 data is received. The H.323 data is converted into composite video and analog audio format data (hereinafter, referred to as “analog data”), and the analog data is output from the video output port 43 and the audio output port 44 to the video input device 4 and the audio input device 7. The video output port 36 and the video input device 4 and the audio output port 37 and the audio input device 5 are compatible with the conventional H.264. The H.323 terminal and the MPEG-4 terminal are connected to each other at a camera, a microphone, a display, and a speaker terminal. The same applies to the video output device 11 and the video input port 34, and the audio output device 14 and the audio input port 35, which will be described later.

When the MPEG-4 terminal of the conversion processing device 33 captures the analog data of the video input device 4 and the audio input device 7, the analog data is sent to the encoding processing units 5 and 8. The encoding units 5 and 8 encode the respective analog data into MPEG-4 and MP3, and transmit them to the server device 3 via the LAN. The transmission processing and the distribution processing in the server device 3 are the same as those described in the first embodiment.

When the multimedia data is distributed from the server device 3, the conversion processing device 33 transmits the MPEG data in its own device.
MPEG-4 data reception processing unit 13 of the MPEG-4 terminal
The G-4 data is converted to MP3 data by the MP3 data reception processing unit 17.
Receive data and select signals.

Upon receiving the MPEG-4 data from the MPEG-4 data reception processing unit 13, the decoding processing unit 12 decodes the MPEG-4 data into a composite video signal, and the decoding processing unit 15 includes a speaker selection processing unit. When the MP3 data selected in step (1) is received, the MP3 data is decoded into analog audio, and the video output device 11 and the audio output device 14 respectively decode the MP3 data into an analog audio signal. 323 terminal 46.

H. When the analog data is received by the video input port 34 and the audio input port 35, the audio / video input / output processing device 40 transmits the analog data to the H.323 terminal 46. H.323 data is encoded. 323
Transmit to terminal 32.

H. The video / audio input / output processing device 45 of the H.323 terminal 32 includes a video input port 41 and an audio input port 4.
2 is captured, the video is displayed on the display from the video output port 43, and the audio is output from the audio output port 44 to the speaker.

By performing such processing, a video conference can be held between terminals having different protocols without being aware of the difference between the protocols.

[0067]

As described above, according to the present invention,
Since the server manages the information of the terminals connected to the video conference system, each terminal needs to transmit the multimedia signal only to the server, and distributes the multimedia signal to all the terminals connected to the server. Therefore, the load on each terminal can be reduced.

Also, MPEG-4 and M which are high compression methods are used.
Since the encoding method such as P3 can be handled, even in a LAN or the like which is a narrow band network, the network does not become congested due to transmission from each terminal or distribution from a server device, and high real-time performance is achieved. A video conference system can be held.

Further, the video data and the audio data are encoded by different encoding methods, so that the audio data corresponding to the speaker can be selected independently of the video data. The device for selection can be simplified.

Further, by decoding only the encoded voice data corresponding to the speaker, a video conference system with higher real-time properties can be held.

Further, when a video conference is held between terminals of different standards, a general-purpose MPEG-4 terminal and H.264 standard can be used without installing expensive dedicated terminals. Since the video conference system can be configured with a configuration in which only a conversion processing device capable of directly using the H.323 terminal or the like is used, the video conference system can be configured more flexibly and inexpensively.

[Brief description of the drawings]

FIG. 1 is a diagram showing a connection mode of a first video conference system according to the present invention.

FIG. 2 is a block diagram showing an MPEG-4 terminal according to the first embodiment.

FIG. 3 is a block diagram showing a server device according to the first embodiment.

FIG. 4 is a flowchart in a video conference system between MPEG-4 terminals according to the first embodiment.

FIG. 5 is a diagram showing a connection mode of a second video conference system according to the present invention.

FIG. 6 illustrates an H.264 system according to the second embodiment. FIG. 3 is a block diagram showing a H.323 terminal.

FIG. 7 is a block diagram showing a conversion processing device according to a second embodiment.

FIG. 8 illustrates an H.264 system according to the second embodiment. 4 is a flowchart in the video conference system between the H.323 terminal and the MPEG-4 terminal.

FIG. 320 terminal and H.320. The figure which showed the connection form of the video conference system between 323 terminals.

[Explanation of symbols]

 1, 2 MPEG-4 terminal 3 server device 4 video input device 5, 8 encoding processing unit 6 MPEG-4 data transmission processing unit 7 audio input device 9 MP3 data transmission processing unit 10, 20 LAN interface 11 video output device 12, 15 Decoding processing unit 13 MPEG-4 data reception processing unit 14 Audio output device 16 Speaker selection processing unit 17 MP3 data reception unit 18 Connection management unit 19 Operation unit 21 MPEG-4 data reception processing unit 22 MPEG-4 data distribution processing unit 23 MP3 data reception processing unit 24 MP3 data distribution processing unit 25 connection management unit 26 connection terminal IP address management unit 27 access permission list 28 data setting management unit 29 operation unit 30 speaker selection management unit 31 MPEG-4 terminal 32 H. H.323 terminal 33 Conversion processing device 34, 41 Video input port 35, 42 Audio input port 36, 43 Video output port 37, 44 Audio output port 40, 45 Video / audio input / output processing device 46H. 323 terminal 47 MPEG-4 terminal

Claims (9)

[Claims] 1. A video conference system having a server device for managing connection and communication of a video conference system, and a plurality of terminals connected to the server device, wherein the terminal includes a video input device for inputting video data; An audio input device that inputs audio data, and a transmission processing unit that transmits the video data and audio data to the server device, wherein the server device manages a terminal connected to a video conference system, and a connection management unit. A speaker selection management unit that selects a speaker and sends a selection signal, and all terminals that manage all video data and audio data and the selection signal distributed from the plurality of terminals by the connection management unit And a video output device for displaying video data distributed from the server device. A speaker selection processing unit for selecting voice data corresponding to a speaker from a selection signal and voice data delivered from the server device, and a voice output device for outputting the voice data selected by the speaker selection processing unit And a video conference system. 2. In a video conference system having a server device for managing connection and communication of the video conference system, and a plurality of terminals connected to the server device, the terminal includes: a video input device for inputting video data; An audio input device for inputting audio data, an encoding processing unit for encoding the video data and audio data into video compression data and audio compression data (hereinafter referred to as “multimedia data”), respectively, A transmission processing unit for transmitting to a server device, wherein the server device manages a terminal connected to a video conference system, and the connection unit connects all multimedia data transmitted from the plurality of terminals. A distribution processing unit that performs streaming distribution to all terminals managed by the management unit, and the terminal further includes: A decoding processing unit that decodes the video compression data and the audio compression data distributed from the server device into video data and audio data, respectively, and a video output device that outputs the video data decoded by the decoding processing unit. And a sound output device for outputting the sound data. 3. A speaker selection management unit for selecting a speaker and transmitting a selection signal together with MP3 data to one of the terminal and the server device, wherein the terminal speaks based on the selection signal. MP for the elderly
3. The video conference system according to claim 2, further comprising a speaker selection processing unit that selects three data and sends only the MP3 data to the decoding processing unit. 4. A speaker selection management unit for selecting a speaker and transmitting a selection signal together with MP3 data to one of the terminal and the server device, wherein the server device is configured based on the selection signal. 3. The video conference system according to claim 2, further comprising a speaker selection processing unit that selects MP3 data corresponding to the speaker and distributes only the MP3 data by streaming. 5. The video conference system according to claim 2, wherein the compressed video data is MPEG-4 data, and the compressed audio data is MP3 data. 6. A video conference system having a server device for managing connection and communication of the video conference system, wherein the server device employs a first encoding method and a first terminal adopts a first encoding method. And, a second terminal that employs a second encoding method, and a conversion processing device that mutually converts between the first encoding method and the second encoding method, the first terminal is a video A video input device for inputting data, an audio input device for inputting audio data, and an encoding processing unit for encoding the video data and audio data into video compressed data and audio compressed data (hereinafter referred to as “multimedia data”), respectively And a transmission processing unit for transmitting the multimedia data to the server device,
A decoding processing unit that decodes the multimedia data distributed from the server device into video data and audio data, a video output device that outputs the video data decoded by the decoding processing unit, and the audio data. And a connection management unit that manages the first terminal and the conversion processing device that are connected to a video conference system, and all of the information transmitted from the plurality of terminals. A distribution processing unit for streaming distribution of multimedia data and the selection signal to all terminals managed by the connection management unit, wherein the second terminal has a video input port for inputting video data, An audio input port for inputting data, a video output port for outputting video data, an audio output port for outputting audio data, And an input / output processing device for converting video and audio data to be input / output to / from a second encoding system and performing input / output processing with the conversion processing device, wherein the conversion processing device is the server Having a function of mutually converting the encoding system of data transmitted from the device or the second terminal and transmitting the other to the other, the first terminal and the second terminal
A video conference system having the function of a terminal. 7. A speaker selection management unit for selecting a speaker and transmitting a selection signal together with voice data or MP3 data to any one of the first terminal, the second terminal, and the server device. The conversion processing device further comprises: a speaker selection processing unit that selects MP3 data corresponding to the speaker based on the selection signal and transmits only the MP3 data to the decoding processing unit. 6. The video conference system according to 6. 8. The server according to claim 1, further comprising: a speaker selection management unit for selecting a speaker and transmitting a selection signal together with MP3 data to one of the first terminal, the second terminal, and the server device. 7. The video conference system according to claim 6, wherein the apparatus has a speaker selection processing unit that selects MP3 data corresponding to the speaker based on the selection signal and distributes only the MP3 data by streaming. 9. The video conference system according to claim 6, wherein said video compression data is MPEG-4 data, and said audio compression data is MP3 data.