JPH1051557A - Video conference terminal and multispot video conference method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve the secrecy of a conference by refusing unwanted connection of video conference terminal by performing communication regardless of the conference under holding, by enabling the temporary connection of any other new video conference terminal during a multispot video conference. SOLUTION: When the terminals cell of the new video conference terminal is reported to a main control means, a multispot conference control means stops transmission to video conference terminals 35 and 36 under connecting. The execution of the video conference in apparent one-to-one corresponding with a video conference terminal appears to be for a video conference terminal 37, when the video conference terminal 37 is temporarily connected. When an input from a remote controller is accepted and 'addition to multispot conference' is selected, after the communication with the video conference terminal 37 of a temporary connected party has started, the main control means reports that information to the multispot conference control means and executes the multispot video conference due to all the connected video conference terminals 35-37. It can be discriminated by the temporary connection, whether or not the terminal can participate in the multispot video conference through that connection.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video conference terminal used for multi-point image transmission and a multi-point video conference method for performing multi-point image transmission.

[0002]

2. Description of the Related Art Conventionally, as a configuration of a system that enables a video conference at multiple points, ITU-T Recommendation H.264 has been proposed. 231 and a multipoint control unit described in ITU-T Recommendation H.231.
A combination with the video conference device described in 230 is known.

FIG. 10 is a block diagram of the conventional video conference system. In FIG. 10, 1 is a multipoint control unit, 2 is a digital network (for example, ISDN), and 3 is a video conference terminal at each point. All the video conference terminals 3 to 5 participating in the video conference at the multipoint are connected to the multipoint control unit 1 via the digital network 2, and the multipoint control unit 1 performs various controls during the call connection. . The multipoint control unit 1 includes a network interface device,
ITU-T Recommendation H. 221, a multiplexing / demultiplexing device for separating and multiplexing a signal completely matching the H.221, an audio processing device for mixing or switching audio, an image processing device and an audio processing device for switching an image to be transmitted to each video conference terminal, It comprises a control processing device for controlling the image processing device.

[0004] The functions, operations, and the like of the video conference system configured as described above will be briefly described. In a multipoint videoconference system including the multipoint control unit 1 and the videoconference terminals 3 to 5 connected via the digital network 2, when a new connection from the videoconference terminal is to be performed, the conference A moderator (an operator of the multipoint control unit 1 or an operator of a multipoint videoconference terminal (not shown) as a conference control terminal connected to perform a conference control of a conference) participates in the multipoint videoconference. The multipoint control unit 1 or the video conference terminal device completely determines whether or not to perform the operation of allowing or rejecting the connection (that is, performing the operation for determining whether or not to participate in the conference), or determining whether or not to participate. Leave it to either.

[0005]

However, in the above-mentioned conventional multipoint video conference system, it is determined whether or not a new video conference terminal is to participate in a conference without communication with the new video conference terminal. Therefore, there has been a problem that the determination lacks accuracy.

[0006] In this video conference terminal, it is demanded that an incoming call from another video conference terminal can be received during the conference and communication can be performed irrespective of the conference being held. In addition, when conducting a multipoint conference, the conference organizer checks the faces of all connected participants and adds a videoconference terminal to the multipoint conference, thereby making unnecessary or external videoconferences possible. There is a demand for rejecting a terminal connection and increasing the confidentiality of a conference.

[0007] The present invention provides a video conference terminal capable of temporarily connecting to another new video conference terminal during a multipoint video conference, and a temporary connection to another new video conference terminal during a multipoint video conference. It is an object of the present invention to provide a multi-point video conference method for performing a video conference.

[0008]

SUMMARY OF THE INVENTION In order to solve this problem, a video conference terminal according to the present invention performs a temporary connection process with a new video conference terminal different from a video conference terminal during a video conference, and a new video conference terminal. Communication block control means for establishing terminal-to-terminal communication with the video conference terminal, transmitting the self-image to the new video conference terminal, and switching the transmission / reception image so that the own device receives the transmission image from the new video conference terminal Multipoint conference control means and a new video conference terminal when it is determined that a new video conference terminal is to participate in the conference, and additional processing is performed when the new video conference terminal is determined not to participate in the conference. And a main control means for performing the cutting process.

As a result, a video conference terminal capable of temporarily connecting to another new video conference terminal during a video conference at multiple points is obtained.

Further, a multipoint video conference method according to the present invention for solving this problem performs a new video conference by performing temporary connection processing with a new video conference terminal different from the video conference terminal during the video conference. A communication establishing step for establishing terminal-to-terminal communication with a terminal, and an image switching step of transmitting a self-image to a new video conference terminal and switching transmission / reception images so that the own device receives a transmission image from the new video conference terminal And when it is decided to join a new video conference terminal to the conference,
When a decision is made not to join the new video conference terminal to the conference, a conference participation determination step of disconnecting the new video conference terminal is performed.

Thus, a multipoint video conference method for temporarily connecting to another new video conference terminal during the multipoint video conference can be obtained.

[0012]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The invention according to claim 1 of the present invention performs a temporary connection process with a new video conference terminal different from a video conference terminal during a video conference, and establishes a connection with the new video conference terminal. Communication block control means for establishing terminal-to-terminal communication, and multipoint conference control means for transmitting a self-image to a new video conference terminal and switching transmission / reception images so that the self-device receives a transmission image from the new video conference terminal When it is determined that a new video conference terminal is to participate in the conference, an additional process to the conference is performed, and when it is determined that the new video conference terminal is not to participate in the conference, a disconnection process of the new video conference terminal is performed. And a main control means, which receives an incoming call from another new video conference terminal during the multipoint video conference and has no relation to the ongoing video conference. The pros and cons of the conference participants of a new television conference terminal has an effect that is determined.

According to a second aspect of the present invention, in the first aspect of the present invention, an audio / video codec for encoding and decoding audio and video is provided, and the multipoint conference control means is a new video conference terminal. To, the self-image from the image input unit is encoded and transmitted by the audio / video codec unit, and transmitted.
In the own apparatus, the transmission / reception image is switched by the image switching unit so that the transmission image is received from the new video conference terminal and displayed on the monitor after the audio / video codec unit performs the decoding process. It is intended to establish terminal-to-terminal communication with a new video conference terminal via the terminal, and has the effect of accurately determining whether the new video conference terminal participates in the conference.

According to a third aspect of the present invention, there is provided a communication system for performing a temporary connection process with a new video conference terminal different from a video conference terminal during a video conference to establish inter-terminal communication with the new video conference terminal. An establishing step, an image switching step of transmitting the own image to the new video conference terminal, and an image switching step of switching the transmission / reception image so that the own device receives the transmission image from the new video conference terminal; and When it is decided to join, it performs additional processing to the conference, and when it is decided not to join the new video conference terminal to the conference, it has a conference participation decision step of disconnecting the new video conference terminal. During a multipoint videoconference, accepts incoming calls from another new videoconference terminal, regardless of the ongoing videoconference. It has the effect that the pros and cons of the conference participants of the video conference terminal is determined.

FIG. 1 shows an embodiment of the present invention.
This will be described with reference to FIG. (Embodiment 1) FIG.1 is a block diagram showing a video conference terminal according to Embodiment 1 of the present invention. In FIG. 1, reference numeral 6 denotes a remote controller as an external input unit that receives control from an operator, 7 denotes a monitor as an image output unit for displaying an image from the other party's video conference terminal or a self-image, and 8 denotes a self-image. A camera as an image input unit, a speaker 9 for outputting audio from the other party's video conference terminal, a microphone 10 for inputting own terminal side audio, an image synthesizing unit 11 for performing image synthesis, and 12 an image An image switching unit 13 for switching between input and output of the audio signal; a voice synthesizing unit 13 for mixing audio and switching between audio input and output;
Reference numerals 4, 15, and 16 denote audio / video codecs for encoding and decoding video and encoding and decoding audio.
8, 19 are multiplexing / demultiplexing units for multiplexing and demultiplexing audio and video, and 20, 21, 22 are digital networks (for example, I / O).
Network interface units (network I / F units) 23, 24, and 25, which are interfaces with the SDN, are communication blocks corresponding to ports A, B, and C corresponding to respective communication lines.
Each of the communication blocks 23, 24, 25 includes an audio / video codec unit 14, 15, 16 and a multiplexing / demultiplexing unit 17, 1
8 and 19 and each of the network interface units 20, 21, and 22.

FIG. 2 is a functional block diagram showing software for controlling the operation of the video conference terminal shown in FIG. The operation of the video conference terminal used by the conference organizer when conducting a video conference at multiple points is controlled by a central processing unit (not shown) that executes the software of FIG. In FIG.
Reference numeral 26 denotes a multipoint conference control means for controlling a conference at a multipoint and managing the information of each videoconference terminal and the contents of an image and a sound transmitted to each videoconference terminal, 27 a menu display, a message display, and the like. Screen control means for performing
28 is a camera control means for controlling a camera, 29 is a remote control means for controlling a key input from the remote control 6,
30 is an initial setting of the video conference system and various control means 2
Main control means for controlling 6 to 29, 31 to 33, 31, 32 and 33 are communication block control means for performing communication control.

FIG. 3 is a block diagram showing a multipoint video conference system including the video conference terminal of the present embodiment, and shows a case where the number of terminals participating in the multipoint video conference is three. FIG.
In the figure, reference numeral 34 denotes a video conference terminal capable of performing the multipoint video conference shown in FIG. 3
5 and 36 are ITU-T Recommendation H.264. 320 is a video conference terminal. 38 is a digital network.

The operation of the multipoint video conference system including the video conference terminal according to the present embodiment will be described with reference to FIGS.
This will be described with reference to FIG. FIG. 4A is a terminal connection diagram showing a video conference terminal connection state before execution of a temporary connection, and FIGS. 4B to 4D are terminal connection diagrams showing a video conference terminal connection state after execution of a temporary connection. FIG. 5 is a flowchart showing the temporary connection process. In FIG. 4, the video conference terminals 34 and the video conference terminals 35 and 36 are the same as those in FIG. 3
Reference numeral 7 denotes a new video conference terminal. The operation described with reference to FIG. 1 to FIG.
When a three-point video conference is being carried out by being connected to the other party's video conference terminals 35 and 36 through the digital network 37 using 3 and 24, another new video conference terminal 37 This is the operation when all the connections are about to be made.

When the communication block control means 33 in FIG. 2 notifies the main control means 30 of the incoming of the new video conference terminal 37 (FIG. 4A), the multipoint conference control means 26 The control unit 30 controls the image synthesizing unit 11, the image switching unit 12, and the audio synthesizing unit 13 to stop the transmission to the connected video conference terminals 35 and 36. Is switched (S1). Next, the communication block control unit 33 causes the communication block 25 to start a connection process (S2). The negotiation method when connecting is IT
U.T. Recommendation H. 242 and H.E. According to H.221, there is no difference from the case of a normal video conference terminal. The multiplexed audio / video data from the other party's video conference terminal 37 (see FIG. 4) is separated by the multiplexing / separating unit 19 (FIG. 1), decoded through the audio / video codec unit 16, and then switched to the image switching unit. 12. At this time, the images input to the image switching unit 12 are all connected video conference terminals 35 to
37 and the image data from the camera 8. As for audio, decoded audio data from the audio / video codecs 14, 15, 16 is input to the audio synthesizer 13.

When the temporary connection with the video conference terminal 37 is completed (communication establishing step), the main control means 30 converts the image transmitted from the camera 8 to the video conference terminal 37 of the temporary connection partner into the image from the camera 8 and transmits the image to the monitor 7. The image switching unit 12 is controlled and switched so that the output image becomes an image from the video conference terminal 37 of the temporary connection partner. At the same time, the sound from the microphone 10 is output to the video conference terminal 37 and the speaker 9 is output.
The voice synthesizing unit 13 is controlled so that the voice output from the video conference terminal 37 becomes the voice output from the video conference terminal 37 (S3, image switching step). At this point, the video conference terminal 3 of the temporary connection partner
The output of the image and the sound to the multipoint video conference participation terminals 35 and 36 except for the video conference terminal 7 is all stopped, and the video conference terminal 37 performs the video conference with the video conference terminal 34 in an apparent one-to-one relationship. (Fig. 4
(B)).

Here, the video conference terminal 3 to be the temporary connection partner
Conference-conference video-conference terminal 3 that is connected before the connection with PC 7 starts
Although the transmission of the image and the voice to the video conference terminals 5 and 36 is stopped, the control of the image switching unit 12 and the voice synthesis unit 13 is performed, and the conference proceeder, Image and audio transmission / reception processing other than the video conference terminal 34 and the video conference terminal 37 may be performed.

After starting communication with the video conference terminal 37 to be temporarily connected, the main control means 30 adds the video conference terminal 37 to the conference on the monitor 7 using the screen control means 27 or terminates the temporary connection. A message asking whether to do so is displayed (S4). When an input from the remote controller 6 is received and the selected content is notified to the main controller 30 by the remote controller controller 29, the main controller 30 performs the following processing according to the selection type.

If "Add to multipoint conference" is selected in step 5 (S5, conference participation determination step), the main control means 30 adds a participating video conference terminal and selects a terminal such as a terminal name and a dial number. If there is information, the information is notified to the multipoint conference control means 26, and the video conference terminal 37 of the temporary connection partner is recognized as a multipoint video conference participation terminal. At the same time, the multipoint conference control means 26 controls the image synthesizing section 11, the image switching section 12 and the voice synthesizing section 13 through the main control means 30, and the all-connected video conference terminal 35
(S6, FIG. 4)
(C)).

If "addition to multipoint conference" is not selected in step 5 (S5) and "temporary connection end" is selected in step 7, the main control means 30 determines that the communication block control means 33 has performed the disconnection processing. Then, the communication block control unit 33 notifies the communication block control unit 33 of the disconnection so as to shift to the step (S8). Next, the main control means 30 notifies the multipoint conference control means 26 that the temporary connection has been completed, and upon receiving the notification, the multipoint conference control means 26 returns to the multipoint video conference before the temporary connection. Thus, the image synthesizing unit 11, the image switching unit 12, and the voice synthesizing unit 13 are controlled through the main control unit 30 to restore the contents of the voice and image transmission (S9), and the multipoint video conference using three points before the temporary connection The state returns to the execution state (FIG. 4D). At this time, if the multipoint video conference system is in an operation mode of image switching based on maximum speaker detection, the content of the image to be transmitted to each of the video conference terminals 35 and 36 is determined by the operation mode.

FIGS. 6 to 9 show received and displayed images at each video conference terminal in each state. FIG. 6A is an image diagram showing mixing images (images that can be transmitted to the video conference terminals 35 to 37) at four points, and FIGS. 6B to 6E show images transmitted from each point. Image diagram, FIG. 7 (a),
(B), (c) are image diagrams of the terminals 35, 36, and 37 when a video conference is being conducted at three points, FIG.
(B), (c), and (d) are images showing reception and display images of the terminals 34, 35, 36, and 37 when the connection from the video conference terminal 37 of the temporary connection partner to the video conference terminal 34 is performed. Figures 9 (a), 9 (b), 9 (c) and 9 (d) show terminals 34, 35 and 3 in a multipoint video conference with four points.
It is an image figure which shows the image of 6, 37. Video conference terminal 3
When the connection from the TV conference terminal 7 to the video conference terminal 34 is made, as shown in FIG. 8, it can be seen that the video conference terminal 34 and the video conference terminal 37 are apparently performing one-to-one opposing communication. When the video conference terminal 37 of the temporary connection partner participates in the video conference, a multipoint video conference with four locations is started. In this case, as shown in FIG. Each video conference terminal 35-3
7 can be combined and transmitted to each of the video conference terminals 35-37.

In the above description, the temporary connection during the video conference has been described using the example of the multipoint video conference.
The same can be implemented in a video conference with one-to-one opposed communication.

As described above, according to the present embodiment, an incoming call from another new video conference terminal 37 is received during a multipoint video conference, and the new video conference terminal is received regardless of the ongoing video conference. Since the main control means 30 determines whether or not to participate in the multipoint video conference of 37, during the multipoint video conference, a new video conference terminal different from the video conference terminal connected by that time is used. Can be temporarily connected, and it is possible to determine whether or not to participate in a multipoint video conference via communication by the connection.

[0028]

As described above, according to the video conference terminal of the present invention, an incoming call from another new video conference terminal is accepted during a multipoint video conference, and the new video conference is received regardless of the ongoing video conference. The main control means determines whether the video conference terminal participates in the multipoint video conference,
During a multipoint video conference, a temporary connection between the multipoint video conference terminal and another new video conference terminal will be possible, and it will be possible to judge whether to participate in the multipoint video conference via communication by that connection An advantageous effect is obtained.

An audio / video codec for encoding and decoding audio and video is provided, and the multipoint conference control means encodes a self-picture from the image input unit to the new video conference terminal by the audio / video codec. The transmission / reception image is switched by the image switching unit so that the transmission / reception unit receives the transmission image from the new video conference terminal and displays it on the monitor after the audio / video codec unit performs the decoding process. The control means establishes terminal-to-terminal communication with the new video conference terminal via the network interface unit, which is advantageous in that it can accurately determine whether the new video conference terminal participates in a multipoint video conference. The effect is obtained.

Further, according to the multipoint video conference method of the present invention, an incoming call from another new video conference terminal is accepted during the multipoint video conference, and the new video conference is performed irrespective of the ongoing video conference. By determining whether a terminal participates in a multipoint videoconference, a temporary connection between the videoconference terminal and another new videoconference terminal is possible during the multipoint videoconference, and communication via the connection is established. This has an advantageous effect that it is possible to determine whether or not to participate in all multipoint video conferences.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a video conference terminal according to Embodiment 1 of the present invention.

FIG. 2 is a functional block diagram showing software for controlling the operation of the video conference terminal shown in FIG. 1;

FIG. 3 is a block diagram showing a multipoint video conference system including the video conference terminal shown in FIG. 1;

4A is a terminal connection diagram showing a video conference terminal connection state before execution of a temporary connection; FIG. 4B is a terminal connection diagram showing a video conference terminal connection state after execution of a temporary connection; Terminal connection diagram showing terminal connection status (d) Terminal connection diagram showing video conference terminal connection status after execution of temporary connection

FIG. 5 is a flowchart showing temporary connection processing;

6A is an image showing a mixing image at four points. FIG. 6B is an image showing an image transmitted from each point. FIG. 6C is an image showing an image transmitted from each point. Image diagram showing images (e) Image diagram showing transmitted images from each point

FIG. 7A is a diagram showing a video conference at a three-point location. FIG. 7B is a diagram showing a video conference at a three-point location. Image when you are

8A is an image diagram showing a display image of a conference proceeder's side video conference terminal when a connection is made to a video conference terminal of a temporary connection partner during a multipoint video conference; FIG. Image showing a display image of another video conference terminal when a connection is made with the video conference terminal of the temporary connection partner at the time (c). A connection was made with the video conference terminal of the temporary connection partner during the multipoint video conference. Image showing a display image of another video conference terminal in the case (d) Image showing a display image of a video conference terminal of a temporary connection partner connected to a video conference terminal on the side of a conference organizer during a multipoint video conference

9A is an image showing an image of a video conference terminal in a multipoint video conference at four locations. FIG. 9B is an image showing an image of another video conference terminal in a multipoint video conference at four locations. Image diagram showing an image of another video conference terminal in a multipoint video conference with four locations (d) Image diagram showing an image of another video conference terminal in a multipoint video conference with four locations

FIG. 10 is a block diagram of a conventional video conference system.

[Explanation of symbols]

 Reference Signs List 6 remote control 7 monitor 8 camera 9 speaker 10 microphone 11 image synthesizing unit 12 image switching unit 13 audio synthesizing unit 14, 15, 16 audio / video codec unit 17, 18, 19 multiplexing / separating unit 20, 21, 22 network interface unit 23, 24, 25 Communication block 26 Multipoint conference control means 27 Screen control means 28 Camera control means 29 Remote control control means 30 Main control means 31, 32, 33 Communication block control means 34 Video conference terminal 35, 36, 37 Video conference terminal 38 Digital Network

Claims (3)

[Claims] Communication block control means for performing a temporary connection process with a new video conference terminal different from a video conference terminal during a video conference to establish terminal communication with the new video conference terminal; A self-portrait is transmitted to the new video conference terminal, and a multipoint conference control unit that switches transmission / reception images so as to receive the transmission image from the new video conference terminal in the own device, and the new video conference terminal is connected to the conference. A main control means for performing an additional process to the conference when it is decided to participate, and a disconnection process for the new video conference terminal when it is decided not to participate in the conference. Terminal. 2. An audio / video codec unit for encoding and decoding audio and video, wherein the multipoint conference control means transmits a self-picture from an image input unit to the new video conference terminal by using the audio / video codec. The transmission / reception image is transmitted by the image switching unit so that the transmission / reception image is transmitted from the new video conference terminal to the own apparatus, and the audio / video codec unit displays the image on the monitor after the decoding processing. 2. The video conference terminal according to claim 1, wherein the communication block control unit establishes terminal-to-terminal communication with the new video conference terminal via a network interface unit. 3. A communication establishing step of performing a temporary connection process with a new video conference terminal different from the video conference terminal during the video conference to establish terminal-to-terminal communication with the new video conference terminal. An image switching step of transmitting a self-image to the new video conference terminal, and switching the transmission / reception image so as to receive the transmission image from the new video conference terminal, and causing the new video conference terminal to participate in the conference. When the decision is made, additional processing to the meeting,
A multipoint videoconference method comprising: a conference participation determination step of performing disconnection processing of the new videoconference terminal when it is determined that the new videoconference terminal is not to participate in the conference.