JPH08298653A - Video conference system and its terminal equipment - Google Patents

Abstract

PURPOSE: To easily manage the progress of a conference by individually managing the speaking right of general terminals by a chairman's terminal and informing all terminals of the movement of speaking right. CONSTITUTION: General terminals A to E requesting speaking right send speaking right acquisition request data to a chairman terminal X. The terminal X analyzes the input data by a data preparing/analyzing device 18, sends speaking right acquisition request data to a conference control device 44, displays the speaking right acquisition requesting terminal on the screen of a monitor 30, ad inquires of its user about permission/nonpermission. When the user of the terminal X executes input operation for permission of speaking right, the device 44 checks the existence of a terminal having speaking right while referring to a speaking right management table stored on a hard disk device 16. When the terminal having the speaking right exists, the address of the terminal is temporarily stored and a terminal newly acquiring speaking right is reported to respective conference terminals.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a television conference system and its terminal device, and more particularly to a television conference system and its terminal device for mutually communicating video and audio between a plurality of conference terminal devices via a communication network.

[0002]

2. Description of the Related Art Video, audio, and other data can be mutually transmitted in real time between a plurality of terminal devices at remote places via a communication line, which is known as a so-called video conference system or video conference system. There is. In such a communication system, when there are a plurality of conference participants (terminals), one of the arbitrary participants of the video conference serves as the chair of the conference, as in a normal conference. Specifically, the terminal that is the chairperson adjusts the microphone volume of each of the other conference terminals and controls the conference so that the talk of the speaker can be easily heard.

On the screen of each conference terminal of the conventional video conference system, as shown in FIG. 10, the image from each conference terminal is always displayed in a constant display area regardless of whether or not the user has the right to speak. It has become so. In FIG. 10, a video conference is held by five terminal devices, and images from the four terminals A, B, C, D, and E are displayed on the monitor screen.

[0004]

As the number of terminals participating in the conference increases, the number of display areas for displaying the image transferred from each conference terminal increases, and who controls the microphone volume alone has a right to speak. It becomes difficult to inform other conference participants (terminals) whether or not they have. For example, in the conventional example, there is a problem in that it is difficult to manage the progress of the conference because the chairperson terminal notifies the other conference terminals of the transfer of the floor by voice.

The video display area for displaying the video transferred from another conference terminal on each conference terminal screen is always of a constant size regardless of the presence or absence of the floor, and any identification indicating the floor is identified. Since it is displayed without any means, there is a problem that it is very difficult to know who has the right to speak and who is currently speaking just by looking at the screen.

An object of the present invention is to solve these problems and to provide a video conference system and a terminal device for the video conference system, which facilitates management of conference progress.

It is another object of the present invention to provide a video conference system and a terminal device for the video conference system, which can easily visually recognize who can speak and who is speaking.

[0008]

A video conference system according to the present invention is a video conference system in which a plurality of conference terminal devices transfer video and audio to each other via a communication network. Is a chairman terminal device that manages the progress of the conference, and the chairman terminal device accepts a floor acquisition request from each conference terminal device during the conference,
Speaking right deciding means for deciding whether or not to give a speaking right to the conference terminal device which has issued the speaking right acquisition request, notifying means for notifying each conference terminal device of the conference terminal device having acquired the speaking right, and acquisition of the speaking right A conference terminal device other than the chairperson terminal device, which creates data for requesting to obtain the floor, and transmits the data to the chairman terminal device. And a display area control means for controlling a display portion assigned to each terminal according to the conference control data from the chairman terminal device.

The speaking right determining means includes a displaying means for displaying a speaking right acquisition request from each conference terminal device to a user of the chairman terminal device and an operating means for inputting whether or not the speaking right is granted by the user. Become.

Preferably, the chairperson terminal device is a terminal device that operates in the chairperson mode, and the conference terminal device is a terminal device that operates in the normal mode.

A terminal device according to the present invention is a terminal device in a video conference system in which a plurality of terminal devices, including one terminal device acting as a chairman, transfer video and audio to each other via a communication network. A speaking right decision means that accepts a speaking right acquisition request from each terminal device during progress and decides whether to give a speaking right to the terminal device that issued the speaking right acquisition request, and a terminal that acquires the speaking right to each terminal device It is provided with a notifying unit for notifying the device and a storage unit for storing the speaking right acquisition terminal information for managing the acquisition status of the speaking right, and operates as the terminal device serving as the chair.

The terminal device according to the present invention is also a terminal device in a video conference system in which a plurality of terminal devices including one terminal device acting as a chairman transfer video and audio to each other via a communication network. In accordance with the voice acquisition request transmission means that creates the voice acquisition request data and sends it to the terminal device that becomes the chair, and the display part assigned to each terminal according to the conference control data from the terminal device that becomes the chair. And a display area control unit for controlling the display area.

[0013]

With the above-described means, the chairperson terminal can individually manage the speaking right of a general terminal and can immediately and automatically notify all terminals of the movement. On all terminals, the video image display area of the speaking right holder is displayed in a different size from the moving image display area of the person who does not have the speaking right due to the conference control data. It will be visually obvious and easy to check.

[0014]

Embodiments of the present invention will be described below in detail with reference to the drawings.

FIG. 1 shows a schematic block diagram of the system configuration of an embodiment of the present invention. Terminals X, A, B, C,
D and E are connected to each other via a communication network to hold a video conference. In FIG. 1, the internal configuration of only the terminal X is shown in detail in a block diagram, but the other terminals AE basically have the same configuration as the terminal X.

The configuration of the terminal X will be described. 10 is a CPU that controls the whole, 12 is a ROM that permanently stores fixed data and programs, 14 is a RAM that is a work area of the CPU 10, 16 is identification information of a communication partner in a video conference, and a monitor screen A hard disk device that stores attribute information and the like when it is displayed on the display device 18 analyzes data received and creates transmission data.
An analysis device 20 is a communication control device that controls communication with other terminals A to E via a communication line.

Reference numeral 22 is an image processing device for encoding a video signal to be transmitted to another terminal and decoding an encoded video signal transferred from the other terminal, and 24 is an audio signal to be transmitted to the other terminal. Is a voice processing device for encoding and encoding encoded voice signals transferred from other terminals.

Reference numeral 26 is an image input / output control device for controlling video input from the video camera 26 and video output to the monitor 30, and 32 is audio input for controlling audio input from the microphone 34 and audio output to the speaker 36. It is an output control device. Reference numeral 38 is a user interface for receiving inputs from the mouse 40 and the keyboard 42.

Reference numeral 44 manages the speaking right of other terminals in the chairperson mode, and in the general mode, creates a speaking right acquisition request for the chairperson and controls each unit in accordance with a control command from the chairperson mode terminal. It is a conference control device that operates.

Reference numeral 46 denotes each of the above elements 10 to 26, 32,
A system bus interconnecting 38 and 44.

In this embodiment, the data creating / analyzing apparatus 1
8, the image processing device 22, the audio processing device 24, and the conference control device 44 are illustrated as functional elements different from the CPU 10, but all or some of the functions possessed by the CPU 10
It is obvious that this can be realized by individual program modules or tasks of the above. In FIG. 1, terminals A to E,
For the purpose of clarifying that X has these functions, C
It is shown separately from the PU 10.

In this embodiment, any one of the terminals A to E and X is used.
The table is in chair mode and the other terminals operate in general mode.

FIG. 2 shows an operation flow chart when the terminal X operates in the chairperson mode. First, when waiting for input from another general terminal (S1) and some data is input (S1), the data creation / analysis device 18 receives the input data from the communication control device 20 and analyzes the input data. (S2).

When the input data is data other than the voice acquisition request data (for example, camera control command and drawing data) (S3), other processing according to the data content is executed (S12). The details of the other processes are irrelevant to the features of this embodiment, and thus the description thereof is omitted.

When the input data is the voice acquisition request data (S3), the data creation / analysis device 18 transfers the voice acquisition request data to the conference control device 44. FIG.
Is an example of the structure of data for requesting to speak. The speaking right acquisition request data includes a data identifier indicating the content of the data, a speaking right acquisition request terminal name indicating the requesting source of the speaking right, and an address (telephone number or the like) of the speaking right acquisition request terminal.

The conference controller 44, in accordance with the data for requesting the right to speak from the device 18, sends the user information as shown in FIG.
The speaking right acquisition request terminal is displayed on the monitor screen through the interface, and the user is asked whether the speaking right acquisition request is permitted or not (S4).

When the user of the chairman terminal performs an input operation that does not allow the speaking right (S5), the process returns to S1 and waits for the next input.

On the other hand, when the user of the chairman terminal performs an input operation for permitting the right to speak (S5), the conference controller 44
By referring to the floor management table stored in the hard disk device 16 (S6), it is checked whether or not there is a terminal currently holding the floor (S7). FIG. 5 shows the structure of the management table. The management table is composed of a terminal name, a terminal address, and each piece of information on a floor acquisition status indicating whether or not to have a floor. If there is a terminal that currently has the speaking right (S7), the terminal address is temporarily stored,
The voice acquisition status of the management table shown in FIG. 5 is rewritten to "none" to deprive the voice (S8).

The conference controller 44 sets the speaking right to the terminal newly permitted to speak in S5 (specifically, FIG.
In the management table shown in (1), the data of the current right to hold is stored in the column of the acquisition status of the right to speak of the terminal) (S
9) Instruct the data creation / analysis device 18 to create information for notifying each conference terminal of a new acquirer of the floor, here, conference control data (S10). The data creation / analysis device 18 creates conference control data having the structure shown in FIG. The conference control data indicates a data identifier for identifying the data content, a new speak right acquisition terminal address consisting of the terminal address of the new speak right acquisition terminal, and whether or not there is a terminal currently holding the speak right. It is composed of a speaking right holding terminal existence flag and a speaking right holding terminal address indicating a terminal address of the speaking right holding terminal when there is a terminal holding the speaking right now. The speaking right holding terminal address is temporarily stored in S8.

After that, the conference control device 44 transmits the created conference control data to each of the conference terminals AE through the communication control device 20 and the communication line (S11). In this way, the conference terminal operating in the chair mode notifies the other conference terminals of the new floor acquisition terminal.

Next, the operation when the terminal X operates in the general mode will be described with reference to FIG. In FIG. 7, terminal A
Is the chairman's terminal.

When any data is input in the input waiting state (S21), the data creation / analysis device 18 receives the input data from the communication control device 20 and analyzes the input data (S22). When the input data is other than the conference control data (S23), the process according to the content of the input data is executed (S30).

If the input data is conference control data (S23), the data creation / analysis device 18 transfers the conference control data to the conference control device 44, and the conference control device 44 transmits the conference control data. It analyzes (S24) and instructs each processing unit to perform processing according to the content. Specifically, the presence / absence of a floor holding terminal (FIG. 6) is identified by the floor holding terminal presence flag of the conference control data (S25). The image input / output control device 26 is instructed to change the display mode of the video display area assigned to the terminal specified by the speaking right holding terminal address (FIG. 6) of the control data to the initial setting state (S26). Depending on the image input control device 26
Changes the corresponding video display area to the initial size (here, it is reduced). At the same time, the key control device 44
The voice processing device 24 is instructed to stop the voice output from the terminal which has been deprived of the right to speak. As a result, the deprivation of the right to speak on the management table of the chairman terminal is actually effective.

Next, the conference control device 44 identifies the conference terminal that newly acquired the right to speak based on the new speech acquisition terminal address of the conference control data (S27). If the terminal that has newly acquired the right to speak is other than the terminal itself (S28), the conference control device 44 instructs the image input / output control device 26 to enlarge the display area for displaying the video from the specified terminal. In response to the instruction, the image input / output control device 26 enlarges the designated video display area to a predetermined size (S29). At the same time, the key control device 44 instructs the audio processing device 24 to enable the audio output from the terminal which newly acquired the floor. As a result, the speaking right set on the management table of the chairperson terminal is actually valid.

For example, when the conference terminal B has the right to speak at present, the monitor screen of the terminal X shows that the image display area of the conference terminal B is larger than the image display areas of the other terminals, as shown in FIG. Is also set large. If the speaking right is transferred to the terminal C from this state, the monitor screen of the terminal X which has received the conference control data has the normal size of the image display area of the terminal B as shown in FIG. The image display area of the terminal C is enlarged while being reduced in size. As described above, in this embodiment, the image from the terminal that has the speaking right is displayed in a larger size than the image from the terminal that does not have the speaking right, so that it becomes clear at a glance who has the speaking right. The movement of the speaking right can be easily understood on the monitor screen.

In the above embodiment, the current speaking right holding terminal can be visually identified by enlarging the video display area. However, the terminal name portion displayed in the video display area or below it can be identified. Obviously, the display may be performed in a specific display mode (for example, the background or the frame may be displayed in a specific color). Also, instead of or in combination with these, an icon suggesting audio output may be displayed at an adjacent position inside or outside the video display area.

Although the embodiment of the exclusive control in which only one terminal has the right to speak at any moment has been described, the present invention makes a statement even if two or more terminals can simultaneously hold the right to speak. Obviously, it is effective as a means for clearly indicating the right holder on the monitor screen. When there is more than one floor holder, a method for clearly indicating the current speaker is, for example, in synchronization with the voice output from each floor-holding terminal, and in proximity to the video display area corresponding to that terminal. Or overlapping and displaying icons while changing the icon that symbolizes the speech (for example, a speaker or an icon that implies the mouth),
You can also display the audio level meter.

[0038]

As can be easily understood from the above description, according to the present invention, it is possible to easily visually confirm who currently has the right to speak. Therefore, the movement of the right to speak can also be visually confirmed easily. As a result, the chairperson can facilitate the meeting.

[Brief description of drawings]

FIG. 1 is a schematic block diagram of an embodiment of the present invention.

FIG. 2 is an operation flowchart of a chairperson mode.

FIG. 3 is an example of a format of data for requesting a right to speak.

FIG. 4 is a user interface for deciding whether to speak or not.

FIG. 5 is an example of a floor management table.

FIG. 6 is an example of a format of conference control data.

FIG. 7 is an operation flowchart of a general mode.

FIG. 8 is an example of a monitor screen of the present embodiment.

FIG. 9 is another example of the monitor screen of the present embodiment.

FIG. 10 is an example of a monitor screen of a conventional example.

[Explanation of symbols]

 X, A, B, C, D, E: Terminal 10: CPU 12: ROM 14: RAM 16: Hard disk device 18: Data creation / analysis device 20: Communication control device. 22: Image processing device 24: Audio processing device 26: Image input / output control device 26: Video camera 30: Monitor 32: Audio input / output control device 34: Microphone 36: Speaker 38: User interface 40: Mouse 42: Keyboard 44 : Conference control device 46: System bus

Claims (13)

[Claims] 1. A video conference system in which a plurality of conference terminal devices transfer video and audio to each other via a communication network, and one of the plurality of conference terminal devices serves as a chairman terminal device for managing the progress of the conference. , The chairman terminal device receives a floor right acquisition request from each conference terminal device during the conference, and a floor right determination means for determining whether or not to give the floor right to the conference terminal device that has issued the floor right acquisition request, The conference terminal device is provided with notifying means for notifying the conference terminal device that has acquired the floor, and storage means for storing the floor acquisition terminal information for managing the acquisition status of the floor. The conference terminal device of 1 creates a voice acquisition request data and assigns it to each terminal according to the voice acquisition request transmission means for transmitting to the chairman terminal device and the conference control data from the chairman terminal device. A video conference system comprising: a display area control means for controlling the allocated display portion. 2. The speaking right determination means displays a speaking right acquisition request from each conference terminal device to a user of the chairman terminal device, and an operating means by which the user inputs and determines whether or not to grant the speaking right. The video conference system according to claim 1, comprising: 3. The video conference system according to claim 1, wherein the chairperson terminal device is a terminal device that operates in a chairperson mode, and the conference terminal device is a terminal device that operates in a normal mode. 4. The display area control means displays the display portion assigned to the terminal having the floor in a manner different from the display portion assigned to the terminal not having the floor. 3. The video conference system according to any one of 3 above. 5. The display area control means displays the moving image display area assigned to the terminal holding the floor in a larger size than the moving image display portion assigned to the terminal not holding the floor. Video conferencing system described. 6. A terminal device in a video conference system in which a plurality of terminal devices, including one terminal device acting as a chairperson, mutually transfer video and audio via a communication network, and each terminal device is in progress during the meeting. And a notification means for notifying each terminal device of the terminal device that has acquired the floor right, and a determination unit that determines whether or not to give the floor right to the terminal device that has issued the floor right acquisition request. And a storage unit for storing speaking right acquisition terminal information for managing the status of obtaining a speaking right, and operates as a terminal device serving as a chair. 7. Further, according to the speaking right acquisition request transmitting means for creating the speaking right acquisition request data and transmitting it to the chairing terminal device, and each terminal in accordance with the conference control data from the chairing terminal device. 7. The terminal device according to claim 6, further comprising a display area control unit that controls a display portion assigned to the terminal, and operates as a general conference participant. 8. The speaking right deciding means comprises a displaying means for displaying to the user a speaking right acquisition request from each terminal device, and an operating means for inputting whether or not the user can grant the speaking right. Alternatively, the terminal device according to item 7. 9. The display area control means displays the display portion assigned to the terminal having the floor in a manner different from the display portion assigned to the terminal not having the floor. 8. The terminal device according to item 8. 10. The display area control means displays the moving image display area assigned to the terminal holding the floor in a larger size than the moving image display portion assigned to the terminal not holding the floor. The terminal device described. 11. A terminal device in a video conference system in which a plurality of terminal devices, including one terminal device acting as a chairperson, mutually transfer video and audio via a communication network,
In accordance with the voice acquisition request transmission means that creates the voice acquisition request data and sends it to the terminal device that becomes the chair, and the display part assigned to each terminal according to the conference control data from the terminal device that becomes the chair. A terminal device, comprising: a display area control unit for controlling. 12. The display area control means displays the display portion assigned to the terminal that has the floor in a manner different from the display portion assigned to the terminal that does not have the floor. The terminal device described. 13. The display area control means displays the moving image display area assigned to the terminal holding the floor, larger than the moving image display portion assigned to the terminal not holding the floor. The terminal device described.