JPH06121309A - System and method for multipoint video conference - Google Patents

Abstract

PURPOSE:To allow a specific participant to be noted by the other participant. CONSTITUTION:A conference terminal 1000a is equipped with a transmission control part 1600a which controls the synthesis and distribution of a video and a voice. Then, the transmission control part 1600a transmits a request signal for the emphatic output of conference information to each conference terminal 1000b, 1000c, 1000d, and 1000e according to an input from a keyboard 1500a, and only the video and voice of a participant 1000a are reproduced at each conference terminal 1000b, 1000c, 1000d, and 1000e. Thus, the participant 1000a can be allowed to temporarily noticed by entire participants 1a-1e, and the conference can be smoothly advanced.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multipoint video conference system in which video data output from a camera and audio data output from a microphone are transmitted to a plurality of conference terminals of other parties through a communication network and reproduced on a monitor and a speaker. In particular, the present invention relates to a multipoint video conference system and a conference method suitable for making a participant of a conference pay attention to a specific participant.

[0002]

2. Description of the Related Art Conventionally, a multipoint video conference system for reproducing video and audio at each point to terminals at a plurality of other points via a communication network is disclosed, for example, in Japanese Patent Laid-Open No. 2-63288.
As described in JP-A-2-63289 and the document "Multimedia distributed presence conference system MERMAID (Information Processing Society of Japan, Vol.32, No.9, 1991)", workstations at respective points are ISDN, LAN. There is one that combines and connects and broadcasts video and audio from each point to each point. However, here, since the video and audio of each point are once captured by the server and transmitted via the server, the video and audio editing functions are concentrated in one server, and are displayed at each point. It is possible to limit the screen operation of video and the playback operation of audio.

Further, in the multipoint video conference system described in Japanese Patent Laid-Open No. 2-302159, a screen editing unit is provided in each terminal, video and audio of all points are taken into the terminals of each point, and output control of video and audio is performed. Can be performed locally on the terminal side. JP-A-2-67891 and the document "B-IS"
Multipoint multimedia communication conference system for DN PM
TC (Technical Report of IEICE, OS90-34, Vol.
90, N0.201, 1990) ”, the multi-point video conference system is a broadband ISDN (BI) which is a next-generation communication network.
SDN) is supposed to be used, high-quality video and audio are transmitted, and the display position and size of the video at an arbitrary point can be freely changed. Further, JP-A-2-67891
In the multi-point video conference system described in No. 3, only a limited number of images from each point are displayed to provide a screen that is easy for each participant to see. However, these conventional techniques do not consider the fact that the entire conference system via the communication network focuses attention on the conference information related to a specific participant.

[0004]

In the above conventional method, once the conference starts, the received video and audio are output according to the independent asynchronous operation of the participants of each terminal, so that all the participants can be specified in the entire system. There was a problem that I couldn't get the participants to pay attention to.

An object of the present invention is to provide a multipoint video conference system and method in which each participant can make other participants pay attention to a specific participant.

[0006]

[Means for Solving the Problems] The above object is to provide a request signal for more emphasized output of conference information including video and audio for a specific participant from the terminal of the specific participant to each other. This is achieved by transmitting the information to the participant's terminal and reproducing the conference information at each terminal as specified by the received request signal. Further, a priority is assigned to each terminal, and when a plurality of emphasis requests are simultaneously made from each terminal that operates independently and asynchronously, priority control according to the priority is performed. Further, in order to allow an arbitrary terminal to focus attention on the conference information related to the other arbitrary terminal, the arbitrary terminal may be able to transmit a request signal to the other arbitrary terminal.

[0007]

According to the present invention, an arbitrary terminal transmits to another terminal a request signal for outputting the participant's own video and audio conference information in a more emphasized manner. , When an emphasis request signal is received from another terminal, the conference information of the participant specified by the received request signal is emphasized and played back, so that a specific video or audio etc. can be displayed to other participants. It can be easily noticed and the conference can proceed smoothly.

Further, according to the present invention, by setting the priority of each terminal in advance, priority control can be performed for a plurality of emphasis requests, and the received request signal is reserved by each terminal. This makes it possible to respond to a plurality of emphasis requests in the order of reservation. Furthermore, by transmitting a request signal related to the conference information of other participants, it is possible to focus attention on any participant other than oneself, and by including the output form of the conference information in the request signal, an arbitrary form can be obtained. You can also use the meeting information in to draw attention to any participant.
Furthermore, by including an instruction to cancel the emphasis request in the request signal, the attention of the participant can be canceled at any timing.

[0009]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to the drawings. FIG. 1 shows a configuration example of a multipoint video conference system according to the present invention. In the figure, 1 (1a, 1b, 1c, 1
d and 1e) are participants of the conference, 1000 (1000a,
1000b, 1000c, 1000d and 1000e)
Is a conference terminal for each of the participants 1a, 1b, 1c, 1d and 1e, and 2000 is a communication network for connecting each conference terminal 1000. In the conference terminal 1000a, 1100a is a camera that shows the participant 1a, and 1200a is a communication network 2000.
Monitor for displaying the video signal received from the screen, 1300
a is a microphone for collecting the voice of the participant 1, 1400
Reference numeral a denotes a speaker for reproducing a voice signal received from the communication network 2000, and reference numeral 1500a denotes an operating keyboard for the participant 1a. Reference numeral 1600a denotes a transmission control unit that takes in a video signal from the camera 1100a, an audio signal from the microphone 1300a, and a control signal from the keyboard 1500a,
It transmits to the other conference terminal 1000 via the communication network 2000, receives the video signal, the audio signal and the control signal from the other conference terminal 1000 via the communication network 2000, outputs the video signal to the monitor 1200a, and outputs the audio signal. The speaker 140
Output to 0a. Other conference terminals 1000b to 1000e
Also in the above, the camera 1100, the monitor 1200, the microphone 1300, the speaker 1400, the keyboard 1500, and the transmission control unit 1 which have the same configuration as the conference terminal 1000a.
Equipped with 600. In the present embodiment, the monitor 12
The case where a plurality of videos are displayed in four divisions on the screen No. 00 has been described, but the present invention is not limited to this, and is similarly applicable to a case where a plurality of videos are displayed in a multi-window. Is.

FIG. 2 shows an example of the configuration of the transmission control unit 1600. Reference numeral 1610 denotes a video distribution unit that outputs the video signal from the camera 1100 as many as the number of connected conference terminals, 162
0 is a video synthesizing unit for synthesizing video signals received from a plurality of conference terminals and outputting them to the monitor 1200, 1630 is an audio distributing unit for outputting audio signals from the microphone 1300 as many as the number of conference terminals connected, and 1640 is A voice synthesis unit that synthesizes voice signals received from a plurality of conference terminals and outputs the synthesized voice signals to the speaker 1400. 1650 is a conference control unit,
A synchronization signal for displaying an image on the monitor 1200 is sent to the image synthesizing unit 1620, and the image distributing unit 1610 and the image synthesizing unit 162 are in accordance with the contents of the control signal from the keyboard 1500 or the control signals received from the plurality of conference terminals.
0, by controlling the audio distributor 1630 and the audio synthesizer 1640, the input / output of the video signal and the audio signal is operated, and the control signal from the keyboard 1500 is output by the number of connected conference terminals. A transmission encoding / decoding unit 1660 takes in the video signal from the video distribution unit 1610, the audio signal from the audio distribution unit 1630, and the control signal from the conference control unit 1650, and transmits the communication signal to the communication network 2000 and the communication network 2000. The video signal, the audio signal, and the control signal received by the video synthesizer 1620 and the audio synthesizer 164, respectively.
0 and the conference control unit 1650. Conference control unit 16
Reference numeral 50 includes a processor 1651, a bus 1652, a main memory 1653, and a disk 1654. The processor 1651 reads and processes various programs (details will be described later) held in the main memory 1653 one by one.

FIG. 3 shows an example of the configuration of the video synthesizing unit 1620. A switcher 1621 outputs a plurality of video signals input from the transmission encoding / decoding unit 1660 to the four-division device 1622 and also selects a video signal designated by the conference control unit 1650 and outputs it to the scan converter 1623. Reference numeral 1622 is a four-division device for reducing and synthesizing a plurality of video signals input from the switcher 1621 to output one screen. 1623 edits the video signal input from the switcher 1621 into a display form designated by the conference control unit 1650, and switches or superimposes the video signal input from the four-division device 1622 on the monitor 1 as one screen.
This is a scan converter for outputting to 200.

An example of the screen output by the video synthesizing unit 1620 is shown in FIGS. 10, 14, 19 and 25. In the present embodiment, the case where one scan converter, a four-division device and a switcher are used has been described as a configuration for editing an arbitrary video in a designated form and displaying a plurality of videos on one screen. However, the present invention is not limited to this, and can be similarly realized by, for example, connecting a plurality of scan converters in cascade. Further, in the present embodiment, by inputting the WS screen display signal together with the video signal to the scan converter, it is possible to display the video and the WS screen in a superimposed manner on one screen.

FIG. 4 shows an example of the configuration of the transmission encoding / decoding unit 1660. 1661-1 to 1661-n encode the video signals from the video distribution unit 1610, output the encoded video signals to the multiplexing / demultiplexing units 1664-1 to 1664-n, and input from the multiplexing / demultiplexing units 1664-1 to 1664-n. Video CODE for decoding the video signal and outputting it to the video synthesizing unit 1620
C section, 1662-1 to 1662-n are audio distribution section 163.
The audio signals from 0 are encoded and multiplexed / demultiplexed 166
4-1 to 1664-n and outputs to the multiplexer / demultiplexer 1664.
It is a voice CODEC unit that decodes voice signals input from -1 to 1664-n and outputs them to the voice synthesis unit 1640. 1663-1 to 1663-n are conference control units 1650
Receiving the control signal from the multiplexer / demultiplexer 1664
-1 to 1664-n, and the multiplexing / demultiplexing unit 1664-
Control signal I / F unit for receiving control signals from 1 to 1664-n and outputting them to the conference control unit 1650, 1664-1
To 1664-n are video CODEC units 1661-1 to 166-16
61-n, audio CODEC section 1662-1 to 1662-
n and control signal I / F section 1663-1 to 1663-n
The video signal, the audio signal, and the control signal from the circuit are multiplexed and output to the line I / F unit 1665.
5 is a multiplexer / demultiplexer that separates the multiplexed signal from 5 into a video signal, an audio signal, and a control signal before multiplexing. 1665
Transmits the multiplexed signals from the multiplexing / demultiplexing units 1664-1 to 1664-n to the communication network 2000, and multiplexes signals received from the communication network 2000 to the multiplexing / demultiplexing units 1664-1 to 1664.
It is a line I / F unit that outputs to -n.

Selection request / recorded in the main memory 1653 of the conference controller 1650 and processed by the processor 1651.
The flow of the selection release transmission process is shown in FIG. In step 10, the input from the keyboard 1500 is monitored, and if the input of the request for emphasizing the conference information is detected, the process proceeds to step 12, and in accordance with the request for emphasizing the conference information, a control signal having “emphasize request” as control information is connected. The number of conference terminals that are in use is output.
In step 14, the input from the keyboard 1500 is monitored, and if the input to de-emphasize the conference information is detected, the step 1
In step 6, in accordance with the cancellation of the emphasis on the conference information, the control signal having the control information of “de-emphasized” is output by the number of connected conference terminals.

Processor 1651 of conference controller 1650
FIG. 6 shows the flow of the emphasis request / emphasis cancellation reception process processed by
Shown in. In step 20, the transmission encoding / decoding unit 16
The input from 60 is monitored, and if a control signal having "enhancement request" as control information is detected, the process proceeds to step 22, where conference information emphasis request processing is performed.
The input from the decoding unit 1660 is monitored, and if a control signal having "emphasis cancellation" as control information is detected, the process proceeds to step 26, and conference information emphasis cancellation processing is performed.

FIG. 7 shows a flow of the conference information emphasis request processing in step 22. In step 30, the video distribution unit 161
0, control the transmission of the video signal to other than the conference terminal that has transmitted the control signal having the control information of "emphasis request", and in step 32, control the audio distribution unit 1630 to control the "emphasis request" control information. The transmission of the audio signal to other than the conference terminal that has transmitted the control signal is stopped, and in step 34, the video synthesizing unit 1620 is controlled to output to the monitor 1200.
Switching to the video signal of only the conference terminal that has transmitted the control signal having the “emphasized request” as the control information, and in step 36, controls the voice synthesizing unit 1640 to output to the speaker 1400.
It switches to the audio signal of only the conference terminal that has transmitted the control signal with the “emphasized request” as the control information.

FIG. 8 shows the flow of the conference information emphasis cancellation processing in step 26. In step 40, the video distribution unit 1610
Control is performed to return to the processing state before receiving the control signal having the “emphasized request” as the control information, and the transmission of the video signal to each conference terminal is restarted. In step 42, the audio distribution unit 1630.
Control to return to the processing state before the reception of the control signal having the “emphasized request” as the control information, and restart the transmission of the audio signal to each conference terminal. In step 44, the video composition unit 162
0 to return to the processing state before receiving the control signal having “emphasized request” as control information, output the video signal from each conference terminal to the monitor 1200, and control the voice synthesis unit 1640 in step 46. Then, the process returns to the processing state before receiving the control signal having the “emphasized request” as the control information, and the audio signal from each conference terminal is output to the speaker 1400.

Participant 1a's emphasis request and each conference terminal 100
One sequence between 0s is shown in FIG. First, each conference terminal 1
000 is in a normal state 100 for transmitting and receiving a video signal and an audio signal, outputting a necessary video and audio, and executing a multipoint video conference. Next, participant 1a
When the conference terminal 1000a instructs the conference terminal 1000a to emphasize the conference information, the conference terminal 1000a enters the emphasized state 200,
A control signal having "highlight request" as control information is transmitted to the other conference terminals 1000b to 1000e. On the other hand, the other conference terminals 1000b to 1000e that have received the control signal having the “emphasized request” as the control information are in the emphasized state 200 and are switched to the output of only the video and audio of the participant 1a.
Participant 1b corresponding to conference terminals 1000b to 1000e
Participants 1a are made to pay attention to ~ 1e. Then, when the participant 1a instructs the conference terminal 1000a to release the emphasis of the conference information, the conference terminal 1000a enters the normal state 300 and sends a control signal having "release of emphasis" as control information to the other conference terminals 1000b to 1000e. Send. On the other hand, the other conference terminals 1000b to 1000e that have received the control signal with the control information of "highlighting cancellation" are in the normal state 300, and the video before receiving the control signal with the control information of "highlighting request" and Return to audio output and restart the multipoint video conference. In addition, in the present embodiment, the case where the control signal having the “release of emphasis” as the control information is transmitted in response to the input from the participant has been described, but it goes without saying that the input does not depend on the input from the participant. A timer may be started after transmitting a control signal having "emphasis request" as control information, and a control signal having "emphasis cancellation" as control information may be transmitted after a predetermined time has elapsed.

FIG. 10 shows an example showing the relationship between the conference state and the output of video and audio from each conference terminal 1000. In the normal state 100, the monitor 120 of the conference terminal 1000a
0a and the speaker 1400a reproduce the video and audio of the other participants 1b to 1e, respectively. Similarly, the other participants 1a to 1e are connected to the monitors 1200 and the speakers 1400 of the other conference terminals 1000b to 1000e, respectively.
The video and audio of are being played. Next, when the highlighted state 200 is entered, the video and audio of the participants 1b to 1e are reproduced on the monitor 1200a and the speaker 1400a of the conference terminal 1000a, respectively, similarly to the normal state 100, but the monitors of the conference terminals 1000b to 1000e are reproduced. Only the video and audio of the participant 1a are uniformly reproduced on the 1200 and the speaker 1400. When the normal state 300 is reached,
The monitor 1200a and the speaker 1 of the conference terminal 1000a
As in the normal state 100, the video and audio of the participants 1b to 1e are reproduced in 400a. Similarly, the video and audio of the other participants 1a to 1e are reproduced on the monitors 1200 and the speakers 1400 of the conference terminals 1000b to 1000e, respectively, and the video and audio reproduction states of the normal state 100 are restored.

According to this embodiment, the participants at all points can be easily made to pay attention to themselves during the conference, and the conference can proceed smoothly. Further, in the emphasized state, all conference terminals other than the conference terminal that transmitted the emphasis request output only the video and audio of the participant of the conference terminal that transmitted the emphasis request, and the video and audio of other participants. Is stopped and the video and audio of the participants are transmitted only to the conference terminal that transmitted the emphasis request. Therefore, the communication cost can be reduced in the emphasized state by reducing the transmission amount.

In the above embodiment, the case where one participant independently inputs the emphasis request has been described, but the present invention can also be applied to the case where a plurality of participants input the emphasis request. A first embodiment in this case will be described below with reference to the drawings.

First, FIG. 11 shows a flow chart of the emphasis request / emphasis release transmission process corresponding to the case where a plurality of participants input the emphasis request in the conference control unit 1650. In step 10, the input from the keyboard 1500 is monitored, and when the input of the request for emphasizing the conference information is detected, step 50
Proceed to, and compare in advance whether the emphasis request received from another conference terminal is being executed. If not, step 5
3. If it is being executed, go to step 52. In step 52, the priority of the conference terminal corresponding to the emphasis request currently being executed is compared with the priority of the own conference terminal, and if the priority of the conference terminal corresponding to the emphasis request currently being executed is higher, the processing is performed. When the priority of the conference terminal of its own is higher, the process proceeds to step 26, the conference information emphasis cancellation processing is performed, and in step 53, the priority of the conference terminal of its own is added in accordance with the request to emphasize the conference information. A control signal having "highlight request" as control information is output by the number of connected conference terminals, and in step 14, input from the keyboard 1500 is monitored. When the input for de-emphasizing the conference information is detected, the process proceeds to step 55, and according to the de-emphasis of the conference information,
A control signal having “priority release” with priority of its own conference terminal as control information is output by the number of connected conference terminals. On the other hand, when the emphasis release input is not detected in step 14, the process proceeds to step 54, where it is compared whether or not the emphasis request received from the other conference terminal is being executed in advance, and if it is being executed, the process is terminated, If it is not being executed, the process proceeds to step 14.

FIG. 12 shows a flow chart of the emphasizing request / emphasis canceling reception process corresponding to the case where a plurality of participants input the emphasizing request in the conference control unit 1650. Step 20
Then, the input from the transmission encoding / decoding unit 1660 is monitored, and if a control signal having "enhancement request" as control information is not detected, the process proceeds to step 24, and if it is detected, the process proceeds to step 58. In step 58, it is compared whether or not an emphasis request received from another conference terminal in advance or an emphasis request transmitted from its own conference terminal is being executed. If the emphasis request is not being executed, the process proceeds to step 22 to execute the emphasis request. If it is in progress, the process proceeds to step 60, in which the priority of the conference terminal corresponding to the emphasis request currently being executed is compared with the priority of the conference terminal corresponding to the received emphasis request, and the priority request currently being executed is determined. When the priority of the corresponding conference terminal is higher, the process proceeds to step 24, and when the priority of the conference terminal corresponding to the received emphasis request is higher, the process proceeds to step 22. In step 22, the conference information emphasis request process is performed, and in step 24
Then, the input from the transmission encoding / decoding unit 1660 is monitored, and if the control signal having the “de-emphasized” as the control information is not detected, the process returns to step 20. The priority of the conference terminal corresponding to the emphasis request is compared with the priority of the conference terminal corresponding to the received emphasis release. Step 20 if the priorities do not match
Return to step 26, if the priorities match, proceed to step 26,
The conference information emphasis cancellation processing is performed.

FIG. 13 shows a sequence between the emphasis request of the participants 1e and 1a and each conference terminal 1000. First, each conference terminal 1000 transmits and receives a video signal and an audio signal, respectively, outputs necessary video and audio,
You are in the normal state 100 of conducting a multipoint video conference. At this time, the priority levels A, B, and
C, D and E are assigned. It is assumed that A has the highest priority, and B, C, D, and E become lower in this order. Next, the participant 1e sends a request for emphasizing the conference information to the conference terminal 100.
0e, the conference terminal 1000e displays the highlighted state 21
The control signal becomes 0, and the control signal having the "emphasized request" with the priority E as the control information is transmitted to the other conference terminals 1000a to 1000d. On the other hand, when the participant 1a instructs the conference terminal 1000a to emphasize the conference information, the conference terminal 1000a is in the emphasized state 220, and the control signal having the "emphasis request" with priority A as the control information is transmitted to the other conference terminals. 1000b-10
00e. Here, the conference terminals 1000c and 1
000d first receives a control signal having "emphasized request" with priority E as control information, and becomes the emphasized state 210,
The participant 1c corresponding to the conference terminals 1000c and 1000d is switched to the output of only the video and audio of the participant 1e.
Participants 1e are made to pay attention to 1d and 1d. Next, a control signal having "highlight request" with priority A higher than priority E as control information is received to enter the emphasized state 220, and the participant 1
The conference terminal 1 is switched to the output of only the video and audio of a.
Participants 1c and 1d corresponding to 000c and 1000d
On the other hand, the participant 1a is focused on. On the other hand, the conference terminal 10
00b first receives a control signal having "highlighting request" with priority A as control information, enters an emphasized state 220, switches to output only video and audio of the participant 1a, and corresponds to the conference terminal 1000b. Participant 1 against Participant 1b
Focus on a. Next, a control signal having "emphasized request" with priority E lower than priority A as control information is received.
Ignore this emphasis request. Other, conference terminal 1000a
Transmits a control signal having the control information of "emphasis request" with priority A to the other conference terminals 1000b to 1000e, and then uses "emphasis request" with priority E lower than priority A as control information. Receives the control signal but ignores this enhancement request. The conference terminal 1000e transmits a control signal using the “emphasized request” with priority E as control information to the other conference terminals 100e.
After transmitting to 0a to 1000d, a control signal having "highlighting request" with priority A higher than priority E as control information is received to enter the highlighted state 220, and only the video and audio of the participant 1a are output. After switching, the participant 1e corresponding to the conference terminal 1000e is focused on the participant 1a. Then, the participant 1a releases the emphasis of the conference information from the conference terminal 100.
0a, the conference terminal 1000a displays the normal state 3
00, the control signal having the priority level A with "emphasis release" as control information is transmitted to the other conference terminals 1000b to 1000e. On the other hand, the other conference terminal 1000b that has received the control signal with the control information being "release of emphasis" with priority A
~ 1000e becomes the normal state 300, and "emphasized request"
The control returns to the output of video and audio before receiving the control signal having control information as, and restarts the multipoint video conference.

FIG. 14 shows an example of the relationship between the conference state and the output of video and audio from each conference terminal 1000. In the normal state 100, the monitor 120 of the conference terminal 1000a
0a and the speaker 1400a include the participant 1b, respectively.
Play the video and audio of ~ 1e. Similarly, the conference terminal 1
Video and audio of the other participants 1a to 1e are reproduced on the monitors 1200 and the speakers 1400 of 000b to 1000e, respectively. Next, when the emphasis state 210 is reached,
Monitor 1200e and speaker 1 of conference terminal 1000e
In the 400e, the video and audio of the participants 1a to 1d are reproduced as in the normal state 100.
On the monitor 1200c and speaker 1400c of 000c and the monitor 1200d and speaker 1400d of the conference terminal 1000d, only the video and audio of the participant 1e are uniformly reproduced. The conference terminals 1000a and 1000b
Does not enter the emphasized state 210 as described with reference to FIG. When the request 220 is further emphasized, the conference terminal 1000
As in the normal state 100, the video and audio of the participants 1b to 1e are reproduced on the monitor 1200a and the speaker 1400a of a, respectively, but the other conference terminals 1000b to 10b.
00e each monitor 1200 and speaker 1400,
Only the video and audio of the participant 1a are reproduced uniformly. Then, in the normal state 300, the video and audio of the participants 1b to 1e are reproduced on the monitor 1200a and the speaker 1400a of the conference terminal 1000a, as in the normal state 100. Similarly, the other conference terminals 1000b-1
The video and audio of the other participant 1 are reproduced on each monitor 1200 and the speaker 1400 of 000e, and the video and audio reproduction state of the normal state 100 is restored.

According to this embodiment, even when a plurality of participants input an emphasis request, they can be easily accepted according to the priority of the conference terminal, and the conference terminal having a higher priority is immediately provided. You can focus on specific participants.

Next, a second embodiment in which a plurality of participants input emphasis requests will be described. In the multipoint video conference system shown in FIG. 1, each conference terminal 1000 is provided with a table for reserving an emphasis request, and when an emphasis request is received from a plurality of conference terminals, each conference terminal reserves this emphasis request in the table. At the same time, only the conference information designated by the emphasis request that is reserved earliest in the table is reproduced. For example, if the reservation status in the table of each conference terminal is reserving the emphasis request of the conference terminal 1000a, the conference terminal 1
In each of the conference terminals 1000 other than 000a, as shown in the emphasized state 200 of FIG. 10, only the video and audio of the participant 1a are switched to reproduction. At this time, for example, when the conference terminal 1000b transmits a control signal having “highlight request” as control information to each conference terminal 1000, each conference terminal 1000 receives the enhancement request from the conference terminal 1000a currently being executed and then the conference terminal 1000b. Book a stress request from the table. After that, when the conference terminal 1000a transmits a control signal having "release of emphasis" as control information to each conference terminal, each of the other conference terminals 1000b to 1000e that receives the control signal having "release of emphasis" as control information, The playback state of only the video and audio of the participant 1a is canceled. And each conference terminal 1
In 000, the emphasis request from the conference terminal 1000a reserved in the table is canceled, and in the other conference terminals 1000 except the conference terminal 1000b, only the video and audio of the participant 1b are reproduced.

According to the present embodiment, even when a plurality of participants input an emphasis request, all the emphasis requests can be accepted, and a specific participant can be made to pay attention to the reservation order of the emphasis requests.

Further, a third embodiment in the case where a plurality of participants input an emphasis request will be described with reference to FIG. In this example, each conference terminal 1000 is added to the multipoint video conference system.
Server 1020 that can be read and written in common
To provide. This server includes a communication control unit 1021, a conference control unit 1022, a table management unit 1023, and a memory 1024. Each conference terminal 1000 reserves the transmission of the emphasis request by once writing the emphasis request in the table in the memory 1024 of the server 1020 according to the input of the emphasis request from the participant 1. Then, the conference central control unit 1022 transmits an emphasis request from the conference terminal that made the earliest reservation to this server to all other association terminals. For example, when the reservation status of the server table is no reservation, when the participant 1a first inputs a request for emphasizing the conference information, the conference terminal 1000a reserves the server 1020 for the emphasizing request of the conference terminal 1000a. Next, the server confirms the reservation status and makes the earliest reservation for the conference terminal 10
00a is instructed to transmit the emphasis request. Upon receiving the instruction from the server 1020, the conference terminal 1000a transmits a control signal having "emphasizing request" as control information to the other conference terminals 1000b to 1000e, as shown in FIG. Then, each conference terminal 100 other than the conference terminal 1000a
In 0b to 1000e, as shown in the emphasized state 200 in FIG. 10, the playback is switched to only the video and audio of the participant 1a. After that, when the participant 1b inputs a request for emphasizing the conference information, the conference terminal 1000b changes the conference terminal 1000b.
Book a request for emphasis on the server. Next, the conference terminal 100
0a, as shown in FIG. 9, the control signal having the “release of emphasis” as control information is used as the other conference terminals 1000b to 100b.
0e, and deletes the emphasis request from the conference room 1000a that has been reserved by the server. Server 10
20 confirms the reservation status again, recognizes the earliest reserved conference terminal from the conference terminal 1000a to the conference terminal 1000b, and instructs the conference terminal 1000b to transmit the emphasis request. The conference terminal 1000b receiving the instruction from the server,
A control signal having “emphasized request” as control information is transmitted to each of the conference terminals 1000a, 1000c to 1000e, and the participants 1b are connected to the conference terminals 1000a, 1000c to 1000e.
Play only the video and audio of.

According to this embodiment, even when a plurality of participants input emphasis requests, all emphasis requests are reserved by the server and the emphasis requests are transmitted in the order of reservation. It is possible to reduce the load on each terminal without receiving the emphasis request from the conference terminal and to make a particular participant who inputs the emphasis request pay attention in the order of reservation.

In the above embodiment, the case where the participants of all the association terminals are focused has been described, but the participants of some conference terminals may be focused. An example of this case will be described. In FIG. 9, for example, the participant 1a is the participant 1
If the emphasis request limited to b and 1c is input, the conference terminal 1
000a transmits the emphasis request to the conference terminals 1000b and 1000c, but does not transmit the emphasis request to the conference terminals 1000d and 1000e. As a result, the conference terminals 1000b and 1000c corresponding to the participants 1b and 1c are switched to the reproduction of only the video and audio of the participant 1a. According to this embodiment, it is possible to limit the conference terminals to which attention is paid.

In the above description, the case in which the attendee who is the target of attention inputs the emphasis request has been described, but the present invention is not limited to this, and participation by a participant other than the attendee of the target of attention is performed. It is also applicable when a person substitutes the input of the emphasis request. An example of this case will be described with reference to the drawings.

Processed in the conference controller 1650,
FIG. 16 shows a flow chart of an emphasis request / emphasis release transmission process corresponding to the case where a participant other than the target of attention substitutes the input of the emphasis request. In step 10, the input from the keyboard 1500 is monitored, and when the input of the request for emphasizing the conference information is detected, the process proceeds to step 64, and it is compared whether the detected request for emphasizing the conference information includes the designation of the target terminal. If the terminal of interest is specified, the process proceeds to step 66, and in accordance with the request for emphasizing the conference information, the control signal having the specified "emphasis request" with the terminal of interest as control information is output for the number of connected conference terminals. Then, in step 22, the conference information emphasis request process is performed, and in step 14, the input from the keyboard 1500 is monitored. When the input for de-emphasizing the conference information is detected, the process proceeds to step 68, and in accordance with the de-emphasizing the conference information, the control signal having the designated “remote emphasis” as the control information as the control information is connected to the conference terminal connected. Is output, and in step 26, conference information emphasis cancellation processing is performed. On the other hand, if the terminal of interest is not specified in step 64, the process proceeds to step 12, and in accordance with the request for emphasizing the conference information, the control signal having the “emphasis request” as the control information is output by the number of connected conference terminals, In step 14,
When the input from the keyboard 1500 is monitored and the input of the de-emphasis of the conference information is detected, the process proceeds to step 16, and according to the de-emphasis of the conference information, the control signal having the “de-emphasis” as the control information is connected. Output only the number of conference terminals.

Processed in the conference controller 1650,
FIG. 17 shows a flow chart of an emphasis request / emphasis release reception process corresponding to a case where a participant other than the attendee of interest pays attention to the input of the emphasis request. In step 20, the input from the transmission encoding / decoding unit 1660 is monitored, and when a control signal having “enhancement request” as control information is detected, the process proceeds to step 70, and the received emphasis request specifies the terminal of interest. Compare whether or not. If the target terminal is not designated, the process proceeds to step 22. If the target terminal is designated, the process proceeds to step 72, and it is compared whether or not the target terminal designated in the received emphasis request is a conference terminal other than itself. If the designated attention terminal is the conference terminal of its own, the procedure proceeds to step 24, and if the designated attention terminal is a conference terminal other than itself, the procedure proceeds to step 22 and the conference information emphasis request processing is performed. In step 24, the input from the transmission encoding / decoding unit 1660 is monitored, and when a control signal having “highlighting cancellation” as control information is detected, the process proceeds to step 73. In step 73, it is compared whether or not there is designation of the target terminal in the received emphasis release. If the target terminal is not designated, the process proceeds to step 26, and if the target terminal is designated, the process proceeds to step 74. In step 74, it is compared whether or not the attention terminal specified for the received de-emphasis is a conference terminal other than its own, and if the designated attention terminal is its own conference terminal, the process is terminated and the specified attention If the terminal is a conference terminal other than itself, the process proceeds to step 26, and the conference information emphasis cancellation process is performed.

FIG. 18 shows a sequence between the participant 1a acting as an emphatic request for the participant 1b and each conference terminal 1000. First, each conference terminal 1000 transmits and receives a video signal and an audio signal, respectively, outputs necessary video and audio, and executes a multipoint video conference in a normal state 100.
It is in. Next, when the participant 1a instructs the conference terminal 1000a to emphasize the conference information instructing the participant 1b to pay attention, the conference terminal 1000a enters the emphasized state 230, and the conference terminal 1000b corresponding to the participant 1b is focused. While transmitting a control signal having the “emphasized request” designated as the terminal as control information to the other conference terminals 1000b to 1000e,
The output is switched to only the video and audio of the participant 1b. On the other hand, the conference terminals 1000b to 1000e, which have received the control signal having the control information of “highlight request” that specifies the conference terminal 1000b as the attention terminal, are in the emphasized state 200, and the video of the participant 1b except the conference terminal 1000b. And output only audio. Therefore, the conference terminal 100
Participants 1a corresponding to 0a, 1000c to 1000e,
Participant 1b is focused on 1c to 1e. Then, when the participant 1a instructs the conference terminal 1000a to release the emphasis of the conference information instructing to release the attention to the participant 1b,
The conference terminal 1000a is in the normal state 300, and the participant 1
"Emphasis request" that designates the conference terminal 1000b corresponding to "b" as the attention terminal and transmits a control signal having "highlight cancellation" as control information to the other conference terminals 1000b to 1000e, and also designates the conference terminal 1000b as the attention terminal. Return to the output of video and audio before transmitting the control signal having control information of. On the other hand, the conference terminals 1000b to 1000e that have received the control signal having the control information of "de-emphasis" that specifies the conference terminal 1000b as the attention terminal are in the normal state 3
00, the multipoint video conference is restarted by returning to the output of the video and audio before receiving the control signal having the “emphasizing request” that designates the conference terminal 1000b as the attention terminal as the control information. In addition, in the present embodiment, the case where the control signal having the “release of emphasis” as the control information is transmitted in response to the input from the participant has been described, but it goes without saying that the input does not depend on the input from the participant. A timer may be started after transmitting a control signal having "emphasis request" as control information, and a control signal having "emphasis cancellation" as control information may be transmitted after a predetermined time has elapsed.

FIG. 19 shows an example showing the relationship between the conference state and the output of video and audio from each conference terminal 1000. In the normal state 100, the monitor 120 of the conference terminal 1000a
0a and the speaker 1400a reproduce the video and audio of the other participants 1b to 1e, respectively, and the conference terminal 1000
The video and audio of the other participants 1a, 1c to 1e are reproduced on the monitor 1200b and the speaker 1400b of FIG. Similarly, the video and audio of the other participant 1 are reproduced on the monitor 1200 and the speaker 1400 of the conference terminals 1000c to 1000e, respectively. Next, when the highlighted state 230 is reached, the monitor 1200 of the conference terminal 1000b is displayed.
b and the speaker 1400b reproduce the video and audio of the participants 1a, 1c to 1e, respectively, as in the normal state 100, but the conference terminal 1000a and the conference terminal 1000c.
Only the video and audio of the participant 1b are uniformly reproduced on the monitor 1200 and the speaker 1400 of up to 1000e.
Then, in the normal state 300, each conference terminal 1000
Similarly to the normal state 100, the monitor 1200 and the speaker 1400 reproduce the video and audio of the other participant 1 and return to the normal state 100 of the video and audio reproduction state. According to the present embodiment, attention can be designated from an arbitrary conference terminal to a specific participant.

Further, in the above description, at each conference terminal,
The case has been explained in which only the video and audio of the participant are switched according to the control signal with the received "emphasis request" as the control information, but it is not necessary to delete the video and audio of the unspecified participant, and each participant does not have to be deleted. It is also possible to reproduce only the video and audio of a specific participant in the specified form while the video and audio of the above are being reproduced. An example of this case will be described with reference to the drawings.

Processed in the conference controller 1650,
FIG. 20 shows the flow of the emphasis request / emphasis release transmission process corresponding to the case where only the video and audio of a specific participant are reproduced in a specified form. In step 10, keyboard 150
The input from 0 is monitored, and when the input of the request for emphasizing the conference information is detected, the process proceeds to step 75, and it is compared whether the detected request for emphasizing the conference information specifies the output form. If the output form is designated, the process proceeds to step 76, and in accordance with the request for emphasizing the conference information, a control signal having “emphasis request” with output form as control information is output for the number of connected conference terminals, and the step is performed. In 14, the input from the keyboard 1500 is monitored, and when the input for de-emphasizing the conference information is detected, the process proceeds to step 78. In step 78, in accordance with the cancellation of the emphasis on the conference information, a control signal having "designation cancellation" with a designated output form as control information is output by the number of connected conference terminals. On the other hand, if the attention terminal is not specified in step 75, the process proceeds to step 12, and according to the conference information emphasis request, the control signal having the “emphasis request” with the attention terminal as the control information indicates the number of connected conference terminals. Output, and in step 14, the input from the keyboard 1500 is monitored. When the input for de-emphasizing the conference information is detected, the process proceeds to step 16, and according to the de-emphasis of the conference information,
A control signal that uses the specified “unemphasized” as control information,
Output only the number of connected conference terminals.

Processed in the conference controller 1650,
FIG. 21 shows the flow of the emphasis request / emphasis release reception process corresponding to the case where only the video and audio of a specific participant are reproduced in a specified form. In step 20, the input from the transmission encoding / decoding unit 1660 is monitored, and when a control signal having "enhancement request" as control information is detected, the process proceeds to step 80, and the received emphasis request has an output form specified. Compare whether or not. If the output form is specified, step 82
Then, the process proceeds to step 24 in which the output form designation emphasis request process is performed. On the other hand, if the output form is not designated in step 80, the process proceeds to step 22, the conference information emphasis request process is performed, and the process proceeds to step 24. In step 24, the input from the transmission encoding / decoding unit 1660 is monitored, and when a control signal having “enhancement cancellation” as the control information is detected, the process proceeds to step 83, and the output form is specified in the received emphasis cancellation. Whether the output form is designated or not is determined, and if the output form is designated, the process proceeds to step 84 to perform the output form designation emphasis cancellation processing.
On the other hand, if the output form is not specified in step 83, the process proceeds to step 26, and the conference information emphasis cancellation processing is performed.

The flow of the output form designation emphasis request processing 82 is shown in FIG. In step 86, it is compared whether or not the video output form is designated. If the video output form is not designated, the process proceeds to step 90. If the video output form is designated, the process proceeds to step 88, and the image synthesis is performed. Part 1620
The video signal of the conference terminal that has transmitted the control signal having the control information of “enhancement request” is set to the designated output form, and is combined with the video signals of the other conference terminals and output to the monitor 1200. In step 90, it is compared whether or not the voice output form is designated. If the voice output form is not designated, the process is ended, and if the voice output form is designated, the process proceeds to step 92 to synthesize the voice. The unit 1640 is controlled so that the audio signal of the conference terminal that has transmitted the control signal having the “emphasized request” as the control information is set to the designated output form, and is synthesized with the audio signals of the other conference terminals and output to the speaker 1400.

FIG. 23 shows the flow of the output form designation emphasis cancellation processing.
Shown in. In step 86, it is compared whether or not the video output form is designated. If the video output form is not designated, the process proceeds to step 90, and if the video output form is designated, the process proceeds to step 94, and the video composition is performed. The video signal of the conference terminal that controls the unit 1620 and transmits the control signal having the “emphasized request” as the control information is set to the output form before the control signal having the “emphasized request” as the control information is received, and the other conference It is combined with the video signal of the terminal and output to the monitor 1200.
In step 90, it is compared whether or not the voice output form is designated. If the voice output form is not designated, the process is terminated. If the voice output form is designated, the process proceeds to step 96, and the voice synthesis is performed. The conference unit 1640 is controlled to output the audio signal of the conference terminal that has transmitted the control signal having the “emphasis request” as the control information to the output form before the control signal having the “emphasis request” as the control information is received, and other conferences. It is combined with the audio signal of the terminal and output to the speaker 1400.

FIG. 24 shows a sequence between the emphasis request of the participant 1a who designates the image magnification and each conference terminal 1000. First, each of the conference terminals 1000a to 1000e is in a normal state 100 in which a multipoint video conference is executed by transmitting and receiving a video signal and an audio signal, outputting the required video and audio, respectively. Next, participant 1a increases the image magnification to 3
A request for emphasizing the conference information that has been specified to be doubled is given to the conference terminal 100.
0a, the conference terminal 1000a displays the highlighted state 2
The control signal becomes 40, and the control signal having the control information of “Emphasis request” in which the image magnification of 3/2 is designated as the output form is transmitted to the other conference terminals 1000b to 1000e. On the other hand, the conference terminal 1000b that has received the control signal having the control information of “emphasizing request” that specifies the image magnification of 3/2 as the output form.
1000e enters the emphasized state 240 and outputs the image of the participant 1a 3/2 times, so that the conference terminals 1000b to 1000b
Participant 1 for participants 1b-1e corresponding to 000e
Focus on a. And the participant 1a has a video magnification of 3/2
The conference terminal 10 cancels the emphasis of the conference information that is specified to be canceled twice.
00a, the conference terminal 1000a is in the normal state 3
00, and the conference terminal 1 sends a control signal using “remove emphasis” that specifies the image magnification of 3/2 as the output form.
000b to 1000e. On the other hand, the conference terminals 1000 b to 10 b to 10 that have received the control signal having the control information of “de-emphasis” that specifies the image magnification of 3/2 as the output form.
00e is in the normal state 300, returns to the output of the video and audio before receiving the control signal having the control information of “Emphasis request” designating the video magnification of 3/2, and restarts the multipoint video conference. . In addition, in the present embodiment, the case where the control signal having the “release of emphasis” as the control information is transmitted in response to the input from the participant has been described, but it goes without saying that the input does not depend on the input from the participant. After sending a control signal with "emphasis request" as control information, start a timer,
After a lapse of a certain time, a control signal having "release of emphasis" as control information may be transmitted.

FIG. 25 shows an example of the relationship between the conference state and the output of video and audio from each conference terminal 1000. In the normal state 100, the monitor 120 of the conference terminal 1000a
0a and the speaker 1400a include the participant 1b, respectively.
Play the video and audio of ~ 1e. Similarly, the conference terminal 1
The video and audio of the other participant 1 are reproduced on the monitors 1200 and the speakers 1400 of 000b to 1000e, respectively. Next, when the highlighted state 240 is reached, the monitor 1200a and the speaker 1400a of the conference terminal 1000a are displayed.
In the same manner as in the normal state 100, the video and audio of the participants 1b to 1e are reproduced. On the other hand, the video and audio of the other participant 1 are reproduced on the monitors 1200 and the speakers 1400 of the other conference terminals 1000b to 1000e, respectively, and the image of the participant 1a is uniformly enlarged by 3/2. . Then, in the normal state 300, the monitor 1200a and the speaker 1400 of the conference terminal 1000a.
Similar to the normal state 100, for example, the video and audio of the participants 1b to 1e are reproduced in a. Similarly, on the monitors 1200 and the speakers 1400 of the conference terminals 1000b to 1000e, the video and audio of the other participant 1 are reproduced, and the enlarged display of the image of the participant 1a is canceled.
It returns to the video and audio reproduction state of the normal state 100.

According to the present embodiment, it is possible to make a particular participant pay attention in an arbitrary reproduction mode without erasing the video and audio of other participants.

Although the above embodiments have been described for the case of a 5-point video conference system, they can be applied to a multi-point video conference system of 2 to 4 points or 6 or more points. Further, in this example, the method of designating the video of the participant to be noticed is in accordance with the input instruction from each terminal, but the present invention is not limited to this, and for example, the speaker is detected by interlocking with the audio level. It is also possible to focus on the video of the relevant participant. Furthermore, in this example, the case where the video and audio of the participants themselves are reproduced has been described, but it does not depend on the type of information to be reproduced, for example, the video reproduced by the VTR, the audio, the still image captured by the image scanner, or the like. Needless to say.

In the above description, the conference start time and the end time are not particularly considered, and the conference progress is left to the participants of each conference terminal for free discussion. It can also be applied to a case where a schedule including the above is reserved and the conference is advanced according to the reservation contents.
An embodiment of this case will be described below with reference to the drawings.

First, FIG. 26 shows a block diagram of a conference progress table 1700 for reserving a schedule including the start / end times of the conference. Reference numeral 1701 denotes a meeting progress date and time indicating the scheduled date and time of the conference including start / end of the conference; 1702, a date and time indicated by the meeting progress date and time 1701 is a date and time when the conference is started, a date and time when the conference is ended and a date and time when the conference is continued The conference / end identification information 1703 indicates whether or not the conference information is forcibly emphasized from the date and time indicated by the conference progress date 1701 and the emphasized participant name indicating a specific participant name to be noticed by other participants. Here, one reservation content shown in the conference progress table 1700 of FIG. 26 will be described. In the multipoint video conference system shown in FIG. 1, first, when the conference progress date / time 1701 indicates 13:00 on September 1, 1992, the conference starts /
The end identification information 1702 indicates “start meeting”, so the meeting is started. Since the emphasized participant name 1703 indicates “A”, if the participant name of the participant 1a is A, the conference information of the participant 1a is changed to the other participants 1b to 1e.
The highlighted state is output to each of the conference terminals 1000b to 1000e, and the emphasized state of the participant 1a is continued. Next, at 13:20 on September 1, 1992, which is indicated by the conference progress date / time 1701, the conference start / end identification information 1702 is “Continue conference”.
The conference is continued and emphasized participant name 1703
Indicates “none”, the participant 1a is released from the emphasized state, and the process according to the emphasis request / emphasis release of each participant 1 is performed as described in the previous embodiment. At 14:00 on September 1, 1992, which is indicated by the conference progress date / time 1701, the conference start / end identification information 1702 indicates “Continue conference”, and thus the conference is continued. Emphasis participant name 1
Since 703 indicates “B”, if the participant name of the participant 1b is B, the conference information of the participant 1b is set to the conference terminals 1000a, 1e of the other participants 1a, 1c to 1e.
000c to 1000e are emphasized and output, and the emphasized state of the participant 1b is continued. Further, at 14:20 on September 1, 1992, which is indicated by the conference progress date / time 1701, the conference start / end identification information 1702 indicates “continuation of conference”, and thus the conference is continued. Since the emphasized participant name 1703 indicates “None”, the emphasized state of the participant 1b is canceled, and as shown in the previous embodiment, the emphasis request / impact request of each participant 1 is returned.
Performs processing according to de-emphasis. Finally the meeting progress date 170
At 15:00 on September 1, 1992 indicated by 1, the conference start / end identification information 1702 indicates “end of the conference”, so the conference is ended. In this way, the conference reserved from 13:00 to 15:00 on September 1, 1992 proceeds as scheduled in the conference progress table 1700.
The conference progress table 1700 is stored in each conference terminal 100.
However, as long as each conference terminal can read the contents of the conference progress table, the place where the conference progress table is prepared is not limited to this, and for example, as shown in FIG. The conference progress table 1700 may be reserved in the server table of the server 1020 of the point video conference system.

FIG. 27 shows a flow of emphasis request / emphasis release transmission / reception processing in the conference control unit 1650 corresponding to the conference progress table shown in FIG. In step 9, a timer (not shown) is monitored and the conference start / end identification information 1702 is displayed.
Is compared with the date and time of the conference progress date and time 1701 indicating “conference start”, and when the date and time indicates “conference start”, the process proceeds to step 11 to check whether the emphasized participant name 1703 is specified. Compare. If no emphasized participant name is specified, the process proceeds to step 13, and after the time-specified emphasis request / release transmission / reception process is performed, the process proceeds to step 21. If the emphasized participant name is specified, the process proceeds to step 15 and it is compared whether the participant specified by the emphasized participant name 1703 is himself or herself. If the designated participant is not himself / herself, the process proceeds to step 19, where after the emphasis request / release reception process is performed, the process proceeds to step 21. Here, the flow of step 19 is as shown in FIG. If the designated participant is himself / herself, the process proceeds to step 12, and a control signal having "highlight request" as control information is output by the number of connected conference terminals. In step 14, the input from the keyboard 1500 is monitored, and if the input for canceling the highlighting of the conference information is detected, the process proceeds to step 16. If the input for de-emphasizing the conference information is not detected in step 14, the process proceeds to step 17 to compare whether the date and time indicated by the next conference progress date and time 1701 has passed,
If the date and time has passed, the process proceeds to step 16, and if the date and time has not passed, the process proceeds to step 14. In step 16, a control signal having “remove emphasis” as control information is output by the number of connected conference terminals and the process proceeds to step 21, where the conference start / end identification information 1702 corresponding to the next conference progress date 1701 is displayed. Compare whether it is "end of meeting",
If it is not “conference end”, the process proceeds to step 11. If it is “conference end”, the process is ended.

FIG. 28 shows the time designation emphasis request / release transmission / reception processing of step 13. In step 10, the input from the keyboard 1500 is monitored, and if the input of the request for emphasizing the conference information is detected, the process proceeds to step 12, and in accordance with the request for emphasizing the conference information, a control signal having "emphasizing request" as the control information,
Output only the number of connected conference terminals. Step 14
Then, the input from the keyboard 1500 is monitored, and if the input for de-emphasizing the conference information is detected, the process proceeds to step 16. If the input for de-emphasis of the conference information is not detected, the process proceeds to step 17
Then, the process proceeds to and the comparison is made as to whether or not the date and time indicated by the next conference progress date and time 1701 has passed. If the date and time has passed, the process proceeds to step 16, and if the date and time has not passed, the process proceeds to step 14. In step 16, a control signal having “release of emphasis” as control information is output by the number of connected conference terminals, and the process proceeds to step 23. On the other hand, if the input of the request for emphasizing the conference information is not detected in step 10, the process proceeds to step 20, the input from the transmission encoding / decoding unit 1660 is monitored, and the control signal having the “enhancement request” as the control information is detected. If not, the process proceeds to step 23, and if detected, the process proceeds to step 22 and the conference information emphasis request process is performed. In step 24, the input from the transmission encoding / decoding 1660 is monitored, and “de-emphasis” is performed.
If a control signal having the control information is detected, the process proceeds to step 26, the conference information emphasis cancellation process is performed, and the process proceeds to step 23. In step 23, it is compared whether or not the date and time indicated by the next conference progress date and time 1701 has passed. If the date and time has passed, the process ends. If the date and time has not passed, the process proceeds to step 10.

According to the present embodiment, it is possible to reduce the burden on each participant of the conference, especially the organizer, for proceeding with the conference, and to proceed with the conference as scheduled within the reserved time. Further, this example is applied to the case where one participant alone inputs the emphasis request described in the first example, but it goes without saying that it can be applied in combination with any of the cases described in the above examples. .

As described above, according to the embodiments of the present invention, a request signal for emphasizing and outputting conference information including video and audio to a specific participant is transmitted from the terminal of the specific participant to another. By sending to each participant's terminal and reproducing only the conference information specified by the received request signal at each terminal, let each other participant pay attention to the specific participant himself / herself with video and audio. It is possible to proceed with the meeting smoothly.

Further, even with respect to a plurality of emphasis requests, it is possible to draw attention to the participant having high priority according to the priority of each terminal. By providing a server that reserves the request signal received by each terminal or reserves the transmission of the request signal, the participants themselves can be made to pay attention in the order of reservation.

Furthermore, by transmitting a request signal for emphasizing and outputting conference information other than oneself, it is possible for any one of the participants to pay attention to any other participant.
In addition, by reproducing the conference information in the form specified by the request signal, it is possible to make any participant pay attention while reproducing other conference information. Furthermore, by including an instruction for canceling emphasis in the request signal to cancel the attention to the participant, the effect of controlling the attention time to the participant can be obtained.

[0054]

According to the present invention, the attention of all the participants can be temporarily gathered to a specific participant, and the conference can be smoothly advanced.

[Brief description of drawings]

FIG. 1 is a configuration diagram of a multipoint video conference system according to the present invention.

FIG. 2 is a block diagram of a transmission control unit in the video conference system of FIG.

FIG. 3 is a configuration diagram of a video composition unit in the transmission control unit of FIG.

FIG. 4 is a block diagram of a transmission encoding / decoding unit in the transmission control unit of FIG.

FIG. 5 is a diagram showing an example of emphasis request / emphasis release transmission processing of the conference control unit of FIG. 2;

FIG. 6 is a diagram showing an example of an emphasis request / emphasis release reception process of the conference controller of FIG.

7 is a diagram showing an example of a conference information emphasis request process in the emphasis request / emphasis release reception process of FIG.

8 is a diagram showing an example of conference information emphasis cancellation processing in the emphasis request / emphasis cancellation reception processing of FIG.

9 is a diagram showing an example of a transmission / reception sequence of emphasis request / emphasis release between conference terminals in the video conference system of FIG.

FIG. 10 is a diagram showing an example of a relationship between each conference state and a display image on a monitor and reproduced sound from a speaker in each conference terminal in the transmission / reception sequence of FIG. 9.

FIG. 11 is a diagram showing an example of an emphasis request / emphasis release transmission process of the conference control unit corresponding to a case where a plurality of participants input an emphasis request.

FIG. 12 is a diagram showing an example of an emphasis request / emphasis release receiving process of the conference control unit corresponding to a case where a plurality of participants input an emphasis request.

FIG. 13 is a diagram showing an example of a transmission / reception sequence of emphasis request / emphasis release between conference terminals corresponding to a case where a plurality of participants input emphasis requests.

FIG. 14 is a diagram showing an example of the relationship between each conference state and the display image on the monitor and the reproduced sound from the speaker in each conference terminal in the transmission / reception sequence of FIG. 13.

FIG. 15 is a configuration diagram of another example of the multipoint video conference system according to the present invention.

FIG. 16 is a diagram showing an example of an emphasis request / emphasis release transmission process of the conference control unit corresponding to a case where a participant other than the principal substitutes the emphasis request.

FIG. 17 is a diagram showing an example of an emphasis request / emphasis release reception process of the conference control unit corresponding to a case in which a participant other than the person in charge substitutes the emphasis request.

FIG. 18 is a diagram showing an example of a transmission / reception sequence of an emphasis request / emphasis release between the conference terminals, which corresponds to a case where a participant other than the principal substitutes the emphasis request.

FIG. 19 is a diagram showing an example of the relationship between each conference state and the display image on the monitor and the reproduced sound from the speaker in each conference terminal in the transmission / reception sequence of FIG. 18;

FIG. 20 is a diagram showing an example of an emphasis request / emphasis release transmission process of the conference control unit corresponding to the case where the video and audio of a specific participant are reproduced in a specified form.

FIG. 21 is a diagram showing an example of an emphasis request / emphasis cancellation reception process of the conference control unit corresponding to the case where the video and audio of a specific participant are reproduced in a specified form.

22 is a diagram showing an example of output form designation emphasis request processing in the emphasis request / emphasis release reception processing of FIG. 21.

23 is a diagram showing an example of output form designation emphasis cancellation processing in the emphasis request / emphasis cancellation reception processing of FIG.

FIG. 24 is a diagram showing an example of a transmission / reception sequence of an emphasis request / emphasis release between conference terminals corresponding to the case where the video and audio of a specific participant are reproduced in a designated form.

FIG. 25 is a diagram showing an example of the relationship between each conference state and the display image on the monitor and the reproduced sound from the speaker in each conference terminal in the transmission / reception sequence of FIG. 24.

FIG. 26 is a diagram showing a configuration example of a conference progress table.

FIG. 27 is a diagram showing an example of an emphasis request / emphasis release transmission / reception process corresponding to a conference progress table.

28 is a diagram showing an example of the time designation emphasis request / cancellation transmission / reception processing of FIG.

[Explanation of symbols]

1000 ... Conference terminal, 2000 ... Communication network, 1 ... Participants, 1100 ... Camera, 1200 ... Monitor, 13
00 ... Microphone, 1400 ... Speaker, 150
0 ... keyboard, 1600 ... transmission control unit, 1610
...... Video distribution unit, 1620 …… Video composition unit, 1630
... voice distribution unit, 1640 ... voice synthesis unit, 1650 ...
Conference control unit, 1660 ... Transmission encoding / decoding unit.

 ─────────────────────────────────────────────────── ─── Continuation of the front page (72) Inventor Shoji Yabushita 1099, Ozenji, Aso-ku, Kawasaki-shi, Kanagawa Stock Company Hitachi Systems Development Laboratory

Claims (12)

[Claims] 1. A multipoint video conference system comprising a plurality of terminals, each of which is equipped with an input device, a conference control means, and a monitor, and which are connected to each other through a communication network, so that one of the terminals emphasizes and outputs the conference information. When the request signal of is transmitted to each of the other terminals, each of the other terminals displays the conference information from the specific terminal specified by the request signal in the mode in which the conference information has priority over the conference information of the other terminals. A multipoint video conference method characterized by playing back. 2. The multipoint video conference method according to claim 1, wherein a priority is assigned to each of the terminals, and the request signal includes information indicating the priority of the calling terminal, and each of the terminals is composed of a plurality of terminals. , The conference information of the specific terminal having the highest priority selected based on the priority information included in the received request signal is reproduced on the monitor in the priority mode. Multipoint video conference method. 3. The multipoint video conference method according to claim 1, wherein each of the terminals has storage means for reserving the request signal, and each terminal reserves reception of the request signal in the storage means. Reproducing the conference information of the specific terminal which is reserved earliest in the storage means on the monitor in the priority mode,
A multipoint video conference method characterized by the above. 4. The multipoint video conference method according to claim 1, wherein the request signal for emphasizing and outputting conference information of a specific terminal is transmitted from a terminal other than the specific terminal to each terminal. A multipoint video conference method, wherein an arbitrary terminal reproduces conference information of another arbitrary terminal on the monitor in the priority mode. 5. The multipoint video conference method according to claim 1, wherein the request signal includes information instructing an output form of the conference information, and each terminal follows the output form information included in the received request signal. A multipoint video conference method comprising: reproducing the conference information on the monitor in the priority mode. 6. The multipoint video conference method according to claim 1, wherein the request signal includes information indicating cancellation of an emphasis request,
The multipoint video conference method, wherein each terminal cancels the priority mode according to the emphasis request cancellation information included in the received request signal. 7. A multipoint video conference system comprising a plurality of terminals each having an input device, a conference control means and a monitor, a server, and a communication network connecting the terminals and the server, wherein the server requests the request. Having a server table for reserving signals, each terminal reserves a request signal for emphasized output of conference information in the server table,
A multipoint video conference method, wherein the server reproduces conference information of a specific terminal reserved in the server table in a priority mode on a monitor of each terminal. 8. The multipoint video conference method according to claim 7, wherein a schedule including a conference start / end time and an emphasis request is reserved in the server table, and the server controls reproduction of the monitor according to the schedule. , A multipoint video conference method characterized by the above. 9. A multipoint video conference system in which a plurality of terminals are connected via a communication network, means for transmitting a request signal for each terminal to emphasize and output meeting information, and the request. A multipoint video conference system, comprising: means for reproducing on a monitor the conference information of a specific terminal that has output a signal, over the conference information of another terminal. 10. The multipoint video conference system according to claim 9, wherein the transmitting unit transmits the emphasis request signal with information indicating a priority assigned in advance to each terminal, and outputs a plurality of emphasis requests. When there is, the monitor reproducing means reproduces the conference information of the specific terminal selected based on the priority information included in the reception request signal on the monitor in the priority mode. Video conferencing system. 11. The multipoint video conference system according to claim 9, wherein each terminal has storage means for reserving the request signal. 12. The multipoint video conference system according to claim 9, wherein the request signal includes information instructing an output form of the conference information, and each terminal follows the output form information included in the received request signal. A multipoint video conference system, wherein the conference information is reproduced on the monitor in the priority mode.