JPH05260463A - System for switching video image of opposite party of conference - Google Patents

Abstract

PURPOSE:To provide a television conference system able to control an output of a monitor screen in response to the state of a TV camera. CONSTITUTION:The sender side is provided with a switch 122 turning on/off an output of a TV camera 120 and with a conference control section 110 controlling on/off of the switch and the turning of the TV camera and the receiver side is provided with a monitor 220. The switch 122 is turned off at the sender side while the TV camera 120 is being turned, the transmission of an input video image from the camera 120 is suppressed, and video data after reception are displayed on the monitor 220 of the receiver side before the camera is turned. Since the transmission of useless video data is suppressed during the turning of the TV camera, the communication cost is saved.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a conference partner video switching system of a video conference system in which video data output from a TV camera is transmitted to a conference room of a partner through a communication network and is displayed on a monitor. The present invention relates to a conference partner video switching method of a video conference system suitable for displaying video data on a monitor.

[0002]

2. Description of the Related Art Conventionally, regarding a video conference system for displaying video data of conference participants on the monitor of the other party, for example, according to Japanese Patent Laid-Open No. 3-69296, there is one
A TV camera and a still image storage memory are provided, and a monitor device is provided on the receiving side. While the TV camera is turning, the video of the speaker registered in advance in the still image storage memory is transmitted and displayed on the monitor. Things have been proposed.

[0003]

However, in the above-mentioned conventional method, it is necessary to register the still image of each conference participant in the still image storage memory before the conference, and the own still image is stored in the still image storage memory. When a conference participant who has not registered becomes a speaker, or when a conference participant appears in a different seat, a still image different from the conference participant who is speaking is displayed on the monitor while turning the TV camera. There was a problem that

Also, since the transmitting side has a still image storage memory, the still image registered in the still image storage memory must be transmitted even while the TV camera is turning, and the communication line is used even while the TV camera is turning. Therefore, there is also a problem that communication cost is required.

An object of the present invention is to solve the above problems and
An object of the present invention is to provide a video conference system that does not transmit video data while the TV camera is rotating and displays the information necessary for the conference participants on the monitor.

[0006]

In order to achieve the above object, in the present invention, when the TV camera on the transmitting side starts turning, the transmission of the image taken by the TV camera is stopped and the TV camera ends turning. During this period, the monitor on the receiving side outputs the image received immediately before turning or the image stored in advance.

Further, according to a further improved embodiment of the present invention, the voice of the conference participant on the transmitting side is picked up by the microphone, the conference participant speaking is detected by the voice level of the microphone, and the conference speaking When the TV camera starts turning to the participant, the transmission of the video captured by the TV camera is stopped, and while the TV camera ends the turning, the video corresponding to the voice of the speaker is output to the monitor on the receiving side. It is characterized by

[0008] In another embodiment, when the TV camera on the transmission side starts turning, the transmission of the video image taken by the TV camera is stopped, and the monitor on the receiving side is Characteristic data indicating the turning destination is output instead of the image of the turning destination.

[0009]

According to the present invention, when the TV camera on the transmission side starts to turn, the transmission of the video image captured by the TV camera is stopped, thereby suppressing the transmission of useless video data having a large amount of information and performing communication. While saving the cost, while the TV camera finishes the turning, the monitor on the receiving side outputs the image received immediately before the turning or the image stored in advance so that the conference of the turning destination can be performed even while the TV camera is turning. The participant's image or the desired image on the receiving side can be viewed, and the conference can be smoothly advanced.

Further, according to the present invention, the TV camera is turned in accordance with the conference participant who is speaking, and while the TV camera finishes the turning, the image on the receiving side monitor corresponds to the voice of the speaker. Is output, the display on the monitor can be switched to the image of the speaker at the turn destination in conjunction with the voice. Further, according to the present invention, while the TV camera finishes turning, the character data indicating the turning destination is output to the monitor on the receiving side, so that the information on the turning destination is displayed on the monitor when the turning of the TV camera is started. be able to.

[0011]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to the drawings.

FIG. 1 is a diagram showing an example of the configuration of a video conference system according to the present invention.

In FIG. 1, 100 is a conference room on the transmitting side,
200 is the conference room on the receiving side, 300 is the conference rooms 100 and 20
It is a communication network connecting 0.

In the conference room 100, 1, 2, and 3 are participants of the conference room 100, and 11, 12, and 13 are participants 1,
Microphones corresponding to 2 and 3, 113 is a microphone mixer that synthesizes and outputs audio signals from the microphones 11, 12 and 13, 120 is a TV camera that reflects one of the participants 1, 2 and 3, 121 is a TV An electric pan head that allows the camera 120 to turn, a switch 122 for turning on / off the output of a video signal projected by the TV camera 120, 1
Reference numeral 11 denotes a remote controller for the participant 2 to turn the TV camera 120 in a desired direction. Reference numeral 112 denotes an audio signal output from the microphones 11, 12 and 13 via the microphone mixer 111, and an output audio level per hour. A speaker detection unit that detects a participant corresponding to the microphone having the maximum sum of the above as a speaker and outputs a turning request for turning the TV camera 120 to the speaker, and 110 is a turning / turning stop request or a statement from the remote control 111. According to the turning request from the person detecting unit 112, the electric camera platform 121 of the TV camera 120.
Control of turning / turning stop to the switch 122 and
The conference control unit 130 controls ON / OFF of the TV camera 120 and outputs control information indicating a turning state of the TV camera 120. Reference numeral 130 denotes a video signal from the switch 122 and the microphone mixer 11.
3 is a transmission encoding unit that encodes the audio signal from the communication unit 3 and sends it to the communication network 300 together with the control information from the conference control unit 110.

In the conference room 200, 230 is the conference room 1.
00 is a transmission decoding unit that decodes a signal received from the communication network 300, 210 is a speaker that reproduces an audio signal from the transmission decoding unit 230, and 220 is a transmission decoding unit 2.
It is a monitor that displays the video signal from 30 on the screen.

FIG. 2 shows the configuration of the transmission coding unit in FIG. In FIG. 2, 131 is an A / D converter that converts the video signal from the switch 122 into a digital signal, 13
2 is a transmission frame memory unit that stores the video signal from the A / D conversion unit 131, and 133 is a transmission frame memory unit 13
2 is a video encoding unit that encodes the output of 2, a control signal I / F unit that outputs the control information from the conference control unit 110 as a control signal, and 138 that converts the audio signal from the microphone mixer 113 into a digital signal. A / D converter,
Reference numeral 137 is an audio encoding unit that encodes the audio signal from the A / D conversion unit 138, and 135 is a multiplexing unit that multiplexes the signals from the video encoding unit 133, the control signal I / F unit 136, and the audio encoding unit 137. The converting unit 134 is a line I / F unit that sends out the multiplexed signal from the multiplexing unit 134 to the communication network 300.

FIG. 3 shows the configuration of the transmission decoding unit in FIG. In FIG. 3, 234 is a line I / F unit that receives a signal from the communication network 300, and 235 is a line I / F unit 23.
4 separates the multiplexed signal from 4 into a plurality of signals before multiplexing, 237 is a voice decoding unit that decodes the voice signal from the separating unit 235, and 238 is a voice signal from the voice decoding unit 237. D / A converter for converting to analog signal, 2
Reference numeral 33 is a video decoding unit that decodes the video signal from the separation unit 235, 232 is a reception frame memory unit that stores the video signal from the video decoding unit 233, and 231 is an output of the reception frame memory unit 232 that is an analog signal. D / A to convert
The conversion unit 236 outputs the control signal from the separation unit 235 as control information, and the control signal I / F unit 239 analyzes the control information from the control signal I / F unit 236 and outputs it to the reception frame memory unit 232. It is a control information identification unit that controls writing of a video signal.

FIG. 4 is a flow chart showing the flow of processing of the conference controller 110 in FIG. In FIG. 4, in step 10, “turning” is output as control information in response to a turning request from the remote controller 111 or the speaker detection unit 112. In step 14, the electric camera platform 121 of the TV camera 120 is instructed to turn to a desired position, and in step 16, the switch 122 is instructed to be turned off. In step 18, it is compared whether or not the turning stop response is confirmed from the electric platform 121, and when the turning stop response is confirmed, the process proceeds to step 24. At step 24, the switch 122 is instructed to be turned on, and at step 26, “stop” is transmitted to the control signal I / F unit 150 as control information.

If the response to the turning stop is not confirmed in step 18, the process proceeds to step 20, and it is compared whether or not the request for turning stop from the remote controller 111 is confirmed. If the request for turning stop is confirmed, step 22 is performed. Then, the instruction is given to the electric pan head 121 to stop turning, and the process proceeds to step 24.
If the turning stop request is not confirmed in step 20,
Return to step 18.

FIG. 5 shows the control information identifying section 23 in FIG.
7 is a flowchart showing the flow of processing of No. 7. 5, in step 28, it is compared whether the control information received from the control signal I / F unit 236 is “turning” or “stop”, and if it is “turning”, the process proceeds to step 30. Writing of a video signal to the reception frame memory unit 232 is prohibited. When the control information received in step 28 is “stop”, the process proceeds to step 32, and the video signal can be written in the reception frame memory unit 232.

FIG. 6 shows the relationship between the turning operation of the TV camera 120 and the display image on the monitor 220 in FIG. In FIG. 6, when the TV camera 120 faces the participant 1 and is in a stopped state, the TV camera 1 is removed from the conference room 100.
20 video signals of participant 1 to be photographed and TV camera 12
A control signal indicating that the turning state of 0 is the “stop” state is transmitted to the conference room 200, the received video signal is transmitted to the monitor 220 in the conference room 200, and the moving image of the participant 1 is displayed on the monitor 220. To be done.

Next, when the TV camera 120 starts turning, the video signal of the participant 1 photographed by the TV camera 120 and the control signal indicating that the turning state of the TV camera 120 is the "turning" state are confered. After the transmission to the room 200, the TV camera starts turning, and when the turning state is reached, the transmission of the video signal from the conference room 100 to the conference room 200 is stopped, and the conference room 2
In 00, the received control signal is analyzed and the TV camera 120
It recognizes that the turning state of "is turning", prohibits the writing of the video signal to the reception frame memory unit 232 shown in FIG. 3, and at this time, the participant 1 written in the reception frame memory unit 232. Output the video signal of
At 0, the still image of the participant 1 is displayed.

Then, when the TV camera 120 ends the turn toward the participant 2 and is stopped, the transmission of the video signal from the conference room 100 to the conference room 200 is restarted, and the conference room 1
00 transmits a video signal of the participant 2 photographed by the TV camera 120 and a control signal indicating that the turning state of the TV camera 120 is “stop” to the conference room 200, and the control received in the conference room 200. Analyze the signal and recognize that the turning state of the TV camera 120 is the "stop" state,
The video signal can be written to the reception frame memory unit 232 shown in FIG. 3, the received video signal is sent to the monitor 220, and the moving image of the participant 2 is displayed on the monitor 220.

Although not shown, regardless of the turning state of the TV camera 120, the synthetic voices of the participants 1, 2, and 3 are constantly transmitted through the communication path 300 to the speaker 2 of the conference room 200.
It goes without saying that it will be played back to 10.

According to the present embodiment, since the video signal is not transmitted during the turning of the TV camera, it is possible to avoid displaying the image with poor image quality during the turning of the TV camera, and at the same time, the communication cost can be reduced by reducing the transmission amount. Can be reduced. Further, according to the present embodiment, since the still image of the turning source is displayed on the monitor while the TV camera is turning, the video display on the monitor is not interrupted even when the TV camera is turning.

Next, a second embodiment of the present invention will be shown.

FIG. 7 shows the configuration of the transmission decoding unit 230 in the second embodiment. In FIG. 7, 231, 232,
233, 234, 235, 236, 237, and 238 are the same as those in FIG. 3, 240 is a VTR for reproducing the video information stored on the tape, and 241 is either the output of the D / A converter 231 or the output of the VTR 240. Monitor 22
A switch connected to the input of 0, 239 is a control signal I / F
The control information identification unit analyzes the control information from the unit 236 and controls the operation of the VTR 240 and controls the connection of the switch 241.

FIG. 8 shows the control information identifying section 23 in FIG.
9 is a flowchart showing a second example of No. 9. In FIG.
Step 28 is the same as in FIG. 5, and the added portion will be described below.

In step 34, the VTR 240 is brought into a video reproducing state, and in step 36, the switch 241 is controlled to connect the output of the VTR 240 to the input of the monitor 220. In step 38, the VTR 240 is set to the image stop state, and in step 40, the switch 241 is controlled to set D
The output of the / A converter is connected to the input of the monitor 220.

FIG. 9 is a second embodiment showing the relationship between the turning operation of the TV camera 120 and the display image of the monitor 220 in FIG.

In FIG. 9, first, when the TV camera 120 is stopped toward the participant 1, the video signal of the participant 1 captured by the TV camera 120 and the turning state of the TV camera 120 from the conference room 100. Is transmitted to the conference room 200 by transmitting a control signal indicating that the
At 0, the received video signal is sent to the monitor 220, and the moving image of the participant 1 is displayed on the monitor 220.

Next, when the TV camera 120 starts turning, the video signal of the participant 1 photographed by the TV camera 120 and the control signal indicating that the turning state of the TV camera 120 is in the "turning" state are confered. After the transmission to the room 200, the TV camera starts turning, and when the turning state is reached, the transmission of the video signal from the conference room 100 to the conference room 200 is stopped, and the conference room 2
In 00, the received control signal is analyzed and the TV camera 120
Recognizes that the turning state of the vehicle is "turning", and the VTR2
The video to be reproduced by 40 is sent to the monitor 220, and the monitor 22
At 0, the image reproduced by the VTR 240 is displayed.

Then, when the TV camera 120 ends the turn toward the participant 2 and is stopped, the transmission of the video signal from the conference room 100 to the conference room 200 is restarted, and the conference room 1
00 transmits a video signal of the participant 2 photographed by the TV camera 120 and a control signal indicating that the turning state of the TV camera 120 is “stop” to the conference room 200, and the control received in the conference room 200. Analyze the signal and recognize that the turning state of the TV camera 120 is the "stop" state,
The received video signal is sent to the monitor 220, and the monitor 220
A moving image of the participant 2 is displayed on the screen.

Although not shown, regardless of the turning state of the TV camera 120, the synthesized voices of the participants 1, 2, and 3 are constantly transmitted through the communication path 300 to the speaker 2 of the conference room 200.
It goes without saying that it will be played back to 10.

According to the present embodiment, since the video signal is not transmitted during the turning of the TV camera, it is possible to avoid displaying the image with poor image quality during the turning of the TV camera, and at the same time, the communication cost can be reduced by reducing the transmission amount. Can be reduced.

Further, according to the present embodiment, since the video reproduced by the VTR is displayed while the TV camera is turning, the video display on the monitor is not interrupted even when the TV camera is turning.

Next, a third embodiment of the present invention will be described.

FIG. 10 is a block diagram of the transmission / decoding unit 230 in this embodiment. In FIG. 10, 231, 23
2, 233, 234, 235, 236, 237, 238
3 is the same as in FIG. 3, and 239 is a control information identification unit that analyzes the control information from the control signal I / F unit 236 and outputs a character signal indicating the participant at the turn destination, and controls the connection of the switch 241. A monitor 241 monitors either the output of the D / A conversion unit 231 or the output of the control signal identification unit 239.
A switch that connects to 20 inputs.

FIG. 11 shows the conference controller 110 in FIG.
3 is a flowchart of the processing of FIG. In FIG. 11, step 1
4, 16, 18, 24 and 26 are the same as those in FIG. 4, and additional parts will be described below. In step 44, in response to a turning request from the remote controller 111 or the speaker detection unit 112, "turning" and "participant at turning destination" are output as control information.

FIG. 12 is a flow chart of the control information identifying section 237 in FIG. In FIG. 12, step 28
Is the same as in FIG. 5, and additional parts will be described below. Step 46
Then, the switch 241 is controlled to control the control information identifying unit 239.
Connect the output of the monitor to the input of the monitor 220, and step 48
Then, a character signal indicating "participant of turning destination" of the control information is output.

In step 40, the switch 241 is controlled to connect the output of the control information identifying section 239 to the input of the monitor 220.

FIG. 13 shows the relationship between the turning operation of the TV camera 120 and the display image on the monitor 220. In FIG. 13, first, when the TV camera 120 is in the stopped state toward the participant 1, the video signal of the participant 1 captured by the TV camera 120 and the turning state of the TV camera 120 are “stopped” from the conference room 100. A control signal indicating the state is transmitted to the conference room 200, the conference room 200 transmits the received video signal to the monitor 220, and the monitor 220 displays the moving image of the participant 1.

Next, when the TV camera 120 starts turning, the video signal of the participant 1 photographed by the TV camera 120 and the turning state of the TV camera 120 must be "turning" to "participant 2". When the TV camera starts to turn after entering a turning state after transmitting a control signal indicating
The transmission of the video signal from the conference room 100 to the conference room 200 is stopped, the received control signal is analyzed in the conference room 200, and T
The turning state of the V camera 120 is “turning” to “participant 2”
Is recognized and the character signal indicating the turning destination is monitored 2
Then, the monitor 220 displays the character information indicating that the turning destination is the participant 2.

Then, when the TV camera 120 ends the turn toward the participant 2 and is stopped, the transmission of the video signal from the conference room 100 to the conference room 200 is restarted, and the conference room 1
00 transmits a video signal of the participant 2 photographed by the TV camera 120 and a control signal indicating that the turning state of the TV camera 120 is “stop” to the conference room 200, and the control received in the conference room 200. Analyze the signal and recognize that the turning state of the TV camera 120 is the "stop" state,
The received video signal is sent to the monitor 220, and the monitor 220
A moving image of the participant 2 is displayed on the screen.

Although not shown, regardless of the turning state of the TV camera 120, the synthetic voices of the participants 1, 2, and 3 are continuously transmitted through the communication path 300 to the speaker 2 of the conference room 200.
It goes without saying that it will be played back to 10.

According to the present embodiment, since the video signal is not transmitted during the turning of the TV camera, it is possible to avoid displaying the image with the poor image quality during the turning of the TV camera, and at the same time, the communication cost can be reduced by reducing the transmission amount. Can be reduced.

Further, according to the present embodiment, since the character indicating the participant at the turning destination is displayed while the TV camera is turning, even if the TV camera is turning, the participant to which the TV camera is heading is always known. When the TV camera is turning to the speaker, the character indicating the speaker at the turning destination is displayed.
Even if the camera is turning, the speaker of the sound reproduced from the speaker can be always known.

Next, a fourth embodiment of the present invention will be described.

FIG. 14 shows the structure of the image decoding apparatus in this embodiment. In FIG. 14, 231, 233,
234, 235, 236, 237, and 238 are the same as those in FIG. 3, and 2321, 2322, and 2323 correspond to the participants 1, 2, and 3, respectively, and are the reception frame memories that store the video signals from the video decoding unit 233. 242, a selector switch 242 for connecting any one of the outputs of the reception frame memory units 2321, 2322, and 2323 and an input of the D / A conversion unit 231. 239 analyzes control information from the control signal I / F unit 236. , Reception frame memory units 2321 and 232
This is a control information identification unit that controls writing of video signals to 2, 2323 and controls connection of the changeover switch 242.

FIG. 15 is a flow chart of processing of the conference control unit 110. In FIG. 15, steps 14, 16, 1
8 and 24 are the same as those in FIG. 4, step 44 is the same as that in FIG. 11, and additional portions will be described below. In step 50, "stop" and "participant at the turn destination" are used as control information for the control signal I /
Output to the F unit 136.

FIG. 16 is a flow chart of the processing of the control information identifying section 239 in FIG. In FIG. 16, step 28 is the same as that in FIG. 5, and additional portions will be described below. In step 52, the received frame memory units 2321 and 2322,
In 2323, the video information is prohibited from being written to the reception frame memory unit corresponding to the “participant of the turn destination” of the control information, and in step 54, the switch 242 is controlled to receive the reception frame memory units 2321, 2322, and 2323. Among these, the output of the reception frame memory unit corresponding to the “participant of the turn destination” of the control information is connected to the input of the D / A conversion unit 231.

In step 56, the reception frame memory unit 2
Of the 321, 2322, and 2323, the video information can be written to the reception frame memory unit corresponding to the "participant at the turn destination" of the control information.

FIG. 17 shows the relationship between the turning operation of the TV camera 120 and the display image on the monitor 290. In FIG. 17, first, when the TV camera 120 is in a stopped state facing the participant 1, from the conference room 100, the video signal of the participant 1 captured by the TV camera 120 and the turning state of the TV camera 120 are “participant”. The control signal indicating the "stop" state in "1" is transmitted to the conference room 200, the received video signal is transmitted to the monitor 220 in the conference room 200, and the moving image of the participant 1 is displayed on the monitor 220. ..

Next, when the TV camera 120 starts to turn, the video signal of the participant 1 photographed by the TV camera 120 and the turning state of the TV camera 120 should be "turning" to "participant 2". When the TV camera starts to turn after entering a turning state after transmitting a control signal indicating
The transmission of the video signal from the conference room 100 to the conference room 200 is stopped, the received control signal is analyzed in the conference room 200, and T
The turning state of the V camera 120 is “turning” to “participant 2”
Is recognized, the writing of the video signal to the reception frame memory unit 2322 corresponding to the participant 2 is prohibited, and the video signal of the participant 2 written in the reception frame memory unit 2322 is output at this time. A still image of the participant 2 is displayed on the monitor 220.

Then, when the TV camera 120 ends the turn toward the participant 2 and is stopped, the transmission of the video signal from the conference room 100 to the conference room 200 is restarted, and the conference room 1
From 00, the video signal of the participant 2 captured by the TV camera 120 and the turning state of the TV camera 120 are “participant 2”.
To the conference room 20 with a control signal indicating that it is in the "stop" state.
0, and the conference room 200 analyzes the received control signal, recognizes that the turning state of the TV camera 120 is “stop” for the “participant 2”, and receives the frame memory corresponding to the participant 2 The video signal can be written to the unit 2322, the received video signal is sent to the monitor 220, and the moving image of the participant 2 is displayed on the monitor 220.

Although not shown, regardless of the turning state of the TV camera 120, the synthesized voices of the participants 1, 2, and 3 are continuously transmitted through the communication path 300 to the speaker 2 of the conference room 200.
It goes without saying that it will be played back to 10.

At the beginning of the conference, nothing is recorded in the reception frame memory units 2321, 2322, and 2323 in FIG. 14, so that when the TV camera 120 first turns toward a participant, the TV During the turning of the camera 120, the image of the participant who is the turning destination cannot be displayed. The problem is that at the start of the conference, all participants 1, 2 and 3 are introduced to themselves, and the TV cameras 120 are temporarily turned to all the participants 1, 2 and 3 to receive a frame memory. The problem can be solved by causing the units 2321, 2322, and 2323 to write the images of the participants 1, 2, and 3.

According to the present embodiment, since the video signal is not transmitted during the turning of the TV camera, it is possible to avoid displaying an image with poor image quality during the turning of the TV camera, and the communication cost can be reduced by reducing the transmission amount. Can be reduced.

Further, according to the present embodiment, since the still image of the turning destination is displayed while the TV camera is turning, even if the TV camera is turning, the TV display is not interrupted and the TV is always displayed. When the TV camera can display the image directed by the camera and the speaker is turning, the still image of the speaker at the turning destination is displayed. Therefore, the video display on the monitor is interrupted even when the TV camera is turning. Without doing so, the video of the speaker can be always switched to and displayed on the monitor in accordance with the sound reproduced from the speaker.

Next, a fifth embodiment of the present invention will be described.

In FIG. 18, 100 and 400 are conference rooms on the transmitting side, 200 is a conference room on the receiving side, and 300 is a communication network connecting the conference rooms 100 and 400 with the conference room 200. The configuration of the conference rooms 100 and 400 is the conference room 10 of FIG.
The same as 0, participants 1, 2, 3 not shown in the conference room 100, participants 4 not shown in the conference room 400,
Five and six are participating in the conference.

In the conference room 200, 230 is the conference room 1
00 is a transmission decoding unit that decodes a signal received from the communication network 300, 210 is a speaker that reproduces an audio signal from the transmission decoding unit 230, and 220 is a transmission decoding unit 2.
It is a monitor that displays the video signal from 30 on the screen.

FIG. 19 is a block diagram of the transmission decoding unit 230. In FIG. 19, reference numeral 234 is a line I / F unit that receives a signal from the communication network 300. 2351 is line I /
The separation unit 2371 separates the multiplex signal of the conference room 100 from the F unit 234 into a plurality of signals before multiplexing, and 2371 is the separation unit 2.
A voice decoding unit that decodes the voice signal from 351; 23
Reference numeral 81 is a D / A conversion unit that converts the audio signal from the audio decoding unit 2371 into an analog signal, and 2331 is a separation unit 235.
A video decoding unit 232 for decoding the video signal from 1
1, 2322 and 2323 are participants 1, 2, 3 respectively.
Corresponding to, a reception frame memory unit that stores the video signal from the video decoding unit 2331, 2311 is a D / A conversion unit that converts the output of the reception frame memory units 2321, 2322, and 2323 into an analog signal, and 2421 is a reception frame. A changeover switch that connects any one of the outputs of the memory units 2321, 2322, and 2323 and the input of the D / A conversion unit 2311, 2361 is a control signal I / F unit that outputs the control signal from the separation unit 2351 as control information, A reference numeral 2391 analyzes control information from the control signal I / F unit 2361, controls writing of a video signal into the reception frame memory units 2321, 2322, and 2323, and also performs changeover switch 24.
21 is a control information identification unit that controls the connection of 21.

Reference numeral 2354 denotes a separation unit for separating the multiplex signal of the conference room 400 from the line I / F unit 234 into a plurality of signals before multiplexing, and 2374 is a voice for decoding the audio signal from the separation unit 2354. Decoding unit, 2384 is a D / A conversion unit for converting the audio signal from the audio decoding unit 2374 into an analog signal, 2334 is a video decoding unit for decoding the video signal from the separating unit 2354, 2324, 2325, 2
Reference numeral 326 corresponds to the participants 4, 5, and 6, respectively, and is a reception frame memory unit for storing the video signal from the video decoding unit 2334. Reference numeral 2314 is a reception frame memory unit 2324.
D that converts the outputs of 2325 and 2326 into analog signals
A / A conversion unit, 2424 is a reception frame memory unit 232
D / A with one of the outputs of 4, 2325, and 2326
Changeover switch 236 for connecting the input of the conversion unit 2314
Reference numeral 4 denotes a control signal I / F unit that outputs the control signal from the demultiplexing unit 2354 as control information, and 2394 analyzes the control information from the control signal I / F unit 2364, and outputs the received frame memory units 2324, 2325, and 2326. It is a control information identification unit that controls the writing of the video signal and the connection of the changeover switch 2424.

Reference numeral 2310 denotes D / A conversion units 2381 and 23.
A voice synthesizer 2320 for synthesizing the voice signal from 84 and outputting it to the speaker is a D / A converter 2311 and 2314.
This is a video synthesizing unit for synthesizing the video signals from and outputting to the monitor.

The process flow chart of the conference control units 110 and 410 (not shown) in the conference rooms 100 and 400 in FIG. 18 may be the same as that in FIG. Further, the flow chart of the processing of the control information identifying units 2391 and 2394 in FIG. 19 may be the same as that in FIG.

FIG. 20 shows the TV camera 12 shown in FIG.
The relationship between the turning operation of 0 and the display image of the monitor 290 is shown. In FIG. 20, first, the TV camera 1 in the conference room 100
20 and the TV camera 420 of the conference room 400 are in the stopped state toward the participant 1 and the participant 4, respectively, from the conference room 100, the video signal of the participant 1 captured by the TV camera 120 and the TV camera 120 of the participant. A control signal indicating that the turning state is the “participant 1” is in the “stop” state is transmitted to the conference room 200, and the TV camera 42 is transmitted from the conference room 400.
0 video signal of participant 4 and TV camera 420
The control signal indicating that the turning state of the “participant 4” is in the “stop” state is sent to the conference room 200, and in the conference room 200, the received video signal is sent to the monitor 220 and the monitor 220.
The moving images of the participants 1 and 4 are displayed in.

Next, when the TV camera 120 in the conference room 100 starts turning to the participant 2, the video signal of the participant 1 captured by the TV camera 120 and the turning state of the TV camera 120 are changed to “participant 2”. After the control signal indicating that the TV camera 420 is in the "turning" state and the video signal of the participant 4 captured by the TV camera 420 are transmitted to the conference room 200, the TV camera starts to turn. From meeting room 200
Transmission of the video signal to the
The video signal of the participant 4 captured by the V camera 420 is transmitted to the conference room 200, the control signal received is analyzed in the conference room 200, and the turning state of the TV camera 120 indicates “participant 2” is “turning”. Recognizing that there is, the writing of the video signal to the reception frame memory unit 2322 corresponding to the participant 2 is prohibited, and the video signal of the participant 2 written in the reception frame memory unit 2322 at this time is received. The video signal of the participant 4 is sent to the monitor 220, and the still image of the participant 2 and the moving image of the participant 4 are displayed on the monitor 220.

Then, the TV camera 120 in the conference room 100
Turns to Participant 2 and stops,
The transmission of the video signal from the conference room 100 to the conference room 200 is restarted, and from the conference room 100, the video signal of the participant 2 captured by the TV camera 120 and the turning state of the TV camera 120 become “participant 2”. A control signal indicating the “stop” state is transmitted to the conference room 200, and the conference room 400 receives the TV signal.
The video signal of the participant 4 captured by the camera 420 is transferred to the conference room 2
00, the conference room 200 analyzes the received control signal, recognizes that the turning state of the TV camera 120 is “stop” for “participant 2”, and receives frame memory corresponding to participant 2 The video signal can be written to the section 2322, the received video signal is sent to the monitor 220,
The moving images of the participants 2 and 4 are displayed on the monitor 220.

Although not shown, the TV camera 12
0 and the turning state of the TV camera 420, the synthesized voices of the participants 1, 2, 3 and the participants 4, 5, 6 are constantly reproduced on the speaker 210 of the conference room 200 via the communication path 300. Needless to say.

At the start of the conference, the reception frame memory units 2321, 2322, 2323, 2 in FIG.
Nothing is recorded in 324, 2325, and 2326. Therefore, when the TV cameras 120 and 420 make a turn toward a participant for the first time, the TV cameras 120 and 4 are not recorded.
During the turn of 20, the image of the participant who is the turn destination cannot be displayed. The problem is that at the start of the meeting, all participants 1, 2, 3, 4, 5, 6 introduce themselves, and all participants 1, 2, 3, 4, 5, 6 are temporarily introduced. By rotating the TV cameras 120 and 420, the reception frame memory units 2321, 2322, 2323, 2324,
The problem can be solved by writing the images of the participants 1, 2, 3, 4, 5, 6, in 2325, 2326.

According to this embodiment, since the video signal of the conference room is not transmitted while the TV camera of the conference room is rotating,
It is not necessary to display an image with poor image quality while the TV camera is rotating, and it is possible to reduce communication costs by reducing the amount of transmission.

Further, according to this embodiment, a TV in a conference room
Since the still image of the turning destination of the TV camera in the conference room is displayed while the camera is turning, even if the TV camera turns, the video display on the monitor is not interrupted and the TV in each meeting room is always displayed. The image that the camera faces can be displayed on the monitor at the same time.

Further, according to the present embodiment, when the TV camera is turning to the speaker in a conference room, a still image of the speaker to whom the TV camera in the conference room turns is displayed.
Even if the camera turns, the video display on the monitor is not interrupted, and the video of the speaker can be switched to and displayed on the monitor at the same time according to the sound of each conference room reproduced from the speaker.

In the above embodiment, the number of participants in the conference room is three.
Although the case of a person has been described, the number of participants may be one, two, four or more. Further, the configuration of the video conference system has been described in the case of the two-point and three-point conferences, but it is also applicable to a multipoint conference system of four or more points.

Although the above embodiment has been described with respect to the case where the TV camera turns, it can be applied to the case where the zoom ratio of the TV camera is changed.

[0077]

As described above, according to the present invention, while the TV camera on the transmitting side is turning, the video transmission is stopped and the image on the receiving side monitor is received immediately before turning or is stored in advance. By displaying, it is possible to prevent the transmission of wasteful video data, which has a large amount of information, and to reduce the running cost of communication. Also, while the TV camera is turning, the video of the conference participant at the turning destination or the receiving side is desired. The video can be viewed, and the conference can be smoothly advanced without interrupting the video display on the monitor.

While the TV camera is turning toward the speaker on the transmitting side, the transmission of the video signal is stopped, the speaker's voice is reproduced on the speaker on the receiving side, and the speaker on the receiving side monitors. By displaying the image of, it is possible to switch the display image on the monitor to the image of the speaker who turns the TV camera in synchronization with the sound, and always see the image that suits the speaker's voice and smoothly. You can proceed to the meeting.

Further, when the TV camera on the transmitting side is turning, the transmission of the video signal is stopped and the character data indicating the turning destination is displayed on the monitor on the receiving side instead of the image of the turning destination. While the TV camera is turning, the conference participant at the turning destination can be known.

[Brief description of drawings]

FIG. 1 is a diagram showing an example of a configuration of a video conference system according to the present invention.

FIG. 2 is a diagram showing a configuration of a transmission encoding unit in the video conference system shown in FIG.

FIG. 3 is a diagram showing a configuration of a transmission decoding unit in the video conference system shown in FIG.

FIG. 4 is a flowchart showing a function of a conference control unit in the video conference system shown in FIG.

5 is a flowchart showing the function of a control information identifying unit in the transmission decoding unit shown in FIG.

FIG. 6 is a diagram showing a relationship between a turning operation of a TV camera and a display image on a monitor in the first embodiment.

7 is a diagram showing a second configuration example of a transmission decoding unit in the video conference system shown in FIG.

8 is a flowchart showing another embodiment of the control information identifying section in the transmission decoding section shown in FIG.

FIG. 9 is a diagram showing another embodiment of the relationship between the turning operation of the TV camera and the display image on the monitor in the second embodiment.

10 is a configuration diagram showing a third embodiment of the transmission decoding unit in the video conference system shown in FIG.

11 is a flowchart showing another embodiment of the function of the conference control unit in the video conference system shown in FIG.

12 is a flowchart showing another embodiment of the processing of the control information identifying unit in the transmission decoding unit shown in FIG.

FIG. 13 is a diagram showing a relationship between a turning operation of a TV camera and a display image on a monitor in the third embodiment.

14 is a configuration diagram showing a fourth embodiment of the transmission decoding unit in the video conference system shown in FIG.

15 is a flowchart showing another embodiment of the function of the conference control unit in the video conference system shown in FIG.

16 is a flowchart showing another embodiment of the function of the control information identification unit in the transmission decoding unit shown in FIG.

FIG. 17 is a diagram showing the relationship between the turning operation of the TV camera and the display image on the monitor in the fourth embodiment.

FIG. 18 is a diagram showing another configuration example of the video conference system according to the present invention.

19 is a diagram showing a configuration of a transmission decoding unit in the video conference system shown in FIG.

FIG. 20 is a diagram showing the relationship between the turning operation of the TV camera and the display image on the monitor in the fifth embodiment.

[Explanation of symbols]

100 ... Conference room (sending side) 1, 2, 3 ... Participants,
11, 12, 13 ... Microphone, 111 ... Remote control, 112 ... Speaker detection section, 113 ... Microphone mixer, 110 ... Conference control section, 120 ... TV camera, 121 ... Electric pan, 122 ... ... switch, 130
... transmission encoding unit, 300 communication network, 200 conference room (reception side), 210 speaker, 220 monitor, 230 transmission decoding unit.

Claims (3)

[Claims] 1. A camera device with a turning function for photographing a conference participant in a first conference room, a display monitor device for the video data provided in a second conference room, and video data of the camera device. In a video conference system comprising a video communication device for transmitting the video data to the display monitor device via a communication network, the video monitor device stops transmission of input video data from the camera device while the camera device is turning. A partner video switching system for a video conference system, which outputs video data that has already been received or predetermined video data that has been stored in advance to the device. 2. A camera device with a turning function for photographing a conference participant in the first conference room, a sound collecting device for picking up the voice of the conference participant, and a sound collecting device provided in the second conference room. A display monitor device and an audio data reproducing device, and a display monitor device and audio data provided in the second conference room via the communication network for the video data from the camera device and the audio data from the sound collecting device. In a video conference system including a communication device for transmitting to a playback device, a means for detecting a conference participant who is speaking based on the sound level of the sound collecting device, and a speech according to an output from the detecting means. Control means for turning the camera device so as to face the conference participant, and while the camera device is turning, the transmission of the video data is stopped, and in this state, the display monitor device Party video switching system of a television conference system and outputs a predetermined video data already stored image data or pre-Received by. 3. The method according to claim 1, wherein the camera device stops transmitting the video data during turning, and outputs character data indicating a turning destination of the camera to the display monitor device. The video switching method of the other party of the video conference system according to Item 2.