JPH02235492A - Video conference system among multi-point - Google Patents

Abstract

PURPOSE:To attain video conference while a picture for all participants of the video conference is observed through one digital line by displaying the picture of an utterance party as a moving picture and displaying the picture of non-utterance parties as a still picture. CONSTITUTION:When a video conference terminal equipment 2a gives the request of connection to other video conference terminal equipments 2b-2d to a multi-point video conference communication controller 1, the controller 1 connect to the terminal equipments 2a-2d through line interface sections 11a-11d. When the connection is finished, the video conference communication is attained among the terminal equipments 2a-2d by using a picture and an audio signal. A video processing section 22 adds a picture identification signal to an inputted video signal by one pattern from the terminal equipment 2a of a station A and sends the result to the other station terminal equipments 2b-2d and the video signal from the station B is sent to the terminal equipments 2a, 2c and 2d together with the picture identification signal by one pattern. Since almost all the limited transmission speed is assigned for the video signal of the station A in this way, a smooth moving picture is displayed on each terminal equipment.

Description

[Detailed Description of the Invention] [Industrial Application Field] The present invention relates to a multipoint video conference system in which three or more video conference terminals are connected via a multipoint video conference communication control device. .

C. Prior Art] FIG. 4 is a functional block diagram showing a conventional multipoint video conference communication control device disclosed in, for example, Japanese Patent Application Laid-Open No. 60-43954. ). teeth,
It is a multi-point video conference communication control device, and (2a) to (2d) are video conference terminals that transmit and receive encoded video signals and audio signals, and are station A, station B, station C, and station D.
Subscripts (a), (b), (c) are attached to the station's video conference terminal, respectively.
), (d) were attached.

And, (3a) to (3d) are digital lines that transmit digital signals in both directions, and (lla) to (11d) are digital lines that are connected to the digital lines (3a) to (3d). This is a line interface unit that controls the interface and synthesizes and distributes video and audio signals.

Also, (12) is . Digital line (3a) to (3d)
and line interface section (1 1 a) ~ (lid
) through audio signal input lines (18g) to (18d) and multiplexes the audio signals from each video conference terminal (2a) to (2d) to output audio signal output lines (19a) to (19).
d) to the line interface section (lla) to (lid
) and digital lines (3a) to (3d) to the respective video conference terminals (2a) to (2d).

Furthermore, (13) is an audio level detection unit having a function of detecting the level of each input audio signal and transmitting an identification signal to the control unit (14), and (14) is an audio level detection unit ( Based on the audio level of 13), the video processing unit (15)
This is a control unit that controls the

(15) is a video processing unit that exchanges and distributes video signals under the control of the control unit (14);
) to (16d) are video signal input lines, and (20) is a speaker identification signal line.

Moreover, FIG. 5 is a functional block diagram showing the configuration of a conventional video conference terminal (2a), and in the figure, (2 0 1
) is a line interface unit that controls the interface with the digital line (3a) and synthesizes and separates video signals and audio signals.

Furthermore, (2 0 2) decodes the video signal input from the multipoint video conference communication control device (1) (see Figure 4) via the digital line (3a) and line interface section (201). This is a video signal decoding unit that outputs the video signal to the video memory unit (2 0 3), and (2 0 3) is
This is a video memory section that stores the video signal input from the video signal decoding section (202).

(204) converts the digital video signal into an analog video signal for each screen and converts the video Tanabata part (204) into an analog video signal for each screen.
It is a video signal D/A converter that outputs to (2).
05) is a video monitor unit that displays the analog video signal input from the video signal D/A converter (204).

Further, (206) is a video camera unit that shoots video of its own station and outputs it as an analog video signal;
7) is a video signal A/D conversion unit that converts the analog video signal input from the video camera unit (2 0 6) into a digital video signal and then outputs it, and (2 0 8)
is a video signal A/D converter that encodes and outputs a digital video signal input manually from the video signal A/D converter (207).

Furthermore, (2 0 9) is a line interface section (2 0 9).
(2 1 0) is an audio signal decoding unit that decodes and outputs the audio signal input through the audio signal decoding unit (2 0 9), and (2 1 0) converts the digital audio signal output from the audio signal decoding unit (2 0 9) into an analog This is an audio signal D/A converter that converts the audio signal into an audio signal and then outputs the audio signal.
This is a speaker section that converts the analog audio signal output from the conversion section into an acoustic signal and outputs it.

Further, (212) is a sake unit that outputs the audio of its own station as an analog audio signal, and (213) is a sake unit that converts the analog audio signal input from the microphone unit (2 1 2) into a digital audio signal. Audio signal A/ to be output after conversion
This is a D conversion unit, and (2 1 4) is an audio signal encoding unit that encodes and outputs the digital audio signal input from the audio signal A/D conversion unit (2 1 3).

Next, the operation will be explained. For example, a video conference terminal (
When 2a) requests the multipoint videoconference communication control device (1) for connection with other videoconference terminals (2b) to (2d), that is, when the videoconference terminal (2a) is the host terminal, the multipoint videoconference terminal (2a) is the host terminal. A point-to-point video conference communication control device (1) is connected to video conference terminals (2a) to (2d) via line interface units (lla) to (lld).

When the connection is completed, the video conference terminal (2a)
(2d) using images and audio. Video conference communication is possible.

In this case, since station A is the host, the video processing unit (l
5) is A input via the video signal input line (16a)
Video signals from the station's video conference terminal (2a) are sent to other video conference terminals (2b), (2C), and (2d) via video signal output lines (1?b), (17C), and (17d). send out.

The audio processing unit (12) also connects the audio signal input line (18a) to the audio signal input line (18a).
, (18b), and (18c) are synthesized and sent to the audio signal output line (19d), and similarly to the audio signal input line (19d).
8b), (18c), and (18d) to synthesize the input audio from the audio signal input lines (18a), (18c), and (18d) to the audio signal output 11 (19a). Then, input sounds from the audio signal input lines (18a), (18b), and (18d) are synthesized and output to the audio signal output line (19c).

At this time, at the video conference terminal (2b) of station B, the digital line (3
b) and the digital video signal obtained via the line interface unit (2 0 1) of the video conference terminal (2b) is decoded by the video signal decoding unit (202), and is decoded by the video signal decoding unit (202) and then decoded by the video memory unit (2 0 3). After being accumulated, the video signal for each screen is D/A converted in the 4D/A converter (204) to become an analog video signal, which is sent to the video monitor unit (204).
5) will be displayed.

Further, the digital audio signal is processed by an audio signal decoding unit (20
9), and is D/A converted in an audio D/A converter (210) to become an analog audio signal and output from a speaker unit (2 1 1).

Note that similar operations are performed on the video conference terminals (2c) and (2d) of other stations.

Then, when the user of the video conference terminal (2a) of station A, that is, the host starts speaking, the audio level detection unit (13) of the multipoint video conference communication control device (1) From ~(2d), audio signal input line (1
8a) to (18d), detects the audio from the audio signal input line (18a) with the highest level, and detects the audio from the audio signal input line (18a) of the station A. 2) Sends information indicating that the input signal is from a) to the control unit (14).

Then, the control unit (14) compares the information with the current status of the image communication path of the video processing unit (15) and, since there is no change, does not change the connection of the image communication path of the video processing unit (15). .

At this time, the video monitors (2 0 5) of each of the teleconference terminals (2a) to (2d) display on their screens the image sent out from the teleconference terminal of station A, which is the current speaker.

Next, when the user of the video conference terminal (2b) of station B starts speaking, the audio level detection unit (13) of the multipoint video conference communication control device (1) detects the audio level by the same operation as described above. Changes in the level of input audio from the signal human power lines (18a) to (18d) are detected and notified to the control unit (14).

The control unit (14) then controls the video conference terminal (2) of the B station.
b) The video signal from the video signal output line (17a), (1
7c), (17d) to another station's video conference terminal (2).
The connection of the image communication path of the video processing unit (15) is changed so that the video is sent to a), (2C), and (2d).

At this time, the video monitor section (205) of each of the video conference terminals (2a) to (2d) displays the video conference terminal (2b) of station B, which is the current speaker. The transmitted images are displayed on the screen.

[Problems to be Solved by the Invention] By the way, in the conventional multipoint video conference communication control device described above, only the image of the speaker can be displayed on the monitor screen of each video conference terminal, and the image of multiple conference participants cannot be displayed. In order to display images, the number of lines and 72 majority numbers had to be increased.

This invention was made to solve the above-mentioned problem, and the monitor screen of each video conference terminal is divided into multiple parts to display only the image of the speaker as a moving image, while the images of other non-speakers are displayed as still images. An object of the present invention is to obtain a multipoint video conference device that can display images.

[Means for Solving the Problems] A multipoint video conference communication control device according to the present invention has a function of transmitting a moving image signal of a speaker and a still image signal of a non-speaker at the end of each session. be. Then, the video conference terminal generates a monitor screen from the moving image signal and still image signal sent from the multipoint video conference a-control device, and displays the video of the speaker and the still image of the non-speakers on each terminal monitor. Display the images at the same time.

[Operation] The identification signal converting function in the present invention adds the identification signal sent from the audio level detection section to each piece of transmitted image information for each screen.

Further, the memory selection section identifies the image sent from the multipoint video conference communication control device based on the identification signal, and if the transmitted image is of a speaker, it is stored in the video memory section, and the image of a non-speaker is sent to the video memory section. If so, it is transferred to the still image memory section.

Further, the output screen synthesis section reads image information necessary for creating a monitor output screen from each moving image memory section and still image memory section, and outputs it to the monitor.

[Example] An embodiment of the present invention will be described below with reference to the drawings.

Note that the same parts as in FIG. 4 are designated by the same reference numerals and their explanation will be omitted.

FIG. 1 is a functional block diagram showing the multipoint video conference communication control device of the present invention, and (21) is a block diagram showing the video processing unit (22) based on the audio level of the audio level detection unit (13).
The controller (22) is controlled by the controller (21) and has a function of exchanging and distributing video signals, as well as transmitting an identification signal to the video processing unit (22). This is a video processing unit that has a function of adding a video identification signal indicating whose image belongs to video information.

FIG. 2 is a functional block diagram showing a video conference terminal according to the present invention, and the same parts as in FIG. In Figure 2, (2 2 1
) connects the multipoint video conference communication control device (11) to the digital line (3a) and the line interface unit (2).
0 1) is decoded and output to the memory select section (2 2 3), and the image identification signal sent at the same time is decoded and output to the control section (2 2 3).
This is a video signal decoding unit that transfers the video signal to 2).

(2 2 2) is a video signal decoding unit (221
) is a control unit that controls the memory select unit (2 2 3) based on the image identification signal sent from (2 2 3).
3) converts the video signal sent from the video signal decoding unit (2 2 1) into a still image memory unit (224) and (2 2
5) or a memory select unit that transfers the data to the video memory unit (2 2 6).

Furthermore, (2 2 4) and (2 2 5) are still image memories that store images of non-speakers and can be read out as needed, and (2 2 6) stores images of speakers. This is a video memory section that can be read out as needed.

Furthermore, (2 2 7) is a video camera section (2 0 6
) is a self-portrait video memory section that can store and read out the image edges photographed from the still image memory section (2 2 4), (2 2 5), and the video memory section (228). 2 2 6) and self-portrait video memory section (2 2
7) is an output double-sided combining unit that reads video information for each screen and transfers it to the video signal D/A converter (204).

Next, the operation will be explained.

The video conference terminal (2a) is connected to another video conference terminal (2b)
When a request for connection with ~(2d) is made to the multipoint video conference communication control device (1), the multipoint video conference communication control device (1) connects the line interface units (1 1 a) to (
Each video conference terminal (2a) to (2d) via
Connect with. When the connection is completed, video conference communication can be performed between the video conference terminals (2a) to (2d) using images and audio.

First, the video processing section (22) connects the video signal input line (16a
), information indicating that the video signal is from station A (image identification signal) is added to the video signal for one screen from the video conference terminal (2a) of station A input via the video signal output line. (17b) to (17d) to the video conference terminals (2b) to (2d) of other stations, and then sends the video signal from station B along with the image identification signal for one screen to the video conference terminal (2a), Send to (2C) and (2d).

Similarly, the video signals from stations C and D are sent out for one screen, and then the video signal from station A is sent out continuously, so almost all of the limited transmission speed can be allocated to the video signal from station A. Therefore, smooth videos are displayed on each device. Note that the audio processing unit (12) is the same as in the conventional example, so a description thereof will be omitted.

At this time, the video conference terminal (2b) of station B uses the digital line (3b) from the multipoint video conference communication control device (1).
) and the digital video signal obtained through the line interface section (2 0 1) of the video conference terminal (2b) is decoded by the video signal decoding section (221) and output to the memory selection section (2 2 3). , the image identification signal is transferred to the control section (2 2 2).

Then, the control section (2 2 2) identifies this image identification signal and sends the video signal from the video signal decoding section (221) to the memory selection section (2 2 3). ), and the video signal for one screen of station A is stored in the video memory section (226).

Furthermore, the video signal for one screen from the next station C is stored in the still image memory section (2 2 4), and the video signal for one screen from station D is stored in the still image memory section (2 2 5). , the video signal for one screen sent next from station A is stored in the video memory section (2 2 6), and then the video signals from consecutive stations A are stored in the video memory (2 2 6). be done.

On the other hand, the video signal of the own station output from the video camera section (206) is converted into A/D converter section (207).
/D converted and then input to the video signal encoding unit (2 0 8), and the self-portrait video memory unit (2 2 7)
is stored in

The output screen synthesis section (2 2 8) includes still image memory sections (2 2 4), (2 2 5), moving image memory section (2 2 6), and self-portrait moving image memory section (2 2 7).
The video signals for one screen are read out from
It is converted into an analog video signal and sent to the video monitor section (
205). The monitor display state of station B at this time is shown in FIG. 3(a). Note that the audio-related processing is the same as in the conventional example, so a description thereof will be omitted.

Next, when the video conference terminal (2a) of station A gives a greeting to start the conference, the audio level detection unit (13) of the multipoint video conference communication control device (1) detects each video conference terminal (2a) to
From (2d), audio signal input lines (18a) to (18d
) is detected, and the audio from the audio signal input line (18a) with the highest level is detected, and it is transmitted to the video conference terminal (2a) of station A.
The control unit (21) transmits information indicating that the input signal is from the control unit (21).
Transfer to.

Then, the control unit (21) uses the information and the current video processing unit (
Comparing the status of the image communication path of 22), there is no change, so we do not change the connection of the image communication path of the video processing unit (22), and
Continues to send video signals from the station.

At this time, only the part of the image sent from the video conference terminal of station A, which is the current speaker, becomes a moving image on the video monitor (205) of each video conference terminal (2a) to (2d), and the other The part of the non-speaker is displayed as a still image. At this time, the monitor display state of station B remains as shown in FIG. 3(a).

Next, when the video conference terminal (2b) of station B starts speaking, the audio level detection unit (13) of the multipoint video conference communication control device (1) detects the audio signal input line (la) in the same manner as described above.
Detect changes in the level of input audio from a) to (18d), and select the audio signal input with the highest level! 1 (18b), and the audio is transmitted to the video conference terminal (2a) of station B.
), and the control unit (21) transmits the video signal from the video conference terminal (2b) of station B to the video signal output lines (17a) and (17c).
, (17d) to another station's video conference terminal (2a),
(2C) and (2d).
) and continue sending video signals from station B.

At this time, each video conference terminal (2a) to (2d)
The video signal from the station is stored in the video memory section (226),
Video signals from other stations are stored in the video memory section (2 2 6
), and video signals from other stations are allocated to still image memory sections (2 2 4) and (2 2 5). At this time, the monitor display state of the B station is as shown in FIG. 3(b). Further, the monitor display state of station B while station C or station D is speaking is displayed in FIG. 3(c) or (d).

For example, in the case of station D, still image information of station B is stored in the still image memory section (2 2 4), still image information of station C is stored in the still image memory section (2 2 5), and still image information of station C is stored in the still image memory section (2 2 5). ) is assigned the video information of station A, and when the speaker changes from station A to station B, the video memory section (2 2
6) The latest video information is stored in the still image memory section (2 2 4)
The video signal of station B obtained from the multipoint video conference communication control device (1) via the digital line (3d) and the line interface unit (201) is stored as still image information in the video memory unit (201). 2 6).

Furthermore, the video memory (2 2 6) of station B, which is currently speaking, operates as a still image memory and stores still image information of station A.

In the above embodiment, the video conference terminal is directly connected to the digital line, but the present invention is not limited to this, and a private branch exchange may be provided between the digital line and the video conference terminal.

Further, in the above embodiment, the self-portrait screen is also displayed in the monitor screen configuration, but the screen configuration may be such that the self-portrait screen is not displayed.

[Effects of the Invention] As explained above, according to the present invention, the image of the speaker is displayed as a moving image, and the image of the non-speaker is displayed as a still image. You can hold a video conference while viewing everyone's images.

Furthermore, if only the speaker is displayed as a moving image, the movement of the speaker's image can be made extremely smooth.

[Brief explanation of the drawing]

FIG. 1 is a functional block diagram showing a multipoint video conference communication control device according to the present invention, FIG. 2 is a functional block diagram showing a video conference terminal, and FIG. 3 is a diagram showing the monitor screen configuration of station B. , FIG. 4 is a functional block diagram showing a conventional multipoint video conference communication control device, and FIG. 5 is a functional block diagram showing a conventional video conference terminal. In the figure, (1) is a multipoint video conference communication control device, (2a), (2b), (2C), and (2d) are video conference terminals, and (3a), (3b), (3C), and (3d) are video conference terminals. ) is a function to send video signals (digital line), (2 0 5
) is the terminal monitor (video monitor section). In addition, in the figures, the same reference numerals indicate the same or equivalent parts. Agent Patent attorney Masuo Oiwa (2 others) Fig. 2゜ (0) AA Kama 1 person (b) B station past B q also has a Shinu painting, display → Kakyu 3rd figure Ito -,yreC゛EiIsshoji Book Figure 5 3. Manual version of the person making the correction 5. Patent claim of the specification subject to amendment 6. Contents of the amendment Claims A video conference using images and sounds between three or more terminals that transmit and receive images and sounds, and a multipoint video conference that accommodates these terminals and each other's subscriber terminals. In a multipoint video conference conducted via a communication control device, the multipoint video conference communication control device has a function of transmitting a video video signal of a speaker and a still image video signal of a non-speaker to each terminal. , each terminal generates a monitor screen from the moving image signal and still image signal sent from the multipoint video conference communication control device, and displays the moving image of the speaker and the still image of the non-speaker on the monitor of each terminal. A multipoint video conference system characterized by simultaneous display.

Claims (1)

[Claims] A multipoint video conference that accommodates a video conference using images and audio between three or more terminals that transmit and receive images and audio, and mutually accommodates these terminals and subscriber terminals. In a multipoint video conference conducted via a communication control device, the multipoint video conference communication control device has a function of transmitting a video video signal of a speaker and a still image video signal of a non-speaker to each terminal. , each terminal generates a monitor screen from the moving image signal and still image signal sent from the multipoint video conference communication control device, and displays the moving image of the speaker and the still image of the non-speaker on the monitor of each terminal. A multipoint video conference system characterized by simultaneous display.