JPH07250313A - Multi-point video conference terminal equipment - Google Patents

Abstract

PURPOSE:To provide a multi-point video conference terminal in which image data at an optional point are displayed on a display means, the image data at an optional point are displayed on the display means even in the case of the multi-point communication system and also image data at other point are displayed simultaneously on the display means. CONSTITUTION:Image data at a point designated by input information from an input section 10 are displayed on a display section 2 under the control of a system control section 11. Furthermore, in the multi-point communication system, image data at an optional point designated by input information from the input section 10 or image data at multi-points are displayed simultaneously on the display section 2.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multipoint video conference terminal for holding a conference between multiple points while displaying image data of multiple points on a display means.

[0002]

2. Description of the Related Art In recent years, the effectiveness of a video conference terminal using a communication line has been emphasized from the viewpoints of reducing business trip costs and effectively utilizing time. Then, not only a video conference terminal having a point-to-point function between two points but also a multi-point video conference terminal having a multipoint function capable of holding a conference between a number of points at the same time has been developed.

FIG. 4 is a block diagram showing the structure of a conventional multipoint video conference terminal of this type. In the figure, 1
Is a camera as an image input means of this terminal, which inputs a self-portrait, a drawing and the like. A display unit 2 displays input image data from the camera 1, received image data from the other party, and the like, and is a CRT (Cathode RayTu).
be; cathode ray tube) or LCD (Liquid Crys)
tal Display; liquid crystal display) and the like. Three
Is a video input interface unit, which switches image input means (camera 1) in accordance with an instruction from a system control unit 11 described later, A / D conversion of image data (conversion from analog to digital), image data size conversion, image data conversion Format conversion is performed.

Reference numeral 4 denotes a video output interface section which serves as a received image scaling section 4a for converting the image size of the received image data and an area for temporarily storing the image data when the image size is converted by the received image scaling section 4a. An image memory unit 4b, an image memory control unit 4c that controls writing and reading of image data to and from the image memory unit 4b, and image data read from the image memory unit 4b under the control of the image memory control unit 4c. , TV) of the TV signal.

Reference numeral 5 denotes a video encoding / decoding unit, which is ITU-
Recommendation of H.T (former CCITT; International Telegraph and Telephone Advisory Committee) The video coding unit 5 performs coding processing of a transmission image signal and decoding processing of a reception image signal according to H.261.
a and a video decoding unit 5b. 6 is a handset as a voice input / output unit of the terminal, 7 is a microphone / speaker as another voice input / output unit of the terminal, 8 is a voice input / output interface unit, and the handset 6 or the microphone / speaker 7 is used. Echo cancellation processing to eliminate echo at times, generation processing of tones such as dial tone, ringing tone, busy tone, and ringing tone, switching processing of voice input / output means (handset 6 and microphone / speaker 7) according to instructions from the system control unit 11 It is something to do.

Reference numeral 9 denotes a voice encoding / decoding unit, which is instructed by the system control unit 11 so that 64 kbps PCM A-law,
64 kbps PCM μ-law, 64 kbps / 56 kb
ps / 48kbps SB-ADPCM, 32kbps
ADPCM, 16 kbps (for example, LD-CEL
P), 8 kbps, etc., according to a voice encoding / decoding algorithm, it performs a transmission voice signal encoding process and a reception voice signal decoding process, and comprises a voice encoding unit 9a and a voice decoding unit 9b. . An input unit 10 is for inputting control information for performing overall control of this terminal, and includes a keyboard, a touch panel, a mouse, and the like.

Reference numeral 11 denotes a system control unit, which is a CPU (Cen
central processing unit), ROM (Read Only Memory)
y; read-only memory), RAM (Random A)
access memory; a readable / writable memory), an auxiliary storage device, and the like, and monitors the status of each unit, controls the entire terminal, creates an operation / display screen according to the status, and executes an application program. . 1
2 is a demultiplexing / multiplexing unit, which is recommended by ITU-T. In accordance with H.261, the audio signal from the audio encoding unit 9a, the image signal from the video encoding unit 5a, and the control signal from the system control unit 11 are multiplexed in transmission frame units, and the reception frame is separated into each medium of constituent units. Then, each part is notified. Reference numeral 13 is a line interface section for ISDN
(Service integrated digital network) The line is controlled according to the user network interface. Reference numeral 14 is a communication line such as ISDN.

Next, the operation of the multipoint video conference terminal configured as described above will be described.

An input image from the camera 1 is input to the video encoding unit 5a via the video input interface unit 3. The input voice from the handset 6 or the microphone / speaker 7 is input to the voice encoding unit 9a via the voice input / output interface unit 8. Then, the input image coded by the video coding unit 5a, the input sound coded by the audio coding unit 9a, and the control signal from the system control unit 11 are transmitted by the demultiplexing / multiplexing unit 12 in transmission frame units. And then transmitted to the communication line 14 via the line interface unit 13.

Next, the received frame from the communication line 14 passes through the line interface unit 13 and the demultiplexing / multiplexing unit 1
At 2, the image signal is separated into the audio signal and the control signal, and they are input to the video decoding unit 5b, the audio decoding unit 9b and the system control unit 11, respectively. Then, the video decoding unit 5
The received image data decoded in b is displayed on the display unit 2 via the video output interface unit 4. Further, the received voice decoded by the voice decoding unit 9b is output from the handset 6 or the microphone / speaker 7 via the voice input / output interface unit 8.

The operation of the video output interface section 4 will be described in more detail. The received image data decoded by the video decoding unit 5b is stored in the image memory unit 4b. The received image data has a certain image size as one frame of data. If this image size is equal to the image size of the TV monitor that is the display unit 2, scaling of the image size is not necessary, but it is usually different. In order to match the image size, the received image data stored in the image memory unit 4b is read out by the control of the image memory control unit 4c according to the conversion method and is input to the received image scaling unit 4a.

The received image scaling unit 4a performs image size conversion according to a predetermined method, and again the image memory control unit 4c controls the image memory unit 4b.
Written in. Here, the image data written in the image memory unit 4b has the same size as the image displayed on the TV monitor. The image data written in the image memory unit 4b in the TV monitor display image size is read out by the control of the image memory control unit 4c and input to the TV signal encoding unit 4d. The TV signal encoding unit 4d converts a signal so that it can be displayed on a TV monitor and adds various synchronization signals and burst signals to form a TV signal. As a result, the received image data is displayed on the display unit 2 which is a TV monitor.

Such a video output interface unit 4
A specific example of the operation will be described. For example, ITU-T
H. In the encoding system based on 261, one frame size of the received image data has a mode of 352 × 288 pixels (FCIF mode) and a mode of 176 × 144 pixels (QCIF mode). Consider one conversion method for displaying on an NTSC-TV monitor. FIG. 5 shows a conceptual diagram of operation. In the figure, image data of 352 × 288 size is stored in the image memory unit 4b.
Now, one line of horizontal 352 pixels is read out, and one dummy data (for example, a black level value) of 4 pixels is added to both ends to make 360 pixels. Between each pixel, 2
Insert the pixel of the arithmetic mean value of the points. Finally, one dummy data (for example, a black level value) is added to the right end. This completes the conversion from 352 pixels to 720 pixels.

Next, consider the vertical line. Vertical 2
For 88 lines, since the TV monitor performs interlaced scanning display, first, from 288 lines to 1 frame 48
0 line is obtained by line interpolation (2 lines are interpolated and inserted for every 3 lines), divided into fields by odd lines and even lines, and read out to the TV signal encoder 4d.
It is also possible to thin out 288 lines to 240 lines (interpolate one line out of every 6 lines) to form one field data and repeatedly output the same field twice during interlaced output. However, when the same field is repeatedly output twice, two lines of the same line are output on the display screen of the TV monitor, and the deterioration of the image quality is noticeable. Therefore, when outputting each field, interpolation processing is performed. Or filter processing may be performed.

By performing the above conversion processing,
The conversion of the 352 × 288 size image data into the TV monitor display is completed. Of course, there are other conversion methods than the above.

In a multipoint video conference, normally, FIGS.
A multipoint control unit (hereinafter referred to as MCU) 16 is used as shown in FIG. The MCU 16 is directly connected to the multipoint video conference terminals (first to fourth terminals in FIGS. 6 to 8) at a plurality of points to be communicated via the communication line 14 and the network 17 (FIG. 6). The image data received from each point is combined or selected, the image data is reconstructed, and the image data is distributed to the multipoint video conference terminal at each point. The multipoint video conference terminal at each point receives the image data distributed from the MCU 16 and displays the image on the TV monitor, which is the display unit 2, in the form of the received image data. In other words, if there is only one image data in the received image data,
Only the image data of the spot is displayed on the TV monitor (Fig. 7). Further, if the received image data is combined with the image data for multiple points, the image data for multiple points is displayed on the TV monitor (FIG. 8). As described above, the multipoint video conference terminal has an M number for displaying image data on the TV monitor.
It depends on the CU 16 and does not perform any special processing on a normal video conference terminal.

[0017]

However, in the above-mentioned conventional multipoint video conference terminal, when the received image data is displayed on the TV monitor, which image data in the received multipoint image data is displayed. Since the image data of which point was not identified, it was not possible to extract the image data of only an arbitrary point or the image data of an arbitrary number of points and display it on the TV monitor.

Further, in the above-mentioned conventional multipoint video conference terminal, in the multipoint communication system in which the image data for multiple points is received by a plurality of frames, the image data of an arbitrary point is extracted to the TV monitor. Of course, the received image data of multiple points could not be displayed on the TV monitor at the same time.

The present invention has been made in view of the above-mentioned problems of the above-mentioned conventional technique, and an object thereof is to obtain image data of an arbitrary point from the received image data of multiple points. Can be displayed on the display means, and even in a multipoint communication system for receiving image data of multiple points by a plurality of frames, the image data of an arbitrary point can be displayed from the image data of the received multipoint. The present invention intends to provide a multi-point video conference terminal capable of displaying the received multi-point image data collectively on the display means at the same time.

[0020]

In order to achieve the above object, the first invention of the present invention is a multipoint video conference terminal for holding a conference between multiple points while displaying image data of multiple points on a display means. In, the input means for inputting information designating image data of an arbitrary point from the image data of the multipoint, and the image data of the point corresponding to the information input by the input means are displayed on the display means. And a control means for controlling the above.

In order to achieve the same object, a second invention of the present invention performs image data storage means for storing received multipoint image data, and write control and read control of image data to the image data storage means. The writing / reading control means, the encoding means for encoding the image data read from the image data storage means into a television signal under the control of the writing / reading control means, and the television signal output from the encoding means are displayed. In a multipoint video conference terminal having a display means and an input means for inputting control information, an image data identification means for identifying image data of each location from the received image data of the multipoint, and an image data storage means Image data size conversion means for converting the size of the read image data, and the input Character code generating means for generating a code of a character to be generated based on control information input from the column, character generating means for generating a character corresponding to the character code output from the character code generating means, and the encoding And a character synthesizing unit for synthesizing the character generated by the character generating unit with the television signal output from the unit.

Further, it is characterized in that it comprises an image data fetching means for displaying a transmitted image.

[0023]

The multipoint video conference terminal according to the present invention displays the image data of an arbitrary point from the received image data of the multipoint,
It is designated by the input information from the input means, and the image data of the designated point is displayed on the display means under the control of the control means. Further, in a multipoint communication system in which image data for multiple points is received by a plurality of frames, image data at an arbitrary point can be designated by the input information from the input means and displayed on the display means. The image data of the spot can be displayed on the display unit at the same time. Further, the transmitted image can be selectively displayed.

[0024]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to FIGS.

FIG. 1 is a block diagram showing the configuration of a multipoint video conference terminal according to an embodiment of the present invention. In FIG. 1, the same parts as those in the above-mentioned conventional FIG. There is. 1 is different from that of FIG. 4 in that the multipoint data identification unit 12a, the image size conversion unit 4e, the superimposing unit 4f, the character generation unit 4g, the character code generation unit 11a, and the high-speed video switch 15 are different from those of FIG. Is added.

The multipoint data identification section 12a is provided inside the demultiplexing / multiplexing section 12 and identifies the image data of each point from the received multipoint image data and the system control section 1
It is something to convey to 1. The system control unit 11 stores the data identification information received from the multipoint data identification unit 12a in its internal RAM. Image size conversion unit 4
e is provided between the image memory unit 4b and the TV signal encoding unit 4d, and converts the size of the image data read from the image memory unit 4b. Superimpose part 4
f is provided between the TV signal encoding unit 4d and the display unit 2, and is a TV output from the TV signal encoding unit 4d.
The character information from the character generator 4g is combined with the signal. The character code generation unit 11a is provided in the system control unit 11, generates a code of a character to be generated according to the control information input from the input unit 10, and outputs the code to the character generation unit 4g. The high-speed video switch 15 is a switch for loading the transmission image data into the image memory unit 4b so that the transmission image data can be displayed on the display unit 2.

Next, the operation of the multipoint video conference terminal according to this embodiment will be described.

The input image from the camera input unit 1 is input to the video encoding unit 5a via the video input interface unit 3. The input voice from the handset 6 or the microphone / speaker 7 is input to the voice encoding unit 9a via the voice input / output interface unit 8. Then, the input image encoded by the video encoding unit 5a and the audio encoding unit 9
The input voice coded in a and the control signal from the system control unit 11 are multiplexed in transmission frame units by the demultiplexing / multiplexing unit 12 and transmitted to the communication line 14 via the line interface unit 13.

Next, the received frame from the communication line 14 is separated into an image signal, an audio signal and a control signal by a demultiplexing / multiplexing unit 12 via a line interface unit 13, and a video decoding unit 5b, respectively. It enters the voice decoding unit 9b and the system control unit 11, respectively. Video decoding unit 5
The received image decoded in b is the high-speed video switch 15
And is displayed on the display unit 2 via the video output interface unit 4. Further, the received voice decoded by the voice decoding unit 9b is output from the handset 6 or the microphone / speaker 7 via the voice input / output interface unit 4. Also,
Since the transmission image data can be fetched by the high-speed video switch 15, the transmission image data can be displayed on the display unit 2 as well as the reception image data.

The multi-point data identification unit 12a searches the received frame and identifies which data is the data of which point even if the data of a plurality of points is embedded in the same frame. An example of the frame structure is shown in FIG. FIG. 2A shows ITU-T Recommendation H.264. 221
It is a frame structure of a single 64 kbps channel (B channel). FIG. 2B shows a unique frame structure in which data at four points are embedded in the same frame and all the frame structures in the time direction are the same. Figure 2 (c) shows
The unique frame structure in the case where the data of one point is embedded in the same frame and the data of four points is received by the frame in the time direction is shown. FIG. 2D shows a unique frame structure in which data at two points is embedded in the same frame and data at four points is received by a frame in the time direction.

Basically, the sub-channel area is allocated as a data area at each point, and the allocation information is put in a certain sub-channel. The multipoint data identification unit 12a identifies this allocation information. The location information, the number of communication locations, etc., which are the identification information identified by the multipoint data identification unit 12a, are all included in the system control unit 1.
It is transmitted to 1. The system control unit 11 stores the identification information identified by the multipoint data identification unit 12a in the internal RAM and receives the identification information.
Allocation of a storage area of the image memory unit 4b according to the number of communication points, instruction of a writing area of received image data according to point information, and the like are transmitted to the image memory control unit 4c. As a result, even if the data of a plurality of points is embedded in the same frame or the data of different points is received by being divided into a plurality of frames, the display of the image data of that point on the display unit 2 is possible. It will be possible.

The character code generation unit 11a generates a code of a character to be generated according to the control information input from the input unit 10 and outputs the code to the character generation unit 4g. The character generation unit 4g generates a character corresponding to the code from the character code generation unit 11a and outputs it to the superimposing unit 4f. The superimposing unit 4f synthesizes the TV signal output from the TV signal encoding unit 4d with the character information from the character generating unit 4g and displays it on the display unit 2. The image size conversion unit 4e selects, for example, 1 from the image data of a plurality of points stored in the image memory unit 4b.
When only the points are taken out and displayed on the display unit 2, the display unit 2 can display the region in an area larger than the image size of the image data stored in the image memory unit 4b. Therefore, the display is performed according to the instruction of the display size. Converts the image size of image data. The display size is instructed via the system control unit 11 according to the control information input from the input unit 10.

A concrete example of the series of operations is shown in FIG. In FIG. 3A, the image size of the image memory unit 4b is converted. The display size is instructed via the system control unit 11 according to the control information input from the input unit 10.

A concrete example of the series of operations is shown in FIG. FIG. 3A shows a state in which all the image data for four points stored in the image memory unit 4b are displayed on the display unit 2 as they are. Here, a case where the display mode is changed by the control information input from the input unit 10 will be described. FIG. 3G is an example of an input key from the input unit 2. First, "EN" which is one of the input keys of the input unit 10
Enter the display setting mode by pressing the "TER" key (Fig. 3
(B)). At this time, the display mode setting window pops up in the center of the screen of the display unit 2 by superimposing. This is due to the functions of the character code generation unit 11a, the character generation unit 4g, and the superimposing unit 4f.

In such a display screen, the cursor is moved to the place to be changed by using the "arrow" key which is one of the input keys of the input section 10. In FIG. 3C, the item of the display point C is one of the input keys of the input unit 10 "SPAC".
The "E" key is used for reversing. This makes the display of the point C unselected. When this setting is completed, the display mode is confirmed by the "ENTER" key. As a result, FIG. The display mode is only for the points A, B, and D as shown in Fig. 3. Fig. 3 (e) is the same as Fig. 3 (b).
This is a case where the three point displays of A, B, and C are in the non-selected state. In this case, since only one point of D is displayed, the vertical and horizontal sizes are set to 2 by the image size conversion unit 4e.
It is magnified twice and displayed on the display unit 2. This state is shown in Figure 3.
It shows in (f).

[0036]

As described above in detail, according to the multipoint video conference terminal of the present invention, the image data of an arbitrary point among the received multipoint image data is displayed by the display means according to the information input from the input means. In the multipoint communication system that can display the image data for multiple points by a plurality of frames, it is possible to extract any point according to the information input from the input means and display it on the display means. The image data can be displayed collectively on the display means at the same time. Also, the transmission image can be selected and displayed.

Therefore, in the multipoint video conference, the user extracts only the image data of the desired point and enlarges and displays it on the display means, or displays the image data of all the points collectively at the same time. The display mode can be freely selected and executed while looking at the display screen of the display means, and as a result, the user interface in communication can be improved.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of a multipoint video conference terminal according to an embodiment of the present invention.

FIG. 2 is a diagram showing an example of a structure of a communication frame in the multipoint video conference terminal.

FIG. 3 is a diagram showing an example of a display mode setting operation in the multipoint video conference terminal.

FIG. 4 is a block diagram showing a configuration of a conventional multipoint video conference terminal.

FIG. 5 is a diagram showing an operation of a video output interface unit in a conventional multipoint video conference terminal.

FIG. 6 is a diagram showing an example of image display in a conventional multipoint video conference terminal.

FIG. 7 is a diagram showing an example of image display in a conventional multipoint video conference terminal.

FIG. 8 is a diagram showing an example of image display in a conventional multipoint video conference terminal.

[Explanation of symbols]

2 display unit (display unit) 4b image memory unit (image data storage unit) 4c image memory control unit (writing / reading control unit) 4d TV signal encoding unit (encoding unit) 4e image size conversion unit (image data size conversion unit) 4f Superimpose section (character synthesizing means) 4g Character generating section (character generating means) 10 Input section (input means) 11a Character code generating section (character code generating means) 12a Multipoint data identifying section (image data identifying means) 15 High-speed video switch (image data acquisition means)

Claims (14)

[Claims] 1. In a multipoint video conference terminal for holding a conference between multiple points while displaying image data of the multiple points on a display unit, image data of an arbitrary point is designated from among the image data of the multiple points. Input means for inputting information to
A multipoint video conference terminal, comprising: control means for controlling image data of a spot corresponding to the information input by the input means to be displayed on the display means. 2. The multipoint video conference terminal according to claim 1, wherein the input means is a keyboard. 3. The multipoint video conference terminal according to claim 1, wherein the input means is a touch panel. 4. The multipoint video conference terminal according to claim 1, wherein the input means is a mouse. 5. The multipoint video conference terminal according to claim 1, wherein the display means is a CRT (cathode ray tube). 6. The multipoint video conference terminal according to claim 1, wherein the display means is an LCD (liquid crystal display). 7. An image data storage means for storing received multi-point image data, a write / read control means for controlling writing and reading of image data to / from the image data storage means, and the write / read control means. The encoding means for encoding the image data read out from the image data storage means into a television signal under the control of the above, the display means for displaying the television signal output from the encoding means, and the input means for inputting the control information. In a multipoint video conference terminal having, image data identifying means for identifying image data of each location from the received image data of multiple locations, and image data for converting the size of the image data read from the image data storage means. It should be generated based on the size conversion means and the control information input from the input means. Character code generating means for generating a character code, character generating means for generating a character corresponding to the character code output from the character code generating means, and the character generating means for the television signal output from the encoding means. A multipoint video conference terminal, comprising: a character synthesizing means for synthesizing a character generated by the above. 8. The multipoint video conference terminal according to claim 7, further comprising image data fetching means for fetching transmission image data to said image data storing means. 9. The multipoint video conference terminal according to claim 8, wherein the image data capturing means is a switch. 10. The multipoint video conference terminal according to claim 7, wherein the input means is a keyboard. 11. The multipoint video conference terminal according to claim 7, wherein the input unit is a touch panel. 12. The multipoint video conference terminal according to claim 7, wherein the input means is a mouse. 13. The multipoint video conference terminal according to claim 7, wherein the display means is a CRT (cathode ray tube). 14. The display means is an LCD (liquid crystal display).
The multipoint video conference terminal according to claim 7, wherein