JPH07131772A - Video conference equipment by central management system - Google Patents

Abstract

PURPOSE:To obtain the video conference equipment in which a video conference with a sense of integration is realized while each conference participant recognizes a paper material such as a drawing on a display device in common. CONSTITUTION:Picture drawing data entered from an entry device 101 by using a light pen or the like are sent from a line I/F section 15 through a common pattern input INF section 11 and a digital signal conversion section 14, a central management device 2 receives the picture drawing data by a line I/F section 21 and written in a common pattern memory 26 via a common pattern access section 25. The picture drawing data of the common pattern memory 26 are sent to each video conference terminal equipment l through a video conversion section 27, a video processing section 23 and a line I/F section 21 and displayed on a common screen on each display device 103. Each conference participant implements the common pattern access processing from each video conference terminal equipment 1 to add or correct the picture drawn data at any time.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION The present invention is a TV using a central control system.
Regarding conference equipment.

[0002]

2. Description of the Related Art Generally, a TV conference device using a centralized management system can be regarded as a schematic structure as shown in FIG. In the figure, reference numeral 1 denotes a TV conference terminal directly used by conference participants, which has an input / output function of an audio signal, a video signal and a data signal for a camera, a microphone, a speaker, a display, an external data device and the like. ing. The detailed configuration of the TV conference terminal 1 for realizing this function is realized, for example, as shown in FIG. 7A, and a data input / output interface (I / F) connected to an external data device via the RS232C interface 102. ) Section 12, display 103, speaker 104, microphone 105, and analog input / output I / F section 13 as an interface means with camera 106, digital signal conversion section 14, and line I / F section 15 are provided.

Further, in FIG. 1, reference numeral 2 denotes a centralized management device for collectively processing video signals, audio signals or data signals sent from each TV conference terminal 1, and the input / output function of each signal and each signal. Has a function of synthesizing, selecting, and transmitting, and a connection function (switching) for data communication. The detailed configuration of the centralized management device 2 for realizing these functions is realized, for example, as shown in FIG. 7B, and the line I / F unit 21, the audio processing unit 22, the video processing unit 23, the data processing unit. 24 are provided.

FIG. 8 conceptually shows the flow of a video signal during a TV conference operation in the conventional TV conference apparatus having such a configuration. As is clear from the figure, according to the conventional TV conference device, each TV conference terminal 1a
Video signals D106a, D106b, D10 sent from ~ 1d
6c and D106d are combined in the central control unit 2 and then each TV
Only the information necessary for the conference terminals 1a to 1d (for example, the composite video signal required for the terminal 1a is like D1a shown in the figure) is selected and sent back to the respective TV conference terminals 1a to 1d, and the The images are displayed in the corresponding areas of the displays 103a to 103d, respectively. Also, in this TV conference device, similar synthesis, selection, and return processing is performed on the audio signals from each of the TV conference terminals 1a to 1d.

In order to hold a somewhat satisfactory conference in this type of TV conference apparatus, the above-described transmission processing is sufficient for only the audio signal and the video signal. However, in this type of video conference apparatus, it is naturally conceivable that there is a request for presenting conference reference materials to each conference participant. Regarding this point, the conventional device of this type is shown in FIG.
It was dealt with by the data transmission as shown in. As can be seen from the figure, in this type of conventional device, the centralized management device 2 is used to perform point-to-point communication between the data devices 110a to 110d connected to the respective TV conference terminals 1a to 1d, regarding data communication. The data processing section 9 of FIG. 2 was only provided with a data switching control function for sending data from one TV conference terminal to another TV conference terminal.

[0006] Therefore, if an attempt is made to use, for example, a diagram as a reference material during a conference, it is necessary to take a method of converting the diagram into a file and performing data communication with each TV conference terminal, or sending by fax. There wasn't. In other words, with this type of conventional device, it is not possible to hold a conference while using information such as diagrams in an online state, and there is often a hindrance to the smooth progress of the TV conference due to lack of understanding.

In order to eliminate such inconvenience, a method of sending a picture or the like as the above-mentioned reference material as a video signal and displaying it by using a camera can be considered, but in this method, the sender does not watch the video. However, even if you try to move forward while adding or deleting the contents of the figure, there is no way to deal with such correction, and in the end it may be an effective way to supplement lack of understanding. There wasn't.

[0008]

As described above, in the above-mentioned conventional TV conference apparatus, in order to present the materials necessary for the conference, it is necessary to rely on the point-to-point data communication between the TV conference terminals. However, there are many cases where the person who provided the material cannot correct or modify the material, resulting in insufficient explanation, which hinders the smooth progress of the video conference.

The present invention eliminates this problem and has a drawing function like a blackboard in a general meeting that participants of the meeting can share in an online state, and description will be given while appropriately adding or correcting the drawing information. TV that makes up for the shortage and is smooth
It is an object of the present invention to provide a TV conference device by a centralized management method that contributes to the progress of a conference.

[0010]

SUMMARY OF THE INVENTION According to the present invention, an audio signal, a video signal, and a data signal sent from each TV conference terminal are centrally managed by a centralized management device, and the centralized management of the video signal therein is performed. The device synthesizes the remaining video signals excluding the video signals of the parties' terminals and sends them back to each other TV conference terminal. At each TV conference terminal, the device itself based on the synthesized video signal sent from the centralized management device. In a video conferencing apparatus using a centralized management system for separately displaying the video of other video conferencing terminals other than the terminal, the video conferencing terminal is distinguished from the screen for separately displaying the video other than its own terminal and the corresponding display screen. A display unit having a common screen, an input unit for inputting drawing data, and a transmission unit for transmitting the drawing data input from the input unit to the central control device, The centralized management device includes a common screen memory that stores drawing data sent from each TV conference terminal, a video signal conversion unit that converts the drawing data stored in the common screen memory into a video signal, and the video signal. And a video processing means for combining and outputting the video signal from the converting means to the area corresponding to the common screen of the combined video signal to be transmitted to each TV conference terminal.

[0011]

According to the present invention, the input means connected to each TV conference terminal accesses the common screen memory in the centralized management device as necessary to store the necessary information, and then the stored information is stored by the centralized management device. It is transmitted to the TV conference terminal and displayed on the common screen set on each display. Regarding this common screen access process, a configuration is applied in which the memory contents are updated and the display information on the common screen can also be modified by performing a drawing operation for appropriate modification with the input means.

According to this structure, each TV conference terminal can use the common screen as if it were a blackboard, and can provide a sufficient explanation while appropriately presenting and correcting necessary information in the online state. The smooth progress of can be realized.

[0013]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described in detail below with reference to the accompanying drawings. FIG. 1 shows a TV according to an embodiment of the present invention.
1 is a block diagram showing detailed configurations of a TV conference terminal of a conference device, a centralized management device, and peripheral devices thereof.

In the figure, the TV conference terminal 1 is RS2.
A data input / output interface (I / I) for exchanging data with an external data terminal via the 32C interface 102.
F) unit 12, which transmits an audio signal and a video signal to an external communication medium (display 102, speaker 104, microphone 10)
5, an analog input / output I / F unit 13 for communicating with a camera 106, a digital signal conversion unit 14 for converting a signal from each communication medium into a digital signal format that can be transmitted through a line, and an interface with the line In addition to the existing configuration of the line I / F unit 15 and the like, an input device 101 having a function of inputting drawing data by, for example, a drawing operation with a light pen on a tablet, and an interface between the input device 101 and A common screen input I / F unit 11 is newly provided and configured.

Further, the centralized management device 2 includes a line I / F unit 21 that controls the interface with the line, and this line I / F unit 2
The audio processing unit 22 having a processing function of adding and selecting audio signals sent from each TV conference terminal 1 through 1 and sending back to each TV conference terminal 1, and a processing function similar to that of the audio signal processing unit 22 for video signals. Video processing unit 23 and TV
Drawing data for displaying on a common screen provided on the display 103 of each TV conference terminal 1 in addition to the existing configuration such as the data processing unit 24 having a data switching processing function for data communication via the conference terminal 1. , A common screen memory 26 for storing drawing data, a common screen access unit 25 for performing access control for writing drawing data in the common screen memory 26, and a video conversion unit 27 for reading drawing data from the common screen memory 26 and converting the drawing data into a video signal. Is newly prepared and configured.

Although only one TV conference terminal 1 is disclosed in FIG. 1 for the sake of convenience, in view of the nature of the TV conference, in the system configuration of this type of TV conference device, the central management device is used. At least another TV for two
It goes without saying that the conference terminal (same configuration as the terminal 1) needs to be connected (see FIG. 5).

According to the video conference apparatus of the present invention, as can be seen from the flow chart of the video signal shown in FIG. 5 as an image, the display 103a of each of the video conference terminals 1A to 1D.
The display screen of 103d is divided into four screens of P1, P2, P3, and P4, and the screens of P1, P2, and P3 among them are used to project the images of the conference participants on three terminals other than the own terminal. . The remaining P4 screen is used to display information common to each TV conference terminal, and as this display information, image information such as graphics used as conference material is applied.

By using such a screen configuration, according to the present invention, each participant of the conference can smoothly proceed with the conference while viewing common materials on the common screen P4. Further, in the present invention, the display information on the common screen P4 can be appropriately corrected while being added or corrected by accessing from each TV conference terminal. This common screen P
4 is used as the access terminal for inputting and modifying the display data, the input device 101 accommodated in each TV conference terminal in the mode shown in FIG. By applying the common screen access processing from the input device 101, in the present invention, each participant of the conference can use the common screen P4.
It becomes possible to proceed with a video conference in a form very close to a normal conference, while using as if on a blackboard.

Next, with reference to the flow charts shown in FIGS. 2 and 3, a schematic operation of video processing in the TV conference apparatus of the present invention will be described. In order to make this video processing operation easier to understand, in the following description, the TV
FIG. 1 showing a detailed configuration of the conference terminal 1 and the centralized management device 2.
5 and FIG. 5, which conceptually shows the flow of video signals in the entire TV conference apparatus, will also be referred to.

First, the common screen access operation from the TV conference terminal 1 is performed according to the flowchart shown in FIG. That is, in the present invention, when a conference between a plurality of TV conference terminals 1A to 1D is in progress due to the operation of the TV conference apparatus shown in FIG. 1, each of the TV conference terminals 1A to 1D performs video communication, audio communication, Data communication and common screen data communication 4
Two communication media will intervene. Specifically, in the present invention, the displays 103a to 1030d of the individual TV conference terminals 1A to 1D during the above-mentioned video conference.
On the screen, the respective images of the conference participants who use terminals other than their own terminal and one uninput common screen P4 (which functions as a blackboard) are displayed.

In this state, when the TV conference terminal 1A tries to present the conference materials and the like, the operator issues a common screen access request by a predetermined operation from the input device 101 of the terminal 1A. In other words, this common screen access request can be said to be a request for using the above-mentioned common screen P4 as a blackboard.

After the conference is started, the TV conference terminal 1A monitors whether or not the common screen access request is issued based on the operation input from the input device 101 (step 201).
Here, when it is recognized that a common screen access request is issued, a request signal to that effect is sent to the centralized management device 2 (step 202).

Next, the TV conference terminal 1A monitors whether or not a signal (a drawing permission signal, which will be described later) permitting the acceptance of the request has been sent from the central control unit 2 (step 20).
3) When recognizing that the request acceptance is permitted (step 203)
If YES, the input of drawing data from the input device 101 is started (step 204).

The operator of the TV conference terminal 1A inputs the drawing data into the display 10 of the terminal 1A.
This can be performed by tracing the tablet of the input device 101 with, for example, a light pen as if writing the desired information on the blackboard by simulating the common screen P4 of 3a on the blackboard [see FIG. 4 (a)]. .

The drawing data input by the above operation is
It is sent from the TV conference terminal 1A to the centralized management device 2, and further transmitted from the centralized management device 2 to each of the terminals 1A to 1D,
Individual displays 103a-1 used as blackboards
It is displayed as an image on the common screen P4 of 03d. As a result, TV with the same feeling as a normal conference using a blackboard
The meeting can be realized.

As a specific example of the common screen access operation from the above-mentioned TV conference terminal 1A, the common screen input I /
The F section 11 receives data (drawing data in this example) input from the input device 101 as XY information in dot units on the common screen P4 [see FIG. 4 (b)], and then the digital signal conversion section 14 Converts the drawing data into a predetermined digital format, and then the line I / F unit 15
Send to. Further, the line I / F unit 15 multiplexes this digital signal with the signal from each communication medium and transmits it to the central control unit 2 through the line. Here, the digital signal generated by the digital signal converting section 14 has a format including XY data in the upper layer and information such as color in the lower layer, as shown in FIG. 4C, for example.

The above-described processing is performed by the other TV terminals 1B ...
When the 1D uses the common screen P4 (blackboard) to correct and add the display information, the same operation can be performed. It should be noted that the above-described process is a process of transmitting drawing data from the TV conference terminals 1A to 1D to the centralized management device 2, but in order to display it on the common screen P4 of the displays 103a to 103d of the TV conference terminals 1A to 1D. The drawing data is transmitted by the reverse route and procedure from the above.

In this way, when the operator of the TV conference terminal 1A finishes writing the desired information on the common screen P4 by using the input device 101, the operator enters the input device 101.
It is necessary to issue a common screen access end request by a predetermined operation. The TV conference terminal 1A monitors whether a common screen access end request is issued based on the operation input from the input device 101 (step 205), and recognizes that the common screen access end request is issued (step 205). (YES at 205), and sends a request signal to that effect to the central control device 2 (step 206).

After that, the TV conference terminal 1A monitors whether or not there is a notification from the centralized management device 2 that the common screen access end request has been accepted and accepted (step 207), and receives the notification. In this case, the series of common screen access processing ends. In the above series of processing, the centralized management device 2 accesses the TV that is already being accessed when the common screen is accessed from the TV conference terminal 1A.
When a conference terminal (for example, 1B) is present, a busy (BUSY) signal is sent to the TV conference terminal 1A that has requested later. On the other hand, on the TV conference terminal 1A side,
When a common screen access request is issued from the own terminal 1A,
When a busy notification is received from the centralized management device 2 (step 208), the operation is immediately ended so as to terminate the access request.

Next, the operation of the centralized management device 2 side for the common screen access request from the above-mentioned TV conference terminal 1A will be described with reference to the flowchart of FIG. First,
When a common screen access request is requested from any of the TV conference terminals 1A to 1D in the state where the conference is proceeding under the operation of the TV conference device as described above, the common screen memory of the centralized management device 2 No. 26 still has no drawing data accumulated. In this case, in the central control device 2, the image conversion unit 27 converts the plain (white or the like) screen data into an image signal, and the image signal is passed through the image processing unit 8 to each T.
It is sent to the V conference terminals 1A to 1D. On the other hand, in each of the TV conference terminals 1A to 1D, the video signal received from the centralized management device 2 is sent to the displays 103a to 103d, and the plain screen corresponding to the screen data is displayed on the common screen P4.

In this state, the centralized management device 2 determines whether or not there is a common screen access request from each of the TV conference terminals 1A to 1D (step 301). This judgment is made by each TV
This is performed according to the detection result of the common screen access unit 25 that detects the common screen access request signal sent from the conference terminals 1A to 1D (for example, detects the order of arrival from the request destination). The detection of the common screen access request signal is performed, for example, in the order of arrival from the request destination, and when there is a request from another TV conference terminal during detection, the request is not accepted and a busy signal is sent to the request destination. Is sent.

When the centralized management apparatus 2 recognizes that there is a common screen access request from the TV conference terminal 1A (YES in step 301), it then recognizes the requesting TV conference terminal 1A (step 302). Terminal 1A
A drawing permission signal is sent to (step 303).

In response to the drawing permission signal, the requesting TV conference terminal 1A first sends back the screen operation access information to the centralized management device 2 and then the input device 1 according to the procedure described above.
Input of drawing data is started from 01.

On the other hand, in the central control device 2, first,
The circuit is set so that the screen operation access information sent from the requested TV conference terminal 1A is sent to the common screen access unit 12 (step 304). After this setting, the common screen access unit 25 sets the drawing data successively sent from the TV conference terminal 1A in a predetermined information format [FIG.
[See (c)] to drawing data, and this drawing data is written in the common screen memory 26 [see FIG. 4 (d)] (step 305).

Subsequently, the central control device 2 monitors whether or not an access end request is issued from the TV conference terminal 1A which is accepting access (step 306). When the access end request is detected, the TV conference terminal is detected. An end permission signal is immediately sent to 1A (step 307),
It returns to a state in which the common screen access request from the other TV conference terminals 1B to 1D can be accepted (step 30).
1).

In the above processing, the drawing data accumulated in the common screen memory 26 is periodically taken out,
It is transmitted to the conference terminals 1A to 1D. That is, the central management device 2 monitors whether or not a preset fixed period has elapsed after step 305 (step 311), and reads the drawing data from the common screen memory 26 every time this fixed period has elapsed (step 311). Step 312). Then, after the read drawing data is converted into a video signal by the video conversion unit 27 (step 313), the video processing unit 23 further transmits from the line I / F unit 21 to each of the TV conference terminals 1A to 1D (step). 314).

On the other hand, in each of the TV conference terminals 1A to 1D, after the video signal corresponding to the drawing data sent from the centralized management device 2 is received by the line I / F unit 15 by the above control, the digital signal conversion unit 14 is received. , Analog input / output section I
Display 103a to 1030d through the / F unit 13
Transfer to. On the displays 103a to 103d, on the basis of the video signal, screens P1, P2, P3 displaying the video corresponding to the drawing data input from the TV conference terminal 1A and displaying the video of the conference participants. Another common screen P4 (blackboard) is displayed.

As a hardware configuration on the side of the centralized management apparatus 2 for realizing the above-mentioned common screen access control, a memory capacity corresponding to two screens of the common screen P4 is given as the common screen memory 26, and one screen worth is provided. It is conceivable that the other is used as an access screen and the other one screen is used as a transmission screen, and the screens are alternately switched and used.

FIG. 5 is an image diagram showing the flow of video signals in the entire TV conference apparatus of the present invention to which the common screen access control is applied. In the figure, in the TV conference terminals 1A, 1B, 1C and 1D, the camera 10 is used.
The video signals of the persons who handle the terminal (conference participants) taken by 6a, 106b, 106c, and 106d are transmitted to the centralized management device 2 via the leased line / premises network 3. In the centralized management apparatus 2, the video signals D106a, D106b, D106c, D106d are selectively combined by the video processing unit 23, and each video conference terminal 1
Send back to A, 1B, 1C, 1D.

In this processing, for example, the TV conference terminal 1
As shown in the figure, the video signals sent back to A are the video signals D106b, D106c, D106d captured by the individual cameras 106b-106d of the other TV conference terminals 1B-1D respectively in the display screens P1, P2, P3. It will be a composite corresponding to.

In each of the TV conference terminals 1A, 1B, 1C, 1D, the individual displays 103a, 103b, 103c, 103d based on the composite video signal from the centralized management device 2.
On the display screens P1, P2, and P3 of, the respective images of the conference participants other than the own terminal are displayed.

In this state, consider the operation when the common screen access is performed from the TV conference terminal 1D. In this case, in the TV conference terminal 1D, drawing data is input from the input device 101d using a light pen, and the drawing data is transmitted to the centralized management device 2 through the private line / premises network 3.
In the centralized management device 2, the drawing data is stored in the common screen memory 26 as the text data TD101 through the common screen access unit 25. After that, in the central control device 2,
The text data TD101 is periodically read from the common screen memory 26, and the video conversion unit 23 causes the video signal D10.
It is converted to 1 and sent to the video processing unit 23. Video processing unit 2
3, the video signal D101 is transmitted to each TV conference terminal 1A, 1
The composite video signals (screen P1) being sent to B, 1C and 1D.
, P2, P3 corresponding areas) are further combined into an area corresponding to the common screen P4, and each TV conference terminal 1A, 1B, 1
Send to C, 1D.

In each of the TV conference terminals 1A, 1B, 1C, 1D, the individual displays 103a, 103b, 1 are based on the composite video signal sent from the centralized management device 2.
Images are displayed on 03c and 103d. As a result of the above processing, the displays 103a, 103b, 103c, 10
In 3d, the images of the other conferees are displayed on the display screens P1, P2, and P3, and the images common to all the conferees are displayed on the remaining common screen P4. The drawing data that was arbitrarily input from will be displayed.

In the present invention, when realizing the above-mentioned common screen access processing, the input device 101 and the common screen input I / F unit 11 are provided on the TV conference terminal 1 side, and the common screen access unit 25 on the centralized management device 2 side. It is necessary to provide the common screen memory 26 and the video conversion unit 27, but otherwise, the drawing data of the common screen is centrally managed from the TV conference terminal 1 by using the same hardware configuration as the existing data communication. 2 and write it in the common screen memory 26, and thereafter, the drawing data is converted into a video signal by the video conversion unit 27 and transmitted to each TV conference terminal 1 online to be displayed on the common screen of the display. In addition, it is possible to easily realize the process of appropriately correcting the display content of the common screen.

[0045]

As described above, according to the present invention,
A central screen device is provided with a common screen memory, and an input means for inputting drawing data to the common screen memory is provided for each TV conference terminal. Necessary information is provided from each TV conference terminal using the input means. After writing to the common screen memory as needed, the contents of this memory were converted into video signals and distributed to each TV conference terminal so that they could be displayed on the common screen set on the display. Participants have the great advantage that they can use the above common screen as if they were on a blackboard and have detailed discussions with reference materials, etc. while using the above common screen, and contribute to the smooth and smooth progress of the video conference. .

[Brief description of drawings]

FIG. 1 is a block diagram showing a main configuration of a TV conference device according to an embodiment of the present invention.

FIG. 2 is a flowchart showing a common screen access operation in the TV conference terminal of the TV conference device of the present invention.

FIG. 3 is a flowchart showing a common screen access response operation in the centralized management device of the TV conference device of the present invention.

FIG. 4 is a conceptual diagram for explaining each procedure such as drawing data input, transmission, and storage related to the common screen access processing of the TV conference device of the present invention.

FIG. 5 is a diagram showing an image of a flow of a video signal in the TV conference device of the present invention.

FIG. 6 is a conceptual diagram showing the overall configuration of a conventional TV conference device.

FIG. 7 is a block diagram showing a detailed configuration of a main part of a conventional TV conference device.

FIG. 8 is a diagram showing an image of a flow of a video signal in a conventional TV conference device.

FIG. 9 is a diagram showing an image of a flow of data signals in a conventional TV conference device.

[Explanation of symbols]

1 (1A, 1B, 1C, 1D) TV conference terminal 11 Common screen input I / F unit 12 Data input / output I / F unit 13 Analog input / output I / F unit 14 Digital signal conversion unit 15 Line I / F unit 101, 101d input device 102 RS232C interface 103 (103a, 103b, 103c, 103d)
Display 106 (106a, 106b, 1036, 106d)
Camera 2 Central management device 21 Line I / F unit 22 Audio processing unit 23 Video processing unit 24 Data processing unit 25 Common screen access unit 26 Common screen memory 27 Video conversion unit 3 Dedicated line / internal network, etc.

Claims (2)

[Claims] 1. An audio signal, a video signal, and a data signal sent from each TV conference terminal are centrally managed by a centralized management device, and regarding the video signal therein, the centralized management device is a video signal of a party terminal. The remaining video signals except the above are combined and sent back to each of the other TV conference terminals, and each TV conference terminal is based on the combined video signal sent from the centralized management device, and the other TV conference terminals other than its own terminal. In the video conference apparatus by the centralized management method for separately displaying the respective images, the TV conference terminal includes a display unit having a screen for separately displaying the images other than its own terminal, and a common screen different from the divided display screen. The centralized management device includes input means for inputting the drawing data, and transmission means for transmitting the drawing data input from the input means to a centralized management device. A common screen memory for storing drawing data sent from the TV conference terminal, a video signal converting means for converting the drawing data stored in the common screen memory into a video signal, and a video signal from the video signal converting means. A video conferencing apparatus according to a centralized management system, comprising: a video processing unit that composites and outputs the composite video signal transmitted to each TV conference terminal to a region corresponding to the common screen. 2. A common screen memory has a storage capacity for the two common screens, and sends one screen for access from each TV conference terminal and sends another one screen to each TV conference terminal. The video conferencing apparatus according to the centralized management system according to claim 1, wherein the video conferencing apparatus is switched and used alternately for use.