JPH05300511A - Television conference device - Google Patents

Abstract

PURPOSE:To provide a compact and an inexpensive system which can improve its operability in a TV conference where plural attendants show plural screens on a display by means of the animations, the still pictures, the voices, the data, etc. CONSTITUTION:A large-size color display 101 is provided to show the operation menus in addition to the animations, the still pictures, the files, etc., together with the operating part mouses 104a and 104b which perform the operating inputs based on the operation menus shown on the display 101. Then the portrait cameras 303a and 303b, a file storing device 103, the microphones 301a and 302b, an image transmitter 317, etc., are operated through a system controller 105. At the same time, the modes of the screens and the menu screens which are shown on the display 101 are switched through those operations carried out by the controller 105.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video conference device, and more particularly to a video conference device suitable for improving the operability of a multimedia video conference system.

[0002]

2. Description of the Related Art FIG. 12 is a system configuration diagram of a conventional video conference apparatus shown in, for example, a document "Video Conference System" (Mitsubishi Electric Technical Report, Vol. 64, No. 8, August 1990). In the figure, 301 is a microphone for inputting a speaker voice of a conference attendee to a video conference, 302 is a voice control device for controlling voice input from the microphone 301, and 303 is a person for inputting a person image of the conference attendee. A camera, 304 is a speaker for amplifying the speech of a meeting attendee at another point, and 306 is a person monitor for displaying a received moving image of a meeting attendee at another point and switching between the transmitted moving image of the own point and 307. Is a still image monitor displaying a still image received from another point or a still image transmitted from the own point, 308 is a zoom and focus of the person camera 303,
Up / down / left / right direction control, image selection as to whether the image displayed on the person monitor 306 is the reception moving image or the transmission moving image,
An operation pad that performs operations such as a still image transmission operation and volume control of the speaker 304, a document image capturing device 309 that captures and inputs a document image or a small three-dimensional object as a still image, and a 310 performs image switching control by operating the operation pad 308. An image control device for performing, 311 is a writing pad for converting input characters and figures into electric signals, 312 is a writing pen for inputting characters and figures to the writing pad 311, and 313 is characters and figures instead of the writing pad 311. Is a whiteboard monitor for displaying characters and figures input from the writing pad 311 or the electronic whiteboard 313, characters received from other points, and figures, and 315 is a whiteboard monitor. The characters and figures displayed on 314 Lint video printer, 316
Is a control device for controlling communication with a writing pad or an electronic whiteboard (not shown) at another location, 317 is a voice control device 302, a video control device 310, and a control device 316.
An image transmission device including a codec for transmitting the respective signals of No. 1 to another point, 318 is an INS 64, INS connecting to another point.
ISDN line such as 1500, 319 digital facsimile for sending and receiving documents, 320 general telephone, 321 data terminal for file transfer, etc.
22 is a digital facsimile 319, a telephone 320,
A TDM 323 as a time division multiplexer for time division multiplexing and transmitting the data of the data terminal 321 is a high-speed digital leased line that fixedly connects to another point.

The operation of the above arrangement will be described below.

The voice of the conference attendee is the microphone 3
This voice is input by the voice control device 3
By 02, the wraparound from the speaker 304 is removed by echo cancellation and sent to the image transmission device 317. The person moving image of the conference attendee captured by the person camera 303 is sent to the image transmitting apparatus 317 as a transmitting moving image via the video control apparatus 310 based on an operation signal from the operation pad 308. A still image such as a document image or a small three-dimensional object captured by the document image capturing device 309 is also sent to the image transmission device 317 via the video control device 310 by an operation signal from the operation pad 308. The writing pad 311 and the electronic whiteboard 313 are used by the attendees to input characters and figures by handwriting, and the characters and figures input to these are sent to the image transmission device 317 via the control device 316. The image transmission device 317 includes a voice control device 302, a video control device 310, and a control device 316.
Data such as voices, images, characters, and graphics received from is sent to other points via the ISDN line 318 or TD.
The data is transmitted to another point using the high-speed digital leased line 323 via M322. On the other hand, the voice, the image, and the data received by the image transmission device 317 from another point are distributed to the voice control device 302, the video control device 310, and the control device 316. That is, the sound is output to the speaker 304 via the sound control device 302, the moving image is displayed on the person monitor 306 via the video control device 310, and the still image is displayed as the still image via the video control device 310. Monitor 3
The data is displayed on the whiteboard monitor 314 via the control device 316 as characters or figures or is printed out from the video printer 315.
Signals from the digital facsimile 319, the telephone 320, and the data terminal 321 are time-division multiplexed by the TDM 322, and the high-speed digital leased line 323 is used to communicate with other terminal equipment (not shown) of the same type.

[0005]

Since the conventional video conference apparatus is constructed as described above, the operation pad 308 is used.
In addition to the basic operation of performing image pickup control by the person camera 303 and the document image pickup device 309, input operation to the writing pad 311 by the writing pen 312, input operation to the electronic whiteboard 313, video printer 315, digital facsimile Since input / output operations by a plurality of devices such as terminal operation of 319, telephone 320, and data terminal 321 are required,
Not only is the operation complicated, but the operation part of each device is separated, so the operation is complicated and requires a large space, and it takes time to learn the operation, so it cannot be easily used by general attendees. There is a problem.

The present invention has been made in order to solve the above-mentioned problems, and a moving image, a still image, a sound,
An object of the present invention is to obtain a video conference device capable of operating and displaying a plurality of pieces of information such as characters and figures in a unified manner and having a small number of constituent devices and which can be installed in a narrow space.

[0007]

In order to achieve the above object, the present invention provides an image input means for inputting a moving image, a voice input / output means for inputting / outputting voice, and inputting data including a still image. Data input / output means for storing and filing, and information display means for displaying information such as moving images and still images, and at least one information such as moving images, voices, and data.
Communication control means for communicating with other stations, operation input means for performing various operation inputs, and an operation menu corresponding to the operation input means are displayed on the information display means in a multiplexed manner and an input from the operation input means is accepted. User interface means, the image input means, the voice input / output means based on an instruction from the user interface means,
The video, audio, which is transmitted from the data input / output means to another station via the communication control means and is received from the other station,
Of the information such as data, the received voice is output from the voice input / output unit, and the received moving image is displayed together with the moving image from the image input unit, the data from the data input / output unit, and the operation menu from the user interface unit. The present invention provides a video conference apparatus including a system control unit for displaying multi-window on the above and storing received data in the data input / output unit.

[0008]

In the above means, the video conference apparatus of the present invention inputs the moving picture of its own station from the image inputting means, the moving picture sent from another station through the communication controlling means, and its own station under the control of the system controlling means. Data transmitted from multiple stations or filed in the data input / output means and the operation menu from the user interface means are displayed on the information display means in a multi-window format so that one operator is provided. It is possible to observe all the information on the information display means and also to operate the operation input means while viewing the operation menu on the information display means.

[0009]

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 is a system configuration diagram of a video conference apparatus according to an embodiment of the present invention. In the figure, 101 is a multi-scan type large color display for displaying a still image, a moving image, and other information, 301a, 30
Reference numeral 2b denotes a microphone for collecting the voice of the conference attendees at a plurality of points and outputting the voice to the voice control device 302.
Reference numerals 03a and 303b denote person cameras that are provided and switched to capture a plurality of conference attendees or scenes. 102 is an image scanner that inputs a still image such as a character or a figure from a document. 103 is an image. A plurality of file storage devices 104a and 104b for storing still images input from the scanner 102 and information such as characters and figures input from the writing pad 311 are provided so as to be operated by a plurality of conference attendees. An operation unit mouse for inputting the operation input, 105 is microphones 301a and 302b, and person cameras 303a and 303
b, image scanner 102, writing pad 31
1 is an input device, a speaker 304 is an output device such as a large color display 101, a control device is an audio control device 302, an image transmission device 317, and the like.
It is a system control device which controls based on operation signals 114a and 114b given based on the input operation of a and 104b.

It should be noted that the voice detection signals 110a, 11a provided from the voice control device 302 to the system control device 105.
0b is for detecting the presence / absence of a voice signal input from the microphones 301a and 302b, and is a secret signal / signal provided from the system controller 105 to the voice controller 302.
The volume signal 111 is a signal for giving an instruction to prohibit output of the input sound from the microphones 301a and 302b to the image transmission device 317 and to control the volume of the speaker 304. On the other hand, the system control device 10
The camera control signals 112a and 112b given from 5 to the person cameras 303a and 303b are for controlling the zoom (enlargement and reduction), the focus (far and near), and the direction (up, down, left and right) of the person cameras 303a and 303b, respectively. It is a thing.

Further, 115 is a transmission audio signal given from the voice control device 302 to the image transmission device 317, 116 is a reception voice signal given from the image transmission device 317 to the voice control device 302, and 117 is an image transmission from the system control device 105. A transmitted video signal provided to the device 317, 118
Is a received moving image signal given from the image transmission device 317 to the system control device 105, 119 is a high-speed data signal exchanged between the image transmission device 317 and the system control device 105, and 120 is a signal of the system control device 105 and the image transmission device 317. Control data signals exchanged between
Is a data signal exchanged between the system control device 105 and the file storage device 103.

FIG. 2 is a block diagram showing details of the system controller 105 in the configuration of FIG. In the figure,
201 is a main CPU of the system controller 105,
Reference numeral 2 is a main memory of the main CPU 201 including a program ROM and work RAM, 203 is a main bus connecting the main CPU 201, the main memory 202 and other input / output interfaces, and 204 is an operation signal from the operation unit mice 104a and 104b. A mouse input interface 205 for inputting the voice detection signal 110a and 110b of the microphones 301a and 302b from the voice control device 302, and a secret signal / volume signal which is a voice control signal to the voice control device 302 for secret talk and volume setting. A voice control interface for outputting 111, 206 for a camera control interface for outputting camera control signals 112a, 112b to the person cameras 303a, 303b, and 207 for the image scanner 102.
A digital video interface for inputting a digital video signal output from the reference numeral 208, a RS232C interface which is a serial interface for inputting a handwriting signal output from the writing pad 311, and 2
Reference numeral 10 is a graphic memory for displaying an image input from the image scanner 102, characters and graphics input from the writing pad 311, and 211 is a video signal selector for selecting one of video signals input from the person cameras 303a and 303b. , 212 stores a video signal selected by the video signal selector 211, and at the same time can read from the main bus 203, a transmission image memory having a two-port structure, and 213 writes a reception moving image signal 118 output from the image transmission device 317. At the same time, a reception video memory of a two-port configuration that can be read from the main bus 203, a reference numeral 214 reads each data of the graphic memory 210, the transmission image memory 212, and the reception video memory 213 via the main bus 203, and synthesizes them into a large size. Color display 1 Synthesis display memory to create a screen contents, 215 converts the digital data from the composite display memory 214 into an analog video signal, DA converter that outputs a video signal for the large color display 101,
Reference numeral 216 is a high-speed data port used for transferring a high-speed data signal 119 such as still image file transfer of the file storage device 103, and reference numeral 217 is related to control of the image transmission device 317 and control of a video conference device or device of a partner station (not shown). A low speed data port used to transfer control data signal 120.

FIG. 3 is an explanatory view showing an example of the screen of the large-sized color display 101 in the video conference apparatus shown in FIG. 1, and particularly shows a display example of the operation control panel screen. In the figure, 400a and 400b are pointers used when operating the operation unit mice 104a and 104b, respectively, and 401 is the person camera 3 as a control target.
03a, 303b camera designation heading,
Reference numeral 402 is a moving image designation headline when designating a display type of a moving image as a control target, 403 is a file designation headline when designating the handling of a file as a control target, and 404 is a voice when designating the handling of sound as a control target. A designated heading 405, a communication designated heading 405 when the handling of communication is designated as a control target, and 411 a camera designated heading 401
Camera 303 that is the specific control content corresponding to
The camera control panel 412 for displaying and designating control functions such as selection of a, 303b, up / down / left / right imaging direction of the selected camera, zooming in / out, focus on perspective, etc. corresponds to the movie designation headline 402. The moving image control panel 413, which is a selection heading for displaying the received image and the transmission image, which is the specific control content, stores and transfers the input image, which is the specific control content corresponding to the file designation heading 403.
A file control panel 414 for displaying and specifying a control function such as reproduction is a voice control panel 415 for controlling and designating the volume control and secret setting which are specific control contents corresponding to the voice designation headline 404. Is a communication partner P, which is a specific control content corresponding to the communication designation heading 405,
A communication control panel for designating communication control functions such as a communication partner Q and a communication partner R.

The operation of the above arrangement will be described below.

Now, when the power of the video conference device is turned on, the initial setting is first performed, but basically, the person camera 3 is used.
The person camera 303a is selected from 03a and 303b, and the up, down, left and right in that direction, zoom enlargement / reduction, and focus perspective are the same as those at the end of the previous conference. In addition, the file control is in a standby state, the voice is in secret at the initial volume, and the communication control is in a state of no communication partner.

Now, FIG. 4 shows the main CPU 201 in the system controller 105 after the power supply of the video conference apparatus is turned on.
6 is a flowchart of an initialization routine stored in the main memory 202 executed by the above. Next, the operation related to initialization will be described with reference to FIG.

When the program starts, step S501
Then, for the voice control device 302, the confidential signal / volume signal 1
At 11, the initial setting of the volume and the setting of confidential talk off are performed.
In the next step S502, the transmission image memory 212 is cleared, in step S503 the reception video memory 213 is cleared, and in step S504, the graphic memory 21 is cleared.
0 is cleared, and in step S505 the composite display memory 21
Clear 4. Then, in step S506, the person camera 303a is selected from the person cameras 303a and 303b. As a result, the person image of the own station captured by the person camera 303a is selected by the video signal selector 211 and written in the transmission image memory 212 as a transmission moving image. In the next step S507, the contents of the transmission image memory 212, that is, the images of the moving image of the person of the own station to be transferred to the composite display memory 214 and transmitted are the camera designation headline 401, the movie designation headline 402, the file designation headline 403, the voice. The full-size color display 101 is displayed together with the designated headline 404 and the communication designated headline 405. Next, in step S508, the camera designation index 401 displayed on the upper portion of the large color display 101.
The camera control panel 411 is displayed in an overlapped manner corresponding to, and in step S509, the communication control panel 415 is displayed in an overlapped manner corresponding to the communication designation index 405.

FIG. 5 is an explanatory diagram of the screen of the large-sized color display 101 after executing the above-mentioned initial setting operation. In the figure, 601 is a transmission image, 602 is a zoom mark for controlling the enlargement / reduction of the transmission image window, 6
Reference numeral 03 is a close mark for closing the transmission image window.

When the operation unit mouse 104a is moved (draged) while pressing a button (not shown) while looking at the above screen, the operation signal 114a output from the operation unit mouse 104a is transmitted to the system control unit 105. Is transmitted to the main CPU 201 via the mouse input interface 204, and the main CPU 201 adds the movement amount received from the operation unit mouse 104a to the position of the pointer 400a and the initial setting value stored in the main memory 202. The position is calculated, the obtained position information is written in the main memory 202, and the pointer graphic is written in the graphic memory 210. In this way, the pointer 400a is displayed at the corresponding position on the screen of the large color display 101. When a video conference is performed by connecting to the communication partner P, the operation unit mouse 104a or 104b is operated to move the pointer 400a or 400.
b is moved to the position of the communication partner P on the communication control panel 415.

Incidentally, the operation unit mice 104a and 104
b and pointers 400a and 400b corresponding to these
Have the same function respectively, the operation and display of the operation unit mouse 104a and the pointer 400a will be described below as an example. Now, when the pointer 400a is moved to the position of the communication partner P on the communication control panel 415 and the button of the operation unit mouse 104a is turned on / off once (hereinafter referred to as click), the operation signal 114
a is transmitted to the system control device 105 and transmitted to the main CPU 201 via the mouse input interface 204. As a result, the main CPU 201 interprets this and issues a request to connect with the communication partner P to the low-speed data port 2
It is transmitted as a control data signal 120 to the image transmission device 317 via 17 The image transmission device 317, which has received the request to connect to the communication partner P, performs a communication procedure with the system controller of the video conference device (not shown) connected to the ISDN line 318 to connect the line.

FIG. 6 shows the main CPU after the line is connected.
21 is a flowchart of a display routine by 201. First, in step S701, the connection state of the line is determined, and if the connection is not completed, this routine is repeated and waits for the connection state. When the line is connected here, the process proceeds to step S702, and the transmission image memory 212
The data is transferred to display a reduced image in the lower left part of the composite display memory 214 with the vertical and horizontal sub-sampling of 1/4.

Next, in step S703, the data in the received video memory 213 that stores the human image from the partner station is displayed in the right central portion of the composite display memory 214 as a reduced image of three-quarters subsampling in both vertical and horizontal directions. Forward to do.

Then, in step S704, the communication partner P in the communication control panel 415, which is the line connection partner, is connected.
Write an underline below the display. That is, on the communication control panel 415, the connected communication partner is displayed with an underline for specific display.

As a result of the above control, when the line connection is completed, a display as shown in the explanatory view of FIG. 7 is obtained on the large color display 101. As is clear from the figure, in the communication control panel 415 drawn from the communication designation heading 405, the display of the communication partner P indicating the current communication connection partner is also underlined, and which station the communication partner is Is shown. A person image to be transmitted to the partner station by being photographed by the person's camera 303a of the own station is a transmission image 601 having a size of a quarter of the full screen at the lower left of the screen of the large color display 101.
Is displayed as. Further, the person image transmitted from the partner station is displayed as a received image 801 on the right side of the center of the large color display 101 in a size of 3/4 of the full screen. When the connection with the communication partner P is established and the received image 801 is correctly received and displayed, the communication control panel 41 is displayed.
The operation input to 5 is unnecessary. Therefore, if there is no operation input to the operation control panel for a predetermined time or longer, the window of the operation control panel, that is, the communication control panel 415 is closed.

Next, the document, figure, etc. used for the conference are input from the image scanner 102, and the file storage device 1
03, the file control panel 413 is operated by operating the operation unit mouse 104a to move the pointer 400a to the file designation heading 403 and clicking once.
open. Further, the pointer 400a is moved to the accumulation position of the file control panel 413, and here the operation unit mouse 10
The storage mode is selected by clicking 4a once.

When a still image is read by the image scanner 102, the main CPU 201 sequentially writes it in the file storage device 103 via the digital video interface 207. The above storage operation is repeated for a plurality of input materials, and these are sequentially written in the file storage device 103. Furthermore, the file storage device 103
A document number and a page number, which are identification signals for identifying a still image signal, are automatically and sequentially generated together with the writing operation to the file storage device 103, and are written in the file storage device 103 in association with the still image signal as index information at the time of search.

When the input operation of the conference material is completed as described above, the material input from the local station video conference apparatus is transmitted to the remote station video conference apparatus.

Next, the operation of transmitting a still image will be described.

First, the operation unit mouse 104a is operated to move the pointer 400a to the transfer position of the file control panel 413 pulled out from the file designation headline 403 and click once to enter the transfer mode. Identification information such as the number is displayed. Here, when the index information corresponding to the identification information is searched, and the operation unit mouse 104a is clicked to select and specify transmission, the main CPU 201 causes the mouse input interface 2 to operate.
The low speed data port 217 receives the instruction via 04.
Transmits a document transfer request to the partner station via the image transmission device 317. When the image transmission device 317 receives a receivable signal from the partner station, the main CPU 201 receives the signal via the low-speed data port 217, reads the still image signal and index information from the file storage device 103, and the high-speed data port 216, image Transmission device 317
This is transmitted to the video conference device of the partner station via.
The partner station writes the still image and index information received by the system controller in the file storage device of the partner station.

Through the operation in the document transfer mode as described above, the document material necessary for the video conference is transmitted prior to the conference.

Next, the operation of the conference material during the conference will be described.

First, in the video conferencing apparatus of the own station, the person who explains the material operates the operation unit mouse 104a to move the pointer 400a to the reproduction position on the file control panel 413 and clicks the operation unit mouse 104a once. As a result, the file storage device 103 enters the reproduction mode and the identification information such as the document number and the number of pages is displayed. Therefore, when the index information corresponding to this identification information is searched and the reproduction is designated by clicking the operation unit mouse 104a,
The main CPU 201 is a mouse input interface 20
The file storage device 103 receives the instruction via
Index information is retrieved, the still image corresponding to that information is read out, and written in the graphic memory 210.

FIG. 8 is a flow chart of the display routine of the main CPU 201 in the file reproduction mode for presenting the material during the conference described above. Next, the file reproduction will be described with reference to FIG.

In step S901, it is first determined whether or not the file reproduction mode is set. If the file reproduction mode is not set, the process returns to the normal monitor routine. on the other hand,
In the case of the file reproduction mode, the process proceeds to step S902, the data in the transmission image memory 212 is sub-sampled by vertical and horizontal thirds to be reduced, and transferred to the lower left display portion of the composite display memory 214. Next, in step S903, the data in the received video memory 213 is subsampled in vertical and horizontal thirds, reduced in size, and transferred to the upper left display portion of the composite display memory 214. Next, in step S905, the file control panel 413 extracted from the file designation heading 403 is overlaid and displayed.

FIG. 9 is an explanatory view of the display screen of the large color display 101 when the file is reproduced by the procedure shown in FIG. 8, in which 1001 is a still image window and 1002 is a still image window 1001 for closing the still image window 1001. It is a close mark. As is clear from the figure, the large color display 101 displays a still image file in the still image window 1001 in addition to the transmitted image 601 of the image of the own station and the received image 801 of the image of the other station. A file control panel 413 for controlling this is also displayed.

The main CPU 201 transfers the index information to the video conference device of the partner station P via the low-speed data port 217 and the image transmission device 317 in parallel with the still image reproducing operation in the video conference device of its own station. The system controller of the video conference device of the partner station P reads out a still image signal corresponding to the index information of the file storage device of the partner station and displays it on the screen of the large color display of the partner station.

By the above operation, the same conference material can be simultaneously displayed on the large color display screens of the own station and the partner station. That is, without transmitting time-consuming still images during a conference, you can quickly spread documents by playing the still image files that were sent in advance on both your station and the partner station. ..

When it is unnecessary to display the presented conference material, the pointer 400a is moved to the position of the close mark 1002 at the upper left of the still image window 1001 and the operation unit mouse 104a is clicked once to open the still image window 1001. Close, large color display 1
01 is deleted from the screen. Then, the file reproduction mode ends, the general line connection state is established, and the general display routine after the line connection as shown in the flowchart of FIG. 6 is performed, and the received image 801 is enlarged in the right center portion as shown in FIG. , The transmission image 601 is displayed small in the lower left part.

On the other hand, in parallel with the operation of closing the still image window 1001 in the video conference device of the own station, the main CPU 201 opens the still image window to the video conference device of the other station via the low-speed data port 217 and the image transmission device 317. Close Transfer erasure request. As a result, even in the video conference apparatus of the partner station, the file reproduction mode is ended and the display on the large-sized color display is updated almost at the same time.

By the way, when the above-mentioned video conference is carried out, the number of conference participants at one point is often about 2 to 10, and the case of one person is rare. When the number of participants is large, it is inconvenient to use one operation unit mouse for inputting the operation of the video conference, so that the operation unit mouse 10 is used in this embodiment.
4a and 104b and two mice are provided as an example. However, this may still be insufficient depending on the number of participants, and it will be necessary to increase the number to three or four.

However, in the case where the number of mice is large as described above, there is a problem that the operation cannot be performed smoothly when one mouse and another mouse specify completely different operations. That is, if the operation of moving the person camera 303a to the right and the operation of moving the person camera 303a to the left overlap with each other, great confusion is caused. Therefore, when using a plurality of mice, it is necessary to set the mouse priority relationship.

FIG. 10 is a flow chart showing an example of a routine for determining the priority relationship of a plurality of mice. The routine shown in the figure shows mouse input control in which the operation output of another mouse is not accepted during the operation of the previously operated mouse and for a predetermined time after the operation is completed.

In step S1101, the operation unit mouse 10
4a of the operation signal 114a is determined,
If it is determined that the operation unit mouse 104a is being operated, the process advances to step S1102 to set N = 10 in a counter (not shown). Next, in step S1103, acceptance of the operation signal 114b of the operation unit mouse 104b is prohibited, and the process returns to step S1101. On the other hand, step S11
The operation signal 114 of the operation unit mouse 104a is determined by 01.
If it is determined that there is no a and the operation unit mouse 104a is not used, the process proceeds to step S1104. Here, it is determined whether or not the counter is N = 0. If N = 0, the process proceeds to step S1105, and the counter is set to N = N.
-1, and the process proceeds to step S1103. That is, in this state, the operation signal 114b of the operation unit mouse 104b is still prohibited from being accepted.

On the other hand, in step S1104, the counter is set to N.
When it is determined that = 0, the process advances to step S1106, the operation mouse 104b of the operation mouse 104b is permitted to accept, and the process proceeds to step S1107.

In step S1107, the operation unit mouse 10
It is determined whether or not there is a 4b operation signal 114b,
If it is determined that the operation unit mouse 104b is being operated, the process advances to step S1108 to set a counter (not shown) to N = 10. Next, in step S1109, reception of the operation signal 114a of the operation unit mouse 104a is prohibited, and the process returns to step S1107. On the other hand, step S11
The operation signal 114 of the operation unit mouse 104b is determined by the determination at 07.
If it is determined that there is no b and the operation unit mouse 104b is not used, the process proceeds to step S1110. Here, it is determined whether or not the counter is N = 0. If N = 0, the process proceeds to step S1111 and the counter is set to N = N.
-1 and proceeds to step S1109. That is, in this state, the operation signal 114a of the operation unit mouse 104a is still prohibited from being accepted.

On the other hand, in step S1110, the counter is set to N.
When it is determined that = 0, the process advances to step S1112, the operation mouse 104a of the operation mouse 104a is permitted to accept, and the process proceeds to step S1101.

As described above, the operation unit mice 104a, 1a
When the reception of one mouse of 04b is permitted, and the operation signal is received by operating that mouse, a predetermined time is counted by the counter and the operation signal of the other mouse is not controlled during that period. By doing 2
Operation signal 114 of one operation unit mouse 104a, 104b
It is possible to avoid the competition between a and 114b. Although the two mice have been described in the flowchart of FIG. 10, the same extension can be applied to a larger number of mice.

FIG. 11 is a flow chart showing another example of the routine for determining the priority relationship of a plurality of mice. The routine shown in the figure is performed by two person cameras 303a and 303a.
In b, the person imaged by the person camera 303a operates the operation unit mouse 104a, and the person camera 303b
Shows an example that can be effectively applied when a person being imaged operates the operation unit mouse 104b.
The camera selected from the person cameras 303a and 303b gives priority to the mouse of the operator who is inputting the image.

Now, in step S1201, it is determined whether or not the person camera 303a is selected. Here, when the person camera 303a is selected, the process proceeds to step S1202, and it is determined whether or not the operation unit mouse 104a is in use by whether or not there is the output operation signal 114a of the operation unit mouse 104a. Here, the operation unit mouse 10
If it is determined that 4a is in use, step S1203.
Operation signal 114 from the operation unit mouse 104b
The reception of b is prohibited, and the process returns to step S1201. on the other hand,
Only when it is determined in step S1202 that the operation unit mouse 104a is not in use, the operation signal 114b from the operation unit mouse 104b is permitted to be accepted and is accepted in step S1201.
Return to.

On the other hand, if it is determined in step S1201 that the human camera 303b is selected, the operation proceeds to step S1205, and the operation mouse 104b is used depending on whether there is an operation signal 114b from the operation mouse 104b. It is determined whether or not it is inside. Here, the operation unit mouse 10
If it is determined that 4b is in use, step S1206
And the operation signal 114 from the operation unit mouse 104a
Accepting a is prohibited, and the process returns to step S1201. on the other hand,
Only when it is determined in step S1205 that the operation unit mouse 104b is not in use, the operation signal 114a from the operation unit mouse 104a is accepted and accepted in step S120.
Return to 1.

That is, the two operation unit mice 104a,
When the cameras 104b are simultaneously operated, the person camera 303
Depending on which camera image of a or 303b is selected, the mouse operation is given priority.
By monitoring the video on the local station side, the person imaged by the selected camera, that is, the person who has the priority for the mouse operation, can be seen at a glance, so it is possible to prevent unnecessary confusion about the priority of the mouse. This makes it possible to smoothly proceed with the video conference.

The operation signals 114a and 11 associated with the dragging and clicking of the operation unit mice 104a and 104b.
Since 4b is not always output as a continuous signal, it is often impossible to immediately determine that the operation of the mouse has ended just because the operation signals 114a and 114b have disappeared. Therefore, it is possible to operate the mass with a margin by determining that the mouse is being operated while the mouse output is present and including the predetermined time (for example, several seconds) after the mouse output disappears. And

Further, the selected person cameras 303a, 3a, 3
Microphone 3 with voice input, not only 03b
01a and 302b are associated with the operation unit mice 104a and 104b, and the microphone 301a with voice input,
The operation unit mice 104a and 104b corresponding to 302b may be given priority.

In addition, a plurality of operation unit mice 104a, 10a
4b may be configured so that the priority is designated by manual setting, for example, the chair is given the highest priority.

In the above embodiment, the large color display 101 is used as a main monitor so that a plurality of conference attendees can easily see it. However, in a video conference, since it is necessary to display a moving image that does not require a high resolution and a document having a high definition such as a document and a graphic, a horizontal scanning frequency of 15 is used in an interlaced system like a general television broadcast. In a display of 0.734 KHz and a vertical scanning frequency of 59.94 Hz, it may be difficult for the characters on the screen to flicker and be difficult to see. In consideration of this point, the large color display 101 is preferably a non-interlaced type with a horizontal scanning frequency of 31 KHz or more and a vertical scanning frequency of 60 Hz or more, and preferably a large multi-scan type. However, instead of this, a monitor displaying a moving image and a monitor displaying a still image or characters may be separated.

In the above-described embodiment, the window size is automatically changed based on the operation and the menu screen is automatically erased. However, all of these operations are performed by input from the mouse. However, the same effect can be obtained.

[0058]

As described above, the video conference apparatus of the present invention uses a plurality of input devices such as a mouse and a menu screen displayed by superimposing the operation input associated with the video conference on the display screen used for the video conference. Since it is configured so that it is possible to concentrate attention on the screen of the video conference, various operations including operations of various terminal devices can be performed without keeping an eye on the screen, which makes the operation complicated. In addition, it is simple and does not need to consider the installation space of the operation unit, so that space efficiency is high, and there is an effect that a video conference system used by an unspecified number can be easily operated and a conference can be facilitated.

[Brief description of drawings]

FIG. 1 is a system configuration diagram of a video conference apparatus according to an embodiment of the present invention.

FIG. 2 is a block diagram of a detailed configuration of a system control device in the configuration of FIG.

FIG. 3 is an explanatory diagram of an operation control panel display on the display.

FIG. 4 is a flowchart of an initial setting routine.

FIG. 5 is an explanatory diagram of an initial screen in a video conference.

FIG. 6 is a flowchart of a display routine after line connection.

FIG. 7 is an explanatory diagram of a screen after line connection.

FIG. 8 is a flowchart of a display routine in a file reproduction mode.

FIG. 9 is an explanatory diagram of a screen in a file reproduction mode.

FIG. 10 is a flowchart of an example of a mouse priority determination routine.

FIG. 11 is a flowchart of another example of a mouse priority determination routine.

FIG. 12 is a system configuration diagram of a conventional video conference apparatus.

[Explanation of symbols]

 101 large color display 102 image scanner 103 file storage device 104a, 104b operation unit mouse 105 system control device 201 main CPU 202 main memory 203 main bus 204 mouse input interface 205 audio control interface 206 camera control interface 207 digital video interface 208 RS232C interface 210 Graphic memory 211 Video signal selector 212 Transmitted image memory 213 Received video memory 214 Synthetic display memory 215 DA converter 216 High speed data port 217 Low speed data port 301, 301a, 301b Microphone 302 Voice control device 303, 303a, 303b Human camera 304 Speaker 306 Moni for people 307 still image monitor 308 operation pad 309 document image pickup device 310 image control device 311 writing pad 312 writing pen 313 electronic whiteboard 314 whiteboard monitor 315 video printer 316 control device 317 image transmission device 318 ISDN line 319 digital facsimile 320 telephone 321 Data terminal 322 TDM 323 High-speed digital leased line

[Procedure amendment]

[Submission date] April 21, 1992

[Procedure Amendment 1]

[Document name to be corrected] Drawing

[Correction target item name] All drawings

[Correction method] Change

[Correction content]

[Figure 1]

[Figure 3]

[Figure 10]

[Fig. 2]

[Figure 4]

[Figure 5]

[Figure 6]

[Figure 7]

[Figure 9]

[Figure 8]

FIG. 11

[Fig. 12]

Claims (10)

[Claims] 1. An image input unit for inputting a moving image, a voice input / output unit for inputting / outputting voice, a data input / output unit for inputting and filing data including a still image, a moving image, a still image, etc. Information display means for displaying information of at least one and information such as moving images, audio, data, etc.
Communication control means for communicating with other stations, operation input means for performing various operation inputs, and an operation menu corresponding to the operation input means are displayed on the information display means in a multiplexed manner and an input from the operation input means is accepted. User interface means, the image input means, the voice input / output means based on an instruction from the user interface means,
The video, audio, which is transmitted from the data input / output means to another station via the communication control means and is received from the other station,
Of the information such as data, the received voice is output from the voice input / output unit, and the received moving image is displayed together with the moving image from the image input unit, the data from the data input / output unit, and the operation menu from the user interface unit. And a system control unit for displaying received data in a data input / output unit. 2. An image input unit for inputting a moving image, a voice input / output unit for inputting / outputting voice, an information display unit for displaying information such as a moving image and a still image, a moving image, a voice,
Communication control means for communicating information such as data with at least one other station, at least one element of direction, zoom and focus of the image input / output means and at least one element of volume and secret of the audio input / output means And connection of the communication control means, operation input means for performing an operation input to operate at least one element of a communication partner, and operation menus corresponding to the operation input means are displayed on the information display means in a multiplexed manner. User interface means for accepting input from the input means, and information transmitted from the image input means and the voice input / output means to another station via the communication control means based on an instruction from the user interface means and another station. Out of the information such as the moving picture and the sound received from Video conference system, characterized in that it comprises a system control means for multi-window display on the information display means together with the operation menu from moving and the user interface means from the force means. 3. An image input unit for inputting a moving image, a voice input / output unit for inputting / outputting voice, a data input / output unit for inputting and filing data including a still image, a moving image, a still image, etc. Information display means for non-terrace display of information of the above, conversion means for format conversion of a moving image input to the information display means, and communication for communicating information such as moving images, voices and data with at least one other station. Control means, operation input means for performing various operation inputs, user interface means for displaying an operation menu corresponding to the operation input means on the information display means in a multiplexed manner, and accepting an input from the operation input means, and the user interface Based on an instruction from the means, information from the image input means, the voice input / output means, and the data input / output means is passed through the communication control means. Of the information such as moving images, voices, and data received from other stations, and the received voice is output from the voice input / output unit, and the received moving image is the moving image from the image input unit and the data input / output unit. A video conferencing apparatus comprising: multi-window display on the information display means together with data from the user interface and an operation menu from the user interface means, and system control means for storing received data in the data input / output means. 4. An image input unit for inputting a moving image, a voice input / output unit for inputting / outputting voice, an information display unit for displaying information such as a moving image and a still image, a moving image, a voice,
A communication control means for communicating information such as data with at least one other station, a plurality of operation input means provided for performing various operation inputs, and an operation menu corresponding to the operation input means on the information display means. And a user interface means for receiving an input from the operation input means, while the operation input means operated first in the plurality of operation input means is being operated, and after the operation is completed. Priority setting means that does not accept operations of other operation input means until a certain time has passed, and the image input means, the voice input / output means, and the data input / output means based on an instruction from the user interface means. Information transmitted from other stations via the communication control means and received from other stations Of the information, the system control means for outputting the received voice from the audio input / output means, and displaying the received moving image in a multi-window on the information display means together with the moving image from the image input means and the operation menu from the user interface means, A video conference apparatus comprising: 5. A plurality of image input means for inputting a moving image, a selection means for selecting the image input means, a sound input / output means for inputting / outputting sound, and information such as a moving image and a still image are displayed. Information display means, communication control means for communicating information such as moving images, voice, and data with at least one other station, a plurality of operation input means for performing various operation inputs, and the information display means. A user interface unit for displaying an operation menu corresponding to the operation input unit in a multiple manner and receiving an input from the operation input unit, and an operation input unit corresponding to the image input unit selected by the selecting unit in the user interface unit. While the user is operating the priority setting means for not accepting the operation of other operation input means, and the user interface hand Video, audio, data, etc. received from another station while transmitting information from the image input means, the voice input / output means, and the data input / output means to another station based on an instruction from the stage via the communication control means. System control means for outputting a received voice from the voice input / output means among the information of (1) and displaying a received moving image on the information display means together with the moving image from the image input means and the operation menu from the user interface means. A video conference apparatus comprising: 6. An image input unit for inputting a moving image, a voice input / output unit for inputting / outputting voice, a data input / output unit for inputting and filing data including a still image, a moving image, a still image, etc. Information display means for displaying information of at least one and information such as moving images, audio, data, etc.
Communication control means for communicating with other stations, operation input means for performing various operation inputs, and an operation menu corresponding to the operation input means are displayed on the information display means in a multiplexed manner and an input from the operation input means is accepted. When the user interface unit and the communication control unit are in a non-connection state, an operation menu is provided so that the user interface unit can operate all of the image input / output unit, the voice input / output unit, the data input / output unit, and the communication control unit. And a system control unit for displaying the information on the moving image from the image input unit in the information display unit. 7. An image input unit for inputting a moving image, a data input / output unit for inputting and storing data including a still image, an information display unit for displaying information such as a moving image and a still image, and a moving image. , A communication control means for communicating information such as data with at least one other station, an operation input means for performing various operation inputs, and an operation menu corresponding to the operation input means are displayed on the information display means in a multiplexed manner. Along with transmitting the information from the image input means and the data input / output means to another station via the communication control means based on an instruction from the user interface means for receiving an input from the operation input means Of the information such as moving images and data received from the station, the received moving images are transferred to the first area, which is relatively small, by the data from the data input / output means. The received data is displayed on the information display means together with the operation menu from the user interface means in the relatively large second area and the moving image from the image input / output means displayed in the relatively small third area. A system conferencing means for storing the video conferencing means in the output means. 8. An image input unit for inputting a moving image, a data input / output unit for inputting and storing data including a still image, an information display unit for displaying information such as a moving image and a still image, and a moving image. , A communication control means for communicating information such as data with at least one other station, an operation input means for performing various operation inputs, and an operation menu corresponding to the operation input means are displayed on the information display means in a multiplexed manner. Along with transmitting the information from the image input means and the data input / output means to another station based on the instruction from the user interface means and the user interface means for receiving the input from the operation input means, The received moving image received from the station is displayed on the information display unit while the moving image from the image input unit is displayed on the received data. System control means stored in the input / output means, and data control means for displaying the data from the data input / output means on the information display means together with other images based on the data communicated through the communication control means. A video conferencing apparatus comprising: 9. An image inputting means for inputting a moving image, a data inputting / outputting means for inputting and storing data including a still image, an information display means for displaying information such as a moving image and a still image, and a moving image. , A communication control means for communicating information such as data with at least one other station, an operation input means for performing various operation inputs, and an operation menu corresponding to the operation input means are displayed on the information display means in a multiplexed manner. Along with transmitting the information from the image input means and the data input / output means to another station based on the instruction from the user interface means and the user interface means for receiving the input from the operation input means, The received moving image received from the station is displayed on the information display unit while the moving image from the image input unit is displayed on the received data. System control means stored in the input / output means, and based on the data communicated through the communication control means, the data from the data input / output means are displayed on the information display means in a multiplexed manner with other images, and the user The data display on the information display means is erased on the basis of the operation of the interface means or the erase instruction given through the communication control means, and when the erase is performed by the user interface means, the erase instruction is sent to another station through the communication control means. A video conferencing device comprising: a data control unit for transmitting. 10. An image inputting means for inputting a moving image, a data inputting / outputting means for inputting and storing data including a still image, an information display means for displaying information such as a moving image and a still image, and a moving image. , A communication control means for communicating information such as data with at least one other station, an operation input means for performing various operation inputs, and an operation menu corresponding to the operation input means are displayed on the information display means in a multiplexed manner. Along with transmitting the information from the image input means and the data input / output means to another station via the communication control means based on an instruction from the user interface means for receiving an input from the operation input means Received video received from the station Multi-window display with other information on the information display means, and the received data is input / output data. System control means for storing in stages,
A video conferencing apparatus comprising: a display control unit that stops the display of the operation menu on the information display unit when the operation input unit is not operated for a certain period of time.