KR970007009B1 - Real-time visual conference system - Google Patents

Abstract

The image terminal comprises such equipments as a microphone, a camera, a housing(100) with the reply cancel key installed therein, a monitor(110), a mouse, a pc main body(130), an interactive terminal(120). And the whole system is composed of the multiple image terminal(140a-140d), the image meeting center(150) and the optical cable which connects each image terminal(140a-140d) and image meeting center(150). The cameras(10c) are connected to the video input terminal of interactive terminal(120), the microphones are connected to the audio input terminal of interactive terminal(120), the reply cancel keys(160a) to each relevant terminal of interactive terminal(120), and the interactive terminal(120) to the image meeting center.

Description

Real time video conferencing system

1 is an example of a conventional video conferencing system block diagram.

2 is another example of a conventional video conferencing system block diagram.

3 is an external view of an image terminal unit according to the present invention.

4 is an overall system block diagram according to the present invention.

5 is a detailed configuration diagram of an image terminal unit according to the present invention.

6 is an example displayed on a monitor of a video terminal unit during a two-party conference according to the present invention.

7 is an example displayed on the monitor of the video terminal unit when reading documents according to the present invention.

8 is an example displayed on the monitor of the video terminal of the three multi-party conference according to the present invention.

9 is an example displayed on the monitor of the video terminal of the four multi-party conference according to the present invention.

10 is a control screen of the video terminal according to the present invention.

11 is a view illustrating a meeting selection screen of a video terminal according to the present invention.

12 and 13 are block diagrams of bidirectional terminals according to the present invention, respectively.

14 is a block diagram of a video conferencing center according to the present invention.

15A to 15C show the operation of the video conferencing center according to the present invention.

16 is a flow diagram of a host computer in accordance with the present invention.

17 is a flowchart of a caller side of a video terminal unit according to the present invention;

18 is a flowchart of a called party's video terminal unit according to the present invention;

19 is a flowchart showing the operation flow at the called party's side of the video terminal according to the present invention.

The present invention relates to a real-time video conference system, and more particularly, to a real-time video conference system capable of multi-party video conference using a personal computer.

In general, video conferencing system is a system that conducts a meeting at each place by combining video and audio of meeting rooms in remote locations. In recent years, video conferencing systems have been required in order to facilitate the exchange of information with remote locations and to speed up decision making in line with the wider and diversification of socio-economic activities.

The video conference system basically installs cameras, monitors, microphones, speakers, etc. in each conference room, and combines them into two-way video and audio lines.

1 is an example of a conventional video conferencing system block diagram.

1 is a video conference system of the concept of a conference room, and the meeting is performed while watching each other's appearances after powering on the equipment according to a predetermined time and a given order.

1, cameras 10a and 10b, microphones 20a and 20b, speakers 30a and 30b and monitors 40a and 40b respectively transmit and receive video and audio signals in the first and second meeting rooms. Install). An A / V switch (A / V switcher) for switching video and audio signals by connecting the cameras 10a and 10b, microphones 20a and 20b, speakers 30a and 30b, and monitors 40a and 40b. 50a, 50b) and a codec for converting a signal from analog to digital or digital to analog for communication, and a high-speed line for communication between the first and second meeting rooms.

If the user of the first meeting room is the caller of the meeting and the user of the second meeting room is the caller of the meeting, the appearance of the caller of the first meeting room is displayed on the monitor 40b of the second meeting room through the camera 10a. . The audio signal is output through the speaker 30b of the second conference room through the microphone 20a of the first conference room. Similarly, the appearance of the called party in the second conference room is displayed on the monitor 40a of the first conference room, and the voice of the called party is output through the speaker 30a of the first conference room.

2 is another example of a conventional video conferencing system block diagram.

FIG. 2 shows a rack video conference system, where a key panel is operated in a limited space such as a president's room to view a conference counterpart.

In FIG. 2, devices incorporating cameras, speakers, monitors, controllers 80a, 80b, and the like are installed in locations 1 and 2, respectively, and are equipped with an A / V switcher, an audio mixer, a power supply, and the like. A center facility 90, conference callers and callees are composed of key panels 70a, 70b and the like that issue control commands to the controllers 80a, 80b.

Another example of the conventional video conferencing system is a system in which the video conferencing system of the concept of the conference room of FIG. 1 is mixed with the video conferencing system of the rack type of FIG.

However, the conventional video conferencing system has a considerable cost in lighting, sound absorbing devices, and auxiliary facilities when constructing a conference room to establish a video conference, and requires video conferencing at a predetermined appointment time and moves to a conference room. There was a problem that it takes. In addition, since a video conference through a monitor such as a television, a true electronic conference is not possible and a certain space is required as well as a dedicated manpower for manipulating equipment for operating a conference.

Accordingly, an object of the present invention is to provide a real-time video conferencing system that implements video conferencing in real time without using a personal computer on the desk to solve the above-mentioned problems.

Another object of the present invention is to provide a real-time video conferencing system that enables video conferencing even when the user terminal is powered off.

It is still another object of the present invention to provide a real-time video conference system capable of two- or multi-party video conference.

It is still another object of the present invention to provide a real-time video conferencing system that processes file transmission, reception, and viewing functions during video conferencing with a counterpart.

In order to achieve the above object, a video terminal based on a personal computer, a video center based on a host computer to manage the entire system, and a high-speed line for a network of the video terminal and a video conference center In the real-time video conferencing system provided, the video terminal is a housing (Housing) equipped with a camera, a microphone and a call answer / cancel key for transmitting the appearance and voice of the conference caller or callee, the conference caller or a plurality of A monitor for displaying the called person in Picture In Picture mode or displaying report material; A speaker for outputting voice of the conference caller or called party; A bidirectional terminal for relaying bidirectional data communication between the conference caller or the called party and controlling conference call tones and power of the video terminal unit; and the video conference center unit includes an optical communication or coaxial cable using an optical cable and a base using RS422. A data transmission unit for baseband communication; An audio / video switcher (A / V switcher) for performing an overlap or wipe function by communicating an audio signal, a video signal, etc. input / output from the video terminal unit with the host computer; A screen splitter that controls a split screen during a multi-party conference such as a three-party conference and a four-party conference; An audio mixer for providing an uniform audio level during the multi-party conference such as the three-party conference and the four-party conference; And a monitor for monitoring the input / output state of the audio / video switcher.

Hereinafter, with reference to the accompanying drawings will be described in detail with respect to the present invention.

3 shows an external view of an image terminal unit according to the present invention.

In FIG. 3, the video terminal includes a housing 100 equipped with a microphone, a camera, and an answer / cancel key, a monitor 110, a body 130 of a mouse and a personal computer, and a two-way terminal (120). ).

4 shows an overall system block diagram according to the present invention.

In FIG. 4, the entire system connects the plurality of video terminal portions 140a to 140d, the video conferencing center portion l50, the respective video terminal portions 140a to 140d, and the video conferencing center portion 150. It consists of an optical cable.

5 is a detailed block diagram of the image terminals 140a to 140d according to the present invention.

In FIG. 5, the camera 10c is connected to the video input terminal Vin of the bidirectional terminal 120, the microphone 20c is connected to the audio input terminal Ain of the bidirectional terminal 120, and the response / cancellation is made. The key 160a is connected to a predetermined terminal of the bidirectional terminal 120. The bidirectional terminal 120 is connected to the video conferencing center.

In addition, the main body 130 of the personal computer includes a video overlay board (Overlay Board, 170) and a video card (180). The video overlay board 170 serves to overlap different images, and is connected to the speaker 30c and the video card 180, respectively. The video card 180 is connected to the monitor 110 for video display.

6 shows an example displayed on the monitor 110 of the video terminal unit during the two-party meeting according to the present invention, Figure 7 shows an example displayed on the monitor 110 of the video terminal unit when viewing the document according to the present invention 8 shows an example of being displayed on the monitor 110 of three video conference units in accordance with the present invention, and FIG. 9 is a monitor 110 of four video conference units in an embodiment of the present invention. FIG. 10 shows an example of a screen displayed on the control panel, and FIG. 10 shows a control screen of a video terminal according to the present invention, and FIG. 11 shows a conference selection screen of a video terminal according to the present invention.

Next, the operational embodiment of FIG. 5 will be described with reference to FIGS. 6 to 11.

First, a desired conference partner is selected from the video caller of the conference caller through the conference selection screen shown in FIG. That is, the names of the participants are displayed in FIG. 11, by selecting and placing a mouse on a desired party.

The conference partner who receives the call selects whether or not to attend the meeting by the answer / cancel key 160a, and when the main body of the video terminal is automatically turned on, the conference is established.

Figure 6 shows an example displayed on the monitor 110 of the video terminal after the meeting is established, the appearance of the conference partner is displayed about 4/5 of the full screen and the lower right corner by the picture-in-picture (PIP) function You will see yourself in the conference call.

If you want to have a meeting while viewing the report data at the time of meeting establishment, if you view the documents through the file box menu of the control screen of FIG. 10, the report data is displayed about 4/5 of the full screen as shown in FIG. The meeting screen that was displayed in the is displayed in the lower right corner.

In the case of a two-party conference, when another conference partner is called to the conference and wants to have a three-party conference, a video conference unit additionally selects a desired conference partner through the conference selection screen of FIG. When the called party responds, the divided screen is provided to everyone who participated in the conference as shown in FIG.

If another person in the above-mentioned three-party conference is added to the conference, the conference caller screen, the first responder screen, the second responder screen, and the third responder screen are displayed as shown in FIG.

If a third party requests a meeting from one of the two during the two-party meeting, the meeting is approved and displayed as shown in FIG.

In addition, if another one of the three-way meeting requests a meeting from one of the three, if the meeting is approved for approval, the same is displayed on the four-way screen as shown in FIG.

In addition, the conference caller who first convened the conference may simultaneously call a plurality of conference partners of two or three persons through the conference selection screen of the video terminal. After the establishment of the multilateral meeting, as in the two-party meeting, one or more documents can be sent to all at once. When the meeting is established, it is rejected or allowed by selecting whether or not to receive the document from the standpoint of receiving documents, as if the participation is selected by the answer / cancel key.

The control screen of the video terminal shown in FIG. 10 is displayed on the right side of the screen of the monitor 110 and is always provided by pressing the left button of the mouse. The control screen consists of meeting, filing cabinet, and screen adjusting group. Meeting group includes meeting connection, closing meeting, filing cabinet for document viewing, document transmission, and screen adjusting group for color contrast, color brightness, sound size, PIP ON, PIP OFF menu. Configure.

The video terminal maintains and modifies the record only at the host computer of the video conferencing center without being dependent on a specific person so that the video terminal can be easily modified even if the title or user is changed by reorganization. Therefore, the title or name of the conference participants and the called party is registered with the host computer of the video conferencing center, and the video terminal downloads and uses it.

Next, the bidirectional terminal 120 will be described.

12 and 13 are block diagrams of bidirectional terminals according to the present invention, respectively.

FIG. 12 is a bidirectional terminal in the case of constituting a network with an optical cable, and FIG. 13 is a bidirectional terminal in the case of constituting a network with a coaxial cable.

In FIG. 12, the configuration will be explained by the video adjustment circuit 170 for adjusting the video signal input from the camera 10d, the audio adjustment circuit 180 for adjusting the audio signal input from the microphone 20d, and A key sensing circuit 190 for sensing the response / cancel key 160b, a melody sound generating device 200 for generating a conference call melody sound, a central processing unit 210 for controlling the entire bidirectional terminal, and an optical A receiver 220, an optical transmitter 230, an interface 240 for interfacing a video signal and an audio signal, a PIP circuit 250 for performing the PIP function, memories 260, 270, and serial data. The input / output interface 280 or the like.

In FIG. 13, the configuration will be described in the same manner as the configuration in FIG. 12 except for the optical receiver and the optical transmitter.

Next, the operation of the bidirectional terminal will be described.

The interactive terminal 120 is logically located at the intermediate point between the PC main unit 130 of the video terminal and the host computer of the video conferencing center, and relays the two-way data communication, when the PC main body 130 is turned off. Not only to provide a melody sound to inform the response of the PC main body 130 automatically supplies power. In addition, the signal by optical communication is separated into a TV signal and a data signal, and power is automatically supplied to the camera 10d at the start of the meeting, and the camera 10d power is cut off at the end of the meeting. Then, key data is detected from the response / cancel key 160b to perform a conference response or cancellation function, and adjust video and audio levels during the conference to suit the conference environment. In the two-party conference, the PIP function is performed for the screen of the caller and the callee.

14 is a block diagram of the video conferencing center unit 150 according to the present invention.

In FIG. 14, the video conferencing center unit 150 includes a host computer 350, which is in charge of data communication and overall operation with each video terminal unit, a TV monitor 290 for monitoring a conference situation, and an audio mixer ( 300, a screen splitter 310 for dividing the screen during the multi-party conference, a data transmitter 320 for data communication between the host computer 350 and the video terminal, an audio / video switcher 330, It consists of a power supply (340).

Next, the operation function of the video conference center will be described.

The host computer 350 is equipped with a multi-processing operating system to perform multi tasking with a multi user. Also, data communication with each video terminal unit, video conference management and maintenance, and data communication with the A / V switcher 330 are performed.

The audio mixer 300 provides an even audio level during a multiparty conference such as a 3 party and a 4 party conference.

The screen splitter 310 performs screen splitting during multi-party conferences such as three-party and four-party conferences.

The data transmission unit 320 supports an optical communication using an optical cable or a baseband communication using a coaxial cable and an RS422 cable.

The A / V switcher 330 communicates with the host computer 350 through an RS232 cable, and performs an automatic switching function by receiving an audio signal, a video signal, etc. input / output from each video terminal.

15A to 15C show the operation of the video conferencing center according to the present invention.

Figure 16 (A) is an example of a two-party conference, Figure 16 (B) is an example of a four-party conference, and Figure 16 (C) is an example of adding a conference call to one of the two-party conferences of Figure 16 (A). .

In FIG. 16A, the user of the first video terminal 140a requests a conference call to the user of the second video terminal 140b to the host computer 350. The host computer 350 requests the conference call to the second video terminal 140b, and when the user of the second video terminal 140b responds / approves to the conference call, the host computer 350 returns its result. 1 Return to the video terminal portion l40a. At this time, the AV switcher 330 connects the audio / video (A / V) signal input from the first video terminal 140a to the second video terminal 140b, and the second video terminal 140b. Command to connect the A / V signal input from the first video terminal 140a.

In FIG. 16B, the user of the first video terminal 140a is connected to the user of the second video terminal 140b, the user of the third video terminal 140c, and the user of the fourth user 140d. In the case of calling a conference, the user of the first video terminal 140a sends the second video terminal 140b, the third video terminal 140c, and the fourth video terminal 140d to the host computer 350. Request a conference call for the user. The host computer 350 requests a conference call to the second video terminal 140b, the third video terminal 140c, and the fourth video terminal 140d, and the second video terminal 140b and the third video terminal 140b. When the user of the video terminal 140c and the fourth video terminal 140d responds / approves to the conference call, the host computer 350 returns the result to the first video terminal 140a. At this time, the A / V signal input from the first to fourth video terminals 140a to 140d is sent to the screen splitter 310 and the audio mixer 300, and the A of the screen splitter 310 and the audio mixer 300 is transmitted. Command to provide the output of the / V signal to each of the video terminal portions 140a to 140d.

FIG. 16 (C) is a case where the user of the third video terminal 140c requests a conference call during the two-party conference of FIG. 16 (A), and the user of the first video terminal 140a is connected to the host computer 350. FIG. ) Sends a command requesting a meeting for the user of the third video terminal 140c. The host computer 350 requests a conference call to the third video terminal 140c, and when the user of the third video terminal 140c answers the call, the first video terminal 140a and the second video terminal, respectively. The call response is returned to the unit 140b. At this time, the A / V switcher 330 disconnects the A / V signal that was connected in FIG. 16 (A) and receives the A / V signal input from the first, second, and third video terminals 140a, 140b, and 140c. Commands are provided to provide the A / V outputs of the screen splitter 310 and the audio mixer 300 to the respective video terminals 140a to 140c.

17 is a flowchart illustrating the operation of the host computer according to the present invention.

Referring to FIG. 17, the main menu screen is displayed first (step 400). The main menu screen includes a menu of video conference start, video conference end, video conference status, video conference history, and terminal management. .

Next, when the start of the video conference is selected on the main menu screen, the basic module of the video conference is executed (steps 410 and 420). That is, the relay process and the transmission processes operate.

Next, if the end of the video conference is selected, the basic module of the video conference ends and returns to the main menu screen (steps 430 and 440).

Next, if the video conference status display is selected, the current video conference status is displayed (steps 450 and 460), that is, the caller, the called party, and the start time of the conference are displayed.

Next, if the video conferencing history display is selected, the video conferencing history view, the video conferencing history deletion, the previous menu, and the operation end menu are displayed (step 470). In the video conference history view, when the start date and the end date of the conference are specified, the video conference history is displayed. Similarly, in the video conference history deletion, if the conference start date and the conference end date are specified, the video conference history for the designated part is deleted.

Next, if terminal management is selected, terminal status view, registrant view, user registration, user deletion, user name change, previous menu, and job termination menu are displayed. In the terminal status view, it is displayed by user name. In the subscriber view, the registrant name and address are displayed. In the user registration, the new subscriber is registered. In the delete user, the existing user is deleted. In the user name change, the existing user name is changed. In the previous menu, the previous menu is executed, and when the operation ends, the video conference in the host computer is terminated (steps 490 to 610).

18 is a flowchart illustrating the operation flow at the caller side of the video terminal unit according to the present invention.

First, a Windows operating system is executed and a video conferencing command is executed (steps 700 and 710). When the video conferencing command is executed, the user's own image is displayed.

Next, select the "conference connection" menu at the control screen of FIG. 10, and select a desired subscriber from the conference connection screen of FIG. 11 to execute the "conference permission" menu (step 720). Here, if only one person is selected, if two people are selected, three parties are established.

Next, the message “Wait a minute” is displayed on the monitor and awaits the callee's response (step 730).

If there is no response or the call is canceled so that a predetermined time is exceeded (step 740).

If there is a response from the called party, the screen is replaced, and the appearance of the called party is displayed as shown in FIG. 6 during the two-party conference, and the appearance of the called party is displayed at the bottom right (step 750). In addition, during the four-party conference, all called subscribers are displayed as shown in FIG.

Next, when the appearance of the conference caller and the called party is displayed, the conference is executed (step 760). Adjust the volume of the microphone, camera and screen color for the conference room environment.

If you need more subscribers during the two-way meeting, you can call another subscriber to join the meeting and switch to the multi-party meeting. (Step 770).

Next, if there are report data during the meeting, you can view the desired documents by selecting "View Documents" on the control screen of FIG. 10, and if you need to send report data, select the "Transfer documents" menu on the control screen of FIG. Desired documents can be sent only to the other party or the designated subscriber (steps 780 to 810).

Next, when the meeting is to be finished, the meeting is terminated by selecting "end meeting" in FIG. 10 (step 820).

19 is a flowchart showing the operation flow at the called party's side of the video terminal according to the present invention.

First, a melody sound indicating that a meeting request has been received from the bidirectional terminal 120 is generated. Next, when the PC main body power is On (On) by pressing the "response" key in the answer / cancel key to terminate the melody sound (steps 900 and 910).

Next, the Windows operating system is executed and a video conference command is executed (steps 920 and 930).

If the PC main body power is OFF in step 900, the melody sound ends and the PC main body power turns on automatically, and the Windows operating system is automatically executed (steps 940 to 960).

Next, if the meeting request is approved, the meeting is displayed while the other party is displayed (step 970).

Hereinafter, the operation flow is the same as the operation flow of the steps 750 to 820 of FIG.

As described above, the present invention can use a personal computer as a video conferencing system at a low cost, and can easily exchange data such as file transfers during a meeting, as well as respond to video conferencing even when the video terminal is turned off. It is effective to execute multiple conferences by simultaneously calling a plurality of subscribers without moving seats.

Claims (4)

The image terminals 140a to 140d based on the personal computer 130, the image center unit 150 based on the host computer 350 to manage the entire system, and the image terminals 140a to 140d. In the real-time video conferencing system having a high-speed line for the network of the video conferencing center unit 150, the video terminal 140a to 140d is a camera for transmitting the state and voice of the conference caller or the called party. And a housing (100) mounted with a microphone and a call answer / cancel key; A monitor 110 for displaying a picture of the conference caller or a plurality of callees in a picture in picture mode or showing report data; A speaker 30c for outputting voice of the conference caller or called party; And a bidirectional terminal 120 for relaying bidirectional data communication between the conference caller or called party and controlling conference call tones and power of the video terminal unit. The video conference center unit 150 may include optical communication using an optical cable or A data transmission unit 320 for baseband communication using a coaxial cable and RS422; An audio / video switcher (A / V Switcher) 330 which performs an overlap or wipe function by communicating an audio signal, a video signal, etc. input / output from the video terminal unit with the host computer; A screen divider 310 for controlling a split screen during a multi-party conference such as a three-party conference and a four-party conference; An audio mixer 300 for providing an uniform audio level during the multi-party conference such as the three-party conference and the four-party conference; And a monitor (290) for monitoring the input / output status of the audio / video switcher. 2. The bidirectional terminal (120) according to claim 1, wherein the bidirectional terminal (120) includes a video adjusting circuit (170) for adjusting a video signal input from the camera (10d), and an audio adjusting circuit (180) for adjusting an audio signal input from the microphone (20d). ), A key sensing circuit 190 for sensing the answer / cancel key 160b, a melody sound generating device 200 for generating conference call melody sounds, a central processing unit 210 for controlling the entire bidirectional terminal, and And an interface stage 240 for interfacing the video signal and the audio signal, a PIP circuit 250 performing a PIP function, memories 260 and 270, and a serial data input / output interface 280. Real time video conferencing system. The real-time video conference system of claim 1, wherein the control screen comprises a conference screen, a filing cabinet screen, and a screen adjustment screen. 2. The real-time video conferencing system of claim 1, wherein the video terminals 140a to 140d automatically turn on when a meeting request comes when the power is turned off.