JP2000270305A - Multi-point conference system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a multi-point conference system where face pictures of all participation members to a conference are displayed on each client computer while suppressing a data transfer quantity. SOLUTION: The multi-point conference system generates face pictures of each member taking participation in a conference and stores a face picture group of all members to storage sections of respective client computers 2, 3 and transfers management data denoting which face picture each member taking part in the conference in the face picture group selects on the respective client computers 2, 3 to each of the client computers 2, 3 via a server computer 1. Thus, each member reads the face picture of each member selected on its own client computers 2, 3 from storage sections 2a, 3a of the respective client computers 2, 3 and conducts the conference while displaying the face picture on a display section of the client computers 2, 3.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multipoint capable of holding a conference with a face image of a user who uses each client computer among a plurality of client computers located at the multipoint via a server computer. The present invention relates to a conference system and a recording medium in which a program necessary for each of a server computer and a client computer for realizing such a system is recorded.

[0002]

2. Description of the Related Art A so-called videophone is known as a system capable of transferring an image together with voice using a communication line. This videophone has the advantage of being able to more realistically transmit the caller's emotional expression and the like using images.
However, videophones require a dedicated telephone capable of shooting and displaying moving images, and the amount of image information transferred through the telephone line is limited. In this case, the image quality itself was insufficient. Furthermore, since there is no concealment function, there is also a problem that an image that is not desired to be transferred to the other party is transferred, for example, when a woman does not apply makeup.

On the other hand, with the recent spread of personal computers (hereinafter referred to as personal computers) to general households and the rapid spread of computer-related data transfer technologies such as the Internet, voice and text are transmitted among a plurality of personal computers. Various software for holding a conference while transferring images have been provided. Such conference software is roughly divided into (1) an image of each member participating in the conference is captured by a small video camera or the like connected to a personal computer, and the actual video is transferred to another member's personal computer. And (2) C such as cartoon characters for each member
There is a type in which a G image is assigned and a conference is held using characters and voices in combination with a character or the like assigned to the G image.

[0004]

However, in the method (1) for transferring a real photographed image, the processing tends to be heavy because of the burden on the image transfer, and the concealment function is provided similarly to the videophone. Therefore, there is a problem that an image that is not desired to be transferred to the other party is transferred. on the other hand,
In the case of using the CG image such as the character (2) above,
In particular, when there are many participants in the conference, it may be difficult to understand at a glance which character represents which member, and although it is possible to change the expression and behavior of each character, it is possible to express the emotions of the members themselves. Was not fully communicated to other members.

[0005]

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and it has been proposed to reduce the amount of actual data transferred between client computers via a server computer while minimizing the amount of data transfer. Provided is a multi-point conference system capable of displaying face images of all members participating in a conference on a computer, and transmitting sufficient emotional expressions by changing a plurality of face images for each member, and a related system. It is an object of the present invention to provide a recording medium in which a program necessary for each of a server computer and each client computer is recorded in order to realize the above.

Therefore, the multipoint conference system according to the first aspect of the present invention is a multipoint conference system in which a conference is performed using a plurality of client computers connected via a server computer. For each member, a plurality of face images are created in advance, and the face image groups of all members are stored in the storage units of the individual client computers, respectively. By transferring management data indicating which face image is selected from the group of face images to each client computer via the server computer, each member selects the face image of each member on his or her own client computer. From the storage unit of each client computer, and It is characterized in that a conference while displaying on the display unit of the cement computer.

Here, a plurality of face images for each member are
For example, a still image showing multiple facial expressions such as a normal face, a smile, an angry face, a disgusting face, a surprised face, and the like, bowing, and shaking the head vertically or horizontally to express consent or opposition. It may be a moving image representing an operation or the like.

According to a second aspect of the present invention, in the system of the first aspect, the server computer receives data including a connection request, a disconnection request, and a face image selection / change request sent from each client computer. A reception function, a new connection member registration function for connecting the client computer and the server computer in response to a connection request from the client computer of the new connection member, and registering the member name of the new connection member; A disconnection member deletion function for disconnecting the client computer and the server computer in response to a disconnection request from the computer and deleting the member name of the member, and data received from the client computer of the newly connected member to the client of the already connected member. New connected member data transmission function to send to the computer, connected member data transmission function to send the connected member data to the client computer of the new connected member, and when any member initially selects or changes the face image A face image management function for registering or rewriting the management data of the face image and transmitting the management data to the client computer of each member, wherein each client computer is provided when a member using the client computer participates in the conference. A connection function for sending a connection request to the server computer to connect; a disconnection function for sending a disconnection request to the server computer when the member using the client computer finishes participating in the conference; and a connection function for connecting to the server computer When I did Connected member data registration function for receiving and registering data of connected members (specifically, management data indicating the member name and the latest selected face image, etc.) from the server computer, and a new function using another client computer. A newly connected member data registration function for receiving and registering data of a connected member (specifically, a member name or the like) from a server computer, and a function for another client computer when another client computer disconnects from the server computer. A cutting member data deletion function for deleting data of a member using a computer, and a face image selection / transmission function for transmitting a face image selection / change request to a server computer when a member using the client computer initially selects or changes a face image. Use the change request function and the client computer The latest selection is made on the display unit of the client computer based on management data (member number, face image number, etc.) sent from the server computer when any member including the member to use initially selects or changes the face image. And a face image display function for displaying a face image.

According to a third aspect of the present invention, there is provided the multipoint conference system according to the second aspect, wherein the server computer further includes a group of face images of a person who is newly participating in the conference from a client computer used by the new participating member. A face image group registration function for receiving and registering, a new participant member face image group transfer function for transmitting a new participant member face image group to a client computer of an existing member, and a registered face image group of an existing member Is transmitted to the client computer of the newly participating member. The client computer further includes a function of storing the client computer when a user using the client computer newly participates in the conference. The face image group of the new participant stored in the New face image group transmission function to be transmitted to the client, and when a user using the client computer newly participates in the conference, receives the face image group of the existing member from the server computer and registers it in the storage unit. A newly-registered member face image group registration function and a newly-registered member face image group reception / registration function for receiving a face image group of a newly-participating member from a server computer and registering the same in a storage unit when another member newly joins the conference. And characterized in that:

A multipoint conference system according to a fourth aspect of the present invention is the multipoint conference system according to any one of the first to third aspects, wherein voice is transmitted and received between members participating in the conference through a separate telephone line.

According to a fifth aspect of the present invention, in the multipoint conference system according to any one of the first to third aspects, each of the client computers includes a sound collecting unit and an audio reproducing unit, and the audio is transmitted between the respective client computers via a server computer. Are transmitted and received.

According to a sixth aspect of the present invention, there is provided the multipoint conference system according to any one of the first to fifth aspects, wherein the client computer has a common application program, and one of the members has the application program on its own client computer. When the program is operated, the operation data is transferred to each client computer via the server computer, and the application program is operated synchronously on each client computer.

According to a seventh aspect of the present invention, there is provided a computer-readable recording medium on which a program necessary for causing a server computer to implement the functions according to any one of the first to sixth aspects is recorded.

A recording medium according to a ninth aspect is a computer-readable recording medium which records a program necessary for causing a client computer to realize the functions according to the first aspect.

[0015]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A first embodiment of the present invention will be described below with reference to the drawings. In FIG. 1, for example, a server computer 1 (a personal computer or a workstation) arranged in a laboratory inside a university, a client computer 2 (personal computer) for an instructor arranged in the laboratory,
By connecting to a plurality of student client computers 3 (PCs) located at the homes of students outside the university, instructors located in the laboratory can give lectures interactively to students located at homes, etc. 1 shows a multipoint conference system.

The client computer 2 and the server computer 1 arranged in the laboratory are connected to a LAN (Local Area).
Network 4). The client computer 3 for off-campus students and the server computer 1 in the laboratory are connected to each other by an ISDN (Integrated Services Digital Network) line 5 or an analog telephone network 6 provided by a telephone company.

More specifically, for example, a client computer 3 of an A-type student using the ISDN line 5 can access a TA (Terminal) when participating in a lecture (conference).
Adapter) 7, a DSU (Digital Service Unit) 8, and the above-described ISDN line 5 are connected to an access server 10 in the laboratory.
It is connected to server computer 1 via AN4.

On the other hand, when participating in a lecture, the B type student's client computer 3 using the analog telephone network 6 transmits to the server computer 1 via the modem 11, the telephone network 6, the access server 10 and the LAN 4. Connected. In this way, the lecturer's client computer 2 and each student's client computer 3
The necessary data is transferred between the server and the server computer 1 via the server computer 1. In addition, there may be a plurality of A type and B type students.

In addition, telephones 12 and 13 are arranged together with the client computers 2 and 3 near the lecturer and each student. Then, for example, the telephones 12 and 13 of the instructor and the B-type student can be connected to the DSU and the TA 14 in the laboratory via the telephone network 6.
U and TA14 are MCU (Multipoint Control Unit) 1
5 is connected.

The A-type student's telephone 13 has the above-mentioned TA7, DSU8, ISDN line 5, DSU and TA
14 and can be connected to the MCU 15. Thus, during the lecture, if the lecturer or one of the students speaks using their own telephones 12 and 13, the voice is transmitted to the telephones 12 and 13 of all other members participating in the conference via the MCU 15. It is to be transferred. The number of DSUs and TAs 14 corresponding to the maximum number of members participating in the lecture is prepared.

Next, in order to configure a multipoint conference system with the server computer 1 and the client computers 2 and 3, an outline of a processing procedure by programs respectively installed in the server computer 1 and the client computers 2 and 3 in advance. Will be described. Note that the program for the server computer 1 and the program for the client computers 2 and 3 are created by the present inventor to realize each function of the multipoint conference system of the present invention, and are each a CD-ROM. It can be recorded on a suitable recording medium such as a ROM and sold or provided, or sold or provided online via the Internet or the like.

First, by installing a server program on the server computer 1, the server computer 1 performs the following functions (procedures) during a multipoint conference (lecture). That is, the server computer 1 includes: (1) a data receiving function F1 for receiving data including a connection request, a disconnection request, and a face image selection / change request sent from each of the client computers 2 and 3;
(2) The client computer 2, 3 is connected to the server computer 1 in response to a connection request from the client computer 2, 3 of the member to be newly connected, and the member number of the new connection member sent with the connection request A new connection member registration function F2 for registering a member name and a member name in the storage unit of the server computer 1, (3)
In response to a disconnection request from the client computer 2, 3 of the connected member, the client computer 2,
(4) a disconnected member deletion function F3 for disconnecting the server computer 1 from the server computer 1 and deleting the member number and member name of the member from the storage unit of the server computer 1;
The data (member number, member name, face image number indicating a face image initially selected from a plurality of face image groups prepared for each member, etc.) received from the client computers 2 and 3 of the newly connected member are A new connection member data transmission function F4 to be transmitted to the client computers 2 and 3 of the connected members, and (5) the data of the connected members (member number, member name and latest selection) are transmitted to the client computers 2 and 3 of the newly connected members. Connected member data transmission function F5 for transmitting the face image number of the detected face image)
And (6) registering or rewriting the management data of the face image (such as the face image number corresponding to the member number) in the storage unit of the server computer 1 when any member initially selects or changes the face image. A face image management function F6 for transmitting the management data (member number and face image number, etc.) to the client computers 2 and 3 of each member is exhibited. Note that the member number is
When registering a member who newly joins a lecture, it can be determined corresponding to the member name.

Further, the server computer 1 also performs the following functions when a new member participates (joins) in a lecture. That is, (7) a member name and a group of face images are received from the client computers 2 and 3 of the person who will be newly participating in the conference, a member number is assigned, and the member number and the member are stored in the storage unit of the server computer 1. A new participant member data registration function F7 for registering a name, adding a face image number to a plurality of face images constituting the face image group, and registering them in the storage unit; Client computers 2 and 3 of the participating members, together with a group of face images with names and face image numbers
A new member data transfer function F8 to be transmitted to
(9) The registered member data transfer function F9 that transmits the registered member numbers and member names of the registered members to the client computers 2 and 3 of the new members together with the face image group to which the face image number is assigned.

On the other hand, each of the client computers 2, 3
By installing the client program on the client computer, each of the client computers 2 and 3 exhibits the following functions (procedures) during a lecture. That is,
(1) A member who uses the client computer 2 or 3 selects a member name from among the names of all members registered in advance in the client computers 2 and 3 and sends the client computer 2 or 3 to the server. A connection function G1 for transmitting a connection request with a member number and a member name to the server computer 1 when connecting to the computer 1 and starting participation in a lecture, and connecting the server computer 1 to the server computer 1
(2) a disconnection function G for transmitting a disconnection request to the server computer 1 and disconnecting when the member using the client computers 2 and 3 ends participating in the lecture;
2 and (3) when connected to the server computer 1,
The data of the connected member (member number, member name, face image number of the latest selected face image, etc.) is received from the server computer 1 and the client computers 2, 3
Connected member data registration function G3 registered in the storage unit
And (4) receiving data (member number, member name, face image number of the initially selected face image, etc.) of the member newly connected using the other client computers 2 and 3 from the server computer 1 and A new connection member data registration function G4 to be registered in the storage units of the computers 2 and 3; and (5) data (member number, member number) of the disconnected member when another client computer 2 or 3 disconnects from the server computer 1. A cutting member data deletion function G5 for deleting the name of the cutting member from the storage unit of the client computer 2, 3 and ending the display of the face image of the cutting member; (6)
When a member using the client computers 2 and 3 initially selects or changes a face image, the server computer 1 requests the server computer 1 to select or change a face image (specifically, the member number and the face image number of the face image to be initially selected or changed). And (7) sent from the server computer 1 when any member including the members using the client computers 2 and 3 initially selects or changes the face image. A face image display function G7 for displaying the latest selected face image on the display unit of the client computer 2, 3 based on the management data (such as the face image number corresponding to the member number).

The client computers 2 and 3 further perform the following functions when a new member participates (joins) in a lecture. That is, (8) when a user using the client computer 2 or 3 newly participates in a lecture, the face image group of the new participant stored in the storage unit of the client computer 2 or 3 is displayed together with the member name. A new participant member data transmission function G8 to be transmitted to the server computer 1, and (9) when a person using the client computers 2 and 3 newly participates in a lecture, the member number, member name,
A registered member data registration function G9 for receiving a face image group, a face image number, and the like from the server computer 1 and registering them in the storage units of the client computers 2 and 3;
0) When another member newly joins the conference, the member number, member name, face image group, face image number, and the like of the newly joined member are received from the server computer 1 and stored in the storage units of the client computers 2 and 3. A new member data registration function G10 for registration is exhibited.

Next, a description will be given of a face image group prepared in advance by members newly participating (joining) in a lecture. The face image group is prepared as a still image taken by a digital camera or a moving image taken by a video camera, and a sufficient number of face images, for example, about a dozen or so, required to express the emotions of the members at that time are prepared. Keep it. In the case of a moving image, if the reproduction time is within several seconds, the capacity of the image can be sufficiently reduced.

More specifically, for example, a standard image (normal face), a smiling face, an angry face, a distressed face, a surprised face, a face expressing disgust, etc. are prepared as still images, while a moving image is prepared.
Image of raising hand (used when asking for remarks), image of shaking head vertically (used for expressing consent or consent), image of shaking head (used for expressing opposition or rejection, etc.) ),
Prepare a bowing image (used at the beginning of the lecture, etc.), a waving image (used at the end of the lecture, etc.), an image of moving the mouth (used at the time of speaking, etc.) Keep it.

Although the number and contents of the images can be freely determined by the individual members, usually, the display of each client computer 2, 3 shows the client computer 2,
The maximum number of sheets to be used is set to, for example, about a dozen or so, because all the face images of the members who use No. 3 are reduced (see FIG. 4).

The face image group of the new participating members is transmitted to the server computer 1 together with the member names by the new participating member data transmitting function G8 of the client computers 2 and 3, and the new participating member data of the server computer 1 is transmitted. The information is registered in the storage unit of the server computer 1 by the registration function F7. further,
The face image group is transferred to the client computers 2 and 3 of the participating members by the new connection member data transmission function F4 together with the member number, member name, and the like assigned by the server computer 1, and is transferred by the new participation member data registration function G10. It is registered in the client computers 2 and 3 of the participating members.

On the other hand, to the client computers 2 and 3 of the newly connected members, the data (member number, member name, face image group and face image number) of the existing members are transmitted from the server computer 1 by the above-mentioned existing member data transfer function F9. Etc.) is transmitted, and the data of the existing members are registered in the client computers 2 and 3 of the new members by the above-mentioned existing member data registration function G9.

The above processing is usually performed before the start of the lecture, and as a result, before the start of the lecture, the storage units 2a and 3a of each of the client computers 2 and 3 as shown in FIG. In addition to the client program described above, a member name list of each member corresponding to the member number and a face image group of each member corresponding to the face image number are stored. As described above, since the face image groups of all members are stored in the individual client computers 2 and 3 in advance, it is necessary to transfer the face images between the client computers 2 and 3 during the actual lecture. Not,
When each member changes his or her own face image, only the face image numbers before and after the change need to be transferred via the server computer 1 to the client computers 2 and 3 of the other members.

Next, a procedure for actually giving a lecture using the multipoint conference system will be briefly described. For example, when a student participates in a lecture and starts a client program of the multipoint conference system on a client computer 3 used by himself / herself at home or the like, a member selection screen H as shown in FIG. The names (member names) of all registered lecture participants are displayed.

Here, one's own name, for example, Noriko Nak
If you select amura, the client computer 3
Is determined, the client computer 3 is connected to the server computer 1 by the connection function G1, and the server computer 1 is the new connection member by the data reception function F1 and the new connection member registration function F2. Student Nakamura member number,
The member name is registered. The procedure by which the instructor connects to the server computer 1 using the client computer 2 is the same as described above.

On the other hand, when the selection of the member name in FIG. 3 is completed, as shown in FIG.
Display part 3b of Nakamura's client computer 3
, For example, in the center or lower part of the first sub-display unit 3c on the left end side, the face image groups P0, P1,... In addition, "○" mark or "X"
Although a mark is included, this is used when a majority decision is taken, and is an image that is automatically added to the face image group created by the members themselves.

Here, when a desired face image, for example, a face image P3 is initially selected by a mouse click operation or the like (not shown), a face corresponding to the face image P3 initially selected by the face image selection / change request function G6 is selected. The image number is sent to the server computer 1 and registered in the storage unit of the server computer 1 by the face image management function F6. As a result, as shown in FIG. 5A, the storage number 1a of the newly connected student Nakamura, the member name, the canvas number, and the initially selected face image number are stored in the storage section 1a of the server computer 1. (For example, 03) is registered as management data. The registration is performed for each connected member. Although not described in detail, the canvas number is data used to determine the arrangement (display order) of the face images of each member on the individual client computers 2 and 3.

By the face image management function F6, the member name, member number, and selected face image number of the connected member are transmitted from the server computer 1 to the client computer 3 of the newly connected student Nakamura. The face image number of the face image P3 initially selected by itself is also transmitted. As a result, as shown in FIG. 6, the client computer 3 of the student Nakamura stores the face image P3 initially selected by the user based on the face image number in the storage unit 3a.
And is enlarged and displayed as its own face image P on the upper part of the first sub-display unit 3c.

In the main display section 3d of the client computer 3 of the student Nakamura, the face images Q, R, S, and T selected by the connected member at that time are the member numbers and face image numbers of the connected members. Is read from the storage unit 3a of the client computer 3 and displayed. FIG. 6 illustrates a case where a lecturer represented by a face image Q and three students represented by face images R, S, and T exist as connected members. Each face image P, Q,
It is preferable to display the member name in the lower part of R, S, and T in Roman characters or kanji characters (not shown).

FIG. 7 shows the client computer 2 of the instructor.
2 shows the display contents of the display unit 2b. The instructor's own face image groups Q0, Q1,... Are displayed in a reduced list from the center to the lower part of the first sub-display part 2c, and are selected at that time in the upper part of the first sub-display part 2c. The own face image Q is displayed in an enlarged manner. In addition, the main display unit 2d displays face images R, S, and F of four students including the newly connected student Nakamura.
T and P are displayed. In addition, newly connected student Nak
The amura's face image P is stored in the server computer 1 using the new connection member data transmission function F4 by the student Nakamura's member number, member name, and initially selected face image number.
In addition to the face images R, S, and T of the three students read from the storage unit 2a of the instructor's own client computer 2 and displayed before,
It has been additionally displayed.

Next, for example, when a student Nakamura wants to change his face image from P3 to P5, in FIG.
When P5 is clicked or the like from the face image group displayed in the reduced list, the face image numbers corresponding to the face images P3 and P5 before and after the change are transmitted to the server computer 1 by the face image selection / change request function G6, and the face By the image management function F6, the face image number in the management data of the student Nakamura is changed to, for example, "05" as shown in FIG.

The change of the management data is performed by the server computer 1 for all the client computers 2 and 3 including the client computer 3 of the student Nakamura himself.
Is transmitted to the student Nak by the face image display function G7.
First sub-display unit 3 of amura's client computer 3
In the upper part of c, the face image P5 after the change is enlarged and displayed as a selected image (see FIG. 8), while the main display unit 2d of the other connected client computers including the instructor client computer 2 displays the student. The image after the change (see FIG. 9) is displayed as the face image P of Nakamura, and the face image of the student Nakamura on the client computer 3 of another student is also changed and displayed, although not shown. The same applies to the procedure in which other lecture participants other than the student Nakamura change their own face images.

As described above, only the face image number is transferred between the individual client computers 2 and 3 via the server computer 1 and the respective client computers 2 and 3 are transferred.
The lecture can be advanced interactively between the lecturer and a plurality of students by using the telephones 12 and 13 while changing the face image of each member displayed in. Therefore, the instructor or the student can quickly transmit his / her own emotional expression or the like to another member by selecting an appropriate face image from his / her own face image group. When one of the members selects a moving image as a face image, a moving image representing the operation of the member within a few seconds is reproduced on each of the client computers 2 and 3, and then the member moves to another face image. The still image state is maintained until is selected.

When each member calls the telephone number corresponding to the MCU 15 from his / her own telephone set 12 or 13 at the start of participation in the lecture, the telephone sets 12 and 13 of all other participating members are set up via the MCU 15. And the voice spoken by any member including the instructor becomes M
The telephones 12 and 13 of all other members via the CU 15
Is forwarded to

In the present embodiment, it is also possible to operate a common application program synchronously on each of the client computers 2 and 3 during a lecture. That is, as shown in FIG. 7 and FIG. 6, the second sub-display units 2e and 3
e, and these second sub-display units 2e and 3e
It is used as a display area for a common application program, for example, a presentation program.

For example, when an instructor prepares a teaching material using a presentation program in advance and performs an operation such as page feed of the teaching material on his / her client computer 2, a control signal corresponding to the operation is generated. The presentation program is transferred to each student's client computer 3 via the server computer 1, and as a result, the presentation program is synchronously operated on each client computer 3 in accordance with an instructor's page turning operation or the like. In addition,
The program for the client of the multipoint conference system includes functions (procedures) necessary for synchronously operating the application program on each of the client computers 2 and 3, and the program for the server includes And a function (procedure) necessary for transferring a control signal for a synchronous operation.

The application programs to be operated in synchronization may be word processing software, browser software for browsing the Internet, or the like.
3 need to be installed. When the application program uses an independently created file such as the above-described slide-type teaching material, the file is stored in the client computer 2 of the instructor via the server computer 1 via the server computer 1 before the lecture. What is necessary is just to transfer it to the computer 3.

The client computers 2, 3
It is not essential that the common application program be operated synchronously, and if such a function is not provided, the second sub-display unit e becomes unnecessary. In addition, it is not essential to display a reduced list of the face images of the members using the client computers 2 and 3 on the first sub-display units 2c and 3c of the client computers 2 and 3, instead of the face images. For example, for example, face image 1-normal face, face image 2-smile,
, Etc., and the correspondence between the face image number and the short explanatory text may be displayed in a list to select a face image.
In this case, the display space can be saved as compared with the case where the face image group is displayed in a reduced list.

In the above description, a case has been described as an example in which the number of participants in the lecture is five. However, in practice, a lecture can be given with about ten or more members participating. In addition, technically, it is possible to join about several tens of members, but in that case, it is necessary to reduce the size of the face image of each member displayed on each client computer 2, 3. It is necessary to limit the maximum number of members who can participate to about ten or less in general, since there is a possibility that the expression of each member may not be sufficiently determined.

In the multipoint conference system for lectures described above, the face images of all members are stored in the client computers 2 and 3, however, even in the case of a moving image, the reproduction time is usually within several seconds. The capacity of the hard disk required for storing the face image is sufficiently small, and the programs for the server and the client are also sufficiently small.

Therefore, the client computer 2,
3 is a so-called mobile computer, which has a slightly lower function than a normal personal computer other than a normal personal computer such as a desktop type or a notebook type, but is small and lightweight and easy to carry. ) Can also be used. By installing the server and client programs on one personal computer, for example, the server computer 1 and the instructor client computer 2 can be used together.

The multipoint conference system is not only a lecture at a university, but also various schools for children or adults, lectures at educational institutions, various consulting, conferences between a parent company and a subsidiary or affiliated company, business negotiations between companies, The present invention can be used for various purposes, such as a conversation involving display of a face image between private friends.

In this case, in addition to the client computer used by the participating members of the conference, a client computer for recording the contents of the conference (a face image sequentially selected by each member during the conference and a voice spoken by each member) together with a time stamp. May be provided separately so that conference record data can be created. It is also possible to store a large number of conference record data and create a conference record database from which desired conference record data can be searched based on the date and contents of the conference.

In the above embodiment, the conference (lecture)
The administrator of the server prepares the server computer 1 and the MCU 15 for voice transfer, but the telephone company also has a conference server function for managing the names of the members participating in the conference and the selected face image data. (Corresponding to the function of the server computer 1), and the telephones of two or more members are mutually connected so that the voice of any one of the members participating in the conference can be transmitted to all the other members. A connection audio server function may be provided. In this case, the telephone company can also provide the above-described minutes recording function and minutes recording database function.

Also, instead of separately transferring the voice by telephone, a microphone (sound collecting unit) is connected or built into each of the client computers 2 and 3, and the voices of the members participating in the conference are transmitted via the server computer 1. The data may be transferred between the client computers 2 and 3 and reproduced by a speaker (sound reproduction unit) attached to each of the client computers 2 and 3. As a result, although the transfer processing is somewhat heavy, there is an advantage that a member who can use only one telephone line can participate in the conference. In this case, the server computer 1 can be provided by an Internet provider or the like.

Recently, a small-sized image information transfer device capable of transferring image information by connecting to a portable telephone has been developed, and the multi-point conference system of the present invention has been developed using the small-sized image information transfer device. Needless to say, in this case, the small-sized image information transfer apparatus described above corresponds to the client computer of the present invention.

[0055]

As described above, according to the multipoint conference system according to the first aspect, the face images of all the participating members of the conference are displayed on the display unit of each client computer, and each member is able to display his / her own image. Since face images can be selected and displayed from a plurality of face image groups prepared in advance, each member can approve or disagree with his or her feelings that change from moment to moment, opinions of other members, etc. Can be conveyed to other members by a face image (still image or moving image) of one's own selection which seems to be optimal in the scene.

Thus, by each member preparing a sufficient number of face images in advance, rich emotional expression and the like, which is not much different from the case of transferring a real image, can be achieved. In addition, since a group of face images of the user can be prepared in a sufficiently satisfactory content in advance, an image that the user does not want to show to other members is not displayed on the client computer of another member. . Further, the face image group of each member is stored in advance in each client computer, and only management data indicating which face image each member has selected is transferred between the client computers via the server computer. The required amount of data transfer is small enough,
Light processing is realized.

According to the multipoint conference system of the second aspect,
The connection of the member using each client computer to the server computer at the start of participation in the conference, disconnection from the server computer at the end of participation in the conference, and the latest face image selected by each member during participation in the conference Functions such as display on each client computer are smoothly realized.

According to the multipoint conference system of the third aspect,
Processing such as registration of a group of face images prepared by members newly participating in the conference to the server computer and transfer of the group of face images from the server computer to client computers of the participating members are performed through a communication line. There is an advantage that even a member or the like can register a face image group and read a face image group of another member quickly and easily.

According to the multipoint conference system of the fourth aspect,
Since the voice transfer is performed separately through a telephone line, basically only the management data indicating the initial selection or change of the face image needs to be transferred between the client computers, and the data transfer processing between the client computers Can be performed very lightly.

According to the multipoint conference system of claim 5,
Each client computer is provided with a sound collecting unit and a sound reproducing unit, and the sound information is transferred between the client computers through the server computer together with the management data and the like. For example, only one telephone line is used in a general home or the like. In this case, there is an advantage that the multipoint conference system can be used.

According to the multipoint conference system of claim 6,
When each client computer has a common application program, operating the application program on any one of the client computers causes the same application program to be operated synchronously on other client computers. When an instructor using one of the client computers gives a lecture to a student using another client computer, the lecture content can be displayed on each client computer using a presentation application program. It is.

The program recorded on the recording medium according to claim 7 describes a procedure for realizing the above-mentioned function in the server computer. The program recorded on the recording medium according to claim 8 is: Since the procedure for realizing the above functions on the client computer is described, the multipoint conference system of the present invention can be realized by installing these programs on the server computer and the client computer, respectively. Therefore, the act of manufacturing or selling various recording media on which the program for the server computer or the client computer is recorded is naturally included in the scope of the present invention.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram showing a configuration of a multipoint conference system according to an embodiment of the present invention.

FIG. 2 is an explanatory diagram showing contents stored in a storage unit of each client computer of the multipoint conference system.

FIG. 3 is an explanatory diagram showing a member name selection screen when a program for a multipoint conference system is started on the client computer.

FIG. 4 is an explanatory view showing contents displayed on a display unit of a client computer after the selection of the member name.

FIG. 5 is an explanatory diagram showing management data registered in a storage unit of the server computer when a new member connects to the server computer of the multipoint conference system.

FIG. 6 is an explanatory diagram showing contents displayed on a display unit of a client computer after connection with the server computer is completed.

FIG. 7 is an explanatory diagram showing the contents displayed on the display unit of another connected client computer.

FIG. 8 is an explanatory view showing display contents of a client computer of any member when the member changes a face image.

FIG. 9 is an explanatory diagram showing display contents of another member's client computer when any member changes a face image.

[Explanation of symbols]

 1 server computer 2, 3 client computer 12, 13 telephone P, Q, R, S, T face image

 ──────────────────────────────────────────────────続 き Continued on the front page F-term (reference) HC02 JT06 KA01 KA06 KA07 LB01 LD08 9A001 CC04 JJ16 JJ27 KK09

Claims (8)

[Claims] 1. A multipoint conference system for conducting a conference using a plurality of client computers connected via a server computer, wherein a plurality of face images are created in advance for each member who can participate in the conference. Each member's face image group is stored in the storage unit of each client computer, and each member participating in the conference selects any face image from their own face image group on their own client computer. By transferring the management data indicating whether or not the face image has been transferred to each client computer via the server computer, each member reads out the face image of each member selected on his or her own client computer from the storage unit of each client computer, and Meeting while displaying on the display of the client computer Multipoint conferencing system according to claim Ukoto. 2. The server computer according to claim 1, further comprising: a data receiving function for receiving data including a connection request, a disconnection request, and a face image selection / change request sent from each client computer; A new connection member registration function for connecting the client computer and the server computer accordingly and registering the member name of the new connection member; and connecting the client computer and the server computer in response to a disconnection request from the client computer of the already connected member. A disconnected member deletion function of disconnecting the member and deleting the member name of the member; a new connection member data transmission function of transmitting data received from the client computer of the newly connected member to the client computer of the connected member; Connected member data transmission function for transmitting data of connected members to client computers of regular connected members; registering or rewriting face image management data when any member initially selects or changes a face image A face image management function of transmitting the management data to each member's client computer, wherein each client computer transmits a connection request to a server computer when a member using the client computer participates in a conference, and connects the member computer to the server computer. A disconnection function that sends a disconnection request to the server computer when a member using the client computer finishes participating in the conference and disconnects the data, and a data of the connected member is transmitted from the server computer when connected to the server computer. Receive and register A registered member data registration function to receive, and a newly connected member data registration function to receive and register data of a newly connected member from a server computer by using another client computer, and to allow another client computer to connect to the server computer. A cut member data deletion function for deleting data of a member using the other client computer when disconnecting, and a request for selecting / changing a face image to the server computer when a member using the client computer initially selects or changes a face image. And a request function for requesting / changing the face image, and a client computer based on management data sent from the server computer when any member including the member using the client computer initially selects or changes the face image. 2. The multipoint conference system according to claim 1, further comprising a face image display function of displaying a face image most recently selected on a display unit of the computer. 3. The server computer further comprises: a face image group registration function for receiving and registering a face image group of a person who is to be a new member of the conference from a client computer used by the new member. New face image group transfer function for transmitting the face image group of the existing member to the client computer of the existing member, and the face image group of the existing member for transmitting the registered face image group of the existing member to the client computer of the new member A group transfer function, wherein each client computer further includes, when a user using the client computer newly joins the conference, a face image group of the new participant member stored in the storage unit of the client computer. A function for transmitting a face image group of a new member to be transmitted to the server computer; When a client computer user newly joins the conference, the registered member's face image group registration function to receive the registered member's face image group from the server computer and register it in the storage unit. 3. The multipoint conference according to claim 2, further comprising a new participant member face image group reception registration function of receiving a face image group of the new participant from the server computer and registering the face image group in the storage unit when newly joining. system. 4. The system according to claim 1, wherein voices are transmitted and received between members participating in the conference separately through a telephone line.
4. The multipoint conference system according to any one of claims 3 to 3. 5. The multi-function device according to claim 1, wherein each client computer includes a sound collecting unit and an audio reproducing unit, and audio is transmitted and received between the client computers via a server computer. Point conferencing system. 6. Each client computer has a common application program, and when any member operates the application program on its own client computer, operation data is transferred to each client computer via the server computer. 6. The multipoint conference system according to claim 1, wherein the application programs are operated synchronously on each client computer. 7. A computer-readable recording medium on which a program necessary for causing a server computer to realize the functions according to claim 1 is recorded. 8. A computer-readable recording medium in which a program necessary for causing a client computer to realize the functions according to claim 1 is recorded.