JP2022080502A - Host terminal, electronic meeting system, method for authentication of entry into electronic meeting, and program - Google Patents

Abstract

To prevent an unqualified third party from entering a virtual meeting room.SOLUTION: A host terminal 100 comprises: a video meeting processing unit 133 for holding a video meeting with a participant terminal; a waiting room processing unit 131 for allowing the participant terminal to enter a virtual waiting room where they wait to participate in the video meeting; and a participation permission reception unit 132 for displaying an image of the participant terminal in the waiting room and accepting whether or not this participant terminal can participate in the video meeting.SELECTED DRAWING: Figure 2

Description

The present invention relates to a host terminal, an electronic meeting system, an entrance authentication method for an electronic conference, and a program.

Conventionally, a video conference system (or a remote conference system) that uses a conference terminal to perform a video conference with a remote party is known.

In electronic conference systems such as video conference systems and teleconferencing systems, a password permitting entry into a virtual conference room is pre-sent to participating members. Participating members use the password sent in advance when entering the virtual conference room provided by the electronic meeting system.

Here, if the password for permitting entry to the virtual conference room is leaked, a third party who is not qualified to participate can enter the virtual conference room. For example, when conducting a school lesson using a video conference system, if the password is leaked in the room entry management using a password etc., there is a possibility that a person who is not qualified to participate in the lesson will participate in the lesson. There is.

Therefore, an invention for determining a face image from a user by a face recognition technique is disclosed. Specifically, the abstract of Patent Document 1 states that "the control unit 21 of the conference management server 20 acquires images of participants from the TV conference terminals (10A, 10B) and authenticates the participants of the remote conference. Then, when the number of people who can be authenticated has reached the required number, the control unit 21 of the conference management server 20 executes the action permission process. Further, the control unit 21 is a TV conference terminal (10A, 10B). ) Is analyzed and the location is detected by tracking the participant image. If the participant image cannot be followed, the control unit 21 executes a determination process of the conference holding condition. The number of participants is large. If the number is less than the required number and the conference holding conditions cannot be maintained, the control unit 21 outputs an alarm to each TV conference terminal (10A, 10B). "

Further, in the abstract of Patent Document 2, "when accepting the use of the conference system, the face image data and the information of the authentication card ID and the pamphlet ID are acquired and transmitted to the management server (203). The authentication card ID and the pamphlet. By devising a method of collating the ID information and the face image data with the DB information of the management server, a corresponding method that can efficiently perform the business is selected (211). "

Japanese Unexamined Patent Publication No. 2009-171119 Japanese Unexamined Patent Publication No. 2006-119784

In both Patent Documents 1 and 2, the face image of the user who is a participant is acquired and the user is authenticated by using the face recognition technique.

However, in order to authenticate the user by the face recognition technique, it is necessary to register the face image of the participant who participates in the video conference in the system in advance, which is complicated. In addition, it is possible that a legitimate participant may not be able to enter the room due to false detection of face recognition, or a third party who is not qualified to participate may enter the room.

In view of the above circumstances, the present invention can prevent a third party who is not qualified to participate in a virtual conference room in the organizer terminal, the electronic meeting system, the method for authenticating entry to the electronic conference, and the program. Make it an issue.

The above object of the present invention is achieved by the following means.
(1) An electronic conference processing unit that holds an electronic conference with a participant terminal,
A waiting room processing unit that allows the participant terminal to enter a virtual conference waiting room for waiting for participation in the electronic conference.
A participation availability reception unit that displays an image of the participant terminal in the conference waiting room and accepts whether or not the participant terminal can participate in the electronic conference.
Organizer terminal equipped with.

(2) An electronic conference processing unit that holds an electronic conference with the participant terminals,
A waiting room processing unit that allows the participant terminal to enter a virtual conference waiting room for waiting for participation in the electronic conference.
When the participant terminal participates in the electronic conference, a waiting room providing unit that provides the virtual conference waiting room for waiting for participation in the electronic conference, and a waiting room providing unit.
The participation permission reception unit that displays the image received from the participant terminal who is in the meeting waiting room and accepts whether or not the participant terminal can participate in the electronic conference.
Equipped with an electronic meeting system.

(3) Steps to enter the participant terminal into a virtual conference waiting room for waiting for participation in the electronic conference, and
The step of displaying the image received from the participant terminal that entered the meeting waiting room, and
The step of accepting whether or not the participant terminal can participate in the electronic conference,
How to authenticate entering an electronic conference, including.

(4) On the computer
Procedure for entering a participant terminal into a virtual conference waiting room for waiting for participation in an electronic conference,
Procedure for displaying an image received from a participant terminal who entered the conference waiting room,
Procedure for accepting whether or not the participant terminal can participate in the electronic conference,
A program to execute.

According to the present invention, it is possible to prevent a third party who is not qualified to participate in the virtual conference room.

It is a block diagram which shows the structure of the video conference system which concerns on 1st Embodiment. It is a schematic diagram which shows the whole structure of the organizer terminal. In the video conference system according to the first embodiment, a sequence diagram (No. 1) showing the overall operation of the room entry authentication process for authenticating the participants participating in the video conference. In the video conference system according to the first embodiment, a sequence diagram (No. 2) showing the overall operation of the room entry authentication process for authenticating the participants participating in the video conference. It is a flowchart which showed the entry authentication processing of the person who wants to participate in a video conference by the organizer terminal of the video conference system which concerns on 1st Embodiment. It is explanatory drawing which showed the conceptual diagram in the case where the control unit displays the member image for a conference waiting room transmitted from each of a plurality of participant terminals on the display screen of the display unit. It is explanatory drawing which showed the selection screen which the participation admissibility reception part of a control unit accepts participation in a video conference by a participant terminal. It is a block diagram which shows the structure of the video conference system which concerns on 2nd Embodiment. In the video conference system according to the second embodiment, it is a sequence diagram which showed the whole operation of the entrance authentication processing of a person who wants to participate in a video conference. It is explanatory drawing which showed that the gesture by a child is photographed by the image pickup part of a participant terminal, and the face image of a child is photographed, and is authenticated. In the video conference system according to the third embodiment, it is a sequence diagram which showed the entry authentication process which the participant terminal directly participates in the video conference of the organizer terminal. It is a flowchart which showed the process which the organizer terminal of the video conference system which concerns on 3rd Embodiment directly participates in a video conference of the participant terminal of the participant who wishes to participate in a video conference. It is explanatory drawing which showed the display screen of the organizer terminal in a videophone system. It is explanatory drawing which showed the display screen of the participant terminal in a videophone system. It is explanatory drawing which showed the display screen of the participant terminal in a videophone system. It is explanatory drawing which showed the display screen of the organizer terminal in a videophone system.

Hereinafter, embodiments of the present invention will be described with reference to the attached drawings. In the description of the drawings, the same elements are designated by the same reference numerals, and duplicate description will be omitted as appropriate.

[Outline of this technology]
In electronic meeting systems such as conventional video conference systems and remote conference systems, passwords sent in advance to participating members are used for authentication at the time of entry to allow entry into a virtual conference room. Judge whether or not. In this case, if the password is leaked, a third party who is not qualified to participate can easily enter the virtual conference room.

For smaller meetings, the meeting organizer often knows the faces of the members participating in the meeting. Therefore, in such a case, it is more appropriate for the organizer of the conference to check the facial images of the participating members than to authenticate with a password.

Therefore, the organizer of the video conference sends the URL (Uniform Resource Locator), which is a virtual conference waiting room link for the participating members to participate in the video conference, to the participating members in advance. This allows the video conference organizer to allow entry into the virtual conference room while checking the facial images of the participating members in the virtual conference waiting room, so that a virtual conference by a third party who is not qualified to participate can be allowed. You can prevent entering the room.

<First Embodiment>
[Video Conference System]
FIG. 1 is a block diagram showing a configuration of a video conference system 400 according to the first embodiment. As shown in FIG. 1, the video conference system 400 according to the first embodiment is configured to include a host terminal 100 and a connection server 300. The organizer terminal 100 and the connection server 300 provide a video conference between the organizer terminal 100 and the participant terminal 200.

The video conference system 400 is an example of an electronic conference system, and the video conference system 400 will be described below as an example of the electronic conference system. Further, the electronic conference is not limited to the video conference, but also includes a voice conference by voice.

First, in the video conference system 400 according to the first embodiment, the schematic operation of each terminal will be described. First, the organizer terminal 100 requests the connection server 300 to create a link for the conference waiting room.

When the connection server 300 receives a request for creating a conference waiting room link (which is also simply referred to as a waiting room link), the waiting room link generation unit 301 generates a conference waiting room link. Then, the connection server 300 transmits the conference waiting room link to the organizer terminal 100. The organizer terminal 100 acquires the generated conference waiting room link, connects to the connection server 300 by the conference waiting room link, and transmits the conference waiting room link to the participant terminal 200.

The participant terminal 200 receives the conference waiting room link and connects to the connection server 300 using the conference waiting room link. When the organizer terminal 100 and the participant terminal 200 are connected to the connection server 300, the organizer terminal 100 and the participant terminal 200 are referred to as Peer To Peer (this is also referred to as P2P (peer-to-peer)). .) Connect.

The connection by P2P is an example, and the connection between the organizer terminal 100 and the participant terminal 200 is not limited to the connection of P2P. The organizer terminal 100 and the participant terminal 200 may be connected to each other, and may be connected via a relay server (not shown), for example. In addition to this, the connection server 300 may have a relay function and relay between the organizer terminal 100 and the participant terminal 200.

As a result, the organizer terminal 100 displays a moving image (for example, a user's face image) of the participant terminal 200 in which the participant terminal 200 has entered a virtual meeting waiting room (which is also simply referred to as a waiting room). do. The organizer confirms the moving image of the participant terminal 200 in the conference waiting room displayed on the display unit of the organizer terminal 100, and inputs whether or not the participant terminal 200 can participate in the video conference. The moving image of the other participant terminal 200 is not transmitted to the participant terminal 200 that is in the meeting waiting room. As a result, the organizer terminal 100 can prevent the information about the participating members of the video conference from being disclosed to a third party who is not qualified to participate.

[About the organizer terminal]
FIG. 2 is a schematic diagram showing the overall configuration of the organizer terminal 100. The organizer terminal 100 includes an input unit 110, an image pickup unit 120, a control unit 130, a display unit 140, a storage unit 150, and a communication unit 160. The organizer terminal 100 is composed of, for example, a multifunctional mobile terminal (smartphone) capable of connecting to the Internet using a browser. The organizer terminal 100 is operated by the organizer who hosted the conference and also the administrator of the conference.

The input unit 110 accepts input of an operation by a user (for example, a conference administrator). The input unit 110 is composed of operation members such as a keyboard, various switches, buttons, and a touch panel that receive various operations of the user. The input unit 110 may be composed of a touch panel integrally laminated on the surface of the display unit 140, which will be described later.

The image pickup unit 120 is configured to capture a face image of a user (for example, a conference manager) who operates the own device. The image pickup unit 120 includes a lens group including a zoom lens and a focus lens, and a shutter having an aperture function. Further, the image pickup unit 120 is an image pickup device composed of a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide Semiconductor) element that converts a subject image into an electric signal, and an analog image signal output from the image pickup device. It has an A / D (Analog-to-Digital) converter that converts the image into a digital signal.

Further, the image pickup unit 120 has an image processing circuit. Therefore, the image pickup unit 120 performs image quality adjustment processing for adjusting white balance, color, brightness, and the like on the image data of the captured user's face image, and performs resizing processing to the display size and the like.

The control unit 130 is an arithmetic processing unit (CPU: Central Processing Unit) that controls the entire organizer terminal 100. The control unit 130 can embody the waiting room processing unit 131, the participation availability reception unit 132, and the video conference processing unit 133 by executing the control program stored in the storage unit 150.

The waiting room processing unit 131 causes the participant terminal 200 to enter a virtual conference waiting room for waiting for participation in the video conference. In the conference waiting room, each participant terminal 200 cannot perform image and / or voice communication with the organizer terminal 100 and other participant terminals 200. As a result, the control unit 130 of the organizer terminal 100 can prevent the information about the participating members of the video conference from being disclosed to a third party who is not qualified to participate.

The participation availability reception unit 132 displays a moving image of the participant terminal 200 in the conference waiting room on the display unit 140, and input by the administrator (user) of this conference regarding whether or not the participant terminal 200 can participate in the video conference. Accept. Here, the moving image of the participant terminal 200 corresponds to, for example, a face image of a user (for example, a person who wishes to participate) who uses the participant terminal 200. That is, the moving image of the participant terminal 200 can be a face image of a user (for example, a person who wants to participate) associated with the participant terminal 200.

The conference manager confirms the facial image (video) of the person (applicant) waiting in the conference waiting room, and permits the person to enter the conference room individually. Since the password for the participant terminal 200 to enter the conference room is simple, there is a possibility that a malicious user may enter the room. In addition, with permission to enter the room using face recognition technology, there is a risk that a legitimate applicant may not be able to enter the room due to erroneous detection, or a third party who is not qualified to participate may be able to enter the room.

However, in the present embodiment, the organizer terminal 100 provides an operation element that allows the face of a person who wishes to participate to be displayed and confirmed as a moving image in the conference waiting room, and individually permits entry into the conference room. Since a human can judge the video of the person who wants to participate, even if a malicious user uses a photograph of a legitimate person who wants to participate, it can be easily distinguished from the moving image of the person who wants to participate. Therefore, only the person who the manager knows can enter the conference room.

The video conference processing unit 133 holds a video conference with the participant terminal 200. The video conference means, for example, performing stream communication of moving images and / or audio between one or more participant terminals 200 and the organizer terminal 100 that have received the permission. At this time, each participant terminal 200 transmits the moving image taken by itself and the recorded sound to the organizer terminal 100 as a stream. The organizer terminal 100 generates a moving image stream of each participant terminal 200 and the organizer terminal 100 and / or an audio stream in which the audio of each participant terminal 200 and the organizer terminal 100 is integrated, and the stream is reproduced. , Sent in a stream to each participant terminal 200.

Instead of the control unit 130 controlling the organizer terminal 100 in an integrated manner, the organizer terminal 100 may be controlled by a plurality of hardware sharing the processing.

The storage unit 150 includes a non-volatile memory, a working memory, a large-capacity storage device, a database described later, and the like. As the non-volatile memory, for example, EEPROM (Electrically Erasable Programmable Read-Only Memory) or the like is used. The large capacity storage device is, for example, a flash memory. The large-capacity storage device records constants, programs, and the like for the operation of the control unit 130. The program refers to a program for executing each process of the flowchart described later in this embodiment. Further, as the working memory, for example, a RAM (Random Access Memory) is used, and it is used as a working area for developing constants, variables, programs read from a large-capacity storage device, etc. for operation of the control unit 130. Further, the working memory is used as a buffer memory for temporarily holding the image data of the user's face image and an image display memory of the display unit 140.

The display unit 140 displays a list of moving images (for example, facial images of users (participants)) associated with each one or a plurality of participant terminals 200. Here, in the virtual conference waiting room displayed on the display unit 140, moving images of the participant terminals 200 received in a stream from one or a plurality of participant terminals 200 are displayed in a list. Specifically, when the organizer terminal 100 and the participant terminal 200 are connected by P2P, the participant terminal 200 stream-transmits a moving image taken by the participant terminal 200 and waits in a virtual conference waiting room. It becomes a state. On the other hand, the display unit 140 of the organizer terminal 100 displays the moving image of each participant terminal 200 received in the stream. The display unit 140 is composed of a display device such as a liquid crystal display or an organic EL (Electro Luminescence) display.

The communication unit 160 is an interface for connecting to other terminals such as the participant terminal 200 and the connection server 300. The organizer terminal 100 according to the present embodiment is connected to the participant terminal 200 and / or the connection server 300 via the communication unit 160, and performs stream communication such as moving images and / or audio.

[About participant terminals]
The participant terminal 200 adopts the same configuration as the organizer terminal 100 except that it does not have a participation acceptance / rejection reception unit 132. Not limited to this, the participant terminal 200 has the same function as the organizer terminal 100, and may function as the organizer terminal 100. Similarly, the organizer terminal 100 may function as a participant terminal 200.

[About the connection server]
The connection server 300 shown in FIG. 1 is composed of a general-purpose computer in which a CPU (not shown), a ROM (not shown), a RAM (not shown), an input / output interface (not shown), and the like are connected to a bus. Has been done.

The connection server 300 embodies a waiting room link generation unit 301 (waiting room providing unit) and an authentication unit 302 (see FIG. 8) described later by, for example, executing a control program stored in a ROM or RAM.

The waiting room link generation unit 301 provides a virtual conference waiting room link for waiting for participation in the video conference when the participant terminal 200 participates in the video conference. As an example, the waiting room link generation unit 301 generates a link for the conference waiting room of the conference in which the organizer terminal 100 invites the participant terminal 200. The authentication unit 302 will be described in detail with reference to FIG.

[Overall operation of the video conference system]
Next, in the video conference system 400 having the above configuration, a method of authenticating the participating members participating in the video conference will be described with reference to FIGS. 1 and 2 with reference to the sequence diagrams of FIGS. 3 and 4. ..

3 and 4 are sequence diagrams showing the overall operation of the room entry authentication process of the participating members participating in the video conference in the video conference system 400 according to the first embodiment.

As shown in FIG. 3, the organizer terminal 100 first accepts an operation by the organizer and accepts an operation for starting a conference (sequence SQ001). The organizer of the video conference system 400 may also be referred to as a conference organizer.

The organizer terminal 100 transmits a request for generating a conference waiting room link when starting a video conference to the connection server 300 via the network (sequence SQ003). Here, the conference waiting room link is a link address of the conference waiting room where the organizer waits before joining the conference when the organizer holds the conference.

When the connection server 300 receives the conference waiting room link generation request from the organizer terminal 100 via the network, the connection server 300 generates the conference waiting room link (sequence SQ005). Then, the connection server 300 transmits a conference waiting room link response indicating that the conference waiting room link has been generated to the organizer terminal 100 (sequence SQ007). When the connection server 300 transmits the conference waiting room link response to the organizer terminal 100, the organizer terminal 100 operated by the organizer and the participant terminal 200 operated by the participating members (participants) in the conference waiting room link. Waiting for entry (Sequence SQ011).

Upon receiving the conference waiting room link response, the organizer terminal 100 displays the conference waiting room link on the display unit 140, and at the same time, displays the waiting for the participating members (participants) to enter the room on the display unit 140 (sequence SQ009).

The organizer terminal 100 enters the virtual conference waiting room of the connection server 300 as the organizer via the network based on the received conference waiting room link response (sequence SQ013). At this time, the organizer terminal 100 executes a process for communicating the conference waiting room link to the participant terminal 200 operated by the participating member (participant wishing person) via the network (sequence SQ015).

When the connection server 300 accepts the entry of the organizer terminal 100 into the virtual conference waiting room, the connection server 300 subsequently waits for the participant terminal 200 to enter the virtual conference waiting room (sequence SQ017).

Further, the organizer terminal 100 communicates (transmits) the conference waiting room link to one or more participant terminals 200 via the network (sequence SQ019). This means of communication is, for example, e-mail, but is not limited to this.

When each of the one or more participant terminals 200 acquires (receives) the conference waiting room link from the organizer terminal 100 via the network, each participant for entering the connection server 300 based on the conference waiting room link. Accepts member operations (Sequence SQ021). Then, each participant terminal 200 enters a virtual conference waiting room based on the conference waiting room link (sequence SQ023).

Further, the participant terminal 200 displays that the organizer terminal 100 waits for the permission of the organizer (sequence SQ027).

When the participant terminal 200 enters the virtual conference waiting room, the connection server 300 starts the P2P connection of the conference waiting room (sequence SQ025). In this case, the connection server 300 transmits an instruction to start a connection to connect to the participant terminal 200 to the organizer terminal 100 (sequence SQ029). Further, the connection server 300 transmits an instruction to start a connection to connect to the organizer terminal 100 to the participant terminal 200 (sequence SQ031).

When the organizer terminal 100 and the participant terminal 200 receive the connection start from the connection server 300, they connect by P2P. Then, the participant terminal 200 stream-transmits a moving image (an image of a person who wants to participate) taken by the participant terminal 200 to the organizer terminal 100 via the network (sequence SQ033).

Proceeding to the sequence diagram of FIG. 4, the organizer terminal 100 displays the moving image (image of the person who wants to participate) received from the participant terminal 200, and allows the participant terminal 200 to enter the virtual conference room. Accepts the operation to select (Sequence SQ035).

A person who wishes to participate in the video conference is photographed in the moving image taken by the participant terminal 200. The organizer terminal 100 displays a moving image (an image of a person who wants to participate) stream received from the participant terminal 200 on the display unit 140, and causes the organizer to select a participating member who is permitted to enter the room. As a result, the participant terminal 200 corresponding to the selected moving image is entered into the virtual video conference room. Therefore, thereafter, the participant terminal 200 and the organizer terminal 100 transmit and receive the image for the conference room ( Sequence SQ037).

As a result, the organizer terminal 100 displays the call screen of the virtual conference room on the display unit 140 of the organizer terminal 100 (sequence SQ039). The participant terminal 200 displays the call screen of the virtual conference room on the display unit 140 of the participant terminal 200 (sequence SQ041). Then, the organizer terminal 100 and the participant terminal 200 start talking directly to each other in the virtual conference room (sequence SQ043).

[Video conference entry authentication process]
Next, with reference to FIGS. 1 and 2, the room entry authentication process for authenticating a person who wishes to participate in the video conference on the organizer terminal 100 of the video conference system 400 according to the first embodiment is shown in FIG. This will be described using a flowchart.

FIG. 5 is a flowchart showing the entrance authentication process of a person who wishes to participate in the video conference by the organizer terminal 100 of the video conference system 400 according to the first embodiment.

As shown in FIG. 5, the input unit 110 of the organizer terminal 100 accepts an operation for starting a video conference by the organizer (step S001).

The control unit 130 of the organizer terminal 100 issues (transmits) a request for generating a conference waiting room link when starting a video conference to the connection server 300 via the network. Then, the control unit 130 acquires (receives) the conference waiting room link response from the connection server 300 (step S003).

When the control unit 130 acquires the conference waiting room link response, the display unit 140 displays the conference waiting room link, and at the same time, the display unit 140 displays the waiting for the participating members (participants) to enter the room (step S005).

When the organizer clicks the conference waiting room link of the display unit 140, the control unit 130 enters the virtual conference waiting room of the connection server 300 as the organizer via the network based on the conference waiting room link. Further, the control unit 130 communicates the conference waiting room link to the participant terminal 200 operated by the participating member (participant wishing person) via the network, and requests the participant terminal 200 to enter the conference waiting room (step S007).

As a result, the waiting room processing unit 131 of the control unit 130 can allow the participant terminal 200 to enter a virtual conference waiting room for waiting for participation in the video conference.

The control unit 130 waits for the start of the P2P connection with the participant terminal 200 from the connection server 300 via the network (step S009), and starts the P2P connection with the participant terminal 200 from the connection server 300. If it is not received (No in step S009), the process of step S009 is repeated. When the control unit 130 receives the connection start from the connection server 300, the control unit 130 starts the P2P connection with the participant terminal 200 (Yes in step S009).

When the control unit 130 receives a stream of the conference waiting room member image from the participant terminal 200 operated by the participating member (participant wishing person), the control unit 130 displays the conference waiting room member image on the display unit 140 of the organizer terminal 100. (Step S011). The member image for the meeting waiting room is, for example, a moving image obtained by the participant terminal 200 taking a picture of the face of the participating member.

FIG. 6 is an explanatory diagram showing a conceptual diagram when the control unit 130 displays a conference waiting room member image transmitted from each of the plurality of participant terminals 200 on the display screen 141 of the display unit 140. ..

As shown in FIG. 6, on the display screen 141 of the display unit 140, moving images of the faces of 13 participating members (participants wishing to participate) taken by each participant terminal 200 are displayed. The display screen 141 of the display unit 140 shows a virtual conference waiting room, and in this conference waiting room, moving images of the user's face received from each of the 13 participant terminals 200 are displayed in a list. ..

Further, in this virtual conference waiting room, the voice recorded by each participant terminal 200 may not be played back by the organizer terminal 100. Further, the voice recorded by the organizer terminal 100 may not be transmitted to each participant terminal 200. This is to conceal the information of participating members from third parties who are not eligible to participate.

The image of this waiting room is not displayed on each participant terminal 200. As a result, the participating members (applicants) of this video conference can be concealed from a third party.

Returning to the flowchart of FIG. 5, the organizer who operates the organizer terminal 100 selects a member to participate in the video conference from the moving images of the faces of the participating members (participants) on the display screen 141 of the display unit 140 ( Allow) (step S013). That is, the participation availability reception unit 132 of the control unit 130 displays a moving image (face image of a person who wishes to participate) of the participant terminal 200 in the conference waiting room, and accepts whether or not the participant terminal 200 can participate in the video conference. ..

In this case, the conference waiting room member image displayed on the display screen 141 of the display unit 140 is, for example, a face image (moving image) of a user (participant) that can be recognized by the organizer. The organizer can authenticate the participants of the video conference at the organizer's own discretion.

The organizer terminal 100 may be able to make a bidirectional voice call or chat with the participant terminal 200 related to the moving image displayed on the display screen 141. As a result, the organizer can confirm the face of each applicant with a video while communicating with each applicant.

FIG. 7 is an explanatory diagram showing a selection screen 142 in which the participation availability reception unit 132 of the control unit 130 accepts participation in the video conference by the participant terminal 200. The selection screen 142 shown in FIG. 7 is displayed, for example, by a pop-up window.

As shown in FIG. 7, the selection screen 142 is superimposed and displayed on the display screen 141 of the display unit 140. On the selection screen 142, as a request to participate in the Web meeting, the participant name is the moving image TN of the patented Hanako, the participation permission button 143 indicating permission to participate in the video conference, and the participation refusal indicating refusal to participate in the video conference. Button 144 is displayed.

The organizer of the video conference displays the selection screen 142 for each participating member (desired participant), confirms the moving image TN (face image of the applicant for participation) for each participating member (desired participant), and confirms the video conference. Whether or not to participate in is determined by the participation permission button 143 or the participation refusal button 144.

Participation in the video conference can be refused for an image in which the facial image shown by the moving image TN is unclear, and the participating members who have not decided to allow or refuse are refused in principle. By rejecting the participating members who have not decided to allow or refuse, in principle, it is possible to prevent unintended members from participating in the video conference.

As a result, the organizer who operates the organizer terminal 100 can authenticate the participant based on the moving images of the faces of the 13 participating members (participants who wish to participate) displayed on the display screen 141 of the display unit 140. Only the participant terminal 200 corresponding to the member can be permitted, and it is possible to prevent a third party who is not qualified to participate in the video conference (virtual conference room).

Returning to the flowchart of FIG. 5, the video conference processing unit 133 of the control unit 130 transmits and receives the image and voice for the conference room of the authorized participating member in a stream, and starts a call to the participant terminal 200. Have a video conference at (step S015).

In this way, when the participation permission / rejection reception unit 132 accepts the permission of the participant terminal 200 to participate in the video conference, the video conference processing unit 133 starts a video conference with the participant terminal 200. End the entry verification process to authenticate those who wish to participate in the video conference.

As described above, the control unit 130 of the organizer terminal 100 of the video conference system 400 according to the first embodiment includes a waiting room processing unit 131, a participation availability reception unit 132, and a video conference processing unit 133. There is. The participation availability reception unit 132 displays a moving image (face image of a person who wishes to participate) of the participant terminal 200 in the conference waiting room, and accepts whether or not the participant terminal 200 can participate in the video conference.

As a result, the control unit 130 of the organizer terminal 100 of the video conference system 400 according to the first embodiment can prevent a third party who is not qualified to participate from entering the virtual conference room.

<Second embodiment>
[Video Conference System]
FIG. 8 is a block diagram showing a configuration of the video conference system 401 according to the second embodiment. As shown in FIG. 8, the video conference system 401 according to the second embodiment is configured to include the organizer terminal 100 and the connection server 300a as in the first embodiment. The organizer terminal 100 and the connection server 300 provide a video conference between the organizer terminal 100 and the participant terminal 200.

The video conference system 401 according to the second embodiment is different from the video conference system 400 according to the first embodiment in that the connection server 300a further includes the above-mentioned authentication unit 302. Other configurations are the same as those of the video conference system 400 shown in the first embodiment. Therefore, the same components as those in the first embodiment are designated by the same reference numerals, and the description thereof will be omitted as appropriate.

The authentication unit 302 receives the authentication information from the participant terminal 200, and authenticates the participant terminal 200 to enter the conference waiting room by the authentication information (first authentication). As a result, the participation permission / rejection reception unit 132 can allow the participant terminal 200 to enter the conference waiting room when the authentication unit 302 successfully authenticates the participant terminal 200.

Further, the authentication unit 302 is a participant based on an ID (IDentification card) card, a barcode, a QR code (Quick Response Code), a predetermined gesture, or an object captured in the image received from the participant terminal 200. Authenticate terminal 200. The authentication information may be a face image of a participant captured by the image pickup unit 120. Here, the authentication information is composed of at least one authentication information, and may be composed of a plurality of authentication information. The authentication information authenticated by the authentication unit 302 is referred to as the first authentication information.

For example, a "bear stuffed animal" may be applied to an object as a characteristic object, and a "bear stuffed animal" may be photographed as the first authentication information. Further, a "red object" may be applied to other objects as a characteristic object, and a "red siren" may be photographed as the first authentication information.

Further, an example in which a predetermined gesture is applied to the first authentication information will be described in detail with reference to FIG. 10 described later.

Since the participant terminal 200 has the same configuration as the organizer terminal 100 and has an image pickup unit 120, it is possible to capture a facial image of a participant who operates the participant terminal 200. At that time, the participant terminal 200 takes a picture of the participant's face image taken by the image pickup unit 120 together with any one of an ID card, a barcode, a predetermined gesture, an object, a QR code, and the like, and performs the first authentication. As information, it can be transmitted to the connection server 300a. Further, the first authentication information is not limited to the one captured at the same time as the face image of the participant by the imaging unit 120, and may be a plurality of captured images separately captured.

As a result, the authentication unit 302 of the connection server 300a receives the first authentication information and authenticates the participant terminal 200. Therefore, the participant terminal 200 can enter the virtual conference waiting room when it is authenticated by the first authentication information.

[Overall operation of the video conference system]
Next, in the video conference system 401 according to the second embodiment, a method of authenticating a person who wants to participate in the conference will be described with reference to FIGS. 1 and 2 with reference to the sequence diagram of FIG.

FIG. 9 is a sequence diagram showing the overall operation of the room entry authentication process of a person who wishes to participate in the video conference in the video conference system 401 according to the second embodiment. In FIG. 9, in the sequence diagram of FIG. 3, the processes of sequences SQ021 to Q025 are different. Therefore, the same processing as that of the first embodiment is designated by the same reference numerals, and the description thereof will be omitted as appropriate.

As shown in FIG. 9, in the sequence SQ051, when the participant terminal 200 acquires (receives) the conference waiting room link from the organizer terminal 100 via the network, the participant terminal 200 participates with the conference waiting room link, for example, a QR code. Using the first authentication information consisting of a person's face image, an operation of entering the conference waiting room is performed (sequence SQ051).

The first authentication information is composed of, for example, a QR code and a face image of a participant. Since the participant terminal 200 includes the image pickup unit 120, the face image of the participant who operates the participant terminal 200 is photographed, and the photographed face image of the participant is transmitted to the connection server 300a together with the QR code. Transmit (sequence SQ053).

The photographed participant's face image and QR code may be included in one photographed image taken at the same time, and the photographed images taken separately may include the participant's face image. QR code and QR code may be included respectively.

The face image of the participant used as the first authentication information is the authentication information used only for the determination of entering the waiting room in the authentication unit 302 of the connection server 300a. Therefore, the face image of the participant used as the first authentication information is converted into a format suitable for authentication, unlike the member image for the conference waiting room displayed on the display unit 140 of the organizer terminal 100.

In the sequence SQ053, the participant terminal 200 connects to the connection server 300a with the conference waiting room link, and requests to enter the virtual conference waiting room using the first authentication information consisting of the QR code and the participant's face image. I do.

The authentication unit 302 of the connection server 300a stores the QR code, the participant's face image (first authentication information) acquired from the participant terminal 200, and the QR stored in the storage unit (not shown) of the own device. The code and the participant's face image are collated to determine whether or not to allow the participant terminal 200 to enter the virtual conference waiting room (sequence SQ055).

As described above, the video conference system 401 according to the second embodiment performs collation in the sequence SQ055 by using the first authentication information.

Then, when the first authentication information received from the participant terminal 200 and the first authentication information stored in the storage unit of the own device match, the authentication unit 302 starts the P2P connection of the conference waiting room. (Sequence SQ025).

On the other hand, if the first authentication information received from the participant terminal 200 and the first authentication information stored in the storage unit of the own device do not match, the authentication unit 302 does not start the P2P connection of the conference waiting room.

The first authentication information is composed of a QR code and a participant's face image, but may be composed of only a QR code or, for example, a participant's face image only. good. Neither is an essential component. In addition, when the first authentication information is composed of the QR code and the face image of the participant, it is determined that the first authentication information matches only when both of them are authenticated. It can improve security against no third party.

Next, as another authentication information in the second embodiment, a method of authenticating with the first authentication information composed of a predetermined gesture and a face image of the child UR will be described.

FIG. 10 is an explanatory diagram showing that the image pickup unit 120 of the participant terminal 200 captures the gesture by the child UR and also captures and authenticates the face image of the child UR. In this case, the child UR, for example, displays the direction of the hand or finger with a gesture in front of the image pickup unit 120 of the participant terminal 200.

The image pickup unit 120 of the participant terminal 200 takes a picture of the child UR at a predetermined timing, and as a condition for entering the virtual meeting waiting room, for example, the gesture is in the "upper" state and the gesture is in the "lower" state. , Gesture shoots "right" state. For example, on the display screen 148a, the child UR indicates the state in which the gesture is "up", on the display screen 148b, the child UR indicates the state in which the gesture is "down", and on the display screen 148c, the child UR indicates the gesture. Indicates the "right" state.

The participant terminal 200 transmits, as the first authentication information, the “up / down / right” information indicated by the gesture and the face image of the child UR to the connection server 300a. Then, when the authentication unit 302 of the connection server 300a receives the "up / down / right" information indicated by the gesture and the face image of the child UR as the first authentication information, the image analysis of the face image of the child UR is executed.

In FIG. 10, the first authentication information is composed of the same captured image captured by the imaging unit 120, but the gesture by the child UR and the face image of the child UR are separately captured. The first authentication information may be configured.

Further, as the first authentication information transmitted by the participant terminal 200, the captured image itself may be transmitted to the connection server 300a using the captured image shown on the display screens 148a to 148c of FIG. 10 as the first authentication information. .. In this case, the authentication unit 302 of the connection server 300a analyzes the received captured image and authenticates with the "up / down / right" information indicated by the gesture by the child UR.

In this way, the authentication unit 302 of the connection server 300a receives the "upper and lower right" information indicated by the gesture as the first authentication information and the face image of the child UR, and "up and down" as the first authentication information. It is determined whether the information of "right" and the face image of the child UR are stored in the storage unit.

As the first authentication information received, the authentication unit 302 determines whether or not the "upper and lower right" information indicated by the gesture and the face image of the child UR match the first authentication information stored in the storage unit. If it is determined and matches, the P2P connection of the conference waiting room is started, and the participant terminal 200 is allowed to enter the virtual conference waiting room.

The first authentication information is composed of the information shown by the predetermined gesture and the face image of the child UR, but may be composed of only the information shown by the predetermined gesture, for example, or the face of the child UR. It may be composed only of images. Neither is an essential component. In addition, when the first authentication information is composed of the information indicated by the predetermined gesture and the face image of the child UR, it is determined that the first authentication information matches only when both of them are authenticated. , Can improve security for unqualified third parties.

As described above, the connection server 300a of the video conference system 401 according to the second embodiment further includes an authentication unit 302. The authentication unit 302 receives the first authentication information composed of the QR code and the face image of the child UR from the participant terminal 200, and uses the first authentication information to enter the conference waiting room of the participant terminal 200. Authenticate entry.

As a result, the connection server 300a of the video conference system 401 according to the second embodiment can prevent a third party who is not qualified to participate from entering the virtual conference waiting room.

Here, in the second embodiment, when the participant terminal 200 enters the virtual meeting waiting room of the organizer terminal 100 (when authenticated), for example, a moving image of the participant terminal 200 (for example, the user's moving image). The face image) may be marked to indicate that the identity is authenticated by the first authentication information.

Further, in the second embodiment, by using the first authentication information, the connection server 300a can determine whether or not the applicant is eligible to enter the conference waiting room, so that he / she can enter the conference waiting room. It is possible to limit the number of participant terminals 200 to be used.

For example, if there is no condition for a person who wishes to participate in the conference waiting room, a large number of moving images (user's face image) of the participant terminal 200 are displayed in the conference waiting room of the organizer terminal 100. This makes it difficult for the organizer to use the conference waiting room of the organizer terminal 100. By strictly applying the entry qualification to the conference waiting room for the first authentication information, only reliable participants can enter the conference waiting room, and it is possible to prevent the conference waiting room of the organizer terminal 100 from becoming inconvenient.

Further, in the second embodiment, as the first authentication information, a number (password) may be displayed by a gesture, and authentication may be performed by the gesture number (password). The number indicating the personal identification number is not limited to four digits, and may be, for example, a three-digit simple password number.

In this case, as the first authentication information transmitted by the participant terminal 200, the numerical information indicated by the gesture as the first authentication information may be transmitted to the connection server 300a, and the image is taken by the image pickup unit 120. The captured image itself may be transmitted to the connection server 300a using the captured image as the first authentication information. When the captured image itself is transmitted to the connection server 300a, the authentication unit 302 of the connection server 300a analyzes the received captured image (moving image) and authenticates with the numerical information indicated by the gesture.

In the second embodiment, the operation of the organizer terminal 100 is the same as in the first embodiment. Further, when the connection server 300a includes the authentication unit 302, the organizer terminal 100 displays an image (an image of a person who wants to participate) received from the participant terminal 200, and a participant who is permitted to enter the virtual conference room. The operation of selecting the terminal 200 is also referred to as a second authentication.

<Third embodiment>
In the third embodiment, in addition to the second embodiment, when the authentication unit 302 authenticates the participant terminal 200, the connection server 300a causes the participant terminal 200 to directly enter the conference room of the video conference. Is.

The difference between the video conference system according to the third embodiment and the video conference system 401 according to the second embodiment is that when the connection server 300a authenticates with the above-mentioned authentication unit 302, the organizer terminal 100 is virtual. The point is that the participant terminal 200 is allowed to enter the conference room of the video conference without accepting the selection operation for permitting the entrance to the typical conference waiting room.

Other configurations are the same as those of the video conference system 401 shown in the second embodiment. Therefore, the differences from the video conference system 401 of the second embodiment will be described, and the same processing will be omitted as appropriate.

FIG. 11 is a sequence diagram showing a room entry authentication process in which the participant terminal 200 directly participates in the video conference of the organizer terminal 100 in the video conference system according to the third embodiment. The video conference system according to the third embodiment is different in the processes after the sequences SQ029 and SQ031 shown in the sequence of FIG. Therefore, the same processing is designated by the same reference numerals, and the description thereof will be omitted as appropriate.

The processing before the sequence SQ055 in FIG. 11 is the same as the sequences SQ001 to SQ053 in FIG. As shown in FIG. 11, the connection server 300a starts the P2P connection of the conference room of the video conference when the verification of the authentication information (first authentication information) matches in the sequence SQ055 of FIGS. 9 and 11. SQ026).

Then, the connection server 300a transmits an instruction to start a connection to connect to the participant terminal 200 to the organizer terminal 100 (sequence SQ029), and starts connecting to the participant terminal 200 to connect to the organizer terminal 100. The instruction is transmitted (sequence SQ031). After that, the organizer terminal 100 and the participant terminal 200 directly send and receive images for the conference room (sequence SQ037).

As described above, when the authentication unit 302 of the video conference system according to the third embodiment authenticates the authentication information of the participant terminal 200, the organizer terminal 100 is a selection operation for permitting entry to the virtual conference waiting room. The participant terminal 200 is entered into a virtual conference room without accepting.

As a result, the organizer terminal 100 displays the call screen of the virtual conference room on the display unit 140 of the organizer terminal 100 (sequence SQ039). The participant terminal 200 displays the call screen of the virtual conference room on the display unit 140 of the participant terminal 200 (sequence SQ041). Then, the organizer terminal 100 and the participant terminal 200 start talking directly to each other in the virtual conference room (sequence SQ043).

[Video conference entry authentication process]
Next, at the organizer terminal 100 of the video conference system according to the third embodiment, with reference to FIGS. 8 and 11, regarding the room entry process in which a person who wishes to participate in the video conference directly participates in the video conference. , Will be described with reference to the flowchart of FIG.

FIG. 12 is a flowchart showing a process in which the organizer terminal 100 of the video conference system according to the third embodiment directly causes the participant terminal 200 of a participant who wishes to participate in the video conference to participate in the video conference. ..

The flowchart of the organizer terminal 100 of the video conference system according to the third embodiment shown in FIG. 12 is different from the flowchart of the organizer terminal 100 of the video conference system 401 according to the second embodiment shown in FIG. The point is that the processing of steps S011 and S013 is not executed.

The processing before step S010 in FIG. 12 is the same as in steps S001 to S007 in FIG. As shown in FIG. 12, when the organizer terminal 100 starts the P2P connection between the participant terminal 200 and the conference room of the video conference (Yes in step S010), the organizer terminal 100 directly transmits / receives images / sounds to / from the authorized member (participant). Then, the call is started (step S015).

In this case, the organizer terminal 100 directly transmits and receives the image for the conference room to and from the authenticated participant terminal 200, and starts a direct call to each other in the virtual conference room.

As described above, the control unit 130 of the organizer terminal 100 of the video conference system according to the third embodiment sets the participant terminal 200 when the participant terminal 200 is authenticated by the authentication unit 302 of the connection server 300a. , Directly enter the video conference room and participate in the video conference.

As a result, the control unit 130 of the organizer terminal 100 of the video conference system 400 according to the third embodiment is based on the authentication information (first authentication information and the second authentication information) set in the second embodiment. Therefore, only the authenticated participant terminal 200 can be allowed to enter the virtual conference room.

<Fourth Embodiment>
In the fourth embodiment, in addition to the third embodiment, when the participant terminal 200 is not authenticated by the authentication unit 302, the unauthenticated participant terminal 200 is admitted to the virtual conference waiting room. The organizer terminal 100 displays a face image of a participating member (participant wishing person) associated with the participant terminal 200 in a virtual meeting waiting room, and selects and operates a permitted participating member (participating person).

That is, in the fourth embodiment, when the participant terminal 200 is not authenticated by the authentication unit 302 in the third embodiment, the participation permission / rejection reception unit 132 of the control unit 130 is a virtual virtual one shown in the first embodiment. A moving image (face image of a person who wishes to participate) of the participant terminal 200 in the conference waiting room is displayed on the display unit 140, and whether or not the participant terminal 200 can participate in the video conference is accepted.

As a result, when the participant terminal 200 is not authenticated by the authentication unit 302, the connection server 300a starts the P2P connection of the conference waiting room, and the organizer terminal 100 participates in the virtual conference waiting room displayed on the display unit 140. While checking the faces of the members (those who wish to participate), you can select the members to enter the virtual conference room.

In the specific processing of the fourth embodiment, in the sequence diagram shown in FIG. 9, the sequence SQ053 is executed from the sequence SQ055, and then the sequence SQ035 in the sequence diagram shown in FIG. 4 is executed.

As described above, the control unit 130 of the organizer terminal 100 of the video conference system according to the fourth embodiment is not authenticated when the participant terminal 200 is not authenticated by the authentication unit 302 of the connection server 300a. Is entered into a virtual meeting waiting room, the face image of the participating member (desired participant) is displayed on the display unit 140, and the authorized participating member (desired participant) is selected and operated.

As a result, the participation availability reception unit 132 of the control unit 130 of the organizer terminal 100 in the video conference system 400 according to the fourth embodiment is based on the authentication information set in the second embodiment and the third embodiment. Even if the participant terminal 200 is not authenticated by the authentication unit 302, the moving image (face image of the person who wants to participate) of the participant terminal 200 in the virtual conference waiting room is displayed on the display unit 140, and the participant terminal 200 is displayed. Accepts whether or not to participate in the video conference.

For example, even if the QR code or ID code cannot be transmitted from the participant terminal 200 to the connection server 300a as the first authentication information and the first authentication information is not authenticated by the authentication unit 302, the organizer terminal 100 is virtual. Participation in a video conference can be permitted by a moving image (face image of a person who wishes to participate) of the participant terminal 200 in a typical conference waiting room.

When the participant terminal 200 is not authenticated by the authentication unit 302, it also corresponds to the case where at least one of the plurality of authentication information constituting the first authentication information is not authenticated. Therefore, when the first authentication information is not authenticated, the participation availability reception unit 132 of the control unit 130 displays a moving image (face image of a person who wishes to participate) of the participant terminal 200 in the virtual conference waiting room on the display unit 140. However, it is possible to accept whether or not the participant terminal 200 can participate in the video conference.

For example, among the first authentication information, for the participant who wants to participate in which the QR code is authenticated and the face image of the participant who wants to participate is not authenticated, the information in which the QR code is authenticated and the participant terminal 200 The moving image (member image for the meeting waiting room) is displayed on the display unit 140 of the organizer terminal 100. As a result, the organizer can recognize the moving image (member image for the meeting waiting room) of the participating members (participants) while confirming the reliability by the QR code, and can permit the participation in the video conference.

<Fifth Embodiment>
A fifth embodiment is an application of the first embodiment to a videophone system and applied to a one-to-one call. For example, the side making the call is the participant of the participant terminal 200, while the side receiving the call is the organizer of the organizer terminal 100.

That is, when making a one-to-one call using the video conference system 400, the face image of the participant transmitted from the participant terminal 200 on the calling side to the receiving side is the organizer on the organizer side. It is displayed on the display unit 140 of the terminal 100 (meeting waiting room mode). Therefore, the organizer of the organizer terminal 100 can authenticate the start of the call and start the call by visually observing the face image of the person who wants to participate in the video (meeting room mode). The moving image of the called side (that is, the side receiving the call) is not transmitted to the other side (the side making the call) until the call is started.

As a result, the called party (the party receiving the call) can start the call after confirming the face of the caller, so that damage due to fraudulent acts can be prevented. , You can start a call with confidence.

FIG. 13A is an explanatory diagram showing a display screen 190 of the organizer terminal 100 in the videophone system. FIG. 13B is an explanatory diagram showing a display screen 191 of the participant terminal 200 in the videophone system.

As shown in FIG. 13A, the display screen 190 of the organizer terminal 100 is provided with a display area 1901, a call preparation button 1902, and a call participation button 1903. The call preparation button 1902 and the call participation button 1903 are provided as functions common to both the organizer terminal 100 and the participant terminal 200. When the call preparation button 1902 is tapped, the display area 1901 is displayed and functions as the organizer terminal.

In the display area 1901, a telephone number for inviting the participant terminal 200 to the conference waiting room mode is displayed. Specifically, in the display area 1901, "I have prepared a call number. Please tell the following number to the person you want to call 1234" is displayed.

As a result, the organizer who operates the organizer terminal 100 notifies the participant who operates the participant terminal 200 of the number "1234" necessary for the call, for example, by telephone or e-mail.

Further, as shown in FIG. 13B, the display screen 191 of the participant terminal 200 is provided with a display area 1910, a call preparation button 1902, and a call participation button 1903. When the call participation button 1903 is tapped, the display area 1910 is displayed and functions as a participant terminal.

In the display area 1910, a call number input field for starting a call with the organizer terminal 100 is displayed. Specifically, "Join a call Please enter the call number □□□□" is displayed.

As a result, the participant wishing to operate the participant terminal 200 inputs the number "1234" necessary for the call acquired from the organizer who operates the organizer terminal 100, and taps the call button 1904.

FIG. 14A is an explanatory diagram showing a display screen 193 of the participant terminal 200 in the videophone system. FIG. 14B is an explanatory diagram showing a display screen 192 of the organizer terminal 100 in the videophone system.

As shown in FIG. 14A, the display screen 193 of the participant terminal 200 is provided with a display area 1931 and an end button 1932. The display area 1931 shows a state in which a participant (participant terminal 200) is calling a virtual conference room in which the organizer (organizer terminal 100) is located. Specifically, in the display area 1931, "Calling the room with the call number 1234 1234" is displayed.

The end button 1932 is a button for ending the telephone call before the organizer of the organizer terminal 100 answers.

Further, as shown in FIG. 14B, the display screen 192 of the organizer terminal 100 is provided with a standby state display image 1921, an organizer image 1922, a video response button 1923, a voice response button 1924, and a rejection button 1925.

The standby state display image 1921 displays a virtual meeting waiting room, and displays a state in which a person who wishes to participate is in the virtual meeting waiting room. The organizer of the organizer terminal 100 can confirm the person who wants to participate displayed on the standby state display image 1921 and select a method of answering the call request.

For example, the organizer responds to a prospective participant in a video conference by selecting and tapping the video response button 1923. In addition, the organizer responds to the applicant by voice by selecting and tapping the voice response button 1924. In addition, the organizer rejects the call by selecting and tapping the reject button 1925.

As described above, in the videophone system according to the fifth embodiment, the organizer, who is the side receiving the call (the side receiving the call), confirms the face of the other party who is the participant who made the call. Then you can start the call.

As a result, the videophone system according to the fifth embodiment can start a call after confirming the face of the other party, so that damage due to fraudulent acts can be prevented and the call can be started with peace of mind. ..

(Modification example)
Each embodiment of the present invention described above is presented as an example, and is not intended to limit the scope of the invention. These novel embodiments can be implemented in various other embodiments, and various omissions, replacements, and changes can be made without departing from the spirit of the present invention. For example, there are the following.

For example, in the video conference systems 400 and 401 according to the first to fourth embodiments, the participation availability reception unit 132 of the control unit 130 of the organizer terminal 100 selects a participating member (participation applicant) who is permitted to enter the room. It was like that. However, for facial images other than the participating members (those who wish to participate) and unclear facial images, entry into the virtual conference room (meeting waiting room) may be refused.

Further, for example, in the video conference systems 400 and 401 according to the first to fourth embodiments, the participant terminal 200 displays the user's face on the conference waiting room member image displayed on the display unit 140 of the organizer terminal 100. It was composed of captured moving images, but it is not limited to moving images. The member image for the conference waiting room displayed on the display unit 140 of the organizer terminal 100 may be a user's face image in which the organizer can recognize the participants in advance, and the image pickup unit 120 of the participant terminal 200 may be the user's face. It may be composed of a still image obtained by taking a picture of.

Further, for example, in the video conference systems 400 and 401 according to the first to fourth embodiments, the organizer terminal 100 and the participant terminal 200 are connected via a relay server (not shown) instead of being connected by P2P. Then, the organizer terminal 100 and the participant terminal 200 may be connected. Further, the connection server 300 may have a relay function and relay between the organizer terminal 100 and the participant terminal 200. The connection between the organizer terminal 100 and the participant terminal 200 is not particularly limited to a wired connection or a wireless connection.

Further, for example, in the video conference system according to the fifth embodiment, the moving image of the called side (the side receiving the call) is not transmitted to the other side until the call is started with the participant. (Meeting waiting room mode), for example, a call (voice, text) other than a moving image may be possible until the call is started (meeting room mode).

That is, in the conference waiting room mode, the organizer terminal 100 may enable a call other than a moving image. This allows the other party (participant) to be identified without showing himself (organizer) to the suspicious partner (participant) and before starting a call with a moving image, for example, by voice or text. You can give instructions and requests.

100 Organizer terminal 110 Input unit 120 Imaging unit 130 Control unit 131 Waiting room processing unit 132 Participation availability reception unit 133 Video conference processing unit (electronic conference processing unit)
140 Display unit 150 Storage unit 160 Communication unit 200 Participant terminal 300, 301a Connection server 301 Waiting room link generation unit (waiting room provision unit)
302 Authentication unit 400, 401 Video conference system 141,145 Display screen 147a, 147b, 147c, 147d Display screen 148a, 148b, 148c Display screen 190,191,192,193,194,195,196 Display screen

Claims (9)

An electronic conference processing unit that holds an electronic conference with a participant terminal,
A waiting room processing unit that allows the participant terminal to enter a virtual conference waiting room for waiting for participation in the electronic conference.
A participation availability reception unit that displays an image of the participant terminal in the conference waiting room and accepts whether or not the participant terminal can participate in the electronic conference.
Organizer terminal equipped with. Images received from one or more participant terminals are listed in the meeting waiting room.
The organizer terminal according to claim 1. When the participation permission / rejection reception unit receives permission for the participant terminal to participate in the electronic conference, the electronic conference processing unit starts the electronic conference with the participant terminal.
The organizer terminal according to any one of claims 1 and 2. An electronic conference processing unit that holds an electronic conference with a participant terminal,
A waiting room processing unit that allows the participant terminal to enter a virtual conference waiting room for waiting for participation in the electronic conference.
When the participant terminal participates in the electronic conference, a waiting room providing unit that provides the virtual conference waiting room for waiting for participation in the electronic conference, and a waiting room providing unit.
The participation permission reception unit that displays the image received from the participant terminal who is in the meeting waiting room and accepts whether or not the participant terminal can participate in the electronic conference.
Equipped with an electronic meeting system. Further provided with an authentication unit that receives authentication information from the participant terminal and authenticates the participant terminal to enter the conference waiting room by the authentication information.
If the participant terminal is successfully authenticated by the authentication unit, the participation permission / rejection reception unit causes the participant terminal to enter the conference waiting room.
The electronic meeting system according to claim 4. The authentication unit authenticates the participant terminal based on an ID card, a barcode, a predetermined gesture, or an object captured in the image received from the participant terminal.
The electronic meeting system according to claim 5. When the authentication unit succeeds in authenticating the participant terminal, the participation acceptance / rejection reception unit connects the participant terminal and the organizer terminal on a peer-to-peer basis or via a relay server.
The electronic meeting system according to claim 5 or 6. A step to enter a participant terminal into a virtual conference waiting room for waiting for participation in an electronic conference,
The step of displaying the image received from the participant terminal that entered the meeting waiting room, and
The step of accepting whether or not the participant terminal can participate in the electronic conference,
How to authenticate entering an electronic conference, including. On the computer
Procedure for entering a participant terminal into a virtual conference waiting room for waiting for participation in an electronic conference,
Procedure for displaying an image received from a participant terminal who entered the conference waiting room,
Procedure for accepting whether or not the participant terminal can participate in the electronic conference,
A program to execute.

Images