JP7131869B1 - Program, information processing method, information processing device, and information processing system - Google Patents

Abstract

Kind Code: A1 A highly reliable personal identification is performed without showing a user's face on the screen of a terminal used by another user when using an online video communication tool. A program for causing a computer with a processor to output video data to an application that provides an online video communication tool, the program comprising steps of acquiring image data of a user and converting the user into an avatar based on the image data. A program is provided for executing a step of generating image data obtained by capturing images, a step of outputting the generated image data, and a step of performing face authentication based on the imaging data. [Selection drawing] Fig. 6

Description

The present invention relates to a program, information processing apparatus and method.

In recent years, online video communication tools for realizing online meetings, online seminars, etc. using the Internet have become widespread. In using such tools, techniques for performing identity verification have been developed. For example, Patent Literature 1 discloses an authentication technique for performing biometric authentication such as face authentication when starting a call and when resuming a call after a call is interrupted, in order to improve security in a communication system such as a video conference.

JP 2015-142193 A

On the other hand, when using an online video communication tool, there is a need to use an avatar as one's alter ego. In such a case, in the conventional technology, it is difficult to perform personal authentication without showing the user's face.

SUMMARY OF THE INVENTION It is an object of the present invention to perform highly reliable identity verification without showing a user's face on the screen of a terminal used by another user when using an online video communication tool.

According to one aspect of the present invention, there is provided a program for causing a computer having a processor to output video data to an application that provides an online video communication tool, the program comprising: obtaining imaging data of a user; A program is provided for executing the steps of generating video data in which a user is converted into an avatar, outputting the generated video data, and performing face authentication based on imaging data.

According to the present disclosure, when using an online video communication tool using the Internet, it is possible to perform identity verification without showing the user's face on the screen of a terminal used by another user.

2 is a diagram for explaining an overview of functions of the video output system 1; FIG. 2 is a block diagram showing the hardware configuration of the video output system 1; FIG. 2 is a block diagram showing the functional configuration of the user terminal 10; FIG. 3 is a block diagram showing a functional configuration of a management server 20; FIG. 3 is a block diagram showing the functional configuration of a face authentication server 30; FIG. 3 is a flow diagram showing an example of the flow of processing of the video output system 1. FIG. FIG. 10 is a flow chart showing an example of a processing flow of video communication processing (S600); FIG. 11 is a flowchart showing an example of the flow of face authentication processing (S700); FIG. 10 is a flow diagram showing an example of the flow of post-authentication processing (S800). 4 is a diagram showing an example of a screen displayed on the user terminal 10; FIG. FIG. 10 is a diagram showing an example of a screen displayed on the user terminal 10 when an authentication error occurs;

Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In the following description, the same parts are given the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

<1. First Embodiment>
(1. Overview of video output system 1)
An overview of the video output system 1 will be described with reference to FIG. A user U can use an online video communication tool using the camera 160 provided in the user terminal 10 . Online video communication tools enable communication between distributors and viewers through online conferences, online seminars, and video distribution, and enable communication between users via user video (video) data distributed over the Internet. Refers to an application that enables

The online video communication tool may be installed in the user terminal 10 in advance, or may be used by accessing a cloud server from a web browser. Examples of online video communication tools include Zoom, Skype, and Google Meet (both registered trademarks).

As shown in FIG. 1A, when using an online video communication tool, normally image data D1 captured by a camera 160 included in the user terminal 10 is displayed on a terminal used by another user. This allows the user U to communicate with other users via video data.

On the other hand, in the video output system 1, as shown in FIG. 1B, the video data D2 in which the user U in the imaging data D1 is converted into the avatar A is output to the online video communication tool. Thus, the video output system 1 has a function as so-called virtual camera software. As a result, the user U can conduct online video communication without showing his/her face on the screens of terminals used by other users.

Further, the video output system 1 can perform face recognition of the user U while outputting the video data D2 in which the user U is converted into the avatar A to the online video communication tool. Therefore, in the video output system 1, it is possible to perform highly reliable identity verification without showing the user's face on the screen of the terminal used by other users. Each configuration will be described in detail below.

(2. Hardware Configuration of Video Output System 1)
FIG. 2 is a block diagram showing an example of the overall configuration of the video output system 1. As shown in FIG. The video output system 1 includes a user terminal 10 , a management server 20 and a face authentication server 30 . The user terminal 10, the management server 20, and the face authentication server 30 are connected for communication via the network 40, for example. The network 40 is realized by, for example, the Internet and/or a communication network provided by a communication carrier.

In this embodiment, a set of multiple devices may be used as one server. How to distribute a plurality of functions required to realize the management server 20 and/or the face authentication server 30 according to this embodiment for one or more pieces of hardware depends on the processing capacity of each piece of hardware and/or each piece of hardware. It can be determined appropriately in view of the specifications required for the server.

The user terminal 10 is implemented by, for example, a stationary PC (Personal Computer), a laptop PC, or the like. Also, the user terminal 10 may be realized by a mobile terminal such as a smart phone or a tablet.

The user terminal 10 includes a communication IF (Interface) 12 , an input device 13 , an output device 14 , a memory 15 , a storage 16 and a processor 17 .

The communication IF 12 is an interface for inputting and outputting signals for the user terminal 10 to communicate with an external device.

The input device 13 is a device (for example, a keyboard, a pointing device such as a mouse, a touch panel, a touch pad, etc.) for receiving an input operation from a user.

The output device 14 is a device (display, speaker, etc.) for presenting information to the user.

The memory 15 temporarily stores programs and data processed by the programs, and is a volatile memory such as a DRAM (Dynamic Random Access Memory).

The storage 16 is for storing data, and is, for example, a flash memory or a HDD (Hard Disc Drive).

The processor 17 is hardware for executing an instruction set described in a program, and is composed of arithmetic units, registers, peripheral circuits, and the like.

The management server 20 manages users who use the video output system 1 and performs user authentication (login/logout). The management server 20 includes a communication IF 22 , an input/output IF 23 , a memory 25 , a storage 26 and a processor 27 .

The communication IF 22 is an interface for inputting and outputting signals so that the management server 20 communicates with an external device.

The input/output IF 23 functions as an interface with an input device for receiving input operations from the user and an output device for presenting information to the user.

The memory 25 temporarily stores programs and data processed by the programs, and is a volatile memory such as a DRAM.

The storage 26 is for storing data, and is, for example, flash memory or HDD.

The processor 27 is hardware for executing an instruction set described in a program, and is composed of arithmetic units, registers, peripheral circuits, and the like.

The face authentication server 30 performs face authentication of users who use the video output system 1 . The face authentication server 30 includes a communication IF 32 , an input/output IF 33 , a memory 35 , a storage 36 and a processor 37 . Since these configurations are the same as those of the management server 20, the description will not be repeated.

(3. Functional Configuration of Video Output System 1)
The functional configuration of the video output system 1 will be described below with reference to FIGS. 3 to 5. FIG.

(3-1. Functional Configuration of User Terminal 10)
FIG. 3 is a diagram showing the configuration of the user terminal 10 that constitutes the video output system 1 of the first embodiment. The user terminal 10 is communicably connected to the management server 20 via a network such as the Internet. The user terminal 10 is a wireless base station compatible with communication standards such as 5G and LTE (Long Term Evolution), or a wireless LAN (Local Area Network) standard such as IEEE (Institute of Electrical and Electronics Engineers) 802.11. It is connected to a network by communicating with a communication device such as a wireless LAN router.

As shown in FIG. 3, the user terminal 10 includes an antenna 110, a wireless communication unit 120 corresponding to the antenna 110, an operation reception unit 130 (including a keyboard 131 and a mouse 132), and an audio processing unit 140 (a microphone 141 and (including speaker 142 ), display 150 , camera 160 , storage unit 170 , and control unit 180 .

Note that the user terminal 10 also has functions and configurations not particularly shown in FIG. 3 (for example, a battery for retaining power, a power supply circuit for controlling power supply from the battery to each circuit, etc.). there is Each configuration indicated by a block in FIG. 3 is electrically connected by a bus or the like.

The antenna 110 radiates a signal emitted by the user terminal 10 as radio waves. Antenna 110 also receives radio waves from space and provides a received signal to radio communication section 120 .

The wireless communication unit 120 performs modulation and demodulation processing for transmitting and receiving signals via the antenna 110 so that the user terminal 10 communicates with other wireless devices. The radio communication unit 120 modulates, demodulates, and frequency-converts radio signals transmitted and received by the user terminal 10 , and provides received signals to the control unit 180 .

The operation accepting unit 130 has a mechanism for accepting user input operations. Specifically, the operation reception unit 130 can include a keyboard 131 and a mouse 132 .

The audio processing unit 140 modulates and demodulates the audio signal, modulates the signal supplied from the microphone 141 , and supplies the modulated signal to the control unit 180 . Also, the audio processing unit 140 provides an audio signal to the speaker 142 . The audio processing unit 140 is implemented by, for example, a processor for audio processing. Microphone 141 receives a voice input and provides voice signal corresponding to the voice input to voice processing section 140 . The speaker 142 converts the audio signal given from the audio processing unit 140 into audio and outputs the audio to the outside of the user terminal 10 .

The display 150 displays data such as images, moving images, and text under the control of the control unit 180 . The display 150 can be implemented by, for example, an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) display.

The camera 160 is a device for receiving light with a light receiving element and outputting it as a photographed image. Camera 160 may be, for example, a real-time camera (including a so-called web camera) capable of transferring captured images to network 40 in real time.

The storage unit 170 is configured by, for example, the memory 15 or the storage 16 and stores data and programs used by the user terminal 10 . As an example, the storage unit 170 stores an avatar database 282 . Avatar database 282 is information about avatars available to users. An avatar is a character displayed as a user's alter ego in a virtual space displayed on a computer screen. The avatar database 282 holds information such as the appearance, attributes (name, gender, species, etc.), and voice of avatars that can be used by the user.

The control unit 180 is implemented by the processor 17 reading a program stored in the storage unit 170 and executing instructions included in the program, and controls the operation of the user terminal 10 . The control unit 180 may be implemented as an application installed in the user terminal 10 in advance, for example. By operating according to a program, the control unit 180 operates as an operation reception module 1801, a transmission/reception module 1802, a notification module 1803, an imaging module 1804, a video generation module 1805, a video output module 1806, and an authentication module 1807. function.

The operation acceptance module 1801 performs processing for accepting a user's input operation to an input device such as the keyboard 131 or the like.

The transmission/reception module 1802 performs processing for the user terminal 10 to transmit/receive data to/from an external device such as the management server 20 according to a communication protocol.

The notification module 1803 performs processing for notifying the user of information. Specifically, the notification control unit 184 performs processing for displaying a display image on the display 150, processing for outputting sound to the speaker 142, processing for causing the camera 160 to vibrate, and the like.

The imaging module 1804 operates the camera 160 to acquire imaging data of the user. Details of the processing of the imaging module 1804 will be described later.

The video generation module 1805 generates video data in which the user is converted into an avatar based on the imaging data acquired by the imaging module 1804 . Details of the processing of the video generation module 1805 will be described later.

A video output module 1806 outputs the video data generated by the video generation module 1805 to an online video communication tool. Details of the processing of the video output module 1806 will be described later.

An authentication module 1807 performs face authentication based on the imaging data acquired by the imaging module 1804 . Details of the processing of the authentication module 1807 will be described later.

A user may install a predetermined application on the user terminal 10 in order to use the service provided by the video output system 1 . The user terminal 10 may accept registration of credit card information and information on payment services provided by mobile payment service providers from users.

(3-2. Functional Configuration of Management Server 20)
FIG. 4 is a diagram showing the configuration of the management server 20. As shown in FIG. As shown in FIG. 4 , the management server 20 includes a communication section 201 , a storage section 202 , an input/output section 203 and a control section 204 .

The communication unit 201 performs processing for the management server 20 to communicate with an external device such as the user terminal 10 .

The storage unit 202 is realized by the memory 25 or the storage 26 and stores data and programs used by the management server 20 . As an example, the storage unit 202 stores a user database 2021 . The user database 2021 stores information (name, gender, age, address, ID, password, etc.) of users who use the video output system 1 .

The input/output unit 203 functions as an interface with an input device for receiving input operations from the user and an output device for presenting information to the user.

The control unit 204 exhibits functions shown as various modules shown below when the processor 27 performs processing according to a program.

The transmission/reception module 2041 controls the process of transmitting/receiving a signal from an external device by the management server 20 according to a communication protocol.

Authentication module 2042 performs user authentication. Details of the processing of the authentication module 2042 will be described later.

(3-3. Functional Configuration of Face Authentication Server 30)
FIG. 4 is a diagram showing the configuration of the face authentication server 30. As shown in FIG. As shown in FIG. 4 , the face authentication server 30 includes a communication section 301 , a storage section 302 , an input/output section 303 and a control section 304 .

The communication unit 301 performs processing for the face authentication server 30 to communicate with an external device such as the management server 20 .

The storage unit 302 is realized by the memory 35 or the storage 36 and stores data and programs used by the face authentication server 30 . As an example, the storage unit 302 stores a face information database 3021 . The face information database 3021 stores face information of users using the video output system 1 registered in advance.

The input/output unit 303 functions as an interface with an input device for receiving input operations from the user and an output device for presenting information to the user.

The control unit 304 exhibits functions shown as various modules shown below when the processor 37 performs processing according to a program.

The transmission/reception module 3041 controls the process of transmitting/receiving a signal from an external device by the face authentication server 30 according to a communication protocol.

The authentication module 3042 refers to the face information database 3021 and performs face authentication. Details of the processing of the authentication module 3042 will be described later.

(4. Flow of processing)
The processing flow of the video output system 1 will be described below with reference to FIGS. 6 to 9. FIG.

(4-1. Processing of video output system 1)
An example of the processing flow of the video output system 1 will be described with reference to FIG. In step S<b>511 , the user terminal 10 receives the ID and password from the user U and transmits them to the management server 20 . In step S<b>521 , the management server 20 receives the ID and password transmitted by the user terminal 10 .

In step S522, the authentication module 2042 of the management server 20 refers to the user database 2021 in the storage unit 202 and performs login authentication using the ID and password. In step S<b>512 , the notification module 1803 of the user terminal 10 displays on the display 150 that login authentication has succeeded based on the notification from the management server 20 .

In step S600, the user terminal 10 executes video communication processing. Details of the video communication processing will be described later.

In step S513, the user terminal 10 receives a logout operation from the user U. FIG. In step S523, the management server 20 receives a request for logout processing.

In step S524, the authentication module 2042 of the management server 20 executes logout processing. In step S<b>514 , the notification module 1803 of the user terminal 10 displays on the display 150 that the user has logged out based on the notification from the management server 20 .

(4-2. Flow of video communication processing)
An example of the processing flow of the video communication processing (S600) will be described with reference to FIG. In step S610, the imaging module 1804 of the user terminal 10 activates the camera 160 to acquire imaging data of the user U.

In step S620, the video generation module 1805 of the user terminal 10 generates video data in which the user is converted into an avatar based on the imaging data acquired by the imaging module 1804. FIG. Specifically, for example, feature points on the user's face in the imaging data are extracted, and the movement of the feature points is tracked. Then, a moving image is generated in which the portion of the avatar corresponding to the feature point is moved according to the tracked movement.

In step S630, the video output module 186 of the user terminal 10 outputs the video data generated by the video generation module 1805 to an application functioning as an online video communication tool. As an example, video output module 186 outputs video data to an input channel that accepts input from virtual camera software configured in an application functioning as an online video communication tool.

At step S640, the authentication module 1807 of the user terminal 10 determines whether or not a predetermined first condition is satisfied. The predetermined first condition may be, for example, a specification that is satisfied at regular intervals (eg, 5-minute intervals) within the required time (eg, 45 minutes) of the video communication processing (S600), or may be satisfied once at random timing. Alternatively, the specification may be satisfied multiple times. Further, the specifications may be such that a user (for example, a lecturer at an online seminar) who organizes online video communication using the video output system 1 can set a predetermined first condition. As an example, the number of times N of face authentication is set during the period from the start to the end of the video communication process (S600), and the specification may be such that the first condition is satisfied N times at random timing.

If the predetermined first condition is satisfied (YES in step S640), face authentication processing (S700) is performed. Details of the face authentication processing will be described later.

After face authentication processing (S700), post-authentication processing (S800) is performed. Details of post-authentication processing will be described later. After the post-authentication process, step S650 is executed.

On the other hand, if the predetermined first condition is not satisfied (NO in step S640), it is determined in step S650 whether or not the online video communication end condition is satisfied. The termination condition may be a specification that is satisfied when a predetermined required time has passed, or a specification that is satisfied by a user's termination operation. If the termination condition is not satisfied (NO in step S650), the processes after step S610 are repeated. On the other hand, if the termination condition is satisfied, the video communication processing (S600) is terminated.

In this way, the video output system 1 generates video data in which the user in the user's imaging data is converted into an avatar, and continues to output the video data to the online video communication tool during the video communication processing (S600). In this state, face authentication processing (S700) is performed when a predetermined first condition is satisfied. That is, in the face authentication process, the video output system 1 executes face authentication using the imaging data acquired by the imaging module 1804, while providing the online video communication tool with an image in which the user in the imaging data is converted into an avatar. Continue to output data. In this manner, conversion to video data and face authentication processing are performed based on the same imaging data.

With such a configuration, even during the face authentication process, the captured data of the user is not displayed on the terminal screens of other users participating in the online video communication using the online video communication tool. , the video data converted into an avatar is displayed. Therefore, it is possible to perform face authentication of the user without showing the user's face on the screen of the terminal of another user participating in the online video communication.

(4-3. Flow of Face Authentication Processing)
An example of the flow of face authentication processing (S700) will be described with reference to FIG. In step S<b>711 , the transmission/reception module 1802 of the user terminal 10 transmits the imaging data acquired by the imaging module 1804 to the management server 20 . In step S721, the transmission/reception module 2041 of the management server 20 receives imaging data.

In step S<b>722 , the transmission/reception module 2041 of the management server 20 transmits the imaging data to the face authentication server 30 . In step S731, the transmission/reception module 3041 of the face authentication server 30 receives imaging data.

In step S732, the authentication module 3042 of the face authentication server 30 refers to the face information database 3021 in the storage unit 302 and executes face authentication.

In step S<b>733 , the transmission/reception module 3041 of the face authentication server 30 transmits the authentication result to the management server 20 . In step S723, the transmission/reception module 2041 of the management server 20 receives the authentication result.

In step S<b>724 , the transmission/reception module 2041 of the management server 20 transmits the authentication result to the user terminal 10 . In step S712, the authentication module 1807 of the user terminal 10 determines the authentication result.

(4-4. Flow of post-authentication processing)
An example of the processing flow of the post-authentication processing (S800) will be described with reference to FIG. In step S810, the authentication module 1807 of the user terminal 10 determines whether or not authentication is successful (authentication OK) (authentication error). If the authentication is OK (YES in step S810), the post-authentication process is terminated. On the other hand, if there is an authentication error (NO in step S810), step S820 is executed.

In step S820, the notification module 1803 outputs the first error screen E1. Details of the first error screen E1 will be described later. At step S830, the authentication module 1807 determines whether a predetermined second condition is satisfied. The predetermined second condition may be, for example, a specification that is satisfied after a predetermined period of time (for example, 10 minutes) after execution of the previous face authentication process (step S700), or within a predetermined period of time (for example, within 10 minutes). It may be a specification that is satisfied at random timing. Further, the specifications may be such that a user who organizes online video communication using the video output system 1 can set a predetermined second condition.

If the predetermined second condition is satisfied (YES in step S830), face authentication processing (S750) is performed again.

After the face authentication process is performed again, step S840 is executed. In step S840, the authentication module 1807 determines the result of face authentication again. If the authentication is OK (YES in step S840), the post-authentication process is terminated. On the other hand, if there is an authentication error (NO in step S840), step S850 is executed.

In step S850, the notification module 1803 outputs the second error screen E2 to the display 150. FIG. Details of the second error screen E2 will be described later. In step S860, the authentication module 1807 performs another authentication using the ID/password received from the user.

In step S870, authentication module 1807 determines the result of authentication. If the authentication is OK (YES in step S870), the post-authentication process is terminated. On the other hand, if there is an authentication error (NO in step S870), step S880 is executed.

In step S880, the notification module 1803 outputs the third error screen E3. Details of the third error screen E3 will be described later. In addition, the notification module 1803 notifies the management server 20 that the face authentication was not possible at the same time or instead of outputting the third error screen E3. The management server 20 may be configured to notify the user hosting the online video communication that face authentication has failed.

(5. Screen example)
Screen examples displayed on the display 150 of the user terminal 10 will be described with reference to FIGS. 10 and 11. FIG.

(5-1. Normal screen)
As shown in FIG. 10A, image data D1 of user U imaged by camera 160 is displayed on display 150 of user terminal 10 during execution of video communication processing (S700).

As shown in FIG. 10B, during execution of the video communication process, the video output module 1806 outputs video data D2 in which user U is converted into avatar A to the online video communication tool. As a result, the video data D2 is displayed on the screens of the terminals of other users participating in the video communication. Note that the user U may choose to output the imaging data D1 to the online video communication tool (so-called face-up state) or not to output the video data D2 (so-called screen-off state).

As shown in FIG. 10C, an authentication screen N1 is displayed during execution of face authentication processing (S800). By notifying the user U that face authentication processing is being performed in this way, it is possible to achieve more accurate face authentication.

(5-2. Screen for authentication error)
FIG. 11A is a diagram showing an example of the first error screen E1. The first error screen E1 is displayed only on the terminal of the user U who performed the face authentication process (S700). As an example, the first error screen E1 displays a notification prompting to return to the front of the camera. At this time, the specification may be such that the user is notified that face authentication will be performed again. By doing so, it is possible to prevent an authentication error from occurring in the second face authentication process.

FIG. 11B is a diagram showing an example of the second error screen E2. The second error screen E2 is displayed only on the terminal of the user U who performed the face authentication process (S750) again. On the second error screen E2, there is displayed a message to the effect that it is necessary to perform authentication using an ID and a password. As a result, it becomes possible to cause a user who has failed face authentication multiple times to perform other authentication using an ID and a password or the like.

FIG. 11C is a diagram showing an example of the third error screen E3. As an example, the third error screen E3 is displayed on the screens of all terminals used by users participating in online video communication. By doing so, it is possible to notify users participating in the online video communication that there is a high possibility that the user U who has undergone the face authentication process is an authentication error and is not the person himself/herself. A security level in communication can be ensured.

Further, the user terminal 10 of the user U who has performed the face authentication process may display the third error screen E3 and/or disable the use of the online video communication tool. By doing so, it is possible to ensure a security level in online video communication.

As described above, in the present embodiment, the video output system 1 includes the step of acquiring the imaging data of the user, the step of generating video data in which the user is converted into an avatar based on the imaging data, and the generated a step of outputting the obtained image data; and a step of performing face authentication based on the imaging data.

As a result, when using an online video communication tool, it is possible to perform highly reliable identity verification without showing the user's face on the screen displayed on the terminal used by another user. Specifically, for example, when an online class is held at an educational site such as a school, it is possible to perform identity verification with high reliability even if the student does not show his/her face. As a result, fraudulent acts such as impersonation can be prevented, and attendance management can be facilitated. In addition, in online meetings, etc., it is possible to confirm the identity without showing the person's face, so it is possible to realize secure communication.

<2. Other Embodiments>
Although the embodiments of the present invention and their modifications have been described above, the application of the present disclosure is not limited to the above-described contents.

For example, in the above embodiment, another authentication is performed when the face authentication process (S750) again results in an error, but the present invention is not limited to this aspect. For example, after performing face authentication three times or more, another authentication may be performed in the case of an authentication error, or another authentication may be performed in the case of an error in the first face authentication.

Further, in the above embodiment, in steps S711 to S731, the imaging data is transmitted from the user terminal 10 to the face authentication server 30 via the management server 20, but it is not limited to this aspect. For example, the user terminal 10 may directly transmit the imaging data to the face authentication server 30 . Also, the authentication result may be directly transmitted from the face authentication server 30 to the user terminal 10 .

Also, in the above-described embodiment, other authentication is performed using an ID and a password, but the present invention is not limited to this aspect, and other biometric authentication or the like may be used.

Also, if other authentication is successful, the face authentication may be performed again within a predetermined period of time.

Further, sharing of predetermined information via a communication line is mainly performed via a WAN such as the Internet. and only via infrared communication or the like.

Also, in the above embodiment, an example of a mode in which the user terminal 10, the management server 20, and the face authentication server 30 have each function has been described, but the present invention is not limited to this mode. That is, some or all of the functions of the present disclosure may be configured to be provided in some or all of the user terminal 10, the management server 20, and the face authentication server 30 in a manner different from the above embodiment.

Furthermore, the present invention may be implemented as a computer-readable non-temporary recording medium that stores the above program.

While various embodiments of the invention have been described above, they are presented by way of example and are not intended to limit the scope of the invention. The novel embodiment can be embodied in various other forms, and various omissions, replacements, and modifications can be made without departing from the scope of the invention. The embodiment and its modifications are included in the scope and gist of the invention, and are included in the scope of the invention described in the claims and equivalents thereof.

<Appendix>
The items described in the above embodiments are added below.
(Appendix 1)
A program for causing a computer having a processor to output video data to an application functioning as an online video communication tool, the program comprising steps of acquiring image data of a user (S610), and converting the user into an avatar based on the image data. A program for executing a step of generating image data (S620), a step of outputting the generated image data (S630), and a step of performing face authentication based on imaging data (S700).
(Appendix 2)
10. The program of claim 1, wherein the step of performing face authentication does not cause the online video communication tool to display the user's imaging data.
(Appendix 3)
3. The program according to appendix 1 or appendix 2, wherein in the step of performing face authentication, an online video communication tool displays video data converted into an avatar.
(Appendix 4)
3. The program according to any one of Appendices 1 to 3, wherein in the step of performing face authentication, face authentication is performed using imaging data.
(Appendix 5)
4. The program according to any one of appendices 1 to 4, wherein when face authentication results in an error, face authentication is performed again within a predetermined time.
(Appendix 6)
The program according to Supplementary Note 5 (Supplementary Note 7), which notifies the user that the face authentication will be performed again within a predetermined time.
7. The program according to appendix 6, which executes authentication other than face authentication when the second face authentication results in an error.
(Appendix 8)
8. The program of Claim 7, which renders the computer unable to use the functionality of the online video communication tool if the other authentication fails.
(Appendix 9)
9. The program according to appendix 7 or appendix 8, wherein when another authentication results in an error, other users who are in online video communication with the user are notified of the error.
(Appendix 10)
10. The program according to any one of Appendices 1 to 9, for notifying an organizer of video communication in an online video communication tool that facial recognition has failed.

1: video output system, 10: user terminal, 13: input device, 14: output device, 15: memory, 16: storage, 17: processor, 20: management server, 25: memory, 26: storage, 27: processor, 29: processor, 30: face authentication server, 35: memory, 36: storage, 37: processor, 40: network, 110: antenna, 120: wireless communication unit, 130: operation reception unit, 131: keyboard, 132: mouse, 140: Audio processing unit, 141: Microphone, 142: Speaker, 150: Display, 160: Camera, 170: Storage unit, 180: Control unit, 184: Notification control unit, 186: Video output module, 201: Communication unit, 202 : storage unit 203: input/output unit 204: control unit 282: avatar database 301: communication unit 302: storage unit 303: input/output unit 304: control unit 1801: operation reception module 1802: transmission/reception Modules 1803: Notification module 1804: Imaging module 1805: Video generation module 1806: Video output module 1807: Authentication module 2021: User database 2041: Transmission/reception module 2042: Authentication module 3021: Face information database 3041: transmission/reception module, 3042: authentication module.

Claims (13)

A program that causes a computer with a processor to function as virtual camera software that outputs video data to an application that functions as an online video communication tool,
obtaining imaging data of a user;
generating video data in which the user is converted into an avatar based on the imaging data;
outputting the generated video data;
During execution of online video communication, face authentication is performed based on the imaging data while the image data converted into the avatar is displayed on the screen of a user terminal used by another user participating in the online video communication. and the program that causes it to run. 2. The program according to claim 1, wherein in the step of performing face authentication, the online video communication tool does not output imaging data of the user. 3. The program according to claim 1, wherein in the step of performing face authentication, the online video communication tool outputs video data converted into the avatar. 4. The program according to any one of claims 1 to 3, wherein in the step of performing face authentication, the imaged data is used to perform the face authentication. 5. The program according to any one of claims 1 to 4, wherein when the face authentication results in an error, face authentication is performed again within a predetermined time. 6. The program according to claim 5, causing the user to be notified that face authentication will be performed again within a predetermined period of time. 7. The program according to claim 6, causing another authentication other than the face authentication to be executed when the repeated face authentication results in an error. 8. The program according to claim 7, which disables the computer from using the function of the online video communication tool if the other authentication fails. 9. The program according to claim 7 or 8, wherein when the other authentication results in an error, the other user who is conducting online video communication with the user is notified of the error. 10. The program according to any one of claims 1 to 9, for notifying a video communication organizer in said online video communication tool that said face recognition has failed. An information processing method executed by a computer having a processor, comprising:
An information processing method, comprising causing the processor to execute the program according to any one of claims 1 to 10. An information processing device comprising a processor,
An information processing apparatus that causes the processor to execute the program according to any one of claims 1 to 10. An information processing system including a computer having a processor,
An information processing system that causes the processor to execute the program according to any one of claims 1 to 10.

Images