KR20220034616A - Service System for User Located Remotely with Non-Face-to-Face and Method thereof - Google Patents

Abstract

Disclosed are a non-face-to-face service system which can provide a non-face-to-face service such as a non-face-to-face class or test to a remote attendee and perform individual authentication, and a service method thereof. The service system of the present invention can provide a non-face-to-face service, such as a non-face-to-face class or test, to a remote attendee, and can measure the attendee's participation degree by authenticating the attendee using a face recognition method.

Description

Service System for User Located Remotely with Non-Face-to-Face and Method thereof

The present invention relates to a non-face-to-face service system capable of providing a non-face-to-face service such as a non-face-to-face class or test to remote attendees and for personal authentication, and a service method therefor.

As a global infectious disease spreads, gatherings or gatherings of several people are restrained and maintaining personal distance has become more important than ever to prevent the epidemic. When entering a place where multiple people gather, personal authentication is required. This is because, in the event of an outbreak of an infectious disease, the personal authentication or personal information presented upon entry can be used as basic data for an epidemiological investigation.

In schools, non-face-to-face classes are being offered as an alternative to face-to-face classes that gather in classrooms, and various tests are being replaced in whole or in part by non-face-to-face tests. The non-face-to-face service will expand until the spread of the infectious disease becomes controllable, and even if the spread of the infectious disease ceases, in some cases, the non-face-to-face service may be established as a normal social contact method.

Unlike gathering in a specific space, when taking an exam or taking a non-face-to-face class, personal authentication is required to confirm that the test taker or student is who they are. However, this personal authentication is also spatially separated, so there are various limitations. In addition, it is necessary to have a method to check whether the test takers or students are participating properly and are proceeding with the course. Additionally, under the influence of the Personal Information Protection Act, there is a restriction that photos of examinees or students cannot be stored and managed without the permission of the individual even for the purpose of personal authentication.

As a personal authentication method, fingerprint recognition, face recognition, iris recognition, password, magnetic card, and the like are generally well-known methods. Among various user authentication methods, face recognition is attracting attention as a non-contact authentication method that does not require direct contact. Face recognition recognizes a user by photographing a face with a camera and comparing it with a registered face image. Face recognition has the advantage that it does not require other user manipulation like iris recognition and the user's body does not come into contact with the device.

Face recognition technology is classified into a method using a two-dimensional image and a method using a three-dimensional shape. Since the three-dimensional recognition technology requires a large amount of computation, a two-dimensional face recognition system is generally used. On the other hand, if it is divided into a method of generating an image for face recognition, there is a method of recognizing a general black-and-white image or a color image by using visible light for face recognition, and a method of recognizing an infrared image by using infrared rays. In some cases, both types of images are used as needed.

Methods using visible light, such as black-and-white or color images, have a limitation in that an illuminance greater than a certain size must be present. Therefore, face recognition is impossible in an environment where sufficient illumination is not provided, such as at night or in a dark room. In addition, there is a problem in that only the face part is darkened when backlight is generated on the subject's face like a general camera. Therefore, infrared images that can be used even when the illumination is insufficient are mainly used for face recognition.

On the other hand, in the case of a class or test conducted in a classroom, the participant maintains a certain level of concentration according to the atmosphere of the field. Likewise, in the case of non-face-to-face tests or classes, when it is proven that participants must concentrate above a certain level and maintain a certain level of concentration, it is possible to eliminate controversy over the efficacy or effectiveness of non-face-to-face services. Therefore, in the case of a non-face-to-face service, it is necessary to check whether the participants maintain a certain level of concentration or higher, if necessary.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a non-face-to-face service system capable of providing a non-face-to-face service, such as a non-face-to-face class or test, and personal authentication to remote participants, and a service method thereof.

In order to achieve the above object, the present invention discloses a service method of a non-face-to-face service system. The service method of the present invention includes the steps of: providing, by a management server, a service screen to an attendee terminal through a network to be displayed through a display unit of the attendee terminal; A camera connected to the participant terminal capturing the participant image at a preset frame rate and providing it to the management server in real time; During the service time during which the service screen is displayed, the concentration determination unit of the management server detects a frame in which an error occurs in which the gaze direction of the participant does not face the service screen and a frame in which the error does not occur among all the video frames of the participant image and calculating the attendance concentration of the attendees.

Attendance Concentration Calculation

The attendance concentration is calculated by the following equation,

Here, Ftotal is the total number of frames of the participant video captured during the service time, and FM is the number of frames in which the error does not occur.

According to an embodiment, the service method of the present invention may further include the step of setting, by the concentration level determination unit, a region of interest on the service screen. In this case, when the gaze direction of the participant does not face the ROI in the service screen, the concentration determination unit may classify the frame as an error frame.

Personal authentication method during service time

According to another embodiment, the service method of the present invention includes the steps of, by the management server, receiving a participant authentication request requesting a service screen from the participant terminal and providing the participant's identification number to an authentication server to request authentication; ; The authentication server reads the registered face image of the participant registered in the database using the identification number, extracts registration-feature point data, provides it to the authentication terminal connected to the participant terminal, and provides the registration-feature point data extracted registration face image a discarding registration-feature point data extraction step; The authentication terminal, which has received the registration-feature point data from the authentication server through the participant terminal, captures the participant, generates a face image for authentication, extracts the feature point data, and then performs an authentication procedure of comparing the registration-feature point data with the registration-feature point data, an authentication step of providing the authentication result to the authentication server through the participant terminal; and providing, by the authentication server, the authentication result to the management server, and providing, by the management server, the service screen to the participants when the authentication result is successful. Here, the registered face image is an image mapped to the participant identification number and registered for personal authentication.

According to an embodiment, the authentication method of the present invention may repeat the registration-feature point data extraction step and the authentication step at a preset time period or repeat at least one preset time period during the service time according to the authentication success. . Through this, the identity of the attendees is repeatedly checked even during the service, and the authentication server discards and does not store the registered face image obtained from the database at each repeating step so that the registered face image of the attendee is not used for other purposes. make sure not to

According to another embodiment, the registered face image of the participant registered in the database may be one in which the management server receives the registered face image from the participant who has applied for the service and stores it in the database.

According to another embodiment, the requesting for participant authentication may include providing, by the participant terminal, access information input by the participant to a web page of the management server for the service and an identification number of the authentication terminal. Wow; and the management server providing the identification number of the participant extracted using the access information together with the identification number of the authentication terminal to the authentication server and requesting to perform an authentication procedure. In this case, the authentication server may provide the registration-feature point data to the authentication terminal using the authentication terminal identification number and the IP address of the participant terminal.

The present invention also extends to a non-face-to-face service system for performing the authentication method.

The non-face-to-face service system according to the present invention can check the concentration of participation of participants who are remotely located and connected online in order to receive non-face-to-face services such as non-face-to-face classes or exams in real time.

Additionally, it is possible to personally authenticate a remote non-face-to-face service participant using a face recognition method. In addition, the authentication system of the present invention can recognize a situation in which the participants change as the participants change or leave during a class or test by repeatedly authenticating the participants in a preset time unit.

As such, the authentication method by face recognition for non-face-to-face personal authentication has a very advantageous aspect in that non-face-to-face service is performed in an online state through a computer device. In other words, there is no need for the participant to take other measures such as manipulating fingerprints for repeated authentication, and the first personal authentication process or repeated personal authentication process is performed without the participant's confirmation. there is

In addition, in order to comply with the Personal Information Protection Act, the authentication system of the present invention stores the face photo provided by the attendee for face authentication only in the area permitted by the attendee, and separately stores the face photo of the attendee or the attendee image taken in the authentication step and personal authentication can be performed without management.

1 is a view showing a non-face-to-face service system of the present invention;
Fig. 2 is a block diagram of an attendee terminal applied to the system of Fig. 1;
3 is a service image and participant image for measuring attendance concentration;
4 is a non-face-to-face service system according to another embodiment of the present invention;
5 is a block diagram of a participant terminal and an authentication terminal applied to the system of FIG. 4;
6 is a flowchart provided to explain the non-face-to-face authentication method of the present invention.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

1 and 2 , the non-face-to-face service system 100 of the present invention includes a management server 110 and a participant terminal 130 , which are connected through a network 10 . Here, the network 10 is an Internet network and includes a connection through a wired or wireless interface.

Meanwhile, for convenience of explanation below, even if described as an operation of a participant, it should be understood as an operation performed by the participant using the participant terminal 130 or an operation of the participant terminal 130 .

The management server 110 is devices belonging to the operator side of the non-face-to-face service in contrast to the participant area, and operates for non-face-to-face personal authentication of the present invention. In the present invention, 'non-face-to-face service' refers to a service provided in a non-face-to-face manner through an online connection, and for example, services that have been conventionally conducted in a face-to-face manner, such as a non-face-to-face class or a non-face-to-face test, are representative, but not limited thereto. .

The management server 110 is a server for providing non-face-to-face services to attendees. The management server 110 provides a web page for non-face-to-face service provision and a service image requested by an attendee, and controls additional procedures necessary for service provision, for example, attendee registration. To this end, the management server 110 includes an attendee registration unit 111 , a service providing unit 113 , and a concentration level determination unit 115 .

Operations of the participant registration unit 111 and the service providing unit 113 may perform conventionally known basic access control, image uploading, data storage management, and the like.

The attendee registration unit 111 controls the attendee registration procedure for the non-face-to-face service. The attendee registration procedure includes input of attendee information and generation of attendee identification numbers, and basically, various conventionally known attendee registration procedures and methods can be applied.

The service providing unit 113 provides a non-face-to-face service to the participant terminal 130 . The service providing unit 113 performs a basic access procedure (eg, a login procedure or a procedure corresponding to login) for the participant terminal 130 that is accessed for the non-face-to-face service. In the present invention, the service provided by the service providing unit 113 is specifically specified as providing a service screen (or service image) through the display unit 203 of the participant terminal 130 . Here, the service screen P1 is fixedly displayed on the entire display unit screen of the attendee terminal 130 , and the entire service screen may be a video or web page that is service content, and the edge of the service screen is fixed for providing the service. It is a frame and a part may be service content. On the other hand, since the service screen is limited to include the content requested by the participant, for example, web page screens before and after class, web page screens before and after the test, etc. are not included in the service screen.

The concentration determination unit 115 uses the service screen provided by the service providing unit 113 to the participant terminal 130 and the participant image provided by the participant terminal 130 to display the service screen on the participant terminal 130 . During the event, it judges the level of concentration of attendees. According to an embodiment, as described below, the participant image may be provided by the authentication terminal 450 instead of the participant terminal 130 .

Referring to FIG. 2 , the attendee terminal 130 is a device for the attendee to access online for non-face-to-face service, and belongs to the attendee area, and includes a first communication unit 201, a display unit 203, an input unit 205, and a speaker ( 207 ), a camera unit 209 , and a service screen processing unit 211 .

The first communication unit 201 is a wired or wireless interface that can connect to the network 10 . The display unit 203 , the input unit 205 , and the speaker 207 are the same as those possessed by a normal computer device, and are basically provided for use of the service provided by the management server 110 .

The camera unit 209 is a means for generating an image by photographing a subject in front, and may be built-in to the participant terminal 130 or may be implemented in an external form like the authentication terminal 450 below.

The camera unit 209 creates a ' participant image' by continuously photographing the participants at a preset frame rate during the 'service time' in order to measure the concentration level of attendance by the concentration level determination unit 115 . Here, the service time refers to the time during which the service screen is displayed, and thus the time before and after class or before and after the test is not included. For example, the camera unit 503 may generate an image by photographing the attendees before and after the service time, but the image at this time is not included in the 'participant image' of the present invention.

The service screen processing unit 211 displays the service screen and other various web pages provided by the service providing unit 113 to attendees. Through the web page displayed by the service screen processing unit 211 , the participant may request the service providing unit 113 of the management server 110 to provide a service by inputting access information. Here, the access information refers to information for proving the right to access the management server 110, log-in information according to member registration, or one-time use for non-members who are allowed access only once or a predetermined number of times. Access information, application number, etc. are all included. The service screen processing unit 211 may be implemented in the form of a web browser.

The service screen processing unit 211 transmits the participant image generated by the camera unit 209 at a preset frame rate to the management server 110 in real time. According to an embodiment, a scripter of a service screen provided by the service providing unit 113 may process image transmission.

How to determine the concentration level of the management server

The concentration determination unit 115 may determine the concentration of participation in various methods. The concentration determination unit 115 receives the participant image from the participant terminal 130 and receives the service screen from the service provider 113 to determine the participation concentration.

Attendance concentration can be calculated as in Equation 1 below.

Here, Ftotal is the total number of frames of attendee video provided during the service time (eg, class time), and FM is the number of frames in a steady state without an error of concentration or the number of frames in which an error event does not occur during the entire service provision time. becomes the number Here, the normal frame is a frame in which there is no problem in the concentration of the participant, and the 'error event' is a state in which a problem in the concentration of the participant is detected. The method of determining the degree of concentration of attendees will be described again below.

The concentration determination unit 115 measures the participant's concentration level in the entire image frame of the participant image generated in real time by the participant terminal 130 at a preset frame rate and provided in real time by using an eye tracking technique. We measure the concentration of participation by extracting the frame where the 'error event' occurred.

Referring to FIG. 3 , the concentration determination unit 115 recognizes an area of interest (AOI) on the service screen P1 displayed on the display unit 203 , and the participant image captured by the camera unit 209 ( An error event is detected by recognizing the gaze direction of the participant in real time for each individual image frame of P2) and determining whether the gaze of the participant gazes at the region of interest. The area of interest is the area where content directly or indirectly related to the service content is displayed within the service screen. For example, the area where the class content is displayed (Aoi1), the instructor's face area (Aoi2), or the instructor's hand (Aoi3) is displayed. area, etc. Alternatively, the entire service screen may be set as an area of interest, and if the gaze of the attendee does not stare at the service screen, it may be recognized as an error.

The gaze direction is recognized by recognizing and tracking the position of the participant's eyes in the participant's image P2. (I think it should be added in a way that explains it in more detail or briefly explains the known algorithm that represents the method)

The concentration determination unit 115 divides a frame in which an error is found and a frame in which an error is not found among the participant images provided during the service time, and calculates the concentration in attendance by using Equation (1).

In addition, the concentration determination unit 115 may display the determination result in the form of a chart as shown in FIG. 3C . An empty area in the continuous chart in FIG. 3C indicates a frame in which an error occurs as the participant's gaze looks at a place other than the area of interest.

Non-face-to-face personal authentication method

4 and 5, the non-face-to-face service system 400 of the present invention can additionally process personal authentication for the attendees who are provided with the non-face-to-face service, and for this purpose, the non-face-to-face service system ( In addition to 100 ), it further includes a database 410 , an authentication server 430 , and an authentication terminal 450 . The authentication terminal 450 and the participant terminal 130 are devices belonging to the participant area, and are directly connected one-to-one between the authentication terminal 450 and the participant terminal 130 without going through the network 10 .

The database 410 and the authentication server 430 are devices belonging to the operator side of the non-face-to-face service in contrast to the attendee area together with the management server 110, and operate for non-face-to-face personal authentication of the present invention. Meanwhile, the management server 110 , the database 410 , and the authentication server 430 may all be managed by different operators.

First, in the attendee registration procedure of the attendee registration unit 111 of the management server 110, the process of storing the face image of the attendee for attendee authentication (hereinafter referred to as 'registered face image') in the database 410 is essential. do. Here, the registered face image may be directly provided by the participant or may be separately photographed by the authentication terminal 450 for participant registration, and is mapped to and stored in the participant identification number.

Although not essential to the present invention, the attendee registration unit 111 is used for non-face-to-face service of the service providing unit 113 when receiving the registered face image stored in the database 410 from the attendee, and the attendee's permission is granted. By receiving it, you must avoid violating the Personal Information Protection Act.

In addition, the service providing unit 113 that provides the non-face-to-face service to the participant terminal 130 controls the authentication server 430 and the authentication terminal 450 to perform personal authentication on the participant during the access procedure. ) to ask The detailed operation of the service providing unit 113 for personal authentication will be described again below.

In the database 410, the registered face image of the registered participant is mapped to the participant identification number, stored and managed.

The authentication server 430 includes an authentication control unit 431, initiates the personal authentication procedure of the present invention in response to the request of the service providing unit 113 of the management server 110, and controls the overall personal authentication procedure. The operation of the authentication server 430 will be described again below focusing on the personal authentication procedure performed between the authentication server 430 and the authentication terminal 450 .

The participant terminal 130 further includes an authentication support unit 213 in addition to the participant terminal 130 of FIG. 2 , and the authentication terminal 450 is connected thereto.

The second communication unit 230 is a wired or wireless interface for direct one-to-one connection with another device, for example, the authentication terminal 450 described below. The second communication unit 230 may be, for example, a wired interface such as USB or a wireless interface such as Bluetooth. The display unit 203 , the input unit 205 , and the speaker 207 are the same as those possessed by a normal computer device, and are basically provided for use of the service provided by the management server 110 .

The service screen processing unit 211 performs a browser function for displaying a web page provided by the service providing unit 113 to the participants. Through the page displayed by the service screen processing unit 211 , the participant may request the service providing unit 113 of the management server 110 to provide a service by inputting access information. Here, the access information refers to information for proving the right to access the management server 110, log-in information according to member registration, or one-time use for non-members who are allowed access only once or a predetermined number of times. Access information, application number, etc. are all included. Meanwhile, the access information is different from the participant identification number for identifying the registered face image stored in the database 410, but the same may be used.

The authentication support unit 213 mediates data between the authentication server 430 and the authentication terminal 450, and displays the face image photographed by the authentication terminal 450 on the display unit 203 of the participant terminal 130. perform the action

The authentication terminal 450 performs a personal authentication procedure for the participant together with the authentication server 430 . The authentication terminal 450 includes a terminal communication unit 501 , a camera unit 503 , and an authentication processing unit 505 .

The terminal communication unit 501 is a wired or wireless communication interface connected to the second communication unit 230 of the participant terminal 130 , and connects the authentication terminal 450 to the participant terminal 130 .

The camera unit 503 generates a face image of the participant for participant authentication by the authentication processing unit 505 . On the other hand, the camera unit 209 may take a picture of an attendee for determining the concentration level of attendance, instead of the camera unit 209 of FIG. 2 , and provide it to the management server 110 . Therefore, the camera unit 209 may generate a ' participant image' by continuously photographing the participants at a preset frame rate during the 'service time' for the concentration determination unit 115 to measure the concentration of participation, and some of the participant images are personal. It can be used for authentication. Accordingly, in the system 400 of FIG. 4 , the camera unit 209 of the participant terminal 130 does not need to operate.

The personal authentication procedure of the authentication processing unit 505 is also performed together with the authentication server 430 . The operation of the authentication processing unit 505 will be described again below with reference to FIG. 3 focusing on the personal authentication procedure performed between the authentication server 430 and the authentication server 430 .

Non-face-to-face personal authentication method

Hereinafter, a non-face-to-face authentication method performed between the authentication server 430 and the authentication terminal 450 will be described with reference to FIG. 6 . The authentication terminal 450 must be connected to the participant terminal 130 .

<Registered face image registration: S601>

The participant's 'registered face image' is mapped to the participant identification number by the participant registration unit 111 of the management server 110 and stored in the database 410 .

The attendee registration unit 111 controls the attendee registration procedure for non-face-to-face service provision (or service screen provision). The attendee registration procedure includes input of attendee information and generation of attendee identification numbers, and basically, various conventionally known attendee registration procedures and methods can be applied.

Also, the participant registration unit 111 registers a 'registered face image' by storing the registered participant's face image in the database 410 . The registered face image stored in the database 410 may be directly provided from the participant for participant registration, or may be separately photographed by the authentication terminal 450 for participant registration.

<Initiation of authentication procedure according to access for service use: S603, S605>

The attendee requests a non-face-to-face service (or service screen) of the management server 110 by accessing the web page for connection of the management server 110 using the service screen processing unit 211 of the participant terminal 130 . The service screen processing unit 211 of the participant terminal 130 accesses the web page for connection provided by the service providing unit 113 of the management server 110 under the control of the participant, and inputs input from the participant through the input unit 209 . The received or pre-stored access information is provided to the service providing unit 113 . At this time, the participant terminal 130 provides the 'authentication terminal identification number' together with the access information to the service providing unit 113. Usually, the scripter of the access web page reads the authentication terminal identification number. The 'authentication terminal identification number' is a unique identification number of the authentication terminal 450 (S603).

In the present invention, the non-face-to-face service request corresponds to requesting participant authentication. The service providing unit 113 extracts the participant identification number mapped to the access information provided from the participant terminal 130 and provides it to the authentication server 430 together with the authentication terminal identification number to start the authentication procedure for the participant who requested the service. request that The participant identification number may be included in the access information or may be generated separately from the access information (S605).

<Registration of authentication server-feature point data extraction: S607 to S611>

The authentication control unit 151 of the authentication server 430 initiates an authentication procedure for participant authentication according to the request of the service providing unit 113 , but authentication of the participant is performed in the authentication terminal 450 . The authentication control unit 151 generates one-time registration-feature data to be used for participant authentication by the face recognition method in the authentication terminal 450 and provides it to the authentication terminal 450 .

First, the authentication control unit 151 reads the registered face image of the corresponding participant from the database 410 using the participant identification number provided from the service providing unit 113 (S607).

The authentication control unit 151 extracts registration-feature point data for face recognition according to a preset algorithm from the registered face image. The registration-feature point data is disposable feature point data that is used only once. When the registration-feature point data is extracted, the authentication control unit 151 reads from the database 410 and discards the registered face image used to extract the registration-feature point data. Accordingly, the registered face image of the participant is still only stored in the database 410 (S609).

The authentication server 430 encrypts the extracted registration-feature point data and provides it to the authentication terminal 450 . Communication between the authentication server 430 and the authentication terminal 450 is performed through the network 10 and the authentication support unit 213 of the participant terminal 130 . The authentication server 430 sends the encrypted key point data to the IP address of the participant terminal 130 provided from the service providing unit 113 in the form of a packet, and the authentication support unit 213 sends the key point data included in the packet. is provided to the authentication terminal 450 (S611).

<Operation of authentication terminal: S613 to S619>

When the authentication terminal 450 receives the registration-feature point data of the participant from the authentication server 430 , the authentication terminal 450 performs an actual authentication procedure for the participant and reports the result to the authentication server 430 .

First, the authentication processing unit 505 of the authentication terminal 450 uses the camera unit 503 to capture a face image of an attendee in front to generate a 'face image for authentication'. In order to photograph the face image for authentication, the authentication support unit 213 of the participant terminal 190 may display a guide for photographing the face through the display unit 203 or the speaker 207 (S613).

The authentication processing unit 505 applies the same algorithm used in step S609 to the photographed face image for authentication as it is, extracts a feature point for face recognition, and authenticates the participant by comparing it with the registration-feature point data (S615).

The authentication processing unit 505 provides only the authentication result of step S615 to the authentication server 430 . Data transmission from the authentication processing unit 505 to the authentication server 430 is performed through the authentication support unit 213 of the participant terminal 130 (S617).

<Provision of service according to successful authentication: S619 to S625>

The authentication server 430 provides the authentication result provided from the authentication terminal 450 to the service providing unit 113 of the management server 110 (S619).

When the authentication result is authentication success, the service providing unit 113 provides a service screen requested by the participant, and if the authentication result is authentication failure, performs a measure according to the authentication failure (S621 to S625).

<Repeat the authentication process>

During the service time during which the service screen in which the service is provided by step S623 is provided, the concentration determination unit 115 calculates the concentration level of the participant's participation. Also, during the service time, the authentication server 430 may repeat the authentication process of steps S607 to S621 at a preset time period or repeat at least one preset time period. The at least one preset time point may correspond to, for example, an end point of the service time or a preset time in the middle of the service time. Accordingly, even the attendees who have completed personal authentication to start the service repeatedly check the identity of the attendees during the service. Through this, it is possible to check a situation such as a change in attendees during the service.

In the above method, personal authentication is repeatedly performed during the service time of the non-face-to-face service of the present invention.

In the above, preferred embodiments of the present invention have been illustrated and described, but the present invention is not limited to the specific embodiments described above, and it is common in the technical field to which the present invention pertains without departing from the gist of the present invention as claimed in the claims. Various modifications may be made by those having the knowledge of, of course, and these modifications should not be individually understood from the technical spirit or perspective of the present invention.

Claims (12)

In the service method of the non-face-to-face service system,
providing, by a management server, a service screen to a participant terminal through a network to be displayed through a display unit of the participant terminal;
The camera unit connected to the participant terminal capturing the participant image at a preset frame rate and providing it to the management server in real time; and
During the service time during which the service screen is displayed, the concentration determination unit of the management server detects a frame in which an error occurs in which the gaze direction of the participant does not face the service screen and a frame in which the error does not occur among all the video frames of the participant image Including the step of calculating the attendance concentration of the attendees,
The attendance concentration is calculated by the following equation,

Here, Ftotal is the total number of frames of the participant images captured during the service time, and FM is the number of frames in which the error does not occur.
The method of claim 1,
Further comprising the step of the concentration determination unit setting a region of interest in the service screen,
The service method of the non-face-to-face service system, characterized in that the concentration determination unit classifies the frame as an error occurred when the gaze direction of the participant does not face the region of interest in the service screen.
The method of claim 1,
receiving, by the management server, a participant authentication request requesting the service screen from the participant terminal, and providing the participant's identification number to the authentication server to request participant authentication;
The authentication server reads the registered face image of the participant registered in the database using the identification number, extracts registration-feature point data, provides it to the authentication terminal connected to the participant terminal, and provides the registration-feature point data extracted registration face image Discarded registration-feature point data extraction step. the registered face image is an image mapped to the participant identification number and registered for personal authentication;
The authentication terminal, which has received the registration-feature point data from the authentication server through the participant terminal, captures the participant, generates a face image for authentication, extracts the feature point data, and then performs an authentication procedure of comparing the registration-feature point data with the registration-feature point data, an authentication step of providing the authentication result to the authentication server through the participant terminal; and
The authentication server provides the authentication result to the management server, and the management server provides the service screen to the participants when the authentication result is authentication success. service method.
4. The method of claim 3,
During the service according to the authentication success, by repeating the registration-feature point data extraction step and the authentication step at a preset time period or at least one preset time period,
The service method of a non-face-to-face service system, characterized in that the identity of the participants is repeatedly checked during the service time, and the authentication server discards and does not store the registered face image obtained from the database at each repeating step.
4. The method of claim 3,
The service method of the non-face-to-face service system, characterized in that the registered face image of the participant registered in the database is that the management server receives the registered face image from the participant who requested the service screen and stores it in the database.
4. The method of claim 3,
The step of requesting the participant authentication is,
accessing, by the participant terminal, a web page of the management server for the service and providing access information input by the participant and an identification number of the authentication terminal; and
and requesting that the management server perform an authentication procedure by providing the identification number of the participant extracted using the access information to the authentication server together with the identification number of the authentication terminal;
and the authentication server provides the registration-feature point data to the authentication terminal by using the authentication terminal identification number and the IP address of the participant terminal.
In the non-face-to-face service system,
a management server connected to the participant terminal through a network; and
and the participant terminal connected to the camera unit to capture the participant's image at a preset frame rate and provide it to the management server in real time,
The management server,
a service providing unit providing the service screen requested by the attendee to the attendee terminal to be displayed through the display unit of the attendee terminal; and
During the service time during which the service screen is displayed, a frame in which an error occurs in which the gaze direction of the attendee does not face the service screen and a frame in which the error does not occur among the entire video frames of the attendee image are detected to calculate the attendee's concentration level Including a concentration judgment unit to
The attendance concentration is calculated by the following formula,

Here, Ftotal is the total number of frames of the participant video captured during the service time, and FM is the number of frames in which the error does not occur.
8. The method of claim 7,
The non-face-to-face service system, characterized in that the concentration determination unit sets the region of interest in the service screen, and classifies the frame as an error frame when the gaze direction of the participant does not face the region of interest in the service screen.
8. The method of claim 7,
When the service provider receives the participant authentication request requesting the service screen from the participant terminal and provides the participant identification number while requesting participant authentication, the participant's registration face image is registered in the database using the participant identification number The authentication server reads and extracts the registration-feature point data, provides it to the authentication terminal connected to the participant terminal, and discards the registered face image from which the registration-feature point data is extracted. the registered face image is an image mapped to the participant identification number and registered for personal authentication; and
The registration-feature point data provided by the authentication server is received through the participant terminal, the participant is photographed to generate a face image for authentication, the characteristic point data is extracted, and an authentication procedure is performed for comparing the registration-feature point data with the registration-feature point data, and the authentication is performed. Further comprising the authentication terminal providing a result to the authentication server through the participant terminal,
The non-face-to-face service system, wherein the authentication server provides the authentication result to the management server, and the management server provides the service to the participant when the authentication result is successful.
8. The method of claim 7,
During the service time according to the authentication success,
The authentication server reads the registered face image of the participant registered in the database again, extracts the registration-feature point data again, provides it to the authentication terminal, and receives the authentication result from the authentication terminal again and provides it to the management server By repeating at a preset time period or at least one preset time period,
The non-face-to-face service system, characterized in that the identity of the participants is repeatedly checked during the service time, and the authentication server discards and does not store the registered face image retrieved from the database each time the repetition is repeated.
8. The method of claim 7,
The registered face image of the participant registered in the database is a non-face-to-face service system, wherein the management server receives the registered face image from the participant who has applied for the service and stores it in the database.
8. The method of claim 7,
The participant terminal accesses the web page of the service providing unit for the service and provides access information input by the participant and the identification number of the authentication terminal,
The service providing unit requests the authentication server to perform an authentication procedure by providing the participant's identification number extracted using the access information received from the participant terminal together with the identification number of the authentication terminal,
The non-face-to-face service system, wherein the authentication server provides the registration-feature point data to the authentication terminal using the authentication terminal identification number and the IP address of the participant terminal.

Images