JP7197764B2 - Information processing device, its control method and program - Google Patents

Description

TECHNICAL FIELD The present invention relates to a teaching device, a control method thereof, and a technology of a program for managing the pass/fail judgment of an examination using the face recognition result of a face recognition means for performing face recognition of an examinee.

In recent years, in university lectures, company training, various qualification examinations, etc., people take lectures and take examinations in places other than classrooms or training locations such as home, using network communication such as the Internet. A system of e-learning that can do this is spreading.

In e-learning, since the student (examinee) and the administrator (monitor) are separated, it is important to have an authentication mechanism to confirm that the regular student (examinee) is taking the course (taking the exam). becomes.

Japanese Patent Laid-Open No. 2004-200000 discloses a technique of confirming attendance based on the results of facial recognition of the examinee, in order to identify the examinee of the lecture and support the implementation of the lecture.

Japanese Patent Laid-Open No. 2002-200000 discloses a technique for calculating the user's presence time and absence time based on a captured image, and summing up the user's presence time and time away from the seat during working hours.

In Patent Document 3, the authentication timing is activated at random during e-learning learning, and the acquired authentication information and the authentication information registered in the authentication server in advance are inspected, and if the authentication information is different, the above A technology is disclosed that forcibly terminates e-learning when the number of mismatches accumulated in a counter exceeds a certain value.

Japanese Patent Application Laid-Open No. 2007-133649 Japanese Patent Application Laid-Open No. 2017-182293 Japanese Patent Application Laid-Open No. 2009-276950

In the e-learning test, if it is not recognized from the result of the automatic determination by the face recognition unit that the examinee has taken the test, it cannot be determined that the examinee has passed the test. There is no disclosure of a mechanism for the user to confirm whether the automatic determination result by the face recognition unit has functioned correctly when the test result is suspended due to the automatic determination result by the authentication unit.

The present invention provides information related to a first time period in which the examinee is determined to be the examinee by face recognition during the test, and information related to a second time period in which the examinee is determined not to be the examinee by face recognition during the test. The purpose is to provide a mechanism that can confirm information related to

The present invention includes acquisition means for acquiring a judgment result by a face authentication means for performing face authentication of an examinee , and a first time period during which the face authentication means determines that the examinee is the examinee during the test . Control is performed so that the percentage of the time and the image of the examinee taken during the first time period are associated with each other and displayed, and the face authentication means determines that the examinee is not the examinee himself/herself during the examination time. display control means for performing control so as to associate and display the ratio of the second time period to the examination time and the image of the examinee photographed during the second time period .

In addition, the present invention includes acquisition means for acquiring a judgment result by face authentication means for performing face authentication of an examinee, a first time period during which the face authentication means determines that the examinee is the person himself/herself during the test, When the face authentication means switches to the judgment that the examinee is the examinee himself/herself, control is performed so that the obtained image is displayed in association with the image obtained, and the face authentication means determines that the examinee is not the examinee himself/herself during the test time. display control means for performing control so as to associate and display the time period 2 and the image acquired when the face authentication means switches to the determination that the examinee is not the person himself/herself .

According to the present invention , information related to the first time period in which the examinee is determined to be the examinee by facial recognition during the test, and the second time period in which the examinee is determined to be the examinee by face recognition during the test. It is possible to provide a mechanism capable of confirming information related to .

System configuration diagram showing an example of the configuration of a course management system A block diagram showing the hardware configuration of an information processing apparatus applicable to the attendance management server 111, the face authentication management server 121, the attendance manager's PC 131, and the students' PC 141. A data configuration diagram showing an example of a data table managed by the attendance management server 111. Data configuration diagram showing an example of a data table managed by the face authentication management server 121 Flowchart showing an example of the overall processing flow Flowchart showing an example of student registration processing Flowchart showing an example of face authentication processing Flowchart showing an example of authentication state detection processing Flowchart showing an example of test execution processing Flowchart showing an example of current authentication status determination processing Flowchart showing an example of automatic pass/fail judgment processing FIG. 10 is a flow chart showing a process of manually correcting automatic determination of face authentication during a test period while an administrator views a test result display screen (for administrator). FIG. It is a figure which shows the test result display screen (for administrators) displayed on a display terminal (for administrators). FIG. 10 is a diagram showing a test result display screen (for examinees) displayed on a display terminal (for examinees); FIG. 10 is a diagram showing a test result list display screen (for administrator) displayed on a display terminal (for administrator); FIG. 10 is a diagram showing a login screen displayed on a display terminal (for examinees); It is a figure which shows the test list screen displayed on a display terminal (for an examinee). It is a figure which shows the test start screen displayed on a display terminal (for an examinee). FIG. 10 is a diagram showing a test completion screen displayed on a display terminal (for examinees);

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a system configuration diagram showing an example of the configuration of the attendance management system of the present invention.

The course management system 100 is configured such that a course management server 111 , a face authentication management server 121 , one or a plurality of course manager PCs 131 , and one or a plurality of student PCs 141 are connected via the Internet 150 .

The attendance management server 111 is a server that centrally manages information on students (or examinees; the same applies hereinafter), courses (lectures), and tests, and provides services related to the courses and tests, and is built on the attendance service environment network 110. and is connected to the Internet 150 via the router 112 .

The attendance management server 111 controls login from the attendance administrator PC 131 and the student PC 141, receives requests from the attendance administrator PC 131 and the student PC 141, performs necessary processing, and provides services. In addition, the attendance management server 111 acquires authentication information from the face authentication management server 121, and implements course and test enrollment restrictions and automatic/manual pass/fail determination of the test.

The test is content that can be used as e-learning, and includes at least one of problems related to the course and content related to the course. For example, it may be a test by answering questions about the course, or a test by looking at the contents of the course and attending the course.

The face authentication management server 121 is a server that manages the face image information required for face authentication of the student, and manages the authentication information acquired during face authentication of the student, and is built on the face authentication service environment network 120. It connects to the Internet 150 via a router 122 .

The face authentication management server 121 receives a request from the PC 141 for students, provides face image information necessary for face authentication, and acquires and accumulates authentication information from the PC 141 for students each time. The face authentication management server 121 receives a request from the attendance management server 111 and provides the accumulated authentication information.

In this embodiment, the attendance management server 111 and the face authentication management server 121 are constructed as separate servers, but they may be constructed on the same server.

The attendance administrator PC 131 is a PC terminal that receives operations from the attendance administrator and presents necessary information to the attendance administrator. Connected.

The attendance manager's PC 131 receives information for student registration from the attendance manager, and transmits necessary information to the attendance management server 111 and the face authentication management server 121 for registration. In addition, the attendance manager's PC 131 accepts an operation to change the face authentication result from the attendance manager on the test result screen displayed by the attendance management server 111, and causes the attendance management server 111 to perform manual pass/fail determination.

The student PC 141 is a PC terminal that receives operations from the student, performs face authentication of the student, and presents necessary information to the student. It is connected to the Internet 150 via.

The student PC 141 accepts a login operation from the student to the course management server 111 and authenticates the student by performing face authentication when sending a login request to the course management server 111 . The student PC 141 displays the content of the course and the test received from the course management server 111 to the student, and transmits the operation/input contents from the student to the course management server 111. , performs face authentication asynchronously and transmits authentication information to the face authentication management server 121 .

In this embodiment, each server and each PC are constructed on separate networks and connected via the Internet, but they may be constructed on the same network (for example, the same local area network). .

FIG. 2 is a block diagram showing a hardware configuration of an information processing apparatus applicable to the attendance management server 111, the face authentication management server 121, the attendance manager's PC 131, and the students' PC 141 according to the embodiment of the present invention. Since each device has the same configuration, it will be described using the same reference numerals.

As shown in FIG. 2, the attendance management server 111, face authentication management server 121, attendance administrator PC 131, and student PC 141 are connected via a system bus 204 to a CPU (Central Processing Unit) 201 and a ROM (Read Only Memory). 202, a RAM (Random Access Memory) 203, an input controller 205, a video controller 206, a memory controller 207, a communication I/F controller 208, etc. are connected.
The CPU 201 comprehensively controls each device and controller connected to the system bus 204 .

The ROM 202 or the external memory 211 also stores a BIOS (Basic Input/Output System), which is a control program for the CPU 201, an OS (Operating System), and other data necessary for realizing functions executed by each server or each PC, which will be described later. Various programs are stored. It also stores information necessary for carrying out the present invention. Note that the external memory may be a database.

A RAM 203 functions as a main memory, a work area, and the like for the CPU 201 . The CPU 201 loads programs and the like necessary for executing processing from the ROM 202 or the external memory 211 to the RAM 203, and executes the loaded programs to realize various operations.

An input controller 205 controls inputs from a keyboard (KB) 209 and a pointing device such as a mouse (not shown). The input controller 205 also controls camera image input from the camera device 213 . The student PC 141 is equipped with a web camera or the like as a camera device, and captures camera images used for face authentication, but a separate camera device may be prepared for face authentication.

Video controller 206 controls display on a display such as display 210 . The display may be a display such as a liquid crystal display. These are used by administrators as needed.

The memory controller 207 is an external storage device (hard disk (HD)), flexible disk (FD), or PCMCIA (Personal Computer Memory Card International Association) Controls access to external memory 211 such as compact flash (registered trademark) memory connected to a card slot via an adapter.

A communication I/F controller 208 connects and communicates with an external device via a network, and executes communication control processing in the network. For example, communication using TCP/IP (Transmission Control Protocol/Internet Protocol) is possible.

It should be noted that the CPU 201 can display on the display 210 by, for example, rasterizing an outline font to a display information area in the RAM 203 . The CPU 201 also allows the user to issue instructions using a mouse cursor (not shown) or the like on the display 210 .

Various programs described later for realizing the present invention are recorded in the external memory 211 and are executed by the CPU 201 by being loaded into the RAM 203 as necessary.

Next, an example of a data table used by the attendance management system in this embodiment will be described with reference to the data configuration diagrams of FIGS. 3 and 4. FIG.

FIG. 3 shows an example of the data structure of a table (database) managed by the attendance management server 111. As shown in FIG.

The course table 300 is a table for managing courses (courses), and has course IDs and course names. The course ID indicates an alphanumeric code for identifying the course, and the course name indicates the name of the course.

The course module table 310 is a table for managing modules (tests and lectures) related to courses, and has course IDs, module IDs, and module types. The course ID corresponds to the course ID of the course table 300, the module ID is an alphanumeric code that identifies the module, the module type classifies the type of module, and "lesson" for a lecture and "test" for a test. ” is set. Contents (test data and lecture contents) are associated with each module ID.

The test table 320 is a table for managing tests, and has test IDs, test names, and passing scores. A test ID is an alphanumeric code that identifies a test and corresponds to the module ID in course module table 310 . The test name indicates the name of the test, and the passing score indicates the minimum score required for the test to pass.

The lecture table 330 is a table for managing lectures, and has lecture IDs and lecture names. The lecture ID is an alphanumeric code that identifies the lecture and corresponds to the module ID in the course module table 310. The lecture name indicates the name of the lecture.

The attendance status table 340 is a table for managing the attendance status of each student of modules (tests and lectures), and includes a module ID, student ID, start time, end time, score, attendance status, authentication rate, and non-authentication rate. have. The module ID corresponds to the module ID of the course module table 310, and matches the test ID of the test table 320 in the case of a test and the lecture ID of the lecture table 330 in the case of a lecture. A student ID is an alphanumeric code that identifies a student, and corresponds to the student ID of the user table 360 . The start time and end time indicate the start time and end time of the module, respectively. The score is the score that is the evaluation result of the test (blank for lectures), and the attendance status indicates the status of attendance. "Automatic) Pass", "(Auto) Fail", "(Manual) Pass", "(Manual) Fail", "Suspend", etc. are set.

The attendance status detail table 350 is a table for managing face authentication results for each student of the module, and has a module ID, student ID, start time, end time, authentication status, and authenticated/unauthenticated ratio. The module ID and student ID correspond to the module ID and student ID of the attendance status table 340, respectively. The start time and end time indicate the start time and end time of the authentication state by face authentication, respectively. The authentication status is the authentication status of face authentication, and depending on the results of automatic authentication and manual correction, "(auto) authenticated", "(auto) unauthenticated", "(manual) authenticated", "(manual) unauthenticated", etc. is set. The authenticated/unauthenticated ratio indicates the percentage of time spent in the current authenticated state in the entire course time of the module.

A user table 360 is a table for managing students, and has student IDs and names. The student ID indicates an alphanumeric code (student code, student number, etc.) for identifying the student, and the name indicates the name of the student.

The certification criteria table 370 is a table for managing certification percentages that serve as criteria for attendance determination, and has module types and thresholds. The module type is similar to the module type of course module table 310 . The threshold indicates an authentication ratio that serves as a criterion for each module type. If it is equal to or higher than this threshold, it is determined that the module (test and lecture) has been taken normally.

FIG. 4 shows an example of the data structure of a table (database) managed by the face authentication management server 121. As shown in FIG.

A user face image table 400 is a table for managing face images used for face authentication of students, and has student IDs, authentication source face images, and acquisition dates and times. The student ID indicates an alphanumeric code for identifying the student, the authentication source face image indicates the link destination of the face image file used for face authentication of the student, and the acquisition date indicates the date and time when the face image file was obtained.

The authentication result table 410 is a table for managing the face authentication results of students, and has student IDs, start time, end time, authentication status, and status end. The student ID is an alphanumeric code for identifying the student, and the start time and end time indicate the start time and end time of the authentication state by face authentication, respectively. The authentication state indicates the authentication state by face authentication. Here, unlike the authentication status of the attendance status details table 350, only the status of automatic face authentication is set. State end indicates whether the current authentication state has ended, and is set to "True" if it has ended, and to "False" if it has not ended. Specifically, "True" is set when the authentication state is changed to another or when the application (program) is terminated, and "False" is set when the same authentication state is continuing.

The trail image table 420 is a table for managing trail images accumulated as a result of face authentication, and has student IDs, image types, acquisition dates and times, and images. The student ID is an alphanumeric code that identifies the student, the image type indicates the type of trail image. "Screen shot" is set. Acquisition date and time indicates the date and time when the image was obtained, and the image indicates a link to the image file.

Next, the processing executed by the attendance management system in this embodiment will be described with reference to the flow charts of FIGS. 5 to 12. FIG.

FIG. 5 is a flow chart showing an example of the overall processing flow executed by the attendance management system. Each processing step is executed by the CPU 201 of each device.

First, in order to register a student, the student administrator's PC 131 accepts a student registration operation from the administrator (step S531), and the student attendance management server 111 issues a student ID and updates the user table 360 (step S531). S511), the face authentication management server 121 registers the face image file and updates the user face image table 400 (step S521). This process will be described later with reference to FIG. As a result of this processing, data regarding the new student is registered in the user table 360 in the course management server and in the user face image table 400 in the face authentication management server 121 .

Prior to a series of processes, in step S541, student PC 141 requests an authentication original face image from face authentication management server 121, and receives the authentication original face image transmitted from face authentication management server 121 in step S522. do. This process is executed whenever necessary, such as when the user face image table 400 is updated.

In step S542, the student PC 141 accepts the student's login request from the login screen of FIG.

In step S512, the attendance management server 111 receives the login request, authenticates the student based on the student ID and password, and executes login processing.

After the login is completed, the student PC 141 asynchronously executes face authentication processing (step S543), and the face authentication management server 121 receives and registers the trace information transmitted from the student PC 141 (step S523). This processing will be described later with reference to FIGS.

Next, the student PC 141 receives a test start operation from the student and conducts the test (step S544). At the start of the test, the attendance management server 111 inquires of the face authentication management server 121 to confirm the student's authentication status, provides contents for conducting the test to the student's PC 141, and receives an answer (step S513). The face authentication management server 121 provides the student's authentication status to the attendance management server 111 at the start of the test (step S524). This process will be described later with reference to FIG.

After completion of the test, the attendance management server 111 performs automatic pass/fail judgment based on the pass/fail criteria and certification criteria (step S514). The face authentication management server 121 provides the attendance management server 111 with the authentication information required for automatic pass/fail judgment (step S525). This process will be described later with reference to FIG.

In step S545, the student PC 141 receives the automatic pass/fail judgment result from the attendance management server 111, and displays the judgment result on the test result display screen (for the student) as shown in FIG.

After the automatic acceptance/rejection determination, the attendance manager's PC 131 receives an operation for manual acceptance/rejection determination from the administrator, and transmits updated contents to the attendance management server 111 (step S532). The attendance management server 111 receives the updated content from the attendance manager PC 131 and re-performs the pass/fail determination (step S515). The face authentication management server 121 provides the attendance management server 111 with the authentication information necessary for manual pass/fail judgment (step S526). This process will be described later with reference to FIG.

In step S546, the student PC 141 receives the result of the manual pass/fail judgment from the attendance management server 111 and displays the result. The test result display screen (for examinee) as shown in FIG. 14 displays the re-determination result after the manual correction process shown in FIG. 12 is completed.

In step S547, the student PC 141 receives a logout request from the student, instructs to end the face authentication process, and ends the face authentication process in step S548.

In step S516, the attendance management server 111 executes logout processing, notifies the student PC 141, and terminates the processing flow.

FIG. 6 is a flow chart showing the details of the student registration process (steps S531, S511, S521). Each processing step is executed by the CPU 201 of each device.

In step S 631 , the PC 131 for the attendance manager receives a student registration operation from the administrator, transmits a student registration request together with the name of the student to the attendance management server 111 , and receive the person ID.

In step S611, the attendance management server 111 receives a student registration request from the attendance administrator PC 131, issues a new student ID, transmits it to the attendance administrator PC 131, and stores the student ID and the new student ID in the user table 360. Register your name.

In step S632, the student administrator's PC 131 transmits a face image registration request to the face authentication management server 121 together with the student ID and the authentication original face image provided by the student.

In step S<b>621 , the face authentication management server 121 receives the face image registration request from the student administrator PC 131 , saves the transmitted authentication source face image in a predetermined folder, etc. Register the ID, the link to the image, and the acquisition date and time.

FIG. 7 is a flowchart showing details of the face authentication processing (steps S543 and S523). Each processing step is executed by the CPU 201 of each device.

In step S<b>741 , student PC 141 requests the face authentication management server 121 for an authentication original face image, and receives the authentication original face image transmitted from the face authentication management server 121 .

In step S721, the face authentication management server 121 transmits the authentication original face image to the student PC 141 in response to the request from the student PC 141. FIG. The authentication original face image to be transmitted here may be all managed images, may be a difference that has been changed since the previous transmission, or may be only for the student who uses the student PC 141 .

In step S742, student PC 141 determines whether or not the application (program) for executing face authentication processing has ended. The end processing of the application may be linked to the student's logout as in step S547, or may be executed by an individual end command. If the application has been terminated, this processing flow is terminated, and if not terminated, the process proceeds to step S743.

In step S743, student PC 141 detects the current authentication status. This process will be described later with reference to FIG.

In step S744, the student PC 141 transmits information regarding the authentication/non-authentication time to the face authentication management server 121. FIG.

In step S722, the face authentication management server 121 updates the start time and end time of the latest authentication state in the authentication result table 410 based on the received information on authentication/non-authentication time.

In step S745, student PC 141 acquires a screen shot as trail information and transmits it to face authentication management server 121 together with necessary information.

In step S723, the face authentication management server 121 saves the transmitted screen shot in a predetermined folder or the like, and registers the student ID, image type=“screen shot”, and save destination link in the trail image table 420. .

In step S746, student PC 141 acquires a camera image as trail information, and transmits it to face authentication management server 121 together with necessary information.

In step S724, the face authentication management server 121 saves the transmitted camera image in a predetermined folder or the like, and registers the student ID, image type=“camera image”, and save destination link in the trail image table 420. .

The student PC 141 repeats the processing from step S743 to step S746 at predetermined time intervals until it is determined in step S742 that the application has ended. Also, in this embodiment, the trail information is always transmitted at specified time intervals in steps S745 and S746. good too.

FIG. 8 is a flowchart showing details of the authentication state detection process (step S743). Each processing step is executed by the CPU 201 of the student PC 141 .

In step S801, the student PC 141 detects the student's face from the image captured by the connected camera device and performs authentication.

Authentication is performed by comparing a photographed face with a pre-registered authentication original face image, and determining whether or not the degree of similarity satisfies a predetermined criterion.

In step S802, student PC 141 detects the current authentication status of the student from the captured video. In this embodiment, the current authentication status of the student is assumed to be either "authenticated" or "unauthenticated".

The "authenticated" state refers to a state in which the student's own face is normally detected in the captured video. The "unauthenticated" state refers to a state in which the student's own face is not normally detected from the captured video.

At step S803, the student PC 141 determines whether the current authentication status of the student detected at step S802 is "authenticated" or "unauthenticated." If it is "authentication", the process proceeds to step S804. If it is "unauthenticated", the process proceeds to step S807.

In step S804, student PC 141 determines whether or not there has been a change in the authentication status since the previous detection of the authentication status. That is, since the current authentication status is "authenticated", if the previous authentication status is "authenticated", the status is not changed, and if it is "unauthenticated", the status is changed. If the state has changed, step S806 is executed, and if the state has not changed, step S805 is executed and this processing flow ends.

In step S805, the student PC 141 continues to record the "authenticated" status since the status has not been changed. In other words, upon receiving this result, the face authentication management server 121 updates the end time of the latest authentication state (registered as "authentication") registered in the authentication result table 410 with the current authentication time in step S722. It will be.

In step S806, the student PC 141 ends the recording of the "unauthenticated" status and newly starts recording the "authenticated" status because the status has changed from "unauthenticated" to "authenticated". . In other words, upon receiving this result, the face authentication management server 121 updates the end time of the latest authentication state (registered as "unauthenticated") registered in the authentication result table 410 with the current authentication time in step S722. and set the end state to "True". Furthermore, the latest authentication status is newly registered as "authentication", the current authentication time is set to the start time and end time, and the status end is set to "False". This marks the end of the "unauthenticated" state and the beginning of the "authenticated" state.

In step S807, student PC 141 determines whether or not the status has changed since the previous detection of the authentication status. That is, since the current authentication status is "unauthenticated", if the previous authentication status is "unauthenticated", the status will not be changed, and if it is "authenticated", the status will be changed. If the state has been changed, step S809 is executed, and if the state has not been changed, step S808 is executed and this processing flow ends.

In step S808, the student PC 141 continues to record the "unauthenticated" status since the status has not been changed. In other words, upon receiving this result, the face authentication management server 121 updates the end time of the latest authentication state (registered as "unauthenticated") registered in the authentication result table 410 with the current authentication time in step S722. will do.

In step S809, the student PC 141 ends the recording of the "authenticated" status and newly starts recording the "unauthenticated" status because the status has changed from "authenticated" to "unauthenticated". . In other words, upon receiving this result, in step S722, the face authentication management server 121 updates the end time of the latest authentication state (registered as "authentication") registered in the authentication result table 410 with the current authentication time. , set the end state to "True". Furthermore, the latest authentication status is newly registered as "unauthenticated", the current authentication time is set to the start time and end time, and the status end is set to "False". This marks the end of the "authenticated" state and the beginning of the "unauthenticated" state.

FIG. 9 is a flowchart showing details of the test execution process (steps S544, S513, S524). Each processing step is executed by the CPU 201 of each device.

In step S941, the student PC 141 displays the test list screen of FIG. 17 to accept test selection, displays the test start screen of FIG. ID), and a request to start the test is sent to the attendance management server 111 together with the student ID.

In step S<b>911 , the attendance management server 111 receives the test start request from the student PC 141 and transmits a current authentication information acquisition request to the face authentication management server 121 . At this time, the current time and user ID are transmitted.

In step S921, the face authentication management server 121 receives a current authentication information acquisition request.

In step S922, the face authentication management server 121 determines the current authentication state, ie, "authenticated" or "unauthenticated". This process will be described later with reference to FIG.

In step 523, the face authentication management server 121 transmits the determination result in step S922 to the attendance management server 111 as the current authentication information.

In step S912, the attendance management server 111 determines whether the current authentication status is "authenticated" or "unauthenticated" based on the transmitted authentication information. In the case of "unauthenticated", the test cannot be started, so the student PC 141 is notified of the result, and is re-executed from step S941. In the case of "authentication", the process proceeds to step S913.

In step S 913 , the attendance management server 111 transmits test contents (test question display screen, answer selection screen, etc.) corresponding to the transmitted test ID to the student PC 141 .

In step S942, the student PC 141 presents the content for the test, receives test answers from the students, and accepts pressing of the end button from the test end screen of FIG. 111.

In step S914, the attendance management server 111 receives the test answers, registers them in a test answer table (not shown), etc., and records the start and end times of the corresponding module IDs and student IDs in the attendance status table 340. do.

FIG. 10 is a flowchart showing details of the current authentication status determination process (step S922). Each processing step is executed by the CPU 201 of the face authentication management server 121 .

In step S1001, the face authentication management server 121 acquires the latest authentication result corresponding to the student ID from the authentication result table 410, and determines the latest authentication status. If the latest authentication status is "authenticated", the process proceeds to step S1002, and if "unauthenticated", the process proceeds to step S1004.

In step S1002, the face authentication management server 121 determines whether the state of the acquired latest authentication result has ended. If the state end of the latest authentication result is "False", the process proceeds to step S1003, and if "True", the process proceeds to step S1004. It should be noted that the status termination of the latest authentication result becomes “True” mainly when the face authentication application (program) is terminated.

In step S1003, the face authentication management server 121 determines the elapsed time from the end time of the latest authentication result to the present time. In other words, the validity of the authentication status is determined based on the elapsed time from the time when "authentication" was last determined. If it is within the predetermined time range, it is determined that the "authenticated" state continues, and the process advances to step S1005. Then, the process proceeds to step S1004.

In step S1004, the face authentication management server 121 sets the current authentication state to "unauthenticated" and ends the processing flow.

In step S1005, the face authentication management server 121 sets the current authentication state to "authenticated" and ends the processing flow.

FIG. 11 is a flowchart showing the details of the automatic pass/fail determination process (step S514). Each processing step is executed by the CPU 201 of each device.

In step S1111, the attendance management server 111 grades the test answers received from the student PC 141 based on correct data (not shown). The scores of the corresponding module ID and student ID in the attendance status table 340 are updated according to the graded score.

In step S 1112 , the attendance management server 111 determines whether the graded score is equal to or higher than the passing score of the corresponding module ID in the test table 320 . If the score is equal to or higher than the passing score, the process proceeds to step S1113, and if the score is less than the passing score, the process proceeds to step S1117.

In step S 1113 , the attendance management server 111 transmits to the face authentication management server 121 a request to acquire authentication time information between the start time and the end time of the corresponding module ID and student ID in the attendance status table 340 .

In step S1121, the face authentication management server 121 receives from the course management server 111 an acquisition request for authentication time information together with the student ID, start time, and end time.

In step S1122, the face authentication management server 121 extracts authentication results between the received start time and end time for the corresponding student ID from the authentication result table 410, and authenticates time information (start time, end time, time ratio).

In step S<b>1123 , the face authentication management server 121 transmits to the attendance management server 111 authentication time information counted for each authentication time.

Subsequently, based on the authentication time information received from the face authentication management server 121, the attendance management server 111 determines the start time, end time, Register authentication status and authentication/non-authentication ratio. Furthermore, the attendance management server 111 calculates the sum of the authentication rate and the unauthenticated rate for the corresponding module ID and student ID in the attendance status detail table 350, and calculates the authentication rate for the corresponding module ID and student ID in the attendance status table 340. , to register the unauthenticated percentage.

In step S1114, the attendance management server 111 checks whether the authentication rate of the corresponding module ID and student ID in the attendance status table 340 is equal to or greater than the threshold of the corresponding module type (here, "test") in the authentication criteria table 370. to decide. If it is equal to or greater than the threshold, the process proceeds to step S1115, and if it is less than the threshold, the process proceeds to step S1116.

In step S1115, the attendance management server 111 determines that the test pass/fail result is passed because both the score and the authentication ratio satisfy the pass criteria, and sets the attendance status to "" for the corresponding module ID and student ID in the attendance status table 340. (Automatically) pass” and terminate the processing flow.

In step S1116, the attendance management server 111 suspends the test pass/fail determination because the score satisfies the pass criteria but the authentication ratio does not meet the pass criteria, and the corresponding module ID and student ID in the attendance status table 340 are stored. , the attendance status is set to "suspended", and the processing flow ends.

In step S1117, the attendance management server 111 determines that the test pass/fail result is failed because the score does not meet the acceptance criteria, and changes the attendance status of the corresponding module ID and student ID in the attendance status table 340 to "(Auto ) is set to "failed" and the process flow ends.

FIG. 12 will be explained.

In S1201, on the display terminal (for the administrator), the pass/fail judgment correction button on the test result list display screen (for the administrator) is pressed by the administrator, and the examinee ID and the test name ID are linked to the course management server. Sends display instructions for test results that are pending.

In S1202, the attendance management server displays the contents of the test result display screen (for administrator) on the display terminal (for administrator) in response to the display instruction of the test result from the display terminal (for administrator). Various display items to be displayed in the test result display screen (for administrator) are acquired from each database (attendance status table 340) and arranged in the test result display screen (for administrator). display control.

The pass/fail judgment (participation status) 1301 at the time of suspension linked to the examinee ID and test name ID is obtained from the database (attendance status table 340) of the attendance management server and placed in the test result display screen (for administrator). .

The test score (score) 1302 associated with the examinee ID and the test name ID is acquired from the database of the attendance management server (attendance status table 340) and arranged in the test result display screen (for administrator).

The authentication ratio (total) 1303 at the time of suspension associated with the examinee ID and the test name ID is acquired from the database of the attendance management server (attendance status table 340) and placed in the test result display screen (for administrator).

The authenticated/unauthenticated ratio (authenticated/unauthenticated ratio) 1307 at the time of suspension associated with the examinee ID and test name ID is obtained from the database of the attendance management server (attendance status details table 350) and displayed on the test result display screen (administrator for ).

In S1203, the course management server transmits an acquisition request for an authentication source image associated with the examinee ID and the test name ID to the face recognition management server, and acquires the corresponding authentication source image from the face recognition management server.

In S1204, the face recognition management server searches the database (user face image table 400) for an authentication source image (authentication source face image) linked to the examinee ID and test name ID, and sends the retrieved authentication source image to the course management server. Send.

In S1205, the attendance management server arranges the authentication original face image 1310 acquired from the face recognition management server on the test result display screen (for administrator).

In S1206, the course management server transmits to the face recognition management server a request to acquire the time zone and face authentication associated with the examinee ID and the test name ID, and acquires the corresponding time zone from the face recognition management server.

In S1207, the face recognition management server searches the database (authentication result table 410) for the time period (start time and end time) and face authentication (authentication status) associated with the examinee ID and test name ID, and searches the searched time period. and face recognition to the attendance management server.

In S1208, the attendance management server arranges the time period 1305 and face authentication 1306 acquired from the face recognition management server on the test result display screen (for administrator).

In S1209, the course management server transmits a snapshot image acquisition request linked to the examinee ID and test name ID to the face recognition management server, and acquires the corresponding snapshot image from the face recognition management server.

In S1210, the face recognition management server searches the database (trace image table 420) for snapshot images (screen shots) linked to the examinee ID and test name ID, and transmits the searched snapshot images to the course management server.

In S1211, the attendance management server arranges the snapshot image 1308 acquired from the face recognition management server on the test result display screen (for administrator).

In S1212, the course management server transmits to the face recognition management server a face authentication image acquisition request linked to the examinee ID and the test name ID, and acquires the corresponding face authentication image from the face recognition management server.

In S1213, the face recognition management server searches the database (trace image table 420) for face authentication images (camera images) linked to the examinee ID and test name ID, and transmits the searched face authentication images to the course management server.

In S1214, the attendance management server arranges the face authentication image 1309 acquired from the face recognition management server on the test result display screen (for administrator).

In S1215, the display terminal (for the administrator) receives the face authentication 1306 pulldown on the test result list display screen (for the administrator) manually corrected by the administrator, and the face in the time period manually corrected for the course management server. Send a change of authorization instruction.

In S1216, the attendance management server receives the pull-down candidates manually corrected by the administrator and their time period, and relates to the display contents of face authentication 1306 on the test result list display screen (for administrator) and the change results. Control to change the authentication ratio (total) and the display value of authenticated/unauthenticated.

In S1217, the course management server recalculates the authentication ratio (total) from the manually corrected pull-down candidates and their time periods received in S1216, so that the authentication ratio (total) 1303 at the time of suspension is , and re-determines whether or not the acceptance condition, which is the threshold value, is satisfied.

In S1218, since the authentication ratio (total) recalculated in S1217 does not yet satisfy the pass condition, the attendance management server changes the pass/fail judgment 1301 at the time of suspension (manually) so that failure is displayed. change.

In S1219, the attendance management server changes the pass/fail judgment 1301 at the time of suspension so that (manual) pass is displayed because the authentication ratio (total) recalculated in S1217 satisfies the pass conditions.

In S1220, the display terminal (for administrator) saves the test result list display screen (for administrator) by pressing the save button 1311 by the administrator, and saves the database of the attendance management server after recalculation and manual correction. An instruction to update (or register) test results such as pass/fail judgment 1301 , face authentication 1306 , authentication/non-authentication ratio 1307 , authentication ratio (total) 1303 , authentication ratio 1304 is transmitted.

In S1221, the attendance management server receives update instructions and pass/fail judgment after manual correction after recalculation 1301, face authentication 1306, authentication/non-authentication ratio 1307, authentication ratio (total) 1303, authentication ratio 1304, and other test results and values. Update or Register in Database At S1222, the content of the test result display screen (for administrator) newly registered at S1221 as shown in FIG. 13 can be viewed on the display terminal (for administrator).

FIG. 13 will be explained.

FIG. 13 shows the reason why the administrator confirmed the automatic judgment of face recognition during the test for each test result, and the test score met the acceptance criteria, but the automatic judgment of face recognition did not meet the acceptance criteria. This is a test result display screen (for the administrator) for the administrator to correct the final pass/fail judgment of the test results whose pass/fail results have been temporarily suspended.

The test result display screen (for administrator) is displayed on the web browser of the client terminal (for administrator) 131 .

Each item displayed on the test result display screen (for administrator) will be explained.

The pass/fail judgment 1301 is the final pass/fail judgment of the test result after correction by the administrator. In the final pass/fail judgment, either pass or fail is displayed.

Passing is indicated by test results in which both the test scores and the certification percentage (total) finally meet predetermined acceptance criteria.

Failure is displayed in the test results where only the test score satisfies the predetermined pass criteria, but the certification percentage finally does not satisfy the predetermined pass standards.

The test score 1302 is the score in the test. For example, the score out of 100 points and the number of correct answers out of 30 questions are displayed.

If the test score pass condition is set to 80 out of 100 points, the test score of 87 points satisfies the pass condition.

The authentication ratio (total) 1303 displays the total authentication ratio of the automatic determination and manual correction at which it was finally confirmed that the examinee himself/herself took the test within the test time, in 100% ratio.

When the acceptance condition for the authentication ratio (total) is set to 70% out of 100%, the acceptance condition is satisfied when the authentication ratio (total) is 71%.

After that, when the administrator manually corrects the automatic determination of face authentication, the authentication ratio (total) changes according to the correction result.

The authentication ratio 1304 indicates the ratio of automatically determined to be the examinee by face recognition and the ratio of manually correcting the examinee to be the examinee by the administrator in the face authentication pull-down, each divided into 100%. doing.

In this embodiment, the rate of automatic determination by face recognition that the examinee is the person himself/herself is 65%, and the rate of the administrator manually correcting that the person is the person himself/herself in the face recognition pull-down is 6%. can be confirmed. As a result of the correction by the administrator, the authentication ratio (total) is 71%, and the pass condition is finally satisfied, and the pass/fail judgment is passed.

The time zone 1305 is the time zone (first time zone) within the test time during which the face recognition unit automatically determines that the examinee is the examinee, or the face recognition unit automatically determines that the examinee is not the examinee. Each time slot is displayed so that the time slot (second time slot) can be confirmed.

In this embodiment, since the examinee is in the picture from 16:02:37 to 16:15:20, it is the time zone in which the face authentication unit automatically determines (authenticates) that the examinee is the person himself/herself. be.

In this embodiment, since the examinee is not captured at all between 16:15:20 and 16:25:31, the face authentication unit automatically determines that the examinee is not the examinee (unauthenticated). is.

In this embodiment, since the examinee is in the picture from 16:25:31 to 16:35:02, the facial recognition unit automatically determines that the examinee is the actual examinee (authentication). be.

In the present embodiment, the examinee is in the picture from 16:35:02 to 16:37:16, but the examinee is not the examinee himself (unknown) because the examinee's face is not facing properly. authentication) is automatically determined.

Face authentication 1306 corresponds to each time period of the first time period or the second time period, and is the personal authentication result during the final test time that can be manually corrected to authenticated or unauthenticated by the administrator.

The administrator can manually select one from the four pull-down candidates (automatic) authentication, (automatic) non-authentication, (manual) authentication, and (manual) non-authentication, and switch to each. .

(Automatic) unauthenticated in the pull-down candidates indicates the result of automatic unauthenticated.

The (manual) authentication in the pull-down candidates indicates that it is the manual authentication reception part. The user can correct the pull-down candidate from (automatic) unauthenticated to (manual) authenticated by the manual authentication reception part.

The (automatic) authentication in the pull-down candidates indicates the automatic authentication result.

(Manual) unauthenticated in the pull-down candidates indicates that it is a manual unauthenticated reception part. The user can correct the pull-down candidate from (auto) authenticated to (manual) unauthenticated by the manual unauthenticated acceptor.

(Automatic) authentication is automatically displayed when the face authentication unit automatically determines that the person is the examinee.

(Automatic) unauthenticated is automatically displayed when the face authentication unit automatically determines that the examinee is not the examinee himself.

(Manual) authentication is switched and displayed when the administrator manually corrects and selects that it is the examinee himself as a result of visually confirming the face authentication image in which the examinee is shown.

(Manual) Unauthenticated is switched and displayed when the administrator visually confirms the face recognition image in which the examinee is shown and manually corrects and selects that it is not the examinee himself/herself.

The authenticated/non-authenticated ratio 1307 corresponds to each time slot of the first time slot or the second time slot.

The authenticated/unauthenticated ratio displays the authenticated ratio to the test time in the first time period and the unauthenticated ratio to the test time in the second time period. The test time in this example is from 16:02:37 to 16:37:16.

If the administrator selects (manual) authentication, it means the ratio of authentication to the test time in the time zone manually corrected to be the examinee himself/herself.

Similarly, if (manual) unauthenticated is selected by the administrator, it means the percentage of unauthenticated exam time for times that are manually corrected to be non-examinees.

A snapshot image 1308 corresponds to each time period of the first time period or the second time period.

In the present embodiment, the period between 16:02:37 and 16:15:20 is the time zone in which the face authentication unit automatically determines that the examinee is the examinee himself. This is trace data for certifying the display contents of the screen, such as a screenshot of the screen acquired when it is automatically determined that the

Similarly, in this embodiment, the period between 16:15:20 and 16:25:31 is the time zone in which the face authentication unit automatically determines that the examinee is not the examinee himself. This is trace data for certifying the display contents of the screen, such as a screenshot of the screen acquired when it is automatically determined otherwise.

In addition, when it is determined that the examinee is the examinee himself/herself, a plurality of trail data are obtained in the first time period, and when the examinee is determined to be the examinee himself/herself, the trace data are obtained in the second time period. You can get multiple copies.

By displaying the trail data in association with the first time period or the second time period, respectively, the test screen can be displayed on the examinee's client in the first time period or the second time period. It is possible to show the administrator the trace data that can be checked whether the terminal was properly displayed.

Furthermore, not only is the trail data acquired immediately after the automatic determination by the face recognition unit displayed, but also the trail data is periodically acquired after a predetermined time has passed after the automatic determination by the face recognition unit, and multiple images are displayed. By displaying the trace data, it is possible to confirm in more detail whether the test screen was properly displayed on the examinee's client terminal in the first time period or the second time period. can be done.

A face authentication image 1309 corresponds to each time slot of the first time slot or the second time slot.

In the present embodiment, the period between 16:02:37 and 16:15:20 is the time zone in which the face authentication unit automatically determines that the examinee is the examinee himself. This is an image that includes the examinee himself who was actually automatically judged as

Similarly, in this embodiment, the period between 16:15:20 and 16:25:31 is the time zone in which the face authentication unit automatically determines that the examinee is not the examinee himself. Otherwise, it is an image that does not include the examinee himself/herself, which is actually automatically judged.

Similarly, in this embodiment, the period between 16:35:02 and 16:37:16 is the time zone in which the face authentication unit automatically determines that the examinee is not the examinee himself. Otherwise, it will be an image that includes the examinee himself who was actually automatically judged, but whose face is not facing the front.

By displaying the images that are actually automatically determined in this manner in association with the first time period or the second time period, respectively, the It is possible to show the administrator image data that allows confirmation of whether or not automatic determination has been made. This verifiable image data can be viewed by an administrator to correct the final result of authentication or non-authentication.

In addition, by leaving image data that can be used to confirm whether the facial recognition was performed correctly, it can be used as evidence in the event that an examinee inquires during the exam whether the facial recognition unit has properly performed an automatic determination. be.

Further, a plurality of pieces of image data with which it is possible to confirm whether automatic determination has been made without error are acquired during the first time period, or a plurality of image data with which it is possible to confirm whether automatic determination has been made without error during the second time period. You can get one. In this way, if there are multiple pieces of image data that can be used to confirm whether or not automatic judgment has been made, it is possible to check in detail changes in the orientation of the examinee's face in each time period of the first time period or the second time period. can be approved.

In other words, the period from 16:35:02 to 16:37:16 is a time period in which the face recognition unit automatically determines that the examinee is not the actual examinee, but the examinee himself who has been authenticated by the face recognition unit is included. By displaying the images side by side, this time zone is the time to look in another direction and think about the answer. For 16 seconds, the administrator can easily confirm from the image data that can confirm whether or not the face recognition unit has automatically determined that the person is not the examinee by mistake.

In addition, the period between 16:15:20 and 16:25:31 is a time period in which the facial recognition unit automatically determined that the examinee was not the examinee. The administrator can easily confirm that the facial recognition unit correctly automatically determined that the examinee was not the examinee from 20:25 to 16:25:31.

In addition to displaying the image data automatically determined by the face recognition unit, after a predetermined time has elapsed after the automatic determination by the face recognition unit, image data for confirming the presence of the examinee is acquired periodically. By displaying a plurality of images, the administrator is provided with image data that enables detailed confirmation that the face recognition unit correctly automatically determined that the examinee was not the examinee in the first time period or the second time period. I can show you.

An authentication source face image 1310 is a master image registered in advance for each examinee so that the face authentication unit can automatically determine the examinee himself/herself.

This master image is an image that the examinee prepares when applying for the examination and is registered for the examination.

By displaying the master image and the image data automatically determined by the face recognition unit side by side so that they can be compared, it is possible to confirm whether the face recognition has been properly automatically determined.

In other words, when the master image is not displayed, it is difficult to extract the feature amount for automatic identification of the examinee by the face recognition unit even if only the image data automatically determined by the face recognition unit is seen. In addition, it is not possible to easily check whether or not many unauthenticated faces have occurred in automatic determination by the face authentication unit due to incorrect authentication.

Furthermore, by displaying the master image, the administrator can easily check whether or not the face authentication was automatically determined with the same examination photograph or the like by comparing it with the examination photograph or the like of the examinee. It is also possible to check whether the master image has been illegally replaced.

A save button 1311 is an operation button for registering in the database the final pass judgment after manual correction by the administrator.

When the save button is pressed, the latest corrections displayed on the screen are sent to the database and registered in the database.

A quit without saving button 1312 is a cancel button for terminating the screen operation without registering in the database the final pass judgment after manual correction by the administrator.

If the button to exit without saving is pressed, the latest corrections displayed on the screen will not be sent to the database, and the database will not be updated.

FIG. 14 will be explained.

Figure 14 shows the test results of a case in which the pass/fail result of the test was temporarily suspended because the test score met the pass criteria, but the automatic judgment of face recognition did not meet the pass criteria. It is a test result display screen (for an examinee).

This test result display screen (for examinees) is displayed on the Web browser of the client terminal 141 for examinees.

Each item displayed on the test result display screen (for examinees) will be explained.

The pass/fail judgment 1301 is the final pass/fail judgment of the examinee's test results. In the final pass/fail judgment, any one of pass, hold, and fail is displayed.

Passing is indicated by test results in which both the test scores and the certification percentage (total) finally meet predetermined acceptance criteria.

Suspension is displayed in test results where only the test score meets the predetermined acceptance criteria, but the certification percentage ultimately does not meet the prescribed acceptance criteria.

A fail is indicated for test results where the test score does not meet the predetermined pass criteria.

The test score 1402 is the score in the test. For example, the score out of 100 points and the number of correct answers out of 30 questions are displayed.

If the test score pass condition is set to 80 out of 100 points, the test score of 87 points satisfies the pass condition.

The authentication ratio 1403 displays the authentication ratio in 100% ratio at which it was automatically determined that the examinee himself/herself had taken the test within the examination time.

If the pass condition for the authentication ratio is set to 70% out of 100%, the pass condition is not satisfied if the authentication ratio is 65%. Therefore, in the case of this examinee, the test result is suspended, and the final pass/fail decision is made after the administrator confirms the correction.

A time zone 1404 is a time zone (first time zone) within the test time that is automatically determined to be present at the seat by the face authentication unit, or a time zone (first time zone) that is automatically determined to be absent from the seat by the face authentication unit. Each time slot is displayed so that the time slot (second time slot) can be confirmed.

In this embodiment, the examinee is shown in the picture from 16:02:37 to 16:15:20. be.

In this embodiment, since the examinee is not captured at all from 16:15:20 to 16:25:31, the face recognition unit automatically determines that the examinee is away (unauthenticated). Obi.

In this embodiment, since the examinee is in the picture from 16:25:31 to 16:35:02, the face recognition unit automatically determines that the examinee is present (authentication). Obi.

In this embodiment, the examinee is in the picture from 16:35:02 to 16:37:16. This is the time zone automatically determined as unauthenticated).

Face recognition 1405 corresponds to each time slot of the first time slot or the second time slot, and is the presence/absence result of the examinee during the examination time.

Presence is automatically displayed when the face authentication unit automatically determines that the person is present.

Away from the seat is automatically displayed when the face authentication unit automatically determines that the user is away from the seat.

The authenticated/non-authenticated ratio 1406 corresponds to each time slot of the first time slot or the second time slot.

The authenticated/unauthenticated ratio displays the authenticated ratio to the test time in the first time period and the unauthenticated ratio to the test time in the second time period.

A snapshot image 1407 corresponds to each time period of the first time period or the second time period.

In the present embodiment, the period from 16:02:37 to 16:15:20 is the time zone in which the face authentication unit automatically determines that the person is present. This is trail data for certifying the display contents of the screen, such as a screenshot of the screen acquired when the judgment is made.

Similarly, in the present embodiment, the period from 16:15:20 to 16:25:31 is the time zone in which the face recognition unit automatically determines that the person is away from the seat. This is trace data for certifying the display contents of the screen, such as a screenshot of the screen acquired when it is automatically determined that there is.

In addition, a plurality of pieces of trail data when it is determined that the person is present is acquired in the first time slot, and the trail data when it is determined that the person is away is acquired in the second time slot. You can get multiple copies.

By displaying the trail data in association with the first time period or the second time period, respectively, the test screen can be displayed on the examinee's client in the first time period or the second time period. It is possible to show the test taker the trail data that can be confirmed whether it was displayed properly on the terminal.

Furthermore, not only is the trail data acquired immediately after the automatic determination by the face recognition unit displayed, but also the trail data is periodically acquired after a predetermined time has passed after the automatic determination by the face recognition unit, and multiple images are displayed. By displaying the trace data, it is possible to show the examinee the trace data that enables more detailed confirmation as to whether the test screen was properly displayed on the examinee's client terminal in the first time period or the second time period. can be done.

A face authentication image 1408 corresponds to each time slot of the first time slot or the second time slot.

In the present embodiment, the period from 16:02:37 to 16:15:20 is the time zone automatically determined as being present by the face recognition unit. This is an image that includes the examinee himself who was automatically judged to be.

Similarly, in the present embodiment, the period from 16:15:20 to 16:25:31 is the time zone in which the face recognition unit automatically determines that the person is away from the seat. It is an image that does not include the examinee himself/herself, who is actually automatically judged to be present.

Similarly, in the present embodiment, the period from 16:35:02 to 16:37:16 is a time zone automatically determined as being away from the seat by the face authentication unit. It is an image that includes the examinee himself who was automatically determined to be present, but whose face is not facing the front.

By displaying the images that are actually automatically determined in this manner in association with the first time period or the second time period, respectively, the It is possible to show the examinee the image data that enables confirmation of whether or not the test has been automatically judged.

In addition, by leaving image data that can be used to confirm whether the automatic determination was correct, it can be used as evidence when inquiring of the administrator whether the facial recognition unit was properly automatically determined during the test period. .

Further, a plurality of pieces of image data with which it is possible to confirm whether automatic determination has been made without error are acquired during the first time period, or a plurality of image data with which it is possible to confirm whether automatic determination has been made without error during the second time period. You can get one. In this way, if there are multiple pieces of image data that can be used to confirm whether or not automatic judgment has been made, it is possible to check in detail changes in the orientation of the examinee's face in each time period of the first time period or the second time period. can be approved.

In other words, the period between 16:35:02 and 16:37:16 is the time zone automatically determined to be absent by the face recognition unit, but includes the examinee himself/herself who was authenticated by the face recognition unit. By displaying the images side by side, this time zone is the time to look in another direction and think about the answer. For 16 seconds, the examinee can easily confirm from the image data that can confirm whether or not the face recognition unit automatically determined that the person was not the examinee by mistake.

In addition, the period from 16:15:20 to 16:25:31 is a time zone automatically judged to be absent from the face authentication unit, but the examinee himself is absent, so The examinee can easily confirm that the facial recognition unit correctly automatically determined that the person was away from the seat from 1:20 to 16:25:31.

In addition to displaying the image data automatically determined by the face recognition unit, after a predetermined time has elapsed after the automatic determination by the face recognition unit, image data for confirming the presence of the examinee is acquired periodically. By displaying a plurality of images, the examinee is provided with image data that enables detailed confirmation that the face recognition unit correctly automatically determined that the examinee was not the examinee in the first time period or the second time period. I can show you.

An authentication source face image 1409 is a master image registered in advance for each examinee so that the face authentication unit can automatically determine the examinee himself/herself.

By displaying the master image side by side with the image data automatically determined by the face recognition unit, it is possible to confirm whether the face recognition has been properly automatically determined.

In other words, when the master image is not displayed, it is difficult to extract the feature amount for automatic identification of the examinee by the face recognition unit even if only the image data automatically determined by the face recognition unit is seen. In addition, it is not possible to easily check whether or not many unauthenticated faces have occurred in automatic determination by the face authentication unit due to incorrect authentication.

Furthermore, by displaying the master image, the examinee can easily check whether or not the face authentication was automatically determined with the same examination photograph, etc., by comparing it with the examination photograph of the examinee. It is also possible to check whether the master image has been illegally replaced.

FIG. 15 will be explained.

Fig. 15 shows a test results list display screen (for administrators) that allows the administrator to select from the list the test results of examinees whose pass/fail results have been suspended from among all the test results of the mid-term Japanese language test. ).

The test result list display screen (for administrator) is displayed on the web browser of the client terminal (for administrator) 131 .

In addition, in the test results of the Japanese midterm test, the test results that passed or failed will not be displayed, and only the test results that are pending will be displayed on the test result list display screen (for administrators). no problem.

The course name 1501 identifies the name of the course taken, and displays the course name, course ID, and the like.

The test name 1502 identifies the content of the test taken, and displays the test name, test ID, and the like.

The test taker 1503 is for identifying the taker, and the name of the taker and the ID of the taker are displayed.

The test score 1504 indicates the test score of the test taker.

The authentication rate 1505 indicates the rate at which the face authentication unit automatically determined that the person was present during the test.

The pass/fail judgment 1506 is the pass/fail result of the test taker. Any one of pass, hold, and fail is automatically displayed from the result of both the test score and the certification rate.

A pass/fail judgment correction 1507 is a forward button for transitioning to a test result display screen (for the administrator) in which the administrator corrects the final pass/fail judgment of the temporarily suspended test results. A forward button is automatically displayed only for temporarily suspended test results.

FIG. 16 will be explained.

FIG. 16 is a login screen for an examinee to log in to the training system.

This login screen is displayed on the Web browser of the client terminal 141 for examinees.

A student ID 1601 is an input field in which the student manually inputs the student ID and the like in order to manage the student who logs in to the training system.

A password 1602 is an entry field in which the examinee manually inputs a password for each examinee, in order to manage the password for logging in to the training system.

A login button 1603 is a button for sending login information to the training system after the examinee manually inputs the examinee's ID and password. After pressing this button, login authentication is performed, and each examinee can start an e-learning test (such as a mid-term test in Japanese).

FIG. 17 will be explained.

FIG. 17 shows a test list screen on which the examinee selects a test to be taken from the list after the examinee logs in to the training system.

This test list screen is displayed on the Web browser of the client terminal 141 for examinees.

An intermediate test button 1701 is a button for selecting the name of the test that the user should take from the test list. By pressing this midterm test button, for example, a midterm Japanese language test is selected, and the screen transitions to the test name screen of the midterm Japanese language test.

FIG. 18 will be explained.

FIG. 18 shows a test start screen for the examinee to start the midterm test of Japanese, for example, after selecting the name of the test to be taken by the examinee on the test list screen.

By pressing the test start button 1801, for example, a midterm Japanese language test is started, the screen transitions to a midterm Japanese language test screen (not shown), and the student takes a large number of exam questions.

Furthermore, in conjunction with pressing the test start button, the test start time is registered in the database.

FIG. 19 will be explained.

FIG. 19 is a test end screen for completing the midterm Japanese language test after the examinee has completed the midterm Japanese language test after starting the midterm Japanese language test on the test start screen. .

By selecting the answer radio button 1901 by the user, for example, the answer to question number 10 of the midterm Japanese language test is completed.

By pressing the previous page button 1902, for example, the screen returns to the answer screen for question No. 9 of the midterm Japanese language test.

By pressing the answer transmission button 1903, for example, answers to the midterm Japanese language test are completed, and the answer results of the midterm Japanese language test are sent to the database. The test scores are automatically scored based on the results of the mid-term Japanese language tests sent here, and the test scores are also registered in the database.

Furthermore, the test end time is registered in the database in conjunction with pressing of the reply transmission button.

Although one embodiment has been described above, the present invention can be embodied as, for example, a system, apparatus, method, program, recording medium, or the like. The present invention may be applied to a system in which the present invention is used, or may be applied to an apparatus consisting of one piece of equipment.

Further, the program in the present invention is a program that allows a computer to execute the processing method of each flowchart, and the storage medium of the present invention stores a program that enables a computer to execute the processing method of each drawing. In addition, the program in the present invention may be a program for each processing method of each device in each figure.

As described above, a recording medium recording a program for realizing the functions of the above-described embodiments is supplied to a system or device, and the computer (or CPU or MPU) of the system or device reads the program stored in the recording medium. Needless to say, the object of the present invention can also be achieved by reading and executing.

In this case, the program itself read from the recording medium implements the novel functions of the present invention, and the recording medium storing the program constitutes the present invention.

Examples of recording media for supplying programs include flexible disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, CD-Rs, DVD-ROMs, magnetic tapes, non-volatile memory cards, ROMs, EEPROMs, silicon A disk, solid state drive, or the like can be used.

Further, by executing the program read by the computer, not only the functions of the above-described embodiments are realized, but also based on the instructions of the program, the OS (operating system) and the like running on the computer are actually executed. Needless to say, a case where part or all of the processing is performed and the functions of the above-described embodiments are realized by the processing are included.

Furthermore, after the program read from the recording medium is written in the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function expansion board is read according to the instruction of the program code. It goes without saying that a case where a CPU or the like provided in a function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

Moreover, the present invention may be applied to a system composed of a plurality of devices or to an apparatus composed of a single device. Further, it goes without saying that the present invention can be applied to the case where it is achieved by supplying a program to a system or apparatus. In this case, by loading a recording medium storing a program for achieving the present invention into the system or device, the system or device can enjoy the effects of the present invention.

Furthermore, by downloading and reading out the program for achieving the present invention from a server, database, etc. on the network using a communication program, the system or device can enjoy the effects of the present invention.

It should be noted that all configurations obtained by combining each of the above-described embodiments and modifications thereof are also included in the present invention.

100 Course Management System 111 Course Management Server 121 Face Authentication Management Server 131 PC for Course Manager
141 Student PC

Claims (13)

Acquisition means for acquiring the judgment result by the face authentication means for performing face authentication of the examinee;
Displaying the percentage of the test time in which the first time period during which the face authentication means determines that the examinee is the examinee himself during the test time is associated with the image of the examinee taken during the first time period. and the percentage of the test time during which the face authentication means determines that the examinee is not the examinee, and the image of the examinee taken during the second time period. a display control means for controlling display in association with
An information processing device comprising: 2. The information processing apparatus according to claim 1, wherein said display control means performs control so as to display the total proportion of the examination time period during which the examinee is determined to be the examinee himself/herself. 3. The information processing according to claim 1, wherein said display control means performs control so as to display the total proportion of the examination time period during which it is determined that the examinee is not the examinee himself/herself. Device. A pass/fail judgment means for judging pass/fail of an examinee according to predetermined conditions including conditions based on the judgment result acquired by the acquisition means,
The display control means controls, with respect to the examinee determined to be on hold by the pass/fail determination means, a first time period in which the face authentication means determines that the examinee is the examinee himself/herself during the test, and the percentage of the test time. , the image of the examinee photographed during the first time period is controlled to be displayed in association with the image of the examinee, and the second time period determined by the face recognition means that the examinee is not the examinee himself during the test time is the test 4. The information processing apparatus according to any one of claims 1 to 3, wherein control is performed so as to associate and display the proportion of the time and the image of the examinee taken during the second time period. . Acquisition means for acquiring the judgment result by the face authentication means for performing face authentication of the examinee;
A first time zone in which the face authentication means determines that the examinee is the person himself/herself during the test, and an image acquired when the face authentication means switches to the determination that the person is the examinee is associated with the image. Control to display, and obtained when switching to a second time period during which the face authentication means determines that the examinee is not the examinee, and when the face authentication means switches to the judgment that the examinee is not the examinee. a display control means for controlling display in association with the image obtained;
An information processing device comprising: 6. The information processing apparatus according to claim 5, wherein the acquired image includes an image of an examinee. 7. The information processing apparatus according to claim 5, wherein said acquired image includes an image of a display screen of said information processing apparatus. A pass/fail judgment means for judging pass/fail of an examinee according to predetermined conditions including conditions based on the judgment result acquired by the acquisition means,
The display control means controls, for an examinee determined to be on hold by the pass/fail determination means, a first time period in which the examinee is determined to be the examinee himself/herself by the face authentication means during the examination, and a second time period in which the face authentication means determines that the examinee is not the examinee himself/herself during the test, and controls to display the acquired image in association with the image obtained when switching to determination that the examinee is the examinee; 8. The information according to any one of claims 5 to 7 , wherein the information is displayed in association with an acquired image when the face recognition means switches to a determination that the person is not the examinee himself/herself. processing equipment. 9. The information processing apparatus according to any one of claims 1 to 8, further comprising correction receiving means for receiving a correction of the determination result obtained by said obtaining means. A correction receiving means for receiving a correction of the determination result obtained by the obtaining means,
9. The information processing apparatus according to claim 4, wherein said pass/fail judgment means re-judges pass/fail of the examinee based on the judgment result of receiving said correction. A control method for an information processing device,
an obtaining step in which the obtaining means obtains the judgment result by the face authentication means for performing face authentication of the examinee;
The display control means displays the proportion of the examination time in which the face authentication means determines that the examinee is the examinee, and the examinee's image taken during the first time period. are displayed in association with each other, and the ratio of the second time period in the test time when the face authentication means determined that the examinee was not the examinee to the test time, and the image taken during the second time period. a display control step for controlling to display the image of the examinee in association with the
A control method for an information processing device, comprising: A control method for an information processing device,
an obtaining step in which the obtaining means obtains the judgment result by the face authentication means for performing face authentication of the examinee;
Acquired when the display control means switches between the first time period in which the face authentication means determines that the person is the examinee during the test, and the face authentication means determines that the person is the examinee. During the test, the face authentication means switches to a second time zone in which the face authentication means determines that the person is not the examinee, and the face authentication means determines that the person is not the examinee. a display control step for controlling display in association with the image acquired when
A control method for an information processing device, comprising: A program for causing an information processing apparatus to function as each means according to any one of claims 1 to 10.

Images