JP6864238B2 - Training equipment, its control method and program - Google Patents

Description

The present invention relates to a training device that manages a pass / fail judgment of an examination by using the face recognition result of a face recognition means that performs face recognition of an examinee, a control method thereof, and a technique of a program.

In recent years, in university lectures, corporate training, various qualification exams, etc., using network communication such as the Internet, taking lectures or taking exams in a place different from the classroom or training place such as home. An e-learning mechanism that enables e-learning is widespread.

In e-learning, students (examinees) and managers (monitors) are separated, so it is important to have an authentication mechanism to confirm how regular students (examinees) are taking (examination). It becomes.

Patent Document 1 discloses a technique for confirming attendance based on the result of face authentication of an examinee in order to identify the examinee of the lecture and support the lecture.

Patent Document 2 discloses a technique of calculating a user's attendance time and leaving time based on a captured image, and totaling the user's attending time and leaving time during working hours.

In Patent Document 3, the authentication timing is randomly activated during e-learning learning, the acquired authentication information and the authentication information registered in advance on the authentication server are inspected, and if the authentication information is different, the above is described. A technique for forcibly terminating e-learning learning when the number of mismatches accumulated in the counter exceeds a certain value is disclosed.

JP-A-2007-133649 JP-A-2017-182293 JP-A-2009-276950

In the e-learning test, if it is not recognized that a legitimate examinee has taken the test based on the authentication result by the face recognition unit, it cannot be judged as a pass, but the techniques disclosed in Patent Documents 1 to 3 include face recognition. There is no disclosure of a mechanism for the user to confirm the test result when the test result is suspended due to the certification result by the department.

An object of the present invention is to provide a mechanism that allows a user to visually confirm the test result when the test result is suspended by the authentication result by the face recognition unit.

The present invention is a training device that manages a pass / fail judgment of an examination by using the face recognition result of a face recognition means that is communicably connected to a display terminal and performs face recognition of an examinee, and the face recognition is performed within the test time. by performing judgment of whether the rate it is determined that the examinee himself condition is satisfied means, the hand-stage test results acceptance judgment is pending tests that control so as to display on the display device The means for controlling the test includes an image of an examinee whose identity is determined by the face recognition means within the test time, and face recognition of the face recognition means within the test time. The master image used is displayed on the display terminal so as to be comparable.

The present invention is a training device that manages a pass / fail judgment of an examination by using the face recognition result of a face recognition means that is communicably connected to a display terminal and performs face recognition of an examinee, and the face recognition is performed within the test time. By determining whether or not the ratio of the examinees determined to be present by the means satisfies the condition, the test result for which the pass / fail determination of the test is suspended is controlled to be displayed on the display terminal. In the means provided with the means and controlled, the image of the examinee whose face recognition means has determined whether or not the examinee is present within the test time and the face recognition means of the face recognition means within the test time. The master image used for face recognition is displayed on the display terminal in a comparable manner .

The present invention is a training device that is communicably connected to a display terminal and manages a pass / fail judgment of a test using the face recognition result of a face recognition means that performs face recognition of an examinee, and the score of the test of the test is high. If the pass criteria are met and the result of the face recognition means determining that the examinee is the examinee within the examination time also meets the conditions, the determination means for determining that the examination is acceptable and the examination A holding means for suspending the pass / fail judgment of the test when the test score meets the pass criteria, but the result determined by the face recognition means to be the examinee within the test time does not meet the conditions. The present invention is characterized by comprising a means for controlling the test result determined to pass the test and the test result for which the pass / fail judgment of the test is suspended so as to be displayed differently on the display terminal.

The present invention is a training device that is communicably connected to a display terminal and manages a pass / fail judgment of a test using the face recognition result of a face recognition means that performs face recognition of an examinee, and the score of the test of the test is high. If the pass criteria are met and the result of the face recognition means determining that the examinee is present within the examination time also meets the conditions, the determination means for determining that the examination is passed, and If the test score of the test meets the passing criteria, but the result of the face recognition means determining that the examinee is present within the test time does not meet the conditions, the test passes or fails. It is provided with a holding means for suspending the determination, and a means for controlling the test result determined to pass the test and the test result for which the pass / fail determination of the test is suspended so as to be displayed differently on the display terminal. It is characterized by that.

The present invention is a training device that manages a pass / fail judgment of an examination by using the face recognition result of a face recognition means that is communicably connected to a display terminal and performs face recognition of an examinee, and the face recognition is performed within the test time. A means for controlling the display of the test result for which the pass / fail judgment of the test is suspended is displayed on the display terminal by determining whether or not the result determined to be the examinee himself / herself is satisfied by the means, and the test. It is characterized by including a receiving means for receiving correction of a test result for which a pass / fail judgment has been suspended, and a registration means for registering the test result for which the correction has been received as a pass / fail judgment for the test.
The present invention is a training device that manages a pass / fail judgment of an examination by using the face recognition result of a face recognition means that is communicably connected to a display terminal and performs face recognition of an examinee, and the face recognition is performed within the test time. A means for controlling whether or not the result of the determination that the examinee is present by the means satisfies the condition, and a means for controlling the display of the test result for which the pass / fail determination of the test is suspended is displayed on the display terminal. It is characterized by including a receiving means for accepting corrections of test results for which the pass / fail judgment of the test is suspended, and a registration means for registering the test results for which the corrections have been received as pass / fail judgments for the test.

INDUSTRIAL APPLICABILITY According to the present invention, it is possible to provide a mechanism that allows a user to visually confirm the test result when the test result is suspended by the authentication result by the face recognition unit.

System configuration diagram showing an example of the configuration of the attendance management system A block diagram showing a hardware configuration of an information processing device applicable to a course management server 111, a face recognition management server 121, a course manager PC 131, and a student PC 141. Data structure diagram showing an example of a data table managed by the attendance management server 111 Data configuration diagram showing an example of a data table managed by the face authentication management server 121 Flowchart showing an example of the overall processing flow Flowchart showing an example of student registration process Flowchart showing an example of face recognition processing Flowchart showing an example of authentication status detection processing Flowchart showing an example of test execution process Flow chart showing an example of the current authentication status judgment process Flowchart showing an example of automatic pass / fail judgment processing It is a flowchart which shows the process which the manager manually corrects the automatic judgment of face authentication during a test period while looking at a test result display screen (for a manager). It is a figure which shows the test result display screen (for an administrator) displayed on the display terminal (for an administrator). It is a figure which shows the test result display screen (for an examinee) displayed on the display terminal (for an examinee). It is a figure which shows the test result list display screen (for an administrator) displayed on the display terminal (for an administrator). It is a figure which shows the login screen which is displayed on the display terminal (for examinees). It is a figure which shows the test list screen displayed on the display terminal (for examinees). It is a figure which shows the test start screen displayed on the display terminal (for examinees). It is a figure which shows the test end screen displayed on the display terminal (for examinees).

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a system configuration diagram showing an example of the configuration of the attendance management system of the present invention.

The attendance management system 100 is configured such that the attendance management server 111, the face recognition management server 121, one or a plurality of attendance manager PCs 131, and one or a plurality of student PCs 141 are connected via the Internet 150.

The course management server 111 is a server that centrally manages information on students (or examinees; the same applies hereinafter), courses (lectures), and tests, and provides services related to courses and tests, and is built on the course service environment network 110. It is connected to the Internet 150 via the router 112.

The course management server 111 controls login from the course manager PC 131 and the student PC 141, receives requests from the course manager PC 131 and the student PC 141, performs necessary processing, and provides a service. In addition, the attendance management server 111 acquires authentication information from the face recognition management server 121, restricts attendance of courses and tests, and automatically / manually determines whether or not to pass the test.

The test is content that can be used as e-learning, and includes at least one of the questions related to the course and the content related to the course. For example, the test may be performed by answering questions related to the course, or may be a test by looking at the contents of the course and taking the test.

The face recognition management server 121 is a server that manages the face image information required for the student's face recognition and manages the authentication information acquired at the time of the student's face recognition, and is constructed on the face recognition service environment network 120. It is connected to the Internet 150 via the router 122.

The face authentication management server 121 receives a request from the student PC 141, provides face image information necessary for face recognition, and acquires and stores the authentication information from the student PC 141 each time. The face recognition management server 121 receives a request from the attendance management server 111 and provides the accumulated authentication information.

In this embodiment, the attendance management server 111 and the face recognition management server 121 are constructed as separate servers, but they may be constructed on the same server.

The course manager PC 131 is a PC terminal that receives operations from the course manager and presents necessary information to the course manager. It is built on the course manager network 130 and is connected to the Internet 150 via the router 132. You are connected.

The attendance manager PC 131 receives information from the attendance manager for student registration, and transmits necessary information to the attendance management server 111 and the face recognition management server 121 for registration. Further, the attendance manager PC 131 accepts a face authentication result change operation from the attendance manager on the test result screen displayed by the attendance management server 111, and causes the attendance management server 111 to execute a manual pass / fail judgment.

The student PC 141 is a PC terminal that receives operations from the student, performs face recognition of the student, and presents necessary information to the student. The router 142 is constructed on the student network 140. It is connected to the Internet 150 via.

The student PC 141 accepts a login operation from the student to the student management server 111, and performs face recognition when transmitting a login request to the student management server 111 to authenticate the student. The student PC 141 displays the course and test contents received from the course management server 111 to the student, and sends the operation / input contents from the student to the course management server 111, but between login and logout. , Performs face authentication asynchronously and transmits the authentication information to the face authentication management server 121.

In this embodiment, each server and each PC are constructed on separate networks and connected via the Internet, but they may be constructed on the same network (for example, the same local area network). ..

FIG. 2 is a block diagram showing a hardware configuration of an information processing device applicable to the attendance management server 111, the face recognition management server 121, the attendance manager PC 131, and the student PC 141 according to the embodiment of the present invention. Since each device has the same configuration, the same reference numerals will be used for description.

As shown in FIG. 2, the course management server 111, the face authentication management server 121, the course manager PC 131, and the student PC 141 are CPU (Central Processing Unit) 201 and ROM (Read Only Memory) via the system bus 204. A configuration is adopted in which 202, a RAM (Random Access Memory) 203, an input controller 205, a video controller 206, a memory controller 207, a communication I / F controller 208, and the like are connected.
The CPU 201 comprehensively controls each device and controller connected to the system bus 204.

Further, the ROM 202 or the external memory 211 will be described later, which is necessary for realizing the functions executed by the BIOS (Basic Input / Output System) and the OS (Operating System), which are the control programs of the CPU 201, and each server or each PC. Various programs etc. are stored. In addition, information necessary for carrying out the present invention is stored. The external memory may be a database.

The RAM 203 functions as a main memory, a work area, and the like of the CPU 201. The CPU 201 realizes various operations by loading a program or the like necessary for executing the process from the ROM 202 or the external memory 211 into the RAM 203 and executing the loaded program.

The input controller 205 controls input from a pointing device such as a keyboard (KB) 209 or a mouse (not shown). The input controller 205 also controls the camera image input from the camera device 213. The student PC 141 is equipped with a Web camera or the like as a camera device and captures a camera image used for face recognition, but a separate camera device may be prepared for face recognition.

The video controller 206 controls the display on a display such as the display 210. The display may be a display such as a liquid crystal display. These are used by the administrator as needed.

The memory controller 207 is an external storage device (hard disk (HD)) for storing boot programs, various applications, font data, user files, edit files, various data, etc., a flexible disk (FD), or a PCMCIA (Personal Computer). It controls access to an external memory 211 such as a compact flash® memory connected to a Memory Card International Association card slot via an adapter.

The communication I / F controller 208 connects and communicates with an external device via the network, and executes communication control processing on the network. For example, communication using TCP / IP (Transmission Control Protocol / Internet Protocol) is possible.

The CPU 201 can display the outline font on the display 210 by executing the outline font expansion (rasterization) process on the display information area in the RAM 203, for example. Further, the CPU 201 enables a user instruction by a mouse cursor (not shown) or the like on the display 210.

Various programs described later for realizing the present invention are recorded in the external memory 211, and are executed by the CPU 201 by being loaded into the RAM 203 as needed.

Next, an example of the data table used by the attendance management system in the present embodiment will be described with reference to the data configuration diagrams of FIGS. 3 and 4.

FIG. 3 shows an example of the data structure of the table (database) managed by the attendance management server 111.

The course table 300 is a table for managing a course (course), and has a course ID and a course name. The course ID indicates an alphanumeric code that identifies the course, and the course name indicates the name of the course.

The course module table 310 is a table for managing modules (tests and lectures) related to a course, and has a course ID, a module ID, and a module type. The class ID corresponds to the class ID of the course table 300, the module ID is an alphanumeric code that identifies the module, the module type classifies the type of module, "lesson" for lectures, and "test" for tests. "Is set. In addition, contents (test data and lecture contents) are associated with each module ID.

The test table 320 is a table for managing tests, and has a test ID, a test name, and a passing score. The test ID is an alphanumeric code that identifies the test and corresponds to the module ID of the course module table 310. The test name indicates the name of the test, and the passing score indicates the minimum score for the test to be judged as passing.

The lecture table 330 is a table for managing lectures, and has a lecture ID and a lecture name. The lecture ID is an alphanumeric code that identifies the lecture and corresponds to the module ID of the course module table 310. The lecture name indicates the name of the lecture.

The attendance status table 340 is a table that manages the attendance status of each student of the module (test and lecture), and is a module ID, a student ID, a start time, an end time, a score, an attendance status, an authentication ratio, and an uncertified ratio. have. The module ID corresponds to the module ID of the course module table 310, and corresponds to the test ID of the test table 320 in the case of a test and the lecture ID of the lecture table 330 in the case of a lecture. The student ID is an alphanumeric code that identifies the student and corresponds to the student ID in the user table 360. The start time and end time indicate the start time and end time of the module, respectively. The score is the score that is the evaluation result of the test (blank in the case of a lecture), and the attendance status indicates the attendance status. "Automatic) pass", "(automatic) fail", "(manual) pass", "(manual) fail", "hold", etc. are set.

The attendance status detail table 350 is a table that manages the face recognition result for each student of the module, and has a module ID, a student ID, a start time, an end time, an authentication status, and an authenticated / unauthenticated ratio. The module ID and the student ID correspond to the module ID and the student ID of the student status table 340, respectively. The start time and end time indicate the start time and end time of the authentication state by face recognition, respectively. The authentication status is the authentication status of face recognition, and depending on the result of automatic authentication and manual correction, "(automatic) authentication", "(automatic) unauthenticated", "(manual) authentication", "(manual) unauthenticated", etc. Is set. The certified / uncertified ratio indicates the ratio of the time in the current certified state to the total attendance time of the module.

The user table 360 is a table for managing students, and has a student ID and a name. The student ID indicates an alphanumeric code that identifies the student (student code, student number, etc.), and the name indicates the student's name.

The authentication standard table 370 is a table that manages the authentication ratio that is the standard for attendance determination, and has a module type and a threshold value. The module type is the same as the module type of the course module table 310. The threshold value indicates the authentication ratio that serves as a criterion for each module type. If it is above this threshold, it is judged that the module (test and lecture) has been taken normally.

FIG. 4 shows an example of the data structure of the table (database) managed by the face authentication management server 121.

The user face image table 400 is a table that manages the face image used for the face authentication of the student, and has the student ID, the authentication source face image, and the acquisition date and time. The student ID is an alphanumeric code that identifies the student, the authentication source face image is the link destination of the face image file used for the student's face recognition, and the acquisition date and time is the date and time when the face image file was acquired.

The authentication result table 410 is a table that manages the face recognition result of the student, and has a student ID, a start time, an end time, an authentication state, and a state end. The student ID is an alphanumeric code that identifies the student, and the start time and end time indicate the start time and end time of the authentication state by face recognition, respectively. The authentication status indicates the authentication status by face recognition. Here, unlike the authentication status of the attendance status detail table 350, only the automatic face authentication status is set. The end of the state indicates whether the current authentication state has ended. If it has ended, "True" is set, and if it has not ended, "False" is set. Specifically, "True" is set when moving to another authentication state or when the application (program) is terminated, and "False" is set when the same authentication state continues.

The trail image table 420 is a table that manages trail images accumulated as a result of face authentication, and has a student ID, an image type, an acquisition date and time, and an image. The student ID is an alphanumeric code that identifies the student, the image type is the type of trail image, the "camera image" for images acquired by the camera device, and the "camera image" for snapshots of what is displayed on the display. "Screen shot" is set. The acquisition date and time indicates the date and time when the image was acquired, and the image indicates a link to the image file.

Next, the process executed by the attendance management system in the present embodiment will be described with reference to the flowcharts of FIGS. 5 to 12.

FIG. 5 is a flowchart showing an example of the overall processing flow executed by the attendance management system. Each processing step is executed by the CPU 201 of each device.

First, in order to register the students, the course administrator PC131 accepts the student registration operation from the administrator (step S531), and the course management server 111 issues the student ID and updates the user table 360 (step). S511), the face authentication management server 121 registers the face image file and updates the user face image table 400 (step S521). This process will be described later in FIG. As a result of this processing, data related to new students is registered in the user table 360 on the attendance management server and in the user face image table 400 on the face recognition management server 121.

Prior to the series of processes, in step S541, the student PC 141 requests the face recognition management server 121 for the authentication source face image, and in step S522, the student PC 141 receives the authentication source face image transmitted from the face recognition management server 121. To do. This process is executed each time necessary, such as when the user face image table 400 is updated.

In step S542, the student PC 141 receives the student login request from the login screen of FIG. 16 and transmits the login request to the student management server 111 together with the student ID and password.

In step S512, the attendance management server 111 receives the login request, authenticates the student based on the student ID and password, and executes the login process.

After the login is completed, the student PC 141 executes the face authentication process asynchronously (step S543), and the face authentication management server 121 receives and registers the trail information transmitted from the student PC 141 (step S523). This process will be described later with reference to FIGS. 7 and 8.

Next, the student PC 141 receives the test start operation from the student and executes the test (step S544). At the start of the test, the attendance management server 111 inquires of the face recognition management server 121 to confirm the authentication status of the student, provides the content for executing the test to the student PC 141, and accepts the answer (step S513). The face recognition management server 121 provides the student authentication status to the attendance management server 111 at the start of the test (step S524). This process will be described later in FIG.

When the test execution is completed, the attendance management server 111 executes an automatic pass / fail judgment based on the pass / fail criteria and the authentication criteria (step S514). The face recognition management server 121 provides the attendance management server 111 with the authentication information necessary for the automatic pass / fail judgment (step S525). This process will be described later with reference to FIG.

In step S545, the student PC 141 receives the automatic pass / fail determination result from the attendance management server 111, and displays the determination result on the test result display screen (for the examinee) as shown in FIG.

After the automatic pass / fail determination, the attendance administrator PC131 accepts the manual pass / fail determination operation from the administrator and transmits the updated content to the attendance management server 111 (step S532). The attendance management server 111 receives the update contents from the attendance manager PC 131 and re-executes the pass / fail determination (step S515). The face recognition management server 121 provides the attendance management server 111 with the authentication information necessary for the manual pass / fail determination (step S526). This process will be described later in FIG.

In step S546, the student PC 141 receives the manual pass / fail determination result from the attendance management server 111 and displays the result. On the test result display screen (for examinees) as shown in FIG. 14, the re-judgment result after the manual correction process shown in FIG. 12 is completed is displayed.

In step S547, the student PC 141 receives the logout request from the student, gives an instruction to end the face authentication process, and ends the face authentication process in step S548.

In step S516, the attendance management server 111 executes a logout process, notifies the student PC 141, and ends the process flow.

FIG. 6 is a flowchart showing the details of the student registration process (steps S531, S511, S521). Each processing step is executed by the CPU 201 of each device.

In step S631, the attendance administrator PC131 accepts the student registration operation from the administrator, transmits the student registration request together with the student name and the like to the attendance management server 111, and the attendance issued from the attendance management server 111. Receive the person ID.

In step S611, the attendance management server 111 receives the student registration request from the attendance manager PC131, issues a new student ID and sends it to the attendance manager PC131, and displays the student ID in the user table 360. Register your name.

In step S632, the attendance manager PC 131 transmits a face image registration request to the face recognition management server 121 together with the student ID and the authentication source face image provided by the student.

In step S621, the face recognition management server 121 receives the face image registration request from the attendance manager PC 131, saves the transmitted authentication source face image in a predetermined folder or the like, and stores the student in the user face image table 400. Register the ID, the link to the image, and the acquisition date and time.

FIG. 7 is a flowchart showing the details of the face recognition process (steps S543 and S523). Each processing step is executed by the CPU 201 of each device.

In step S741, the student PC 141 requests the face recognition management server 121 for the authentication source face image, and receives the authentication source face image transmitted from the face recognition management server 121.

In step S721, the face recognition management server 121 transmits the authentication source face image to the student PC 141 in response to the request from the student PC 141. The authentication source face image transmitted here may be all the images managed, the difference changed from the previous transmission, or only the image of the student who uses the student PC 141.

In step S742, the student PC 141 determines whether or not the application (program) for executing the face recognition process has been terminated. The termination process of the application may be linked to the logout of the student as in step S547, or may be executed by an individual termination command. If the application is terminated, this processing flow is terminated, and if it is not terminated, the process proceeds to step S743.

In step S743, the student PC 141 detects the current authentication status. This process will be described later in FIG.

In step S744, the student PC 141 transmits information regarding the authenticated / unauthenticated time to the face recognition management server 121.

In step S722, the face recognition management server 121 updates the start time and end time for the latest authentication status of the authentication result table 410 based on the received information on the authentication / unauthentication time.

In step S745, the student PC 141 acquires a screen shot of trail information and transmits it to the face recognition management server 121 together with the necessary information.

In step S723, the face recognition management server 121 saves the transmitted screen shot in a predetermined folder or the like, and registers the student ID, the image type = "screen shot", and the save destination link in the trail image table 420. ..

In step S746, the student PC 141 acquires the camera image which is the trail information and transmits it to the face recognition management server 121 together with the necessary information.

In step S724, the face recognition management server 121 saves the transmitted camera image in a predetermined folder or the like, and registers the student ID, the image type = "camera image", and the save destination link in the trail image table 420. ..

The student PC 141 repeats the processes from step S743 to step S746 at predetermined time intervals until it is determined that the application has been terminated in step S742. Further, in the present embodiment, the trail information is always transmitted at predetermined time intervals in steps S745 and S746, but only when the authentication status changes or when the time interval for transmission is set and transmitted. May be good.

FIG. 8 is a flowchart showing the details of the authentication state detection process (step S743). Each processing step is executed by the CPU 201 of the student PC 141.

In step S801, the student PC 141 detects the student's face from the image captured by the connected camera device and authenticates the student's face.

The authentication is performed by comparing the photographed face with the pre-registered authentication source face image and determining whether or not the similarity satisfies a predetermined standard.

In step S802, the student PC 141 detects the current student authentication status from the captured video. In this embodiment, the current student authentication status is either "authenticated" or "unauthenticated".

The "authentication" state means that the face of the student's self-confidence is normally detected in the captured image. In addition, the "unauthenticated" state means a state in which the student's own face is not normally detected from the captured video.

In step S803, the student PC 141 determines whether the current student authentication status detected in step S802 is "authenticated" or "unauthenticated". If it is "authentication", the process proceeds to step S804. If it is "unauthenticated", the process proceeds to step S807.

In step S804, the student PC 141 determines whether or not the state has changed since the last authentication state was detected. That is, since the authentication status this time is "authentication", if the immediately preceding authentication status is "authentication", the status is unchanged, and if it is "unauthenticated", the status is changed. If there is a change in the state, step S806 is executed, and if there is no change in the state, step S805 is executed to end this processing flow.

Since the status of the student PC 141 has not changed in step S805, the recording of the "authentication" status is continued. That is, in response to this result, the face recognition management server 121 updates the end time of the latest registered authentication status (registered as "authentication") in the authentication result table 410 with the current authentication time in step S722. It will be.

In step S806, since the status of the student PC 141 was changed from "unauthenticated" to "authenticated", the recording of the "unauthenticated" status is terminated and the recording of the "authenticated" status is newly started. .. That is, in response to this result, the face recognition management server 121 updates the end time of the latest registered authentication status (registered as "unauthenticated") in the authentication result table 410 with the current authentication time in step S722. Then set the end of state to "True". Furthermore, the latest authentication status is newly registered as "authentication", the current authentication time is set for the start time and end time, and the status end is set to "False". This indicates that the "unauthenticated" state has ended and the "authenticated" state has started.

In step S807, the student PC 141 determines whether or not the state has changed since the last time the authentication state was detected. That is, since the authentication status this time is "unauthenticated", if the immediately preceding authentication status is "unauthenticated", the status is not changed, and if it is "authenticated", the status is changed. If there is a change in the state, step S809 is executed, and if there is no change in the state, step S808 is executed to end this processing flow.

In step S808, since the status of the student PC 141 has not changed, the recording of the “unauthenticated” status is continued. That is, in response to this result, the face recognition management server 121 updates the end time of the latest registered authentication status (registered as "unauthenticated") in the authentication result table 410 with the current authentication time in step S722. Will be done.

In step S809, since the status of the student PC 141 has been changed from "authenticated" to "unauthenticated", the recording of the "authenticated" status is terminated and the recording of the "unauthenticated" status is newly started. .. That is, in response to this result, the face recognition management server 121 updates the end time of the latest registered authentication status (registered as "authentication") in the authentication result table 410 with the current authentication time in step S722. , Set the state end to "True". Furthermore, the latest authentication status is newly registered as "unauthenticated", the current authentication time is set for the start time and the end time, and the status end is set to "False". This indicates that the "authenticated" state has ended and the "unauthenticated" state has started.

FIG. 9 is a flowchart showing the details of the test execution process (steps S544, S513, S524). Each processing step is executed by the CPU 201 of each device.

In step S941, the student PC 141 displays the test list screen of FIG. 17 and accepts the test selection, displays the test start screen of FIG. 18 and accepts the press of the test start button, whereby the test ID (module) The test start request is transmitted to the attendance management server 111 together with the ID) and the student ID.

In step S911, the attendance management server 111 receives the test start request from the student PC 141 and transmits the acquisition request of the current authentication information to the face recognition management server 121. At this time, the current time and user ID are transmitted.

In step S921, the face recognition management server 121 receives the current authentication information acquisition request.

In step S922, the face recognition management server 121 determines the current authentication state, that is, "authentication" or "unauthenticated". This process will be described later in FIG.

In step 523, the face recognition management server 121 transmits the determination result in step S922 to the attendance management server 111 as the current authentication information.

In step S912, the attendance management server 111 determines whether the current authentication status is "authenticated" or "unauthenticated" based on the transmitted authentication information. In the case of "unauthenticated", the test cannot be started, so the result is notified to the student PC 141, and the test is executed again from step S941. In the case of "authentication", the process proceeds to step S913.

In step S913, the attendance management server 111 transmits the test contents (test question display screen, answer selection screen, etc.) corresponding to the transmitted test ID to the student PC 141.

In step S942, the student PC 141 presents the test content, receives the test answer from the student, and receives the press of the end button from the test end screen of FIG. 19, thereby receiving the test answer from the attendance management server. Send to 111.

In step S914, the attendance management server 111 receives the test answer, registers it in the test answer table (not shown), and records the corresponding module ID, the start time, and the end time of the student ID in the attendance status table 340. To do.

FIG. 10 is a flowchart showing the details of the current authentication status determination process (step S922). Each processing step is executed by the CPU 201 of the face authentication management server 121.

In step S1001, the face recognition management server 121 acquires the latest authentication result corresponding to the student ID from the authentication result table 410, and determines the latest authentication status. If the latest authentication status is "authentication", the process proceeds to step S1002, and if it is "unauthenticated", the process proceeds to step S1004.

In step S1002, the face recognition management server 121 determines the end of the state of the latest acquired authentication result. If the state end of the latest authentication result is "False", the process proceeds to step S1003, and if it is "True", the process proceeds to step S1004. The state termination of the latest authentication result is "True" mainly when the face authentication application (program) is terminated.

In step S1003, the face recognition management server 121 determines the elapsed time from the end time of the latest authentication result to the present time. That is, the validity of the authentication state is determined based on the elapsed time from the time last determined as "authentication". If it is within the preset predetermined time range, it is determined that the "authentication" state is continued, and the process proceeds to step S1005. If the predetermined time range is exceeded, it is determined that a system malfunction or the like has occurred. Then, the process proceeds to step S1004.

In step S1004, the face recognition management server 121 sets the current authentication state to "unauthenticated" and ends the processing flow.

In step S1005, the face recognition management server 121 sets the current authentication state to "authentication" and ends the processing flow.

FIG. 11 is a flowchart showing the details of the automatic pass / fail determination process (step S514). Each processing step is executed by the CPU 201 of each device.

In step S1111, the attendance management server 111 scores the test answers received from the student PC 141 based on the correct answer data (not shown). The scores of the corresponding module ID and student ID in the attendance status table 340 are updated according to the scored scores.

In step S1112, the attendance management server 111 determines whether or not the scored score is equal to or higher than the passing score of the corresponding module ID in the test table 320. If it is above the passing score, the process proceeds to step S1113, and if it is below the passing score, the process proceeds to step S1117.

In step S1113, the attendance management server 111 transmits to the face recognition management server 121 a request for acquiring the corresponding module ID of the attendance status table 340 and the authentication time information between the start time and the end time of the student ID.

In step S1121, the face recognition management server 121 receives the authentication time information acquisition request from the course management server 111 together with the student ID, the start time, and the end time.

In step S1122, the face recognition management server 121 extracts the authentication result between the received start time and the end time for the corresponding student ID from the authentication result table 410, and the authentication time information (start time, End time, time ratio) are totaled.

In step S1123, the face recognition management server 121 transmits the authentication time information aggregated for each authentication time to the attendance management server 111.

Subsequently, the attendance management server 111 sets the start time, end time, and the corresponding module ID and student ID of the attendance status detail table 350 for each authentication state based on the authentication time information received by the face recognition management server 121. Register the authentication status and the certified / unauthenticated ratio. Further, the attendance management server 111 calculates the total of the corresponding module ID and the student ID of the attendance status detail table 350, the authentication ratio, and the unauthenticated ratio, and calculates the total of the corresponding module ID and the student ID of the attendance status table 340. , Register the unauthenticated rate.

In step S1114, the attendance management server 111 determines whether or not the authentication ratio of the corresponding module ID and student ID of the attendance status table 340 is equal to or greater than the threshold value of the corresponding module type (here, "test") of the authentication standard table 370. to decide. If it is equal to or more than the threshold value, the process proceeds to step S1115, and if it is less than the threshold value, the process proceeds to step S1116.

In step S1115, the attendance management server 111 determines that the test pass / fail result is passed because both the score and the authentication ratio satisfy the pass criteria, and sets the attendance status of the corresponding module ID and student ID in the attendance status table 340. Set to "(automatic) pass" and end the processing flow.

In step S1116, the attendance management server 111 withholds the test pass / fail judgment because the score meets the pass criteria but the authentication ratio does not meet the pass criteria, and the corresponding module ID and student ID of the attendance status table 340. Set the attendance status to "Hold" and end the processing flow.

In step S1117, the attendance management server 111 determines that the test pass / fail result is rejected because the score does not meet the pass criteria, and sets the attendance status of the corresponding module ID and student ID in the attendance status table 340 to "(automatic). ) Set to "Fail" and end the processing flow.

FIG. 12 will be described.

On the display terminal (for the administrator) in S1201, the correction button for the pass / fail judgment on the test result list display screen (for the administrator) is pressed by the administrator, and the attendance management server is linked to the examinee ID and the test name ID. Send instructions to display the test results that are on hold.

In S1202, the attendance management server receives the test result display instruction from the display terminal (for the administrator), and the contents of the test result display screen (for the administrator) are displayed on the display terminal (for the administrator). So that various display items displayed on the test result display screen (for managers) are acquired from each database (attendance status table 340) and placed on the test result display screen (for managers). Display control.

The pass / fail judgment (attendance status) 1301 associated with the examinee ID and the test name ID at the time of holding is acquired from the database of the attendance management server (attendance status table 340) and placed in the test result display screen (for the administrator). ..

The test score (score) 1302 associated with the examinee ID and the test name ID is acquired from the database (attendance status table 340) of the attendance management server and arranged in the test result display screen (for the administrator).

The authentication ratio (total) 1303 at the time of holding associated with the examinee ID and the test name ID is acquired from the database (attendance status table 340) of the attendance management server and arranged in the examination result display screen (for the administrator).

The authentication / unauthenticated ratio (authentication / unauthenticated ratio) 1307 associated with the examinee ID and test name ID at the time of hold is acquired from the database of the attendance management server (attendance status detail table 350) and the test result display screen (administrator). (For) is placed inside.

In S1203, the attendance management server transmits a request for acquiring the authentication source image associated with the examinee ID and the test name ID to the face recognition management server, and acquires the corresponding authentication source image from the face recognition management server.

In S1204, the face recognition management server searches the database (user face image table 400) for the authentication source image (authentication source face image) associated with the examinee ID and the test name ID, and uses the searched authentication source image as the attendance management server. Send.

In S1205, the attendance management server arranges the authentication source face image 1310 acquired from the face recognition management server on the test result display screen (for the administrator).

In S1206, the attendance management server transmits a time zone associated with the examinee ID and the test name ID and a face authentication acquisition request to the face recognition management server, and acquires the corresponding time zone from the face recognition management server.

In S1207, the face recognition management server searches the database (authentication result table 410) for the time zone (start time and end time) and face recognition (authentication status) associated with the examinee ID and the test name ID, and the searched time zone. And send face recognition to the attendance management server.

In S1208, the attendance management server arranges the time zone 1305 and the face authentication 1306 acquired from the face recognition management server on the test result display screen (for the administrator).

In S1209, the attendance management server transmits a request for acquiring a snapshot image associated with the examinee ID and the test name ID to the face recognition management server, and acquires the corresponding snapshot image from the face recognition management server.

In S1210, the face recognition management server searches the database (trail image table 420) for the snapshot image (screen shot) associated with the examinee ID and the test name ID, and transmits the searched snapshot image to the attendance management server.

In S1211, the attendance management server arranges the snapshot image 1308 acquired from the face recognition management server on the test result display screen (for the administrator).

In S1212, the attendance management server transmits a request for acquiring a face recognition image associated with the examinee ID and the test name ID to the face recognition management server, and acquires the corresponding face recognition image from the face recognition management server.

In S1213, the face recognition management server searches the database (trail image table 420) for the face recognition image (camera image) associated with the examinee ID and the test name ID, and transmits the searched face recognition image to the attendance management server.

In S1214, the attendance management server arranges the face authentication image 1309 acquired from the face recognition management server on the test result display screen (for the administrator).

In S1215, the display terminal (for the administrator) has the face in the time zone in which the pull-down of the face authentication 1306 on the test result list display screen (for the administrator) is manually corrected by the administrator and manually corrected for the attendance management server. Send an instruction to change the authentication.

In S1216, the attendance management server receives the pull-down candidates manually corrected by the administrator and the time zone, and is related to the display contents of the face authentication 1306 on the test result list display screen (for the administrator) and the change results thereof. Control to change the authentication ratio (total) and the displayed value of authenticated / unauthenticated.

In S1217, the attendance management server recalculates the authentication ratio (total) from the pull-down candidates after manual correction received in S1216 and the time zone, so that the authentication ratio (total) 1303 at the time of holding can be obtained. , Re-determine whether or not the acceptance condition, which is the threshold value, is satisfied.

Since the attendance management server in S1218 does not yet meet the pass conditions for the authentication rate (total) recalculated in S1217, the content of the pass / fail judgment 1301 at the time of hold is displayed so that (manual) fail is displayed. change.

Since the authentication ratio (total) recalculated in S1217 satisfies the pass condition, the attendance management server in S1219 changes the content of the pass / fail judgment 1301 at the time of holding so that the (manual) pass is displayed.

On the display terminal (for the administrator) in S1220, the save button 1311 on the test result list display screen (for the administrator) is pressed by the administrator, and the database of the attendance management server is manually corrected after recalculation. A test result update instruction (or registration instruction) such as pass / fail judgment 1301, face authentication 1306, authentication / non-authentication ratio 1307, authentication ratio (total) 1303, and authentication ratio 1304 is transmitted.

In S1221, the attendance management server outputs test results and values such as pass / fail judgment 1301, face authentication 1306, authentication / unauthentication ratio 1307, authentication ratio (total) 1303, authentication ratio 1304, etc. after update instruction and manual correction after recalculation. Updating or registering in the database On the display terminal (for the administrator) in S1222, the contents of the test result display screen (for the administrator) newly registered in S1221 as shown in FIG. 13 can be viewed.

FIG. 13 will be described.

In FIG. 13, the administrator confirms the automatic judgment of face recognition during the test for each test result, and the test score meets the pass criteria, but the reason why the automatic face recognition judgment does not meet the pass criteria. This is a test result display screen (for the administrator) for the administrator to correct the final pass / fail judgment of the test result for which the pass / fail result of the test is temporarily suspended.

The test result display screen (for the administrator) is displayed on the Web browser of the client terminal (for the administrator) 131.

Each item displayed on the test result display screen (for the administrator) will be explained.

The pass / fail judgment 1301 is the final pass / fail judgment of the test result after the manager corrects it. In the final pass / fail judgment, one of pass and fail is displayed.

Pass is displayed in the test result that finally meets the predetermined pass criteria in terms of both the test score and the certification ratio (total).

Only the test score meets the predetermined pass criteria, but the certification rate is finally displayed in the test results that do not meet the predetermined pass criteria.

The test score 1302 is a score in the test. For example, the number of points out of 100 points and the number of correct answers out of 30 questions are displayed.

When the passing condition of the test score is set to 80 points out of 100 points, the passing condition is satisfied when the test score is 87 points.

The certification rate (total) 1303 displays the total certification rate in the automatic determination and manual correction in which it is finally confirmed that the examinee himself / herself was taking the test within the test time as a 100-minute rate.

When the pass condition of the certification ratio (total) is set to 70% out of 100%, the pass condition is satisfied when the certification ratio (total) is 71%.

After that, when the administrator manually corrects the automatic judgment of face recognition, the authentication ratio (total) also changes according to the correction result.

The authentication ratio 1304 shows the ratio automatically determined by face recognition as the examinee and the ratio manually corrected by the administrator by the pull-down of face recognition as the examinee in 100%. doing.

In this embodiment, 65% is automatically determined to be the examinee by face recognition, and 6% is manually corrected by the administrator to be the examinee by pulling down the face recognition. Can be confirmed. According to the correction result by the administrator, the certification ratio (total) becomes 71%, and finally the pass condition is satisfied, and the pass / fail judgment is passed.

The time zone 1305 is either the time zone (first time zone) automatically determined by the face recognition unit to be the examinee within the examination time, or the time zone 1305 is automatically determined not to be the examinee by the face recognition unit. Each time zone is displayed so that the time zone (second time zone) can be confirmed.

In this embodiment, since the examinee is shown between 16:02:37 and 16:15:20, the face recognition unit automatically determines that the examinee is the examinee (authentication). is there.

In this embodiment, since the examinee is not shown at all between 16:15:20 and 16:25:31, the face recognition unit automatically determines that the examinee is not the examinee (unauthenticated). Is.

In this embodiment, since the examinee is shown between 16:25:31 and 16:35:02, the time zone automatically determined by the face recognition unit to be the examinee (authentication). is there.

In this embodiment, the examinee is shown between 16:35:02 and 16:37:16, but the examinee is not the examinee himself / herself in the face recognition section because the examinee's face is not oriented properly (not yet). It is a time zone that is automatically determined as (authentication).

The face recognition 1306 corresponds to each time zone of the first time zone or the second time zone, and is the personal authentication result during the final test time that can be manually corrected by the administrator to be authenticated or unauthenticated.

The administrator can manually select one of the four pull-down candidates, (automatic) authentication, (automatic) unauthenticated, (manual) authentication, and (manual) unauthenticated, and switch to each. ..

Among the pull-down candidates, (automatic) unauthenticated indicates that it is an automatic unauthenticated result.

Among the pull-down candidates, (manual) authentication indicates that it is the manual authentication receiving unit. The user can correct the pull-down candidate from (automatic) unauthenticated to (manual) authentication by the manual authentication receiving unit.

Among the pull-down candidates, (automatic) authentication indicates that it is the automatic authentication result.

Among the pull-down candidates, (manual) unauthenticated indicates that it is a manual unauthenticated reception unit. The user can correct the pull-down candidate from (automatic) authentication to (manual) unauthenticated by the manual unauthenticated reception unit.

(Automatic) authentication is automatically displayed when the face recognition unit automatically determines that the examinee is the person himself / herself.

(Automatic) unauthenticated is automatically displayed when the face recognition unit automatically determines that the examinee is not the examinee.

The (manual) authentication is switched and displayed when the administrator manually corrects and selects the examinee himself / herself as a result of visually checking the face authentication image showing the examinee.

(Manual) Unauthenticated is displayed by switching when the administrator visually checks the face recognition image showing the examinee and manually corrects and selects the person who is not the examinee himself / herself.

The certified / unauthenticated ratio 1307 corresponds to each time zone of the first time zone or the second time zone.

As the certified / uncertified ratio, the certified ratio with respect to the test time in the first time zone and the uncertified ratio with respect to the test time in the second time zone are displayed, respectively. The test time of this example is between 16:02:37 and 16:37:16.

When the administrator selects (manual) authentication, it means the authentication ratio to the examination time in the time zone manually corrected to be the examinee himself / herself.

Similarly, if the administrator chooses (manual) unauthenticated, it means the unauthenticated ratio to the test time in the manually corrected time zone if the examinee is not the examinee himself / herself.

The snapshot image 1308 corresponds to each time zone of the first time zone or the second time zone.

In this embodiment, the period from 16:02:37 to 16:15:20 is the time zone in which the face recognition unit automatically determines that the examinee is the examinee himself / herself. This is trail data for certifying the display contents of the screen such as a screenshot of the screen acquired when it is automatically determined.

Similarly, in this embodiment, the period from 16:15:20 to 16:25:31 is a time zone in which the face recognition unit automatically determines that the examinee is not the examinee himself / herself. It is trail data for certifying the display contents of the screen such as a screen shot of the screen acquired when it is automatically determined that it is not.

In addition, a plurality of trail data when it is determined that the examinee is the examinee is acquired in the first time zone, and the trail data when it is determined that the examinee is not the examinee is acquired in the second time zone. You may acquire a plurality of sheets.

By displaying the trail data in association with the first time zone or the second time zone, respectively, the test screen can be displayed on the examinee's client in the first time zone or the second time zone. It is possible to show the administrator the trail data that can confirm whether it was displayed properly on the terminal.

Further, not only the trail data acquired immediately after the automatic judgment by the face recognition unit is displayed, but also the trail data is periodically acquired after a predetermined time has passed after the automatic judgment by the face recognition unit, and a plurality of sheets are obtained. By displaying it, the administrator can be shown trail data that can confirm in more detail whether the test screen was properly displayed on the examinee's client terminal in the first time zone or the second time zone. Can be done.

The face recognition image 1309 corresponds to each time zone of the first time zone or the second time zone.

In this embodiment, the period from 16:02:37 to 16:15:20 is the time zone in which the face recognition unit automatically determines that the examinee is the examinee himself / herself. It is an image including the examinee who was actually automatically judged as.

Similarly, in this embodiment, the period from 16:15:20 to 16:25:31 is a time zone in which the face recognition unit automatically determines that the examinee is not the examinee himself / herself. Otherwise, it is an image that does not include the examinee who was actually automatically determined.

Similarly, in this embodiment, the period from 16:35:02 to 16:37:16 is a time zone in which the face recognition unit automatically determines that the examinee is not the examinee himself / herself. Otherwise, it is an image that includes the examinee who was actually automatically determined, but the face is not facing the front.

By displaying the images actually automatically determined in this way in association with the first time zone or the second time zone, respectively, there is no doubt that the first time zone or the second time zone will be displayed. It is possible to show the administrator the image data that can confirm whether it is automatically determined. The administrator can see this confirmable image data and correct the final result of authentication / unauthentication.

Furthermore, by leaving image data that can confirm whether it was definitely automatically judged, it can also be used as a trail when the examinee inquires whether it was properly automatically judged by the face recognition unit during the test period. is there.

In addition, a plurality of image data capable of confirming whether or not the image was automatically determined was acquired in the first time zone, and a plurality of image data capable of confirming whether or not the image was automatically determined were acquired in the second time zone. You may get the number of sheets. In this way, if there are a plurality of image data that can be confirmed whether the judgment is automatic, the change in the orientation of the examinee's face in each time zone of the first time zone or the second time zone can be confirmed in detail. Can be acknowledged.

That is, the period from 16:35:02 to 16:37:16 is a time zone in which the face authentication unit automatically determines that the examinee is not the examinee, but includes the examinee who has been authenticated by the face authentication unit. By displaying the images side by side, this time zone is the time when I was thinking about the answer by looking in the other direction all the time, not some kind of violation such as absence, but from 16:35:02 to 16:37. For 16 seconds, the administrator can easily confirm from the image data that can confirm whether or not the automatic determination was made by mistake in the face authentication unit if the examinee was not the examinee himself / herself.

In addition, the period from 16:15:20 to 16:25:31 is a time zone automatically determined by the face recognition unit to be not the examinee himself, but due to the absence of the examinee himself, 16:15. From minutes 20 seconds to 16:25:31, the administrator can easily confirm that the face recognition unit correctly and automatically determines that the examinee is not the examinee himself / herself.

Further, not only the image data automatically determined by the face recognition unit is displayed, but also the image data for confirming the presence of the examinee is periodically acquired after a predetermined time has passed after the automatic determination by the face recognition unit. By displaying a plurality of images, the administrator can be informed in detail that the face recognition unit has correctly and automatically determined that the image is not the examinee in the first time zone or the second time zone. I can show you.

The authentication source face image 1310 is a master image registered in advance for each examinee in order for the face recognition unit to automatically determine the examinee himself / herself.

This master image is an image prepared by the examinee at the time of application for the examination and registered for the examination.

By displaying the master image and the image data automatically determined by the face recognition unit side by side in a comparable manner, it is possible to confirm whether the face recognition is properly automatically determined.

In other words, when the master image is not displayed, even if only the image data automatically determined by the face recognition unit is viewed, the master image itself is an image in which it is difficult for the face recognition unit to extract the feature amount for automatically determining the examinee. In addition, it is not possible to easily confirm whether or not unauthenticated frequently occurs in the automatic judgment by the face recognition unit due to incorrect authentication.

Further, by displaying the master image, the administrator can easily confirm whether the face recognition is automatically determined based on the same examination photograph or the like by comparing with the examination photograph or the like of the examinee. You can also check whether the master image has been replaced illegally.

The save button 1311 is an operation button for registering the final pass determination after the administrator manually corrects it in the database.

When the save button is pressed, the latest corrections displayed on the screen are sent to the database and registered in the database.

The button 1312 that ends without saving is a cancel button for ending the screen operation without registering the final pass determination after the administrator manually corrects it in the database.

If the Exit button is pressed without saving, the latest corrections displayed on the screen will not be sent to the database and the database will not be updated.

FIG. 14 will be described.

FIG. 14 shows the test results of the case where the pass / fail result of the test was temporarily suspended because the test score met the pass criteria, but the automatic face recognition judgment did not meet the pass criteria. This is the test result display screen (for examinees).

This test result display screen (for the examinee) is displayed on the Web browser of the examinee client terminal 141.

Each item displayed on the test result display screen (for examinees) will be explained.

The pass / fail judgment 1301 is the final pass / fail judgment of the test result of the examinee. In the final pass / fail judgment, one of pass, hold, and fail is displayed.

Pass is displayed in the test result that finally meets the predetermined pass criteria in terms of both the test score and the certification ratio (total).

Only the test score meets the predetermined pass criteria, but the certification rate is finally displayed in the test results that do not meet the predetermined pass criteria.

Failure is displayed in the test results where the test score does not meet the prescribed passing criteria.

The test score 1402 is a score in the test. For example, the number of points out of 100 points and the number of correct answers out of 30 questions are displayed.

When the passing condition of the test score is set to 80 points out of 100 points, the passing condition is satisfied when the test score is 87 points.

The certification rate 1403 displays the certification rate at which it is automatically determined that the examinee himself / herself was taking the test within the test time in 100%.

If the pass condition of the certification rate is set to 70% out of 100%, it means that the pass condition is not satisfied when the certification rate is 65%. Therefore, in the case of this examinee, the test result is put on hold, and the final pass / fail judgment is made after the administrator confirms the correction.

The time zone 1404 is either a time zone (first time zone) automatically determined by the face recognition unit to be present within the test time, or it is automatically determined by the face recognition unit to be away from the desk. Each time zone is displayed so that the time zone (second time zone) can be confirmed.

In this embodiment, since the examinee is shown between 16:02:37 and 16:15:20, the time zone when the face recognition unit automatically determines that the examinee is present (authentication). is there.

In this embodiment, since the examinee is not shown at all between 16:15:20 and 16:25:31, the time automatically determined by the face recognition unit to be away (unauthenticated). It is a belt.

In this embodiment, since the examinee is shown between 16:25:31 and 16:35:02, the time automatically determined by the face recognition unit to be present (authentication). It is a belt.

In this embodiment, the examinee is shown between 16:35:02 and 16:37:16, but the examinee is away from the seat at the face recognition unit because the examinee's face is not oriented properly ( It is a time zone that is automatically determined as (unauthenticated).

The face recognition 1405 corresponds to each time zone of the first time zone or the second time zone, and is the result of the examinee's presence / absence during the examination time.

The presence is automatically displayed when the face recognition unit automatically determines that the person is present.

The absenteeism is automatically displayed when the face recognition unit automatically determines that the person is absent.

The certified / uncertified ratio 1406 corresponds to each time zone of the first time zone or the second time zone.

As the certified / uncertified ratio, the certified ratio with respect to the test time in the first time zone and the uncertified ratio with respect to the test time in the second time zone are displayed, respectively.

The snapshot image 1407 corresponds to each time zone of the first time zone or the second time zone.

In this embodiment, the period from 16:02:37 to 16:15:20 is a time zone in which the face recognition unit automatically determines that the person is present, and the face recognition unit automatically determines that the person is present. It is trail data for certifying the display contents of the screen such as a screenshot of the screen acquired when the judgment is made.

Similarly, in this embodiment, the period from 16:15:20 to 16:25:31 is a time zone in which the face recognition unit automatically determines that the person is away from the seat, and the face recognition unit is away from the seat. It is trail data for certifying the display contents of the screen such as a screenshot of the screen acquired when it is automatically determined to be present.

In addition, a plurality of trail data when it is determined to be present may be acquired in the first time zone, or trail data when it is determined to be away from the seat may be acquired in the second time zone. You may acquire a plurality of sheets.

By displaying the trail data in association with the first time zone or the second time zone, respectively, the test screen can be displayed on the examinee's client in the first time zone or the second time zone. It is possible to show the examinee the trail data that can confirm whether it was displayed properly on the terminal.

Further, not only the trail data acquired immediately after the automatic judgment by the face recognition unit is displayed, but also the trail data is periodically acquired after a predetermined time has passed after the automatic judgment by the face recognition unit, and a plurality of sheets are obtained. By displaying it, the examinee can be shown trail data that can confirm in more detail whether the examination screen was properly displayed on the examinee's client terminal in the first time zone or the second time zone. Can be done.

The face recognition image 1408 corresponds to each time zone of the first time zone or the second time zone.

In this embodiment, the period from 16:02:37 to 16:15:20 is the time zone in which the face recognition unit automatically determines that the person is present, and the face recognition unit actually determines that the person is present. It is an image including the examinee who was automatically judged in.

Similarly, in this embodiment, the period from 16:15:20 to 16:25:31 is a time zone in which the face recognition unit automatically determines that the person is away from the seat, and the face recognition unit is away from the seat. It is an image that does not include the examinee who was actually automatically determined to be present.

Similarly, in this embodiment, the period from 16:35:02 to 16:37:16 is a time zone in which the face recognition unit automatically determines that the person is away from the seat, and the face recognition unit is away from the seat. This is an image that includes the examinee who was actually automatically determined to be present, but the face is not facing the front.

By displaying the images actually automatically determined in this way in association with the first time zone or the second time zone, respectively, there is no doubt that the first time zone or the second time zone will be displayed. It is possible to show the examinee the image data that can confirm whether the judgment is automatically made.

Furthermore, by leaving image data that can confirm whether it was definitely automatically judged, it can also be used as a trail when asking the administrator whether it was properly automatically judged by the face recognition unit during the test period. ..

In addition, a plurality of image data capable of confirming whether or not the image was automatically determined was acquired in the first time zone, and a plurality of image data capable of confirming whether or not the image was automatically determined were acquired in the second time zone. You may get the number of sheets. In this way, if there are a plurality of image data that can be confirmed whether the judgment is automatic, the change in the orientation of the examinee's face in each time zone of the first time zone or the second time zone can be confirmed in detail. Can be acknowledged.

That is, the period from 16:35:02 to 16:37:16 is the time zone automatically determined by the face recognition unit to be away from the desk, but includes the examinee who has been authenticated by the face recognition unit. By displaying the images side by side, this time zone is the time when I was thinking about the answer by looking in the other direction all the time, not some kind of violation such as absence, but from 16:35:02 to 16:37. For 16 seconds, the examinee can easily confirm from the image data that can confirm whether the automatic determination is made by the face authentication unit by mistake if he / she is not the examinee himself / herself.

In addition, the period from 16:15:20 to 16:25:31 is the time zone automatically determined by the face recognition unit to be away from the desk, but due to the absence of the examinee himself, 16:15. From minutes 20 seconds to 16:25:31, the examinee can easily confirm that the face recognition unit has correctly and automatically determined that he / she is away from his / her seat.

Further, not only the image data automatically determined by the face recognition unit is displayed, but also the image data for confirming the presence of the examinee is periodically acquired after a predetermined time has passed after the automatic determination by the face recognition unit. By displaying a plurality of images, the examinee can be provided with image data in which it is possible to confirm in detail that the face recognition unit correctly and automatically determines that the examinee is not the examinee in the first time zone or the second time zone. I can show you.

The authentication source face image 1409 is a master image registered in advance for each examinee in order for the face recognition unit to automatically determine the examinee himself / herself.

By displaying the master image and the image data automatically determined by the face recognition unit side by side, it is possible to confirm whether the face recognition is properly automatically determined.

In other words, when the master image is not displayed, even if only the image data automatically determined by the face recognition unit is viewed, the master image itself is an image in which it is difficult for the face recognition unit to extract the feature amount for automatically determining the examinee. In addition, it is not possible to easily confirm whether or not unauthenticated frequently occurs in the automatic judgment by the face recognition unit due to incorrect authentication.

Furthermore, by displaying the master image, the examinee can easily confirm whether the face recognition is automatically determined based on the same examination photograph or the like by comparing with the examination photograph or the like of the examinee. You can also check whether the master image has been replaced illegally.

FIG. 15 will be described.

FIG. 15 shows a test result list display screen (for managers) in which the administrator selects from a list the test results of the examinees whose pass / fail results have been put on hold from all the test results that have taken the intermediate test in Japanese. ).

The test result list display screen (for the administrator) is displayed on the Web browser of the client terminal (for the administrator) 131.

In addition, in the test results of the intermediate test in Japanese, the test results that passed or failed are not displayed, but only the pending test results are displayed on the test result list display screen (for managers). There is no problem.

The course name 1501 identifies the name of the course taken, and displays the course name, course ID, and the like.

The test name 1502 identifies the content of the test taken, and displays the test name, test ID, and the like.

The test examinee 1503 identifies the examinee, and the examinee name, the examinee ID, and the like are displayed.

The test score 1504 indicates the test score of the test participant.

The certification ratio 1505 indicates the ratio automatically determined to be present by the face recognition unit during the test time.

The pass / fail judgment 1506 is a pass / fail result of the test participants. From the results of both the test score and the certification rate, one of pass, hold, and fail is automatically displayed.

The pass / fail determination correction 1507 is a forward button for screen transition to the test result display screen (for the administrator) in which the administrator corrects the final pass / fail determination of the temporarily suspended test result. The forward button is automatically displayed only for the temporarily held test results.

FIG. 16 will be described.

FIG. 16 is a login screen for the examinee to log in to the training system.

This login screen is displayed on the Web browser of the examinee's client terminal 141.

The student ID 1601 is an input field in which the examinee manually inputs the examinee ID and the like in order to manage the examinee who logs in to the training system.

The password 1602 is an input field in which the examinee manually inputs the password for each examinee in order to manage the password for logging in to the training system.

The login button 1603 is a button for transmitting login information to the training system after the examinee manually inputs the examinee ID and password. After pressing this button, login authentication is performed, and each examinee can start an examination (intermediate test in Japanese, etc.) by e-learning.

FIG. 17 will be described.

FIG. 17 is a test list screen in which the examinee selects a test to be taken from the list after the examinee logs in to the training system.

This test list screen is displayed on the Web browser of the examinee's client terminal 141.

The intermediate test button 1701 is a button for selecting the test name to be taken from the test list. By pressing this intermediate test button, for example, the intermediate test of the national language is selected, and the screen transitions to the test name screen of the intermediate test of the national language.

FIG. 18 will be described.

FIG. 18 is a test start screen for the examinee to start the test of, for example, an intermediate test in a Japanese language after the examinee selects a test name to be taken on the test list screen.

By pressing the test start button 1801, for example, the test for the intermediate test in Japanese is started, the screen is changed to the intermediate test screen in Japanese (not shown), and the student takes a large number of examination questions.

Further, the test start time is registered in the database in conjunction with the pressing of the test start button.

FIG. 19 will be described.

FIG. 19 is a test end screen for the examinee to answer all the tests of the national language mid-term test and finish the test of the national language mid-term test after starting the test of the national language mid-term test on the test start screen. ..

By selecting the answer radio button 1901 by the user, for example, the answer to the test question No. 10 of the mid-term test in a national language is completed.

By pressing the button 1902 on the previous page, for example, the screen for answering the test question No. 9 of the mid-term test in Japanese will be returned.

By pressing the answer transmission button 1903, for example, the answer of the test of the mid-term test of the national language is completed, and the answer result of the mid-term test of the national language is transmitted to the database. The test score will be automatically scored according to the answer result of the intermediate test in the national language sent here, and the test score will also be registered in the database.

Furthermore, the test end time is registered in the database in conjunction with the pressing of the response transmission button.

Although one embodiment has been described above, the present invention can take an embodiment as, for example, a system, an apparatus, a method, a program, a recording medium, or the like, and specifically, is composed of a plurality of devices. It may be applied to a system or a device consisting of one device.

Further, the program in the present invention is a program in which a computer can execute the processing method of the flowchart shown in each figure, and the storage medium of the present invention stores a program in which the computer can execute the processing method in each figure. The program in the present invention may be a program for each processing method of each device in each figure.

As described above, the recording medium on which the program that realizes the functions of the above-described embodiment is recorded is supplied to the system or the device, and the computer (or CPU or MPU) of the system or the device stores the program in the recording medium. Needless to say, the object of the present invention can be achieved by reading and executing.

In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium storing the program constitutes the present invention.

Recording media for supplying programs include, for example, flexible disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, CD-Rs, DVD-ROMs, magnetic tapes, non-volatile memory cards, ROMs, EEPROMs, and silicon. Disks, solid state drives, etc. can be used.

Further, by executing the program read by the computer, not only the function of the above-described embodiment is realized, but also the OS (operating system) or the like running on the computer is actually operated based on the instruction of the program. Needless to say, there are cases where a part or all of the processing is performed and the processing realizes the functions of the above-described embodiment.

Further, after the program read from the recording medium is written in the memory provided in the function expansion board inserted in the computer or the function expansion unit connected to the computer, the function expansion board is based on the instruction of the program code. It goes without saying that there are cases where the CPU or the like provided in the function expansion unit performs a part or all of the actual processing, and the processing realizes the functions of the above-described embodiment.

Further, the present invention may be applied to a system composed of a plurality of devices or a device composed of one device. It goes without saying that the present invention can also be applied when it is achieved by supplying a program to a system or an apparatus. In this case, by reading the recording medium in which the program for achieving the present invention is stored into the system or the device, the system or the device can enjoy the effect of the present invention.

Further, by downloading and reading a program for achieving the present invention from a server, database, or the like on the network by a communication program, the system or device can enjoy the effect of the present invention.

It should be noted that the present invention also includes all configurations in which each of the above-described embodiments and modifications thereof are combined.

100 Course management system 111 Course management server 121 Face recognition management server 131 Course manager PC
141 Student PC

Claims (26)

It is a training device that manages the pass / fail judgment of the test by using the face recognition result of the face recognition means that is connected to the display terminal in a communicable manner and performs face recognition of the examinee.
By percentage it is determined that the examinee himself is determined whether conditions are satisfied in the face authentication unit within the test time, display test results acceptance judgment of the tests were pending at the display terminal a manual stage that controls so as to,
In the controlling means, an image of the examinee whose identity is determined by the face recognition means within the test time and a master used for face recognition of the face recognition means within the test time. A training device characterized in that images are displayed on the display terminal in a comparable manner. The training apparatus according to claim 1, wherein the control means displays the master image in a comparable manner on a display screen for the administrator to correct the pass / fail judgment of the test. In the controlling means, the time acquired within the test time is different from each other, and a plurality of images of the examinee determined to be the examinee himself / herself and the face recognition means within the test time. The training apparatus according to claim 1 or 2, wherein the master image used for face recognition is displayed on the display terminal in a comparable manner. The training apparatus according to claim 3, wherein the controlling means displays a list of the plurality of images divided by the time acquired within the test time. It is a control method of a training device that manages the pass / fail judgment of an examination by using the face recognition result of a face recognition means that is connected to a display terminal in a communicable manner and performs face recognition of an examinee.
Control to that hand stage of the training device, by percentage it is determined that the examinee himself is determined whether conditions are satisfied in the face authentication unit in the test time, the acceptance determination of the test pending test results comprises as engineering that controls so as to display on the display terminal,
In the control step, an image of the examinee whose identity is determined by the face recognition means within the test time and a master used for face recognition of the face recognition means within the test time. A control method characterized in that images are displayed on the display terminal in a comparable manner. It is a program that can be read and executed by a training device that manages the pass / fail judgment of the test using the face recognition result of the face recognition means that is connected to the display terminal in a communicable manner and performs face recognition of the examinee.
The training device,
By percentage it is determined that the examinee himself is determined whether conditions are satisfied in the face authentication unit within the test time, display test results acceptance judgment of the tests were pending at the display terminal to function as a means that controls so as to,
An image of an examinee whose identity is determined by the face recognition means by the face recognition means within the test time by the controlling means, and a master used for face recognition of the face recognition means within the test time. A program for displaying images on the display terminal so that they can be compared. It is a training device that manages the pass / fail judgment of the test by using the face recognition result of the face recognition means that is connected to the display terminal in a communicable manner and performs face recognition of the examinee.
By percentage of candidates is determined to be presence in the face authentication unit in the test time to determine whether or not conditions are satisfied, the test result of acceptance judgment is pending tests the display a manual stage that controls so as to display on the terminal,
The controlling means is used for the image of the examinee whose presence or absence is determined by the face recognition means within the test time and the face recognition of the face recognition means within the test time. A training device characterized in that the master images that have been used are displayed on the display terminal so that they can be compared. The training apparatus according to claim 7, wherein the control means displays the master image in a comparable manner on a display screen for the administrator to correct the pass / fail judgment of the test. In the controlling means, the time acquired within the test time is different from each other, and a plurality of images of the test taker who are determined whether or not the test taker is present and the face within the test time. The training device according to claim 7 or 8, wherein the master image used for face recognition of the authentication means is displayed on the display terminal in a comparable manner. The training apparatus according to claim 9, wherein the controlling means displays a list of the plurality of images divided by the time acquired within the test time. It is a control method of a training device that manages the pass / fail judgment of an examination by using the face recognition result of a face recognition means that is connected to a display terminal in a communicable manner and performs face recognition of an examinee.
Control to that hand stage of the training device, the proportion of candidates in the face authentication unit is determined to be presence is possible to determine whether or not conditions are satisfied in the test time of the test test acceptance judgment is pending results include more engineering that controls so as to display on the display terminal,
In the control step, an image of the examinee whose presence or absence is determined by the face recognition means within the test time and a face recognition of the face recognition means within the test time are used. A control method characterized in that the master images that have been used are displayed on the display terminal so that they can be compared. It is a program that can be read and executed by a training device that manages the pass / fail judgment of the test using the face recognition result of the face recognition means that is connected to the display terminal in a communicable manner and performs face recognition of the examinee.
The training device,
By percentage of candidates is determined to be presence in the face authentication unit in the test time to determine whether or not conditions are satisfied, the test result of acceptance judgment is pending tests the display to function as a means that controls so as to display on the terminal,
An image of an examinee whose presence or absence is determined by the face recognition means within the test time by the controlling means, and a face recognition of the face recognition means within the test time. A program for displaying the existing master image on the display terminal so that it can be compared. It is a training device that manages the pass / fail judgment of the test by using the face recognition result of the face recognition means that is connected to the display terminal in a communicable manner and performs face recognition of the examinee.
If the score of the test of the test meets the passing criteria and the result of being determined to be the examinee by the face recognition means within the test time also meets the conditions, it is determined that the test is passed. Judgment means and
If the test score of the test meets the passing criteria, but the result determined by the face recognition means to be the examinee does not meet the conditions within the test time, the pass / fail judgment of the test is suspended. With the holding means to
A means for controlling the test result determined to pass the test and the test result for which the pass / fail judgment of the test is suspended so as to be displayed differently on the display terminal.
A training device characterized by being equipped with. The training device according to claim 13, wherein the control means is controlled so as to have a different display on the display terminal on a display screen for the administrator to correct the pass / fail judgment of the test. It is a control method of a training device that manages the pass / fail judgment of an examination by using the face recognition result of a face recognition means that is connected to a display terminal in a communicable manner and performs face recognition of an examinee.
When the test score of the test meets the passing criteria and the result of the face recognition means determining that the examinee is the examinee within the test time, the determination means of the training device also satisfies the condition. Judgment process to judge that the test is passing,
When the holding means of the training device meets the passing criteria for the test score of the test, but the result of being determined to be the examinee by the face recognition means within the test time does not meet the condition. , A pending process that suspends the pass / fail judgment of the test,
A step of controlling the means for controlling the training device so that the test result determined to pass the test and the test result with which the pass / fail judgment of the test is suspended are displayed differently on the display terminal.
A control method comprising. It is a program that can be read and executed by a training device that manages the pass / fail judgment of the test using the face recognition result of the face recognition means that is connected to the display terminal in a communicable manner and performs face recognition of the examinee.
The training device,
If the score of the test of the test meets the passing criteria and the result of being determined to be the examinee by the face recognition means within the test time also meets the conditions, it is determined that the test is passed. Judgment means and
If the test score of the test meets the passing criteria, but the result determined by the face recognition means to be the examinee does not meet the conditions within the test time, the pass / fail judgment of the test is suspended. With the holding means to
A means for controlling the test result determined to pass the test and the test result for which the pass / fail judgment of the test is suspended so as to be displayed differently on the display terminal.
A program to make it work. It is a training device that manages the pass / fail judgment of the test by using the face recognition result of the face recognition means that is connected to the display terminal in a communicable manner and performs face recognition of the examinee.
The test is passed when the test score of the test meets the passing criteria and the result of determining that the examinee is present by the face recognition means within the test time also meets the conditions. Judgment means to judge
If the test score of the test meets the passing criteria, but the result of determining that the examinee is present by the face recognition means within the test time does not meet the conditions, the pass / fail of the test Holding means to hold the judgment and
A means for controlling the test result determined to pass the test and the test result for which the pass / fail judgment of the test is suspended so as to be displayed differently on the display terminal.
A training device characterized by being equipped with. The training device according to claim 17, wherein the control means is controlled so as to have a different display on the display terminal on a display screen for the administrator to correct the pass / fail judgment of the test. It is a control method of a training device that manages the pass / fail judgment of an examination by using the face recognition result of a face recognition means that is connected to a display terminal in a communicable manner and performs face recognition of an examinee.
When the judgment means of the training device satisfies the passing criteria for the test score of the test and the result of the judgment that the examinee is present by the face recognition means within the test time also satisfies the condition. In addition, a determination step for determining that the test has passed, and
The holding means of the training device satisfied the passing criteria for the test score of the test, but the result of determining that the examinee was present by the face recognition means within the test time did not satisfy the condition. In that case, a pending process that suspends the pass / fail judgment of the test and
A step of controlling the means for controlling the training device so that the test result determined to pass the test and the test result with which the pass / fail judgment of the test is suspended are displayed differently on the display terminal.
A control method comprising. It is a program that can be read and executed by a training device that manages the pass / fail judgment of the test using the face recognition result of the face recognition means that is connected to the display terminal in a communicable manner and performs face recognition of the examinee.
The training device,
The test is passed when the test score of the test meets the passing criteria and the result of determining that the examinee is present by the face recognition means within the test time also meets the conditions. Judgment means to judge
If the test score of the test meets the passing criteria, but the result of determining that the examinee is present by the face recognition means within the test time does not meet the conditions, the pass / fail of the test Holding means to hold the judgment and
A means for controlling the test result determined to pass the test and the test result for which the pass / fail judgment of the test is suspended so as to be displayed differently on the display terminal.
A program to make it work. It is a training device that manages the pass / fail judgment of the test by using the face recognition result of the face recognition means that is connected to the display terminal in a communicable manner and performs face recognition of the examinee.
Controlled so that the test result for which the pass / fail judgment of the test is suspended is displayed on the display terminal by determining whether or not the result determined to be the examinee himself / herself by the face recognition means within the test time satisfies the condition. Means to do and
A reception means for accepting corrections to test results for which the pass / fail judgment of the test has been suspended, and
A registration means for registering the test result for which the correction has been accepted as a pass / fail judgment of the test, and
A training device characterized by being equipped with. It is a control method of a training device that manages the pass / fail judgment of an examination by using the face recognition result of a face recognition means that is connected to a display terminal in a communicable manner and performs face recognition of an examinee.
The test result in which the pass / fail judgment of the test is suspended depending on whether the means controlled by the training device satisfies the condition that the result determined by the face recognition means to be the examinee is satisfied within the test time. And the process of controlling the display on the display terminal
The receiving means of the training device receives the correction of the test result for which the pass / fail judgment of the test is suspended, and the receiving process.
A registration step in which the registration means of the training device registers the test result for which the correction has been accepted as a pass / fail judgment of the test.
A control method comprising. It is a program that can be read and executed by a training device that manages the pass / fail judgment of the test using the face recognition result of the face recognition means that is connected to the display terminal in a communicable manner and performs face recognition of the examinee.
The training device,
Controlled so that the test result for which the pass / fail judgment of the test is suspended is displayed on the display terminal by determining whether or not the result determined to be the examinee himself / herself by the face recognition means within the test time satisfies the condition. Means to do and
A reception means for accepting corrections to test results for which the pass / fail judgment of the test has been suspended, and
A registration means for registering the test result for which the correction has been accepted as a pass / fail judgment of the test, and
A program to make it work. It is a training device that manages the pass / fail judgment of the test by using the face recognition result of the face recognition means that is connected to the display terminal in a communicable manner and performs face recognition of the examinee.
By determining whether or not the result of determining that the examinee is present by the face recognition means within the examination time satisfies the condition, the test result in which the pass / fail determination of the test is suspended is displayed on the display terminal. Means to control and
A reception means for accepting corrections to test results for which the pass / fail judgment of the test has been suspended, and
A registration means for registering the test result for which the correction has been accepted as a pass / fail judgment of the test, and
A training device characterized by being equipped with. It is a control method of a training device that manages the pass / fail judgment of an examination by using the face recognition result of a face recognition means that is connected to a display terminal in a communicable manner and performs face recognition of an examinee.
The pass / fail judgment of the test is suspended by determining whether or not the means controlled by the training device satisfies the result of the face recognition means determining that the examinee is present within the test time. The process of controlling the test results to be displayed on the display terminal,
The receiving means of the training device receives the correction of the test result for which the pass / fail judgment of the test is suspended, and the receiving process.
A registration step in which the registration means of the training device registers the test result for which the correction has been accepted as a pass / fail judgment of the test.
A control method comprising. It is a program that can be read and executed by a training device that manages the pass / fail judgment of the test using the face recognition result of the face recognition means that is connected to the display terminal in a communicable manner and performs face recognition of the examinee.
The training device,
By determining whether or not the result of determining that the examinee is present by the face recognition means within the examination time satisfies the condition, the test result in which the pass / fail determination of the test is suspended is displayed on the display terminal. Means to control and
A reception means for accepting corrections to test results for which the pass / fail judgment of the test has been suspended, and
A registration means for registering the test result for which the correction has been accepted as a pass / fail judgment of the test, and
A program to make it work.

Images