JP5169342B2 - Skill evaluation system, skill evaluation method and skill evaluation program - Google Patents

Description

  The present invention relates to a skill evaluation system, a skill evaluation method, and a skill evaluation program for evaluating a current skill from a test result, for example, for skill improvement.

Traditionally, training and examinations have been conducted with the aim of improving employees' skills. For example, a human resource development support system for supporting human resource development has been studied (see, for example, Patent Document 1). The technical human resource development support system described in this document includes a human resource development support device, a database, a communication network, a user terminal, and a company terminal. The human resource development support device includes a target level setting unit for setting a target level for learning, a training information providing unit for providing training information for clearing the target level, and training information provided by the training information providing unit. And a proficiency level judging means for judging the proficiency level of the skill acquired by.
JP 2006-185317 A (first page)

  By the way, it is necessary to improve skills on knowledge necessary for performing business. In this case, the test target pass level may be accidentally exceeded. In this case, even when employees learn knowledge necessary for work, it is difficult to accurately grasp in which field the knowledge is lacking. As a result, efficient learning support may not be possible.

  The present invention has been made in view of the above-described problems, and an object thereof is to provide a skill evaluation system, a skill evaluation method, and a skill evaluation program capable of efficient learning support in order to improve skills.

In order to solve the above-described problem, the invention described in claim 1 includes a candidate identifier that identifies a candidate, a test identifier that identifies a test, a problem identifier that identifies a problem to be asked in this test, The review requirement criteria used for selecting the grade data storage means for recording the grade data regarding the correctness of the examinee's answer in association with the number of times the examinee answered the question and the grade comment for prompting the review A skill evaluation system comprising recorded data storage means and control means for analyzing examinees' skills, wherein the control means extracts scoring data of a plurality of examiner identifiers from the scoring data storage means. Te, for each problem, using the examination times recorded on the scoring data, and calculates the statistics of the number of retries until correct counts the problem retry count exceeds the statistic Calculate the total number and divide the total number by the total number of questions to calculate the comment determination ratio. If the comment determination ratio is higher than the review required standard, specify the first grade comment that encourages review. When the comment determination ratio is lower than the review required standard, the second grade comment indicating that it is understood is identified, and the personal grade data including the identified first grade comment or the second grade comment is generated. The gist of the invention is that it has a means for analyzing the results.

The invention according to claim 2, in skill evaluation system according to claim 1, before Symbol test identifier, and issues the identifier for identifying the problems involved in this study, an identifier identifying a category of the problem, the problem And a question data storage means for recording the question answer in association with each other, a review question data storage means for storing the review question data including the category and difficulty level, the question content, the correct answer and the reference content, and the examination used by the examinee The review requirement criteria are stored for each category, and the results analysis means calculates the total number of the counts of the number of retries exceeding the statistical value for each category, By dividing the total number by the total number of questions by category, a comment determination ratio is calculated, and the first grade comment or the second grade comment is classified by category. Constant, and the control means, means for transmitting the review questions corresponding to the category to which the first score comments is attached, extracted from the review questions data storage means, for every predetermined period examinee terminal of said examinee Is further provided.

The invention according to claim 3 is the skill evaluation system according to claim 2, and includes test identifiers, a problem number given in the test, and a problem identifier for identifying the problem, and stores test data relating to the test Test data storage means, and the problem data storage means stores problem data including an identifier for specifying a category and a difficulty level, a problem, and an answer to the problem. the gist that you are.

The invention according to claim 4 is a test identifier for specifying a test that needs to be passed in order to take the test for the test identifier for specifying the test in the skill evaluation system according to claim 2 or 3. A test taker test condition data storage means for storing a test taker test condition, a test taker identifier for identifying a test taker, a test identifier for a test taken by the test taker, and a scoring data storage means in association with the test result And when the test identifier of a newly set test is input, the control means extracts a test identifier as a test taker test condition of the test in the test taker test condition data storage means; , Means for extracting a candidate identifier of a candidate who has passed a test with a test identifier of a candidate test condition from the scoring data storage means, and a candidate having the extracted candidate identifier The examinee terminal that further summarized in that and means for transmitting the examination notification mail.

The invention according to claim 5 is a test taker identifier for identifying a test taker, a test identifier for specifying a test, a problem identifier for specifying a question to be asked in the test, and the number of times the test taker has answered the question. In connection with the above, a scoring data storage means for recording scoring data regarding the correctness of the answer of the examinee, a data storage means for recording review necessary criteria used for selecting a grade comment for prompting review, and a control A skill evaluation method for analyzing a test taker's skill using the means, wherein the control means extracts scoring data of a plurality of test taker identifiers from the scoring data storage means, and for each question, the scoring using the examination times recorded in the data, calculates the statistical value of the number of retries until correct, calculates the total number of retries has been counted considerations beyond the statistics, the total number By dividing by the number of questions, the comment determination ratio is calculated, and when the comment determination ratio is equal to or higher than the review required standard, the first grade comment that encourages review is specified, and the comment determination ratio is lower than the review required standard In this case, the second grade comment indicating that it is understood is identified, and the grade analysis step is executed to generate and output personal grade data including the identified first grade comment or the second grade comment. And

The invention described in claim 6 is a test taker identifier that specifies a test taker, a test identifier that specifies a test, a problem identifier that specifies a question to be asked in this test, and the number of times that the test taker answered the problem. In conjunction with the above, a scoring data storage means for recording scoring data relating to the correctness of the examinee's answer and a review necessary standard used for selecting a grade comment for prompting a review are recorded
A skill evaluation program for analyzing a candidate's skill using the data storage means and the control means, wherein the control means extracts the scoring data of a plurality of examiner identifiers from the scoring data storage means. Then, for each question, use the number of examinations recorded in the scoring data to calculate the statistical value of the number of retries until the correct answer is obtained, and calculate the total number of problems for which the number of retries exceeds the statistical value. The comment determination ratio is calculated by dividing the total number by the total number of questions. If the comment determination ratio is equal to or higher than the review required standard, a first grade comment that prompts review is specified, and the comment determination ratio is determined. If There below refresher necessary criteria generate Career data identifying the second performance comment indicating an understanding, it includes a first score comments or second grades comments identified Function as an outcome analysis means for outputting Te is summarized as.

(Function)
According to the present invention, the control means extracts scoring data of a plurality of examiner identifiers from the scoring data storage means, and uses the number of examinations recorded in the scoring data for each question, and the number of retries until a correct answer is obtained. Statistic value is calculated, and personal performance data in which this statistical value is compared with the number of retries of each examinee is generated and output. In general, a problem with a large number of retries until a correct answer is likely not to be accurately understood. For this reason, by using such number of retries, it is possible to grasp a field where the examinee's skill is low. Then, by browsing the personal results data comparing the number of retries until the other test taker answers correctly and the number of retries of the test taker, the difficulty of the problem is eliminated, and it is objectively given to others. Compared to areas with lower skills.

According to the present invention, when the control means obtains the test taker identifier, the test identifier, and the test taker answer associated with the problem identifier from the test taker terminal, it is recorded in the scoring data storage means. The number of this examination is specified from the number of examinations taken. The control means compares the correct answer recorded in the question data storage means for each question identifier with the received answer to calculate the examinee's grade, and if this grade is lower than the acceptance criteria, the examinee Notify the terminal of the retest. For this reason, it is possible to urge the examinee to perform a retest until the acceptance standard is reached.
Therefore, it is possible to make the examinee answer the question with poor understanding many times, and it is expected to improve the skill.

  According to the present invention, the control means generates personal performance data in which the number of retries of the examinee and the statistical value of the number of retries are classified by category or difficulty level. For this reason, by browsing the personal result data, it is possible to grasp the lack of understanding by category and difficulty level.

  According to the present invention, the control means calculates a statistical value of the number of retries of the examinees belonging to the same affiliation and a statistical value of the number of retries of the examinees belonging to other affiliations, and calculates the statistical value of the number of retries. The included department evaluation data is generated and transmitted to the terminal of the department head. For this reason, the head of the affiliation can grasp a problem that the examinee belonging to his / her department does not understand. Therefore, it can be expected that many test takers belonging to the department effectively improve the skills of the test takers by reviewing in the department for problems with poor understanding.

  According to the present invention, an examinee's lack of understanding can be evaluated from the number of retries.

  Hereinafter, an embodiment embodying the present invention will be described with reference to FIGS. In this embodiment, a skill management system will be described as a skill evaluation system for evaluating the skills of each employee in a group company. The skill management system according to the present embodiment performs a test on the employee via a web screen, notifies the employee and the head of the employee of the result of the test, and uses it to improve the skill of each employee.

  As shown in FIG. 1, a test taker terminal 11 used by employees who take the test is connected to the skill management system 20 via a network. The examinee terminal 11 includes display means such as a display and input means such as a keyboard and a pointing device. The display means of the examinee terminal 11 displays a question, an individual test result (result report), etc. in order to carry out the test. The input means of the examinee terminal 11 is used for inputting the answer of the employee who took the test or inputting an instruction for browsing the individual test result.

  Furthermore, a department manager terminal 12 used by the department manager of the department to which the employee who took the test belongs is connected to the skill management system 20 via a network. The affiliation head terminal 12 includes display means and input means in the same manner as the examinee terminal 11. The display means of the department head terminal 12 displays the test results of employees belonging to the department supervised by the department manager. The input means of the affiliation head terminal 12 is used for inputting an instruction or the like for browsing the test result of the employee.

  On the other hand, the skill management system 20 includes a control unit 21 as a control means, a department data storage unit 22, an employee data storage unit 23, an examination data storage unit 24, a question data storage unit 25, an examinee data storage unit 26, and a scoring data storage. A portion 27 is provided. Here, the department data storage unit 22 and the employee data storage unit 23 function as belonging data storage means, the test data storage unit 24 functions as test data storage means, and the problem data storage unit 25 functions as problem data storage means. The scoring data storage unit 27 functions as scoring data storage means.

  The control unit 21 includes a CPU, a RAM, a ROM, and the like (not shown), and performs processing described later (processing including a test setting stage, an authentication stage, a test execution stage, a results analysis stage, and the like). By executing the skill management program for that purpose, the control unit 21 functions as a test setting unit 210, an authentication unit 211, a test execution unit 212, and a result analysis unit 213.

The test setting means 210 executes a process of setting and recording information necessary for performing the test, such as the test execution period and the pass level.
The authentication unit 211 executes a process for authenticating a test taker who takes the test.

The test execution means 212 executes a process for urging the employee to perform a test and to perform a retest when the acceptance criteria are not satisfied.
The grade analysis means 213 analyzes the grade of each employee who took the exam, and creates and distributes grade data. This grade analysis means 213 calculates the statistical value of the number of retries of the examinees belonging to the same affiliation and the statistical value of the number of retries of the examinees belonging to other affiliations, and the department including the statistical values of the number of retries It functions as a department evaluation data generating means for generating evaluation data, and functions as a department result transmitting means for transmitting the generated department evaluation data to the terminal of the department manager.

  Further, the grade analysis means 213 stores review-required reference data used for selecting a grade comment for encouraging review by category or difficulty level. In the present embodiment, the grade analysis unit 213 identifies a problem in which the number of retries of the examinee exceeds the overall average value of the number of retries. The grade analysis means 213 calculates the specified problem ratio (comment judgment ratio) in the specified problem category (or difficulty level). When the comment determination ratio is equal to or higher than the review necessary standard, the grade analysis means 213 attaches a grade comment that “review is necessary”. On the other hand, if the result analysis means 213 is lower than the review requirement standard, the grade analysis means 213 attaches a grade comment “I understand enough”.

In addition, the control unit 21 provides a URL (Uniform Resource) of a web page for performing the test.
Locator) is stored.
As shown in FIG. 2A, department data 220 relating to a department is stored in the department data storage unit 22. This department data 220 is registered when a new department is created and data is input. The department data 220 includes data relating to a department identifier, a department name, a department identifier, and an employee identifier of the department head.

In the department identifier data area, data relating to an identifier (department identifier) for identifying each department is recorded.
Data relating to the name of this department is recorded in the department name data area.

In the department identifier data area, data relating to an identifier for specifying the department to which the department belongs is recorded.
In the employee identifier data area of the department manager, data relating to the employee identifier for identifying the department manager is recorded.

  The employee data storage unit 23 stores employee data 230 related to employees as shown in FIG. The employee data 230 is registered when the employee enters the company and data is input. This employee data 230 includes data relating to employee identifiers, department identifiers, employee names, passwords, and email addresses.

In the employee identifier data area, data relating to an employee identifier for identifying each employee is recorded.
In the department identifier data area, data relating to the department identifier for identifying the department to which the employee belongs is recorded.

In the employee name data area, data related to the employee name is recorded.
In the password data area, data relating to the password of the employee is recorded. This password is used for personal authentication together with the employee identifier.

In the mail address data area, data related to the mail address used by the employee is recorded.
The test data storage unit 24 stores test data 240 related to the test as shown in FIG. This test data 240 is registered when a new test is performed. The test data 240 includes data on a test identifier, a test name, a test type, a pass level, a retry setting, a test period, and a result analysis flag.

Data relating to an identifier (test identifier) for specifying each test is recorded in the test identifier data area.
Data relating to the name of the test is recorded in the test name data area.

In the test type data area, data for specifying the type of test is recorded.
In the acceptance level data area, data relating to the lowest score (acceptance criteria) of the acceptance level of this test is recorded.

  In the retry setting data area, data related to the setting for the questioning method in the case of a retest (retry) is recorded. In the present embodiment, data for specifying either the setting to retry only the wrong problem (partial retry setting) or the setting to retry all problems including the wrong problem (all question retry setting) is recorded. Has been.

  In the test period data area, data relating to a test period in which this test is performed is recorded. This test period data area includes data on the start date and the end date. In addition, a candidate takes the test several times during this test period until it passes.

In the grade analysis completed flag data area, data relating to a flag indicating that the grade data of each employee in the conducted test is analyzed and the grade data is transmitted is recorded.
As shown in FIG. 3A, the problem data storage unit 25 stores problem data 250 relating to a problem. This problem data 250 is registered when a new problem is created. The question data 250 includes data relating to test identifiers, question numbers, categories, difficulty levels, question formats, question contents, correct answers, and reference contents.

  Data relating to an identifier (test identifier) for specifying each test is recorded in the test identifier data area. The test data 240 and the problem data 250 are associated with each other through this test identifier.

  In the question number data area, data relating to the number of each question included in this test is recorded. In the present embodiment, the problem can be specified by the data regarding the problem number and the test identifier data.

  In the category data area, data relating to the category to which this problem belongs is recorded. In the present embodiment, for example, a category such as “host printer” or “scanner” is used for problems of electronic devices.

  In the difficulty level data area, data for specifying the difficulty level of this problem is recorded. In the present embodiment, three levels of difficulty of “basic problem”, “standard problem”, and “application problem” are used.

Data for specifying the question format is recorded in the question format data area. In the present embodiment, three question formats are used: a question for selecting one answer, a question for selecting a plurality of answers, or a form for entering an answer to be filled in a blank.

In the question content data area, data relating to the content of the question in question is recorded.
In the correct answer data area, data relating to the correct answer of the problem is recorded.
In the reference content data area, content that serves as a reference in order to correctly answer this problem is recorded.

  The examinee data storage unit 26 stores examinee data relating to employees taking the examination. This candidate data is registered when an employee to take an exam determines. The examinee data includes data on employee identifiers, test identifiers, and results analysis results.

In the employee identifier data area, data relating to an identifier (employee identifier) for identifying each employee taking the examination is recorded.
In the test identifier data area, data relating to an identifier (test identifier) for specifying a test to be taken by the employee is recorded.
In the results analysis result data area, data relating to the results of analyzing the results of the employees who took this test is recorded.

  In the scoring data storage unit 27, as shown in FIG. 3B, data relating to scoring of the examinee who took the test is recorded. This scoring data 270 is recorded when an employee takes a test. The scoring data 270 includes data on correctness / incorrectness corresponding to employee identifiers, test identifiers, exam times, date and time of exams, test results, and question numbers.

In the employee identifier data area, data related to an identifier (employee identifier) for identifying each employee who took the examination is recorded.
In the test identifier data area, data relating to an identifier (test identifier) for specifying a test taken by the employee is recorded.

Data on the number of times this employee took this examination (how many times) is recorded in the examination times data area.
In the examination date / time data area, data relating to the date and time when this employee took the examination is recorded.

  In the examination result data area, data relating to a passing result of the employee's examination is recorded. If the percentage (%) of correct answers by the test takers exceeds the passing level, a flag indicating “Pass” is recorded in the test result data. If the correct answer is lower than the passing level, the test result A flag indicating “fail” is recorded in the data.

  In the answer correct / incorrect data area, data on the correctness of the answer of the employee is recorded in association with the question number. In this answer correct / incorrect data area, a flag indicating “correct” is recorded if the answer of the examinee is correct for the corresponding question number, and “false” is indicated if the answer of the examinee is incorrect. A flag is recorded.

  Further, the skill management system 20 is connected to a computer terminal (not shown) used by a test creator who manages the test. This computer terminal includes a display, a keyboard, and a pointing device used for inputting department data 220, employee data 230, problem data 250, and test data 240.

Next, processing using the skill management system 20 having the above-described configuration will be described with reference to FIGS.
First, the skill management system 20 executes a test setting process. Specifically, when the test creator instructs to create a new test, the test setting unit 210 of the skill management system 20 displays a test creation screen for setting a new test on the display. This test creation screen includes a setting input field for inputting and selecting a test name, a test type, a pass level, a retry setting, a test period, and the like of a test to be performed, and a registration button. The test creator enters data for these items.

  Further, on this creation screen, a question creation button for creating a question to be given in this test is set. When this question creation button is selected, the test setting means 210 displays a question creation screen on the display. This question creation screen includes a setting input field for entering and selecting a question number, question category, difficulty level, question format, question content, correct answer, reference content, etc. in this exam, and a registration button. Yes.

  The test creator inputs data for each item on the test creation screen and each item on the question creation screen, and sets a registration button. As a result, the test setting unit 210 assigns a test identifier, generates test data 240, and stores the test data 240 in the test data storage unit 24. Further, the test setting unit 210 generates problem data 250 and stores it in the problem data storage unit 25.

  Thereafter, the skill management system 20 executes an examination notification process. In this case, the test setting unit 210 of the skill management system 20 extracts the test data 240 including the test identifier of the test to be performed from the test data storage unit 24, and creates an examination notification mail using the test data 240. Then, the test creator inputs a list of employees taking the test via the computer terminal. The employee list includes an employee identifier that identifies the employee. As a result, the test setting unit 210 acquires the employee identifier of the employee taking the examination, extracts the employee data 230 including the employee identifier from the employee data storage unit 23, and for each email address included in the extracted employee data 230 Send an email notification. This examination notification mail includes the examination identifier, examination name, examination type, acceptance level, examination period, and URL of the examination web page. Then, the test setting unit 210 records the employee identifier of the employee who has transmitted the examination notification mail and the test identifier of the test to be taken in the examinee data storage unit 26.

(Examination processing)
Next, test execution processing performed by the skill management system 20 when an employee takes a test will be described with reference to FIG.

  The employee (test taker) who has received the examination notification mail selects a URL included in the examination notification mail when the examination period comes. Thereby, the examinee terminal 11 accesses the skill management system 20 and transmits the test identifier.

  The skill management system 20 transmits login screen data to the examinee terminal 11 that has been accessed. The examinee terminal 11 displays a login screen on the display using the received login screen data. This login screen includes an entry field for employee identifiers and passwords, and a send button.

  The examinee inputs his / her employee identifier and password in the input field of the login screen, and selects the send button. Thereby, the examinee terminal 11 executes a login request process (step S1-1). Specifically, the examinee terminal 11 transmits an authentication request including the employee identifier and password input on the login screen to the skill management system 20.

The control unit 21 of the skill management system 20 that has received the authentication request executes an authentication process (step S1-2). Specifically, the authentication unit 211 of the control unit 21 extracts employee data 230 including the received employee identifier and password from the employee data storage unit 23. When the corresponding employee data 230 can be extracted, the authentication unit 211 completes the authentication process.

  Next, the control unit 21 of the skill management system 20 executes an examination information transmission process related to an examination that the employee can take (step S1-3). Here, the control unit 21 first acquires information on a test that includes the employee identifier of the employee whose authentication has been completed, the current date and time are included in the test period, and has not yet passed the test. Specifically, the test execution unit 212 of the control unit 21 extracts test taker data including the employee identifier for which the authentication process has been completed from the test taker data storage unit 26. The test execution unit 212 compares the test period of the test data 240 including the test identifier of the extracted candidate data with the current date, and extracts the test identifier of the test data 240 whose current date is included in the test period. Further, the test execution unit 212 extracts the test identifiers from the scoring data 270 including the extracted test identifiers, excluding the test identifiers of the scoring data 270 with “passed” in the test result data area. Then, the test execution unit 212 generates test information including information regarding the specified test identifier, the test name of the test data 240 including the test identifier, the test type, the pass level, and the test period, and transmits the test information to the examinee terminal 11.

  The examinee terminal 11 displays a list of test selection screens on the display based on the received examination information. This test selection screen includes information related to tests that the employee is scheduled to take and test execution buttons corresponding to the tests.

  Therefore, the examinee terminal 11 executes a test selection process (step S1-4). Here, the examinee browses the displayed examination information and selects the examination execution button of the examination to be taken. In this case, the examinee terminal 11 transmits the test identifier of the test for which the test execution button is selected to the skill management system 20.

  Next, the control unit 21 of the skill management system 20 that has received the test identifier determines whether or not to transmit all questions in order to identify the problem to be transmitted. In the present embodiment, all questions are transmitted in the case of all questions retry setting or in the case of the first examination.

  Specifically, the test execution means 212 of the control unit 21 first determines whether or not all question retry setting data is recorded in the retry setting data area of the test data 240 including the test identifier of this test. . If all question retry setting data is recorded, the test execution unit 212 transmits all questions ("YES" in step S1-5).

  On the other hand, when partial retry setting data is recorded in the retry setting data area of the test data 240, the test execution unit 212 determines whether or not it is the first test. Specifically, the test execution unit 212 of the control unit 21 searches the scoring data storage unit 27 for scoring data 270 including the acquired test identifier and the authenticated employee identifier. Here, when the corresponding scoring data 270 cannot be extracted, since this is the first examination, the test execution means 212 transmits all questions (“YES” in step S1-5).

  On the other hand, when the corresponding scoring data 270 can be extracted, since this is the second and subsequent examinations, the test execution means 212 transmits only the wrong question (“NO” in step S1-5). In this case, the control unit 21 of the skill management system 20 executes a process for identifying the problem to be extracted (step S1-6). Specifically, the test execution means 212 of the control unit 21 identifies the scoring data 270 having the largest number of exams in the extracted scoring data 270, and associates the scoring data 270 with the “wrong” flag in the answer correct / incorrect data area. Identify the problem number that has been identified.

Next, the control unit 21 executes a problem extraction process (step S1-7). Here, the test execution means 212 of the control unit 21 transmits all questions (“Y” in step S1-5).
ES ”), the problem data 250 including the test identifier is extracted from the problem data storage unit 25.

  On the other hand, when partial transmission is performed (in the case of “NO” in step S1-5), problem data 250 including the problem number specified in step S1-6 and the test identifier of this test is stored in problem data storage unit 25. Extract from

  Next, the control unit 21 of the skill management system 20 executes question data generation and transmission processing (step S1-8). Specifically, the test execution means 212 of the control unit 21 generates question screen data including the question contents of the extracted problem data 250. The test execution means 212 includes a test identifier, a question number, and an answer column corresponding to each question in the question screen data. Then, the control unit 21 transmits the generated test screen data to the examinee terminal 11.

  The examinee terminal 11 that has received the question screen data executes an examination process (step S1-9). Specifically, the examinee terminal 11 displays the question screen on the display based on the received question screen data. This question screen includes the contents of the question of the test, the corresponding answer columns, and a send button. The examinee selects or fills in the answer in each answer column while reading the contents of the question. When the examinee answers all the questions included in the question screen, the examinee selects the send button. In this case, the examinee terminal 11 transmits to the skill management system 20 answer data including the test identifier, the answer of the examinee associated with the question number, and the current date and time.

  The control unit 21 of the skill management system 20 that has received the answer data executes a scoring process (step S1-10). Specifically, the test execution means 212 of the control unit 21 that has received the answer data generates the received test identifier, the test taker's test identifier, and scoring data 270 having the current date and time as the test date and time, and stores the scoring data storage Store in the unit 27.

  Then, the test execution unit 212 specifies the question data 250 including the test identifier and the question number, and specifies the correct answer data of this question. Then, the test execution means 212 compares the correct answer of the same question number with the examinee's answer included in the answer data.

  Here, the test execution means 212 associates the “correct” flag with the question number for a problem whose answer matches the correct answer, and sets the “false” flag for a problem whose answer does not match the correct answer. The generated score data 270 is stored in association with the problem number.

  Next, the test execution means 212 records the test result. Here, the ratio of the “false” flag temporarily stored by scoring is calculated from the number of questions presented in the test. Specifically, the test execution means 212 counts the “false” flag to calculate the total number, and divides by the number of questions of this test (the largest question number in the question data 250 including this test identifier). Calculate the wrong percentage. Then, the test execution means 212 calculates a rate (%) that the examinee has answered correctly from the rate of the wrong question, and compares it with the pass level of the test data 240 including the test identifier of this test. The test execution means 212 records the “pass” flag as the test result data in the scoring data 270 when the correct answer ratio is equal to or higher than the pass level, and sets the “fail” flag to the test result when lower than the pass level. The data is recorded in the scoring data 270.

  Further, the test execution means 212 obtains the data of the largest examination time out of the scoring data 270 including the same employee identifier and examination identifier, and the number obtained by adding “1” to this examination time as the current examination time. Record in scoring data 270.

Next, the control unit 21 of the skill management system 20 executes a result notification process (step S1-11). Specifically, the test execution means 212 of the control unit 21 transmits a result notification mail to the examinee terminal 11. This test notification mail includes test result data of “pass” or “fail”, and further, in the case of “fail”, includes prompting to perform the test again during the test period. Thus, the test execution process ends.

(Result analysis process)
Thereafter, when the test period ends, the control unit 21 of the skill management system 20 executes an examinee's result analysis process. This results analysis process will be described with reference to FIG.

  First, the control unit 21 of the skill management system 20 executes a process for specifying a result analysis target (step S2-1). Specifically, the result analysis means 213 of the control unit 21 compares the current date with the test period of the test data 240, and the test identifier of the test data 240 for which the test period has ended and the result analyzed flag is not recorded. To extract.

  Also, the grade analysis means 213 counts different employee identifiers in the scoring data 270 including the test identifier of this test, and calculates the number of examinees actually taken. Further, the grade analysis means 213 compares the department identifiers of the employee data 230 with each other, counts the number of examinees having the same department identifier, calculates the number of examinees in each department, and determines the departments to which the examinees belong. The department identifiers are specified, and the number of participating departments is calculated by counting the number of these department identifiers.

  Next, the control unit 21 of the skill management system 20 executes an average correct answer rate calculation process (step S2-2). Here, the control unit 21 determines the overall average correct answer rate for all examinees who took the same examination, the average correct answer rate for each department in the same department, and the average correct answer rate for other departments in other departments excluding this department. Calculate every time.

  Specifically, the grade analysis means 213 of the control unit 21 extracts the grade data 270 including the test identifier specified as the grade analysis target and “test take time: once” from the grade data storage unit 27. The grade analysis means 213 calculates the total number by counting the number of “correct” flags for each question in the extracted scoring data 270, and divides by the number of examinees of this test to obtain the overall average correct answer rate. calculate.

  Next, the grade analysis means 213 sequentially identifies the department to be processed from the department to which the examinee belongs, and repeatedly executes the following processes. The grade analysis means 213 specifies the employee identifier of the employee data 230 having the department identifier of the department to be processed, and stores the scoring data 270 of “test times: once” including the employee identifier and the specified test identifier. Extracted from the unit 27. Then, the grade analysis means 213 calculates the total number by counting the number of “positive” flags for each question in the extracted scoring data 270, and divides by the number of examinees in this department to obtain the average for each department. Calculate the correct answer rate. The above process is repeated for all departments to which the examinee belongs, and the average correct answer rate of each department is calculated.

  Next, the result analysis means 213 calculates the average correct answer rate of other departments. Here, the results analysis means 213 sequentially identifies the departments to be processed and repeatedly executes the next process. The grade analysis means 213 totals the average correct answer rates of other departments excluding the departments to be processed, and divides this by the number of other departments (the number obtained by subtracting “1” from the number of participating departments). An average correct answer rate (an average correct answer rate for other departments) is calculated and temporarily stored in association with the department identifier of the department to be processed.

  Next, the control part 21 performs the calculation process of the average value of the number of retries (step S2-3). Here, the control unit 21 determines the overall average value of the number of retries in all examinees who have taken the examination of the grade analysis target, the average value of the number of retries in the same department by department, and the number of retries in other departments excluding this department. The average value of other departments is calculated.

  Here, first, the result analysis means 213 calculates the number of retries for each examinee according to problem. Specifically, the employee identifier included in the scoring data 270 having the test identifier specified as the result analysis target is sequentially specified, and the following processing is repeatedly executed. The grade analysis means 213 extracts the scoring data 270 including the test identifier and the identified employee identifier from the scoring data storage unit 27, and obtains the examination times in which the “correct” flag is recorded for each question number from these, The value obtained by subtracting “1” from each test is calculated as the number of retries for this employee. This is repeatedly executed for the employee identifier of the extracted scoring data 270, and the number of retries for each question for each examinee is calculated.

  The grade analysis means 213 calculates the total number of retries for each question by summing the number of retries for each question for each question, and divides this total by the number of test takers for this test. Calculate the overall average.

  Next, the grade analysis means 213 sequentially identifies the department to be processed from the department to which the examinee belongs, repeatedly executes the following process, and calculates the average number of retries by department for each problem. . The grade analysis means 213 sums up the number of retries of the employee identifier of the employee data 230 including the department identifier of the department identified as the processing target, divides this total number by the number of examinees of this department, The average value is calculated.

  Next, the average value of other departments is calculated. Here, the results analysis means 213 sequentially identifies the departments to be processed and repeatedly executes the next process. The result analysis means 213 obtains the average value of the number of retries of other departments excluding the processing target department, divides this average value of each department by the number of other departments, and obtains the average value of other departments for the number of retries. Calculate and temporarily store in association with the department identifier of the department to be processed.

  Next, the control part 21 performs the production | generation process of personal results data (step S2-4). The personal result data generation process and the next personal result data notification process are sequentially executed by extracting the employee identifiers of the employees who have taken the exam one by one. In this personal performance data generation process, the control unit 21 categorizes the average correct answer rate for each question and the individual correct answer rate for each question category, and the overall average of the number of retries for each question. An individual retry number bar graph in which values and individual retry times are arranged is generated and included in the personal result data.

  Here, first, the result analysis means 213 of the control unit 21 generates a personal correct answer rate bar graph. Specifically, the grade analysis means 213 extracts the “identification times: once” scoring data 270 including the employee identifier of the employee specified as the creation target of the personal grade data and the examination identifier of this examination, and each question number Get answer correct / incorrect data associated with. At this time, if the flag is “correct”, the correct answer rate is 100%. If the flag is “false”, the correct answer rate is 0%. Then, a correct answer rate bar graph in which the average correct answer rate and the individual correct answer rate in each question are arranged for each question category is generated.

Further, the result analysis means 213 of the control unit 21 generates a retry bar graph for each individual. Specifically, the grade analysis means 213 extracts scoring data 270 including this test identifier and this employee identifier. The grade analysis means 213 acquires the exam times in which the “correct” flag is recorded for each question number in the extracted scoring data 270, and calculates a value obtained by subtracting “1” from the exam times as the number of retries. . In the all question retry setting, there are cases where the same employee answers a plurality of correct questions to the same question, and a plurality of “correct” flags are registered in the scoring data 270 having the same employee identifier, test identifier, and question number. In this case, a value obtained by subtracting “1” from the minimum value of the examination times in which the “correct” flag is recorded is calculated as the number of retries. Then, the result analysis means 213 classifies the same category and generates a retry number bar graph in which the overall average number of retry times for each problem and the individual retry number are arranged.

  Furthermore, the grade analysis means 213 calculates the ratio of problems in which the number of retries exceeds the overall average value in order to attach a grade comment. Specifically, the result analysis means 213 calculates the total number by counting the number of problems in which the number of retries exceeds the overall average value for each category or degree of difficulty, and the number of problems for each category or degree of difficulty. Divide to calculate the comment determination ratio. Then, the result analysis means 213 compares the calculated comment determination ratio with the review necessary criteria for each category or each difficulty level. Here, when the comment judgment ratio is equal to or higher than the review required standard, the grade analysis means 213 identifies a grade comment that “review is necessary”, and when it is lower than the review required standard, ""

  Then, the result analysis means 213 generates personal result data of each person including the first correct / incorrect answer, the number of retries for each problem, the individual correct answer rate bar graph, and the individual retry number bar graph. This personal performance data includes the number of individual retries and their average value for each problem classified by category, and the number of individual retries and their average value for each problem classified by difficulty. Further, the personal result data includes a grade comment associated with each category or difficulty level. Then, the grade analysis means 213 records the generated personal grade data in the grade analysis result data area associated with the employee identifier and the test identifier of the employee in the examinee data storage unit 26.

  Next, the control part 21 performs notification processing of personal result data (step S2-5). Specifically, the grade analysis means 213 of the control unit 21 extracts employee data 230 including one employee identifier from the employee data storage unit 23, and the analysis is completed for the email address included in the employee data 230. Send an email containing the message. This mail includes a URL indicating a data storage area in which the result analysis result data associated with the employee identifier of the employee is recorded in the examinee data storage unit 26.

  The examinee causes the examinee terminal 11 to access the URL of the received mail, thereby displaying the personal result data on the display. On this display, an individual correct answer rate bar graph 50 as shown in FIG. 6A and an individual retry count bar graph 60 as shown in FIG. 6B are displayed.

  Next, the results analysis means 213 executes department-specific results data generation processing (step S2-6). In this departmental grade data generation process and the next departmental grade data notification process, the department identifier of the department to which the employee who took the exam belongs is sequentially extracted as the departmental grade data generation process target, and this department identifier is used. It is executed repeatedly. Here, the grade analysis means 213 displays a list of correct / incorrect answers and a list of retry counts for each question, a correct answer rate bar graph for each department, and a retry count graph for each department for each employee belonging to the department. Generate grade data by department. Specifically, the grade analysis means 213 extracts the employee data 230 including the department identifier for which the department-specific grade data is generated, and “examination times: once” including the employee identifier and test identifier of each employee data 230. The scoring data 270 is extracted. The grade analysis means 213 creates a list of correct / incorrect answers in the scoring data 270 and a list of the number of retries for each question for employees belonging to this department. Next, the grade analysis means 213 generates, for each question, a correct answer rate bar graph for each department in which the overall average correct answer rate, the correct answer rate for each department in this department, and the correct answer rates for other departments excluding this department are arranged as bar graphs. To do. Furthermore, the result analysis means 213 generates a retry count bar graph for each department in which the overall average value of the number of retries, the average value of the department, and the average value of other departments are arranged in a bar graph for each problem. Then, the result analysis means 213 generates department-specific result data including these.

  Next, the control unit 21 executes department-by-department result data notification processing (step S2-7). Specifically, the result analysis unit 213 of the control unit 21 acquires the department data 220 including the department identifier from the department data storage unit 22 and specifies the employee identifier of the head of the department included in the department data 220. Then, the grade analysis means 213 extracts employee data 230 including the identified employee identifier from the employee data storage unit 23. The result analysis means 213 transmits the generated department-specific result data to the email address included in the employee data 230.

  The department head terminal 12 displays the department-specific result data attached to the received mail on the display based on the operation of the department head. On this display, a correct answer rate bar graph 70 for each department as shown in FIG. 7A and a retry number bar graph 80 for each department as shown in FIG. 7B are displayed.

  On the other hand, when the skill management system 20 transmits individual performance data to each examinee and transmits department-specific performance data for the department head to which the examinee belongs, the performance analysis completed flag is recorded for this test data 240. To do. This completes the grade report process.

According to this embodiment, the following effects can be obtained.
In the present embodiment, the control unit 21 of the skill management system 20 transmits the question screen data to the examinee terminal 11, and the examiner terminal 11 displays the question screen based on the question screen data. When the examinee answers all the questions and selects the send button, the examinee terminal 11 transmits the answer data to the skill management system 20. The control unit 21 of the skill management system 20 compares the answer data with the correct answer data, specifies answer correct / incorrect data associated with the question number, specifies the test result, and records it as scoring data 270. In the case of “failed”, the control unit 21 transmits to the examinee terminal 11 a result notification mail including a message prompting the user to perform a retest. For this reason, it is possible to urge the examinee to perform a retest until the acceptance standard is reached. Therefore, the examinee can be made to answer the question that is poorly understood many times, and the skill improvement of the examinee can be expected.

  -In this embodiment, the control part 21 performs the calculation process of the average value of the number of retries using the scoring data 270 (step S2-3), and the total average value of the number of retries in each problem and the number of individual retries Generate a retry bar graph for each individual with the. The control unit 21 generates personal result data including this individual retry count bar graph, stores it in the test taker data storage unit 26, and executes notification processing for the test taker (step S2-5). Since there is a high possibility that the problem with a large number of retries is not accurately understood, the examinee grasps the field where his skill is low by viewing the retry number bar graph 60 included in the personal results data data. be able to. In addition, by comparing with the overall average value of the number of retries, it is possible to eliminate the difficulty of the problem and to objectively grasp a field where the skill is lower than that of others.

  In the present embodiment, in the personal results data generation process (step S2-4), the control unit 21 uses the individual retry count and average value for each problem classified by category, and the individual for each problem classified by difficulty. Personal performance data including the number of retries and the average value thereof is generated. For this reason, the examinee can grasp a part with poor understanding level for each category, or can grasp the degree of understanding level from the difficulty level of the problem.

  -In this embodiment, the control part 21 produces | generates the correct answer rate bar graph which arranged the average correct answer rate in each question, and the individual correct answer rate for every question category in the production | generation process (step S2-4) of individual performance data. This correct answer bar graph is included in the personal performance data. For this reason, the examinee who has browsed the personal result data can grasp the level of the examinee who has taken the same examination.

  -In this embodiment, the control part 21 has memorize | stored the review required reference data which attaches the grade comment to the effect that a review is required for every category or each difficulty from the frequency | count of retry. The control unit 21 calculates the comment determination ratio in the personal result data generation process (step S2-4), and compares this with the review-required criteria. The grade analysis means 213 includes a grade comment that “review is necessary” in the personal grade data when the comment judgment ratio is higher than the review requirement, and if it is lower than the review requirement, Include a comment on the grade in the personal grade data. For this reason, the examinee who has browsed the personal results data can efficiently grasp the category and the difficulty level of his / her understanding level from the results comments.

  -In this embodiment, the control part 21 produces | generates the performance data classified by department (step S2-6), and performs the transmission process of the performance data classified by department (step S2-7). For this reason, the department head of each department can grasp the problems that the examinees belonging to his department do not understand by browsing the departmental result data. Therefore, it is possible to efficiently improve the skills of employees by reviewing in the department regarding problems that are not well understood by employees belonging to the department.

  In the present embodiment, when the retry setting in the test data 240 is the partial retry setting, the control unit 21 of the skill management system 20 uses the score data 270 of the test taker to determine the problem that the test taker has not yet answered correctly. Extract and send. On the other hand, if the retry setting is the all-retry setting, all problems are extracted and transmitted. For this reason, the retry setting can be appropriately changed according to the intention of the questioner.

Moreover, you may change the said embodiment as follows.
In the above embodiment, the control unit 21 calculates an overall average value of the number of retries (step S2-1), and a retry number graph in which the overall average value of the number of retries in each problem and the individual retry number are arranged. The personal result data including is generated (step S2-3). The statistical value of the number of retries calculated from other examinees compared with the number of individual retries is not limited to the average value, and may be, for example, a median value (median) or a mode value (mode).

  In the above embodiment, the control unit 21 acquires employee identifier data that identifies an employee to be tested through a computer terminal. However, the present invention is not limited to this, and the skill management system 20 may automatically identify an employee who takes an examination from tests that the employee has taken in the past, and acquire employee identifier data. Specifically, the test data 240 is provided with a data area for storing data relating to a test taker test condition relating to a condition for taking this test. This candidate test condition is a test identifier that identifies a test that must already pass to take this test. The test creator inputs a test identifier of a test that needs to pass in order to take the newly set test into the test data 240 via the computer terminal. Then, when the test data 240 is recorded, the skill management system 20 extracts the scoring data 270 including the test identifier recorded as the examinee test condition, and the test result of the scoring data 270 and the passing level are extracted. To identify the employee identifier of the employee who has passed the examination of the candidate exam conditions. Then, the skill management system 20 may execute an examination notification process by sending an examination notice mail to the employee identifier. In this case, it is possible to take an examination according to the skill of the employee, so that skill improvement can be efficiently achieved according to the current skill of each employee.

In the above embodiment, the control unit 21 of the skill management system 20 transmits an examination notification email to the employee taking the examination. However, the present invention is not limited to this, and a message indicating that the employee is taking an examination may be transmitted to the department head to which this employee belongs. In this case, the test setting unit 210 of the control unit 21 extracts the employee data 230 having the same department identifier from the employee data 230 including the employee identifier of the employee who has transmitted the examination notification mail. The test setting unit 210 generates in-department candidate notification data including the name of the employee in the extracted employee data 230 and the test name, test type, and test period included in the test data 240. The test setting means 210 extracts the department data 220 including the department identifier of the extracted employee data 230 from the department data storage unit 22, and stores the employee data 230 including the employee identifier of the head of the department included in the department data 220 as the employee data storage. Extracted from the unit 23. Then, the test setting unit 210 transmits an in-department examiner notification mail to the mail address of the employee data storage unit 23. As a result, the head of the affiliation can understand the employees taking the examination in the department and the examination period, so it can be expected to encourage the examinee to take the examination more reliably.

  In the above embodiment, the problem data 250 is specified from the test identifier and the problem number. Instead, a problem identifier that identifies the problem may be assigned to the problem data 250. For example, the test data 240 includes data associating a problem number and a problem identifier that are given in this test. In this case, since the problem can be associated with a plurality of tests, the already created problem can be used for other tests.

  In the above embodiment, the skill management system 20 is connected to the examinee data storage unit 26 that records examinee data including the result analysis result data. The control unit 21 of the skill management system 20 records the generated personal result data in the test result data storage unit 26 in the result analysis result data area associated with the employee identifier and the test identifier of the employee. The skill management system 20 may perform a test suitable for the examinee based on the result analysis result data. Specifically, the skill management system 20 is connected to review question data storage means that stores data related to review questions. This review question data includes data on categories, difficulty levels, question formats, question contents, correct answers, and reference contents. The control unit 21 of the skill management system 20 specifies the category and difficulty level to which the grade comment “review is necessary” in the individual grade data of the examinee in association with the employee identifier. And the control part 21 extracts the review question data corresponding to this category and difficulty, and transmits to the mail address of the employee data 230 containing an employee identifier for every predetermined period (for example, every day). As a result, employees can easily review categories and difficulty issues that are poorly understood, so that the skills of employees can be improved efficiently.

1 is a schematic diagram of a system in an embodiment. It is a block diagram of the data recorded on the data storage part, (a) shows a department data storage part, (b) shows an employee data storage part, (c) shows a test data storage part. It is a block diagram of the data recorded on the data storage part, (a) shows a problem data storage part, (b) shows a scoring data storage part. The flowchart for demonstrating the process sequence of a test implementation process. The flowchart for demonstrating the process sequence of a results analysis process. It is explanatory drawing explaining the data contained in personal performance data, (a) shows a correct answer rate bar graph, (b) shows a retry number bar graph. It is explanatory drawing explaining the data contained in the results data according to a department, (a) shows a correct answer rate bar graph, (b) shows a retry frequency bar graph.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 ... Testee terminal, 12 ... Affiliate terminal terminal, 20 ... Skill management system, 21 ... Control part as a control means, 22 ... Department data storage part, 23 ... Employee data storage part, 24 ... Test data storage part, 25 ... Question data storage unit, 26 ... examinee data storage unit, 27 ... answer data storage unit, 210 ... test setting means, 211 ... authentication means, 212 ... test execution means, 213 ... grade analysis means, 220 ... department data, 230 ... Employee data, 240 ... test data, 250 ... question data, 270 ... scoring data.

Claims (6)

A candidate identifier that identifies the candidate, a test identifier that identifies the exam, a problem identifier that identifies the question to be tested on the exam, and the number of times the candidate has answered the question, A scoring data storage means for recording scoring data regarding the correctness of the answer;
A data storage means that records review-required criteria used to select a grade comment for encouraging review;
A skill evaluation system comprising a control means for analyzing a candidate's skills,
The control means includes
Extracting the scoring data of a plurality of test taker identifiers from the scoring data storage means, for each question, using the number of tests recorded in the scoring data, calculating the statistical value of the number of retries until the correct answer,
Calculate the total number of issues where the number of retries exceeds the statistical value, and calculate the comment determination ratio by dividing the total number by the total number of questions.
If the comment determination ratio is equal to or higher than the review required standard, the first grade comment for reviewing is specified. If the comment determination ratio is lower than the review required standard, the second grade comment indicating that the comment is understood. A skill evaluation system comprising: a grade analysis means for generating and outputting personal grade data including the identified first grade comment or the second grade comment . Before Symbol test identifier, and issues the identifier for identifying the problems involved in this study, an identifier identifying a category of the problem, the problem, the problem data storage means for recording in association with answer to this problem,
Review question data storage means for storing review question data including categories and difficulty levels, question contents, correct answers and reference contents;
It is further connected to the candidate terminal used by the candidate,
The review criteria are stored by category,
The result analysis means calculates the total number of problems for which the number of retries exceeds the statistical value for each category, and calculates the comment determination ratio by dividing the total number by the total number of questions for each category. Then, specify the first grade comment or the second grade comment by category,
The control means further comprises means for extracting a review question corresponding to the category to which the first grade comment is attached from the review question data storage means and transmitting it to the examinee terminal of the examinee at predetermined intervals. The skill evaluation system according to claim 1, wherein: Test data storage means for storing test data relating to the test, including a test identifier, a question number given in the test, and a question identifier for identifying the question;
3. The problem data storage unit stores problem data including an identifier for specifying a category and a difficulty level, a problem, and an answer to the problem, with respect to the problem identifier. Skill evaluation system described in. A test taker test condition data storage means for storing a test taker test condition that is a test identifier that specifies a test that needs to be passed in order to take the test for a test identifier specifying the test;
A scoring data storage means for associating a test taker identifier for specifying a test taker, a test identifier of a test taken by the test taker, and the test result;
The control means includes
Means for extracting a test identifier as a test taker test condition in the test taker test condition data storage means when a test identifier of a newly set test is input;
Means for extracting from the scoring data storage means a candidate identifier of a candidate who has passed a test of a test identifier of a candidate test condition;
4. The skill evaluation system according to claim 2, further comprising means for transmitting an examination notification mail to an examinee terminal used by the examinee having the extracted examinee identifier . A candidate identifier that identifies the candidate, a test identifier that identifies the exam, a problem identifier that identifies the question to be tested on the exam, and the number of times the candidate has answered the question, A scoring data storage means for recording scoring data regarding the correctness of the answer;
A data storage means that records review-required criteria used to select a grade comment for encouraging review;
A skill evaluation method that analyzes a candidate's skill using a control means,
The control means includes
Extracting the scoring data of a plurality of test taker identifiers from the scoring data storage means, for each question, using the number of tests recorded in the scoring data, calculating the statistical value of the number of retries until the correct answer,
Calculate the total number of issues where the number of retries exceeds the statistical value, and calculate the comment determination ratio by dividing the total number by the total number of questions.
If the comment determination ratio is equal to or higher than the review required standard, the first grade comment for reviewing is specified. If the comment determination ratio is lower than the review required standard, the second grade comment indicating that the comment is understood. A skill evaluation method characterized by executing a grade analysis step of generating and outputting personal grade data including the identified first grade comment or second grade comment . A candidate identifier that identifies the candidate, a test identifier that identifies the exam, a problem identifier that identifies the question to be tested on the exam, and the number of times the candidate has answered the question, A scoring data storage means for recording scoring data regarding the correctness of the answer;
A data storage means that records review-required criteria used to select a grade comment for encouraging review;
A skill evaluation program that analyzes the skills of examinees using control means,
The control means;
Extracting the scoring data of a plurality of test taker identifiers from the scoring data storage means, for each question, using the number of tests recorded in the scoring data, calculating the statistical value of the number of retries until the correct answer,
Calculate the total number of issues where the number of retries exceeds the statistical value, and calculate the comment determination ratio by dividing the total number by the total number of questions.
If the comment determination ratio is equal to or higher than the review required standard, the first grade comment for reviewing is specified. If the comment determination ratio is lower than the review required standard, the second grade comment indicating that the comment is understood. A skill evaluation program that functions as a grade analysis unit that generates and outputs personal grade data including the identified first grade comment or second grade comment .

Images