JP2002351304A - Program and device for deciding difficulty - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a difficulty deciding program which dynamically decides the difficulty of a test according to test results of examinees. SOLUTION: This difficulty deciding program which dynamically decides the difficulty of test problems according to the test results of the examinees having tests has a comparison procedure for comparing the test results of two common test problems which are totaled targeting the examinees having had the two common test problems in a combination of two of tests and a difficulty order determining means for determining the difficulty order of the two test problems based on the comparison result by the comparison procedure.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION The present invention provides a difficulty determination program for dynamically determining the difficulty of a test based on a test result for a subject.

[0002]

2. Description of the Related Art Conventionally, questions to be taken in order to determine the ability of a test taker are usually determined in advance by the test taker subjectively or by examining with a colleague of the test taker to determine the degree of difficulty of the test. I have. Alternatively, the degree of difficulty is determined by conducting a trial test on a test taker in advance.

[0003]

However, the above-described conventional method of determining the degree of difficulty has the following problems.

[0004] If the difficulty level of the question is determined by the subjectivity of the subject, the degree of difficulty is low in objectivity and the difficulty level of the question indicated by the result of the examinee actually working on the same question occurs. Also, if the difficulty level of the question is determined based on the results of the examination between the subject and his / her colleagues, the challenger and his / her colleague are at a level far from the examinees, so the difficulty of the This causes a gap. Furthermore, if a trial test is performed on a test subject who is considered to be substantially the same as the test taker in advance, it takes time and cost, and the degree of difficulty is determined by the characteristics of the test subject.

[0005] Due to such a deviation of the difficulty level determination, it is necessary to address a problem in which a person who has high ability can surely answer correctly even if the person has high ability, or a person who does not achieve sufficient ability. Nevertheless, there were problems such as having to tackle problems that could not be answered at all.

In other words, there is a deviation in the difficulty determination of the problem for determining the ability of the examinee, and as a result, the current ability of the examinee could not be accurately determined.

It is an object of the present invention to provide a difficulty determination program for dynamically determining the difficulty of a test based on a test result from a subject.

[0008]

According to the present invention, there is provided a difficulty determination program for dynamically determining the difficulty of a test question based on a test result of a tested subject. In a combination of two tests among the tests, a comparison procedure of comparing test results of each of the two common test questions aggregated for subjects who have received two common test questions, and a comparison result by the above comparison procedure And a difficulty order determination procedure for determining the order of difficulty between the two test questions based on the above.

In the computer system in which such a difficulty determination program is installed, the order of the difficulty is determined based on the sum of the test results of the two test subjects.

Therefore, it is possible to more accurately determine the difficulty level without performing a trial test, thereby reducing costs. In addition, bias is less likely to occur due to the ability characteristics of the group of solvers, and more accurate difficulty determination can be performed.

As a means for solving the above problems, the present invention can also be a difficulty level determining apparatus for executing the above difficulty level determining program. Further, it may be a storage medium storing the above-mentioned difficulty determination program. Furthermore,
A difficulty level determination method executed by the above difficulty level determination program may be used.

[0012]

Embodiments of the present invention will be described below with reference to the drawings.

A server computer in which a program according to an embodiment of the present invention is installed is configured, for example, as shown in FIG.

FIG. 1 is a diagram showing a configuration example of a test server. In FIG. 1, a test server 100 is a server computer, and sends a question to answerer terminals 21 to 24 (hereinafter, referred to as the answerer terminal 20) used by an answerer connected via a network 35. Provide and receive the answer to the question from the answerer terminal.

The test server 100 includes a communication control processing unit 10
1, the installer 102, and the input control processing unit 103
, Display control processing unit 104, output control processing unit 105
And a question / correct answer table 107, a question / answer receiving program 108, a student table 109, a correct answer determining program 110, and a problem difficulty determining unit 115.

The communication control processing unit 101 is connected to the network 3
And a communication unit for connecting to a network via a telephone line or a LAN (Local Area Network).

The installer 102 is, for example, a CD-R
The program according to the present invention is read from the CD-ROM 120 set in the OM drive, and the read program is installed in, for example, an auxiliary storage device. Then, when a problem difficulty determination process described later is started, a CPU (central processing unit) that controls the entire computer starts the process according to the program installed in the auxiliary storage device. The medium for storing the program is not limited to the CD-ROM, but may be any medium that can be read by a computer.

The input control processing unit 103 is a processing unit for controlling data from an input unit such as a mouse and a keyboard. The input control processing unit 103 is used by an administrator of the test server 100 to perform a problem difficulty determination process described later. Controls various necessary information input to the.

The display control processing section 104 is a processing section for controlling data to be displayed on a display unit such as a display, and displays various information necessary for an administrator on the display unit under the control of the CPU.

The output control processing unit 105 is a processing unit for controlling data output to an output unit such as a printer, and outputs a processing result or designated information to the output unit.

The question / correct answer table 107 is a table for managing a question registered in advance and a correct answer for each question.

The question / answer receiving program 108 is a CP
It is started by U and, based on the question / correct answer table 107, issues a question to the answerer 20 via the network 35 and accepts an answer to the question set by the answerer 20.

The student table 109 is a table for managing the solver information regarding the solver who answers the question as a student.

The correct answer determination program 110 is started by the CPU and refers to the question / correct answer table 107 to
It is determined whether or not the answer from the answerer terminal 20 provided from the question / answer receiving program 108 is a correct answer.

The problem difficulty determination processing section 115 further includes a problem / answerer correct answer table 111, a problem difficulty determination program 112, a problem difficulty order table 113, and a level distribution table 114.

The question / answerer correct answer table 111 is a table for managing the correct answer or incorrect answer of the answerer for each question based on the judgment result of the correct answer judgment program 110.

The problem difficulty determination program 112 determines the difficulty of the problem based on information indicating the correct or incorrect answer of the solver for each problem managed in the problem / answerer correct answer table 111.

The problem difficulty order table 113 is a table for managing the difficulty of the problem determined by the problem difficulty determination program 112.

The level distribution table 114 is a table referred to when the difficulty level is updated by the problem difficulty determination program 112, and the level is determined corresponding to the relative position with respect to the total number of questions.

Next, the processing by the problem difficulty level determination program 112 will be described with reference to FIGS. 2, 3, and 4 to 9.

FIGS. 2 and 3 are flowcharts for explaining the problem difficulty determination program. FIGS. 4 to 9 are diagrams showing examples of question / answerer correct answer tables for explaining the processing steps in the question difficulty determination program.

In FIG. 2, the problem difficulty level determination program 112 sets "1" to the starting point pointer ino in the question / answerer correct answer table 111 (step S15).
It is determined whether or not the starting point pointer ino is larger than the number of questions obtained by subtracting “1” (step S16). If large,
Proceed to step S34.

On the other hand, if the starting pointer ino is not larger than the number of questions obtained by subtracting “1”, the compared pointer jno
Is set as the starting pointer ino to which "1" is added (step S17), and it is determined whether or not the compared pointer jno is larger than the number of questions (step S18). If it is larger, the start pointer ino is incremented by "1", and the process returns to step S16 to determine whether the start pointer ino is larger than the number of questions obtained by subtracting "1". Thereafter, the same processing as described above is performed.

On the other hand, if the compared pointer jno is not larger than the number of questions, the number of common answerers no_com_ans,
Score ipoin of the problem indicated by the origin pointer ino
"0" is set to t and the score jpoint of the problem indicated by the compared pointer jno (step S10).
Further, the answerer pointer idp is set to "1", and it is determined whether or not the answerer pointer idp is larger than the number of answerers (step S21). If it is larger than the number of answerers, the process proceeds to step S28.

On the other hand, if the answerer pointer idp is not larger than the number of answerers, it is determined whether or not the answerer idp has answered the question ino (step S22). If not, the process proceeds to step S23. On the other hand, if the answer is yes, it is further determined whether or not the same answerer idp has answered the question jno (step S24). If not, the process proceeds to step S23.

On the other hand, when answering, the number of common answerers n
o_com_ans is increased by “1” (step S2)
5). In addition, the answer i
The score of dp is added (step S26). Further, the score of the answerer idp is added to the score jpoint of the question jno (step S27), and the process proceeds to step S23.

In step S23, the answerer pointer idp is incremented by "1", and the process returns to step S21 to repeatedly determine whether the next answerer has answered questions ino and jno.

Steps S21-S23 and S24-S2
If the answerer idp becomes larger than the number of answerers in step S21 by repeating the process of step 7, if the number of common answerers no_com_ans is equal to or more than “3”, that is, if both the question ino and the question jno It is determined whether three or more persons have answered (step S28).
If three or more have not answered, the question jno is increased by "1" (step S29), and the process returns to step S18 in FIG. That is, as described above, the process of comparing the same problem ino with the next problem jno is repeated.

On the other hand, when three or more persons answer,
The score jpoint of o is the score ippoint of the problem ino
It is determined whether it is higher (step S28). If not high, the problem jno is increased by "1" (step S2).
9) Returning to step S18 in FIG. 2, the process of comparing the same question ino with the next question jno is repeated.

On the other hand, if the answer is high, the question jno is moved to the ino-th position in the question / answerer correct answer table 111,
Shift one by one after the problem ino (Step S3)
1). Then, ino is set to jno, that is, the question jno is set as a starting point pointer (question ino) (step S32). Further, the question jno is incremented by "1" (step S29), and the process returns to step S18 in FIG. 2 to repeat the process of comparing the question ino with the next question jno.

If it is determined in step 18 in FIG. 1 that jno is greater than the number of questions, and it is further determined that ino, which has increased "1", is greater than the number of questions, in which "1" has been subtracted (steps S33 and S16). ), And step S34 is executed. In the processing from steps S34 to S36, the difficulty level of the problem is updated.

In step S34, "1" is set in ino.
Is set, and each time ino is increased by “1”, steps S35 and S36 are repeated until ino becomes the number of questions. The value obtained by dividing ino by the number of questions is set as a relative position (step S35), the relative position level distribution table 114 is drawn, and the obtained level is set as the level position of each question (step S36). If it is determined in step S34 that ino has exceeded the number of questions, the processing in the question difficulty determination program ends.

In step S28, the number of common answerers no_
It is determined whether or not “com_ans” is equal to or greater than “3”. Any combination of a predetermined number of persons that can accurately determine the correct answer rate may be used. A larger natural number may be specified.

In the configuration of the level distribution table 114 referred to in step S36, for example, when the difficulty is indicated by five levels, the relative position obtained in step S35 is obtained as in the example 1141 of the level distribution table. Is "0.0
If the relative position is within the range of "less than 0.4 to 0.7", it corresponds to level 2 and the relative position is "0.7. If it is within the range of “less than 1.0”, it corresponds to level 3.

The level distribution table 114 may have a plurality of tables corresponding to the number of levels. Further, for example, a table indicating the number of levels and the number of questions for each level set by the administrator of the test server 100 may be used.

Next, with reference to an example of the question / answerer correct answer table 111, the processing steps in the question difficulty level determination program will be described in detail. It is assumed that the question / answerer correct answer table 111 has, for example, contents as shown in FIG.

In FIG. 4, the question / answerer correct answer table 111 includes a level indicating the level of difficulty of the question,
Probno indicating the question number specifying the question, a list of answerers indicating the answerers who answered the question, the number of correct answers indicating the number of correct answers, the number of correct answers indicating the number of correct answerers, and the correct answer indicating the correct answer rate of the question With rate. Further, in the question / answerer correct answer table 111 shown in the example of FIG. 4, nine questions are classified into levels 1 to 3, and as level 1, Prob
No. “11”, “12” and “13” are classified, and as Level 2, Probno “21”, “22” and “2”
3 is classified, and as level 3 Probno “3”
1 "," 32 "and" 33 ".

The answerer name list is a list of answerers who have answered at least one of the questions indicated by the above Probno. In this case, answerers from "Fujitsu Ichiro" to "Fuji Shichiro" are listed. If the answer is correct, “1” is recorded, and if it is incorrect, “0” is recorded.

The number of answers indicates the number of persons who answered the corresponding question in the list of answerers (that is, the sum of “0” and “1”). (That is, the sum of “1”). The correct answer rate is represented by the number of correct answers / the number of answers.

When the problem difficulty determination program 112 is started, the starting point pointer ino is determined in step S15 in FIG.
Indicates Probno "11", and in step S17, the compared pointer jno indicates Probno "12". In step S20, the answerer pointer id
p is "Ichiro Fujitsu" shown at the top of the answerer name list
Point to. In steps S22 and S24 of FIG. 3, it is determined that "Fujitsu Ichiro" indicated by the answerer pointer idp has not answered both of "11" and "12" of the Probno, and in step S23, the answerer pointer idp Refers to the next respondent, Jiro Fujitsu.

In this case, in steps S22 and S24, "Fujitsu Jiro" indicated by the answerer pointer idp is Pr
It is determined that the user has answered both the obno “11” and “12”, and the value of the number of common answerers no_com_ans is increased by “1” as the number of people who answered both questions (step S25). Furthermore, the problem ino (=
Probno "11") is assigned to the question i
Accumulates at point. In this case, “1” is accumulated. Also, the problem jno (= Probn) of "Jiro Fujitsu"
o “12”) is calculated as the score jpoint of question jno.
Accumulates. In this case, “1” is accumulated.

In step S23 of FIG. 3, the answerer pointer idp is shifted by one answerer at a time, and the processing from steps S21 to S27 is repeated to obtain Probn.
o If you answer both "11" and "12",
The number of common respondents no_com_ans, the score ipoint of the problem ino (score of Probno "11") and the score jpoint of the problem jno (score of Probno "12") are accumulated. In steps S28 and S30, if the number of respondents answering both is three or more and the question jn
The score jpoint of o is the score ippoint of the problem ino
If higher, the question jno is moved to the position of the question ino (steps S31 and S32). In this case, "Jiro Fujitsu", "Goro Fujitsu", "Shiroro Fujitsu", "Kuro Fujitsu" and "Juro Fujitsu" in the answerer name list are
Answering to both no “11” and Probno “12”, the score ipoint of the accumulated problem ino is “6”, and the score jpoint of the accumulated problem jno is “7”. Therefore, since the correct answer rate of Probno “12” is high, in the question / answerer correct answer table 111, the Probno “1” is located at the position of Probno “11”.
"2" moves, and after Probno "11", it shifts to the right one by one, and the question / answerer correct answer table 111 is configured as shown in FIG.

FIG. 5 shows that by performing the same processing as described above, Probno "12" and Probno "13"
In comparison with "Shirou Fujitsu" in the list of answerers,
“Fujitsu Kuro”, “Fujitsu Juro”, “Fuji Jiro”, “Fuji Saburo” and “Fuji Shichirou” have answered both questions, and the accumulated question ino score ipoint is “5”, Since the score jpoint of the accumulated question jno is “4”, the movement of the Probno “13” is not performed.

Probno "12" and Probno "2"
In comparison with "1", six people, "Goro Fujitsu", "Shiro Fujitsu", "Kuro Fujitsu", "Jiro Fuji", "Saburo Fuji" and "Shiro Fuji Fuji" in the list of answerers answered both questions. The score ipo of the accumulated problem ino
int is "5", score jpoi of accumulated problem jno
Since nt is “4” (branch to “No” according to the determination in step S30 of FIG. 3), the movement of Probno “21” is not performed.

Probno "12" and Probno "2"
In the comparison with "2," only two of the answerer names "Jiro Fujitsu" and "Goro Fujitsu" answered the two questions ("No" in the determination at step S28 in FIG. 3). "), And the Probno" 22 "is not moved.

Probno "12" and Probno "2"
In comparison with "3," four persons, "Jiro Fujitsu,""GoroFujitsu,""KuroFujitsu," and "Fujisaburo Fuji" in the list of answerers answered both questions, and the accumulated Since the score ipoint is “4” and the score jpoint of the accumulated question jno is “3” (branch to “No” according to the determination in step S30 of FIG. 3), Pr
Obno "23" is not moved.

Probno "12" and Probno "3"
In comparison with "1", six persons in the list of answerers, "Jiro Fujitsu", "Shiro Fujitsu", "Juro Fujitsu", "Jiro Fuji", "Saburo Fuji" and "Shiro Fuji" answered both questions. The score ipo of the accumulated problem ino
int is "5", score jpoi of accumulated problem jno
Since nt is “6” (branch to “Yes” according to the determination in step S30 in FIG. 3), Probno “31” is moved to the position of Probno “12”, and Probno is moved.
After “12”, each shifts to the right one by one, as shown in FIG.
The question / answerer correct answer table 111 is configured.

Further, if the same processing as described above is continued with Probno “31” as the starting point pointer ino,
no "12", "13", "11", "21", "2"
In the comparison with “2”, “23”, “32”, and “33”, the branch to “No” is made according to the determination in step S28 or step S30 in FIG. The starting point pointer ino is incremented by "1" (step S33 in FIG. 2), set to Probno "12", and the same processing as above is continued.

As described above, if the comparison using the eighth question from the beginning as the starting point pointer ino is completed, a question / answerer correct answer table 111 is constructed as shown in FIG.

From FIG. 7, the question / answerer correct answer table 11 is shown.
In 1, the problems are sorted in order of difficulty, for example, Probno
"31", Probno "12", Probno "2"
2 ", Probno" 23 ", Probno" 13 ",
Probno "11", Probno "21", Pro
It is rearranged in the order of bno “32” and Probno “33”.

The level is updated by the processing from steps S34 to S36 in FIG. 2, and the difficulty level is set as shown in FIG. In FIG. 8, the level indicating the difficulty level
Probno "31" which was "3" is level
Probno "2" which was level "2" to "1"
Probno “13”, which was level “1”, was level “1”, and Probno “13” was level “2”, level “1”.
Probno "11" which was 1 "1" is level
Probno "2" which was level "2" to "2"
"1" is updated to level "3" and stored in the difficulty level order table 113.

As can be seen from FIG. 8, at the updated level, a high accuracy rate is not always an easy problem and a low accuracy rate is not always a more difficult problem.
For example, level "2" has Probno "23",
"13" and "11", and the correct answer rate is "85.
71 "," 62.50 ", and" 66.67 ".
The vel “3” includes Probno “21”, “32” and “33”, and the correct answer rates are “55.56” and “5”, respectively.
0.00 "and" 73.33 ". The level “3” includes the levels “Probno” “13” included in the level “2” and the probno “33” having a higher accuracy rate than “11”.

From the above, the problem difficulty determination program 11
For example, by activating the problem difficulty level determination processing unit 115 having 2 at predetermined intervals, the difficulty level can be dynamically updated. Further, since the difficulty level is determined based on the actual answer, there is no need to perform a trial test. Therefore, since it is not a subjective difficulty determination of the subject or the like, the difficulty of the problem can be objectively determined.

Next, a method of activating the problem difficulty determination processing section 115 by the administrator of the test server 100 will be described with reference to FIGS.

FIG. 9 is a diagram showing an example of a screen for setting a test question level. In FIG. 9, a test question level setting screen example 200 includes a skill number input area 201 for inputting a skill number, a set date display area 202 indicating a previous set date on which a difficulty level has been set, and a problem difficulty level determination program. 112
Button 203 for automatically setting the number of questions for each level.
04, a manual setting button 205 for the administrator to manually set the number of questions for each level, an input area 206 for each level for setting the number of questions for each level, and a test result display area 209 for displaying test results. Having.

The skill number for which the administrator of the test server 100 wants to judge the difficulty of the problem is entered in the skill number input area 20.
When the answer is 1, the difficulty level determination processor 115 displays a list of test results indicating the answerers who answered the question corresponding to the skill number input from the question / answerer correct answer table 111 and their results, in the test result display area 209. To be displayed. For example, the administrator enters "1245" in the skill number input area 201.
Is entered in the test result display area 209, the answerers who answered the question corresponding to the skill number "1245" and the test result list showing their results are displayed. The test result list displayed in the test result display area 209 has the same data configuration as the question / answerer correct answer table 111 shown in FIG.

Further, the problem difficulty level determination processing section 115 obtains the last set date on which the difficulty level of the problem corresponding to the skill number is updated from the problem difficulty order table 113, and displays the updated date on the set date display area 202. Let it.

The administrator refers to the test result list displayed in the test result display area 209 and, when changing the level assignment, selects the automatic setting button 204 or the manual setting button 2.
05 is selected. When the number of questions is automatically set for each level, the automatic setting button 204 is clicked, and the difficulty calculation button 203 is clicked to start the question difficulty determination program 112. On the other hand, when the number of questions is manually set for each level, the manual setting button 205 is clicked. A level-specific input area 206 for inputting the number of questions in the lower row and the level in the upper row
Assign the number of questions to each level. From FIG. 9, for example, by assigning the number of questions “3” to levels 1 to 3 and setting the number of questions “0” to levels 4 to 5, assignment to levels 1 to 3 is made. The administrator inputs the number of questions for each level in the level-specific input area 206 and clicks on the difficulty level calculation button 203, so that the problem difficulty level determination processing unit 115 transfers the setting information of the level-specific input area 206 to the level distribution. It is stored in an auxiliary storage device or the like as a table 114, and the problem difficulty determination program 112 is executed.

The result of the difficulty determination by executing the problem difficulty determination program 112 is shown, for example, in a screen example of FIG.

FIG. 10 is a diagram showing an example of a test question level update instruction screen. In FIG. 10, a test question level update instruction screen example 210 includes a skill number display area 211 for displaying a skill number, a set date display area 212 for indicating a previous set date on which the difficulty level has been set, and a calculated level. An update instruction button 213 for setting the difficulty level and a test result display area 219 for displaying a test result indicating the updated level are provided.

The administrator of the test server 100 refers to the result display area 219 showing the updated level of the question corresponding to the skill number “1245” shown in the skill number display area 211 on the update instruction screen example 210. , Update level (u
To set the level indicated by “update-level” as the level before updating (origin-level), the user clicks the update instruction button 213. origi
n-level indicates the level updated on the previous set date shown in the set date display area 212.

When the administrator of the test server 100 clicks the update instruction button 213, the result of the level update is shown, for example, in the screen example of FIG.

FIG. 11 is a diagram showing an example of a screen for completing the update of the test question level. In FIG. 11, a test question level update completion screen example 220 has a skill number display area 221 for displaying a skill number, a set date display area 222 for indicating a set date on which the difficulty level has been updated, and an updated level. It has a test result display area 229 for displaying a test result list.

The administrator of the test server 100 refers to the update completion display area 229 in the update instruction screen example 220 and refers to the skill number “124” shown in the skill number display area 221.
Check the list of test results set to the updated level of the question corresponding to “5”. The set date display area 222 displays the current date.

As described above, the test server 100 in which a question is provided (answered) to the answerer terminal 20 via the Internet can be used in a situation where a question is randomly asked without specifying a time. Can be sequentially updated. In addition, with the increase in the participation of the solvers, the accuracy of the difficulty determination of the question improves. Therefore, it is possible to more accurately determine the difficulty level of the question, and as a result, it is possible to accurately grasp the ability of the answerer.

Further, since the difficulty level can be determined with high accuracy, an appropriate question can be made according to the ability of the answerer. In other words, it is a person who has to tackle a problem that can be answered correctly despite being a person with high ability, or a person who has not achieved sufficient ability, caused by the conventional deviation of the difficulty determination. Nevertheless, it is possible to avoid problems such as having to tackle a problem that cannot be answered at all.

In the above example, the processing from steps S22 to S30 shown in FIG. 3 corresponds to the comparison procedure, and the processing in steps S31 and S32 shown in FIG. 3 corresponds to the difficulty order determination procedure.

An additional note will be given. (Supplementary Note 1) In a difficulty level determination program that dynamically determines the difficulty level of a test question based on the test result of a tested subject, two test questions common to a combination of two tests among a plurality of tests. A comparison procedure for comparing the test results of each of the two common test questions tallied for the subjects who received the test, and a difficulty order between the two test questions is determined based on the comparison result of the comparison procedure. A difficulty determination program having a difficulty order determination procedure. (Supplementary Note 2) In the difficulty level determination program according to Supplementary Note 1, the comparing step may be such that the test results are not compared when the number of subjects who have undergone the two tests does not satisfy a predetermined number. Judgment program. (Supplementary note 3) In the difficulty level determination program according to Supplementary note 1 or 2, in the difficulty order determination step, a test question having a higher percentage of correct answers is easier than the other test question based on a comparison result obtained by the comparison procedure. A difficulty determination program that determines the order of difficulty. (Supplementary Note 4) In the difficulty level determination program according to any one of Supplementary Notes 1 to 3, a level indicating the level of the difficulty level is assigned based on the order of difficulty levels of the test questions determined in the procedure for determining the order of difficulty level. A difficulty level determination program having a level assignment procedure. (Supplementary Note 5) In the difficulty level determination program according to any one of Supplementary Notes 1 to 5, the level assignment procedure includes the test problem based on a level reference management table that manages an assignment reference to the level for each level. Difficulty level judgment program that assigns a character. (Supplementary Note 6) In the difficulty level determination program according to any one of Supplementary Notes 1 to 5, the comparing step includes the step of: combining the test result with a test result table that manages test results using a matrix of test questions and subjects.
A difficulty level determination program having a total sum calculation procedure of obtaining test results of subjects who have received three test questions and calculating a total sum. (Supplementary Note 7) In the difficulty determination program according to any one of Supplementary Notes 1 to 6, a test result determined based on an answer to a test question transmitted from the subject via a network is managed in the test result table. A difficulty determination program having a result management procedure to perform. (Supplementary Note 8) In a difficulty level determination device that dynamically determines the difficulty level of a test question based on a test result of a tested subject, two common test questions in a combination of two tests among a plurality of tests. Comparing means for comparing the respective test results of the two common test questions totaled for the test subjects who have received the test, and determining the order of difficulty between the two tests based on the comparison results by the comparing means A difficulty level determination device having difficulty level determination means. (Supplementary Note 9) In a storage medium storing a program for causing a computer to perform a process in a difficulty determination device that dynamically determines the difficulty of a test question based on a test result of a tested subject, 2 of the tests
In a combination of two tests, a comparison procedure for comparing test results of the two common test questions aggregated for subjects who received two common test questions, and a comparison result based on the comparison procedure, 2 above
A storage medium storing a program having a difficulty order determining procedure for determining the order of difficulty between two tests. (Supplementary Note 10) In a difficulty level determination method for dynamically determining a difficulty level of a test question based on a test result of a tested subject, two common test questions in a combination of two tests among a plurality of tests. A comparison procedure for comparing the test results of the two common test questions totaled for the subject who received the test, and a difficulty order between the two tests is determined based on the comparison result by the comparison procedure. A difficulty level determination method including a difficulty level determination procedure.

[0079]

As described above, according to the present invention, it is possible to more accurately determine the degree of difficulty without performing a trial test, thereby reducing costs. In addition, since order comparison is performed by a combination of a predetermined number or more of examinees who have answered two same questions, bias is hardly applied due to the ability characteristics of the group of answerers, and more accurate difficulty level determination can be performed. Further, each time the number of examinees increases, by performing this comparison, the accuracy of the difficulty level determination result of the problem group increases sequentially. That is, as the number of examinees increases, the accuracy of the difficulty level determination improves.

In addition, it is possible to determine the difficulty level of a problem suitable for the Internet age, in which questions can be set at random.

[0081]

[Brief description of the drawings]

FIG. 1 is a diagram illustrating a configuration example of a test server;

FIG. 2 is a flowchart for explaining a problem difficulty level determination program;

FIG. 3 is a flowchart for explaining a problem difficulty level determination program;

FIG. 4 is a diagram illustrating an example of a process in a problem difficulty level determination program.

FIG. 5 is a diagram showing an example of a process in a problem difficulty level determination program.

FIG. 6 is a diagram showing an example of a process in a problem difficulty level determination program.

FIG. 7 is a diagram showing an example of a process in a problem difficulty level determination program.

FIG. 8 is a diagram showing an example of a process in a problem difficulty level determination program.

FIG. 9 is a diagram illustrating an example of a test question level setting screen.

FIG. 10 is a diagram illustrating an example of a test question level update instruction screen;

FIG. 11 is a diagram illustrating an example of an update completion screen of a test question level.

[Explanation of symbols]

 Reference Signs List 20 solver terminal 35 network 100 test server 101 communication control processing unit 102 installer 103 input control processing unit 104 display control processing unit 105 output control processing unit 107 question / correct answer table 108 application / answer receiving program 109 examinee table 110 correct answer determining program 111 Question / answerer correct answer table 112 Problem difficulty determination program 113 Problem difficulty order table 114 Level distribution table 115 Problem difficulty determination processing unit 120 CD-ROM

Continued on the front page F-term (reference) 2C028 AA12 BA01 BA02 BC01 BD02 CA13

Claims (5)

[Claims] 1. A difficulty level determination program for dynamically determining a difficulty level of a test problem based on a test result of a tested subject, wherein two common tests are included in a combination of two tests among a plurality of tests. A comparison procedure for comparing the test results of the two common test questions aggregated for the subject who received the problem; A difficulty level determination program having a difficulty level determination procedure to be determined. 2. The difficulty determination program according to claim 1, wherein the comparing step does not compare the test results when the number of subjects who have undergone the two tests does not satisfy a predetermined number. Difficulty judgment program. 3. The difficulty determination program according to claim 1, wherein the order of difficulty determination step determines a test question having a higher percentage of correct answers based on a result of the comparison by the comparison step. A difficulty level determination program that is determined in order of difficulty level to be easier. 4. The difficulty level determination program according to claim 1, wherein the level indicating the level of the difficulty level is based on the order of the difficulty level of the test questions determined in the difficulty level determination step. A difficulty level determination program having a level allocation procedure for allocating a level. 5. A difficulty level determination device for dynamically determining the difficulty level of a test question based on a test result of a tested subject, comprising: two tests common to a combination of two tests among a plurality of tests. Comparing means for comparing the respective test results of the two common test questions aggregated with respect to the subject who received the problem; and determining the order of difficulty between the two tests based on the comparison result by the comparing means. And a difficulty order determining device.