JP3819256B2 - Difficulty determination program and difficulty determination device - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention provides a difficulty level determination program that dynamically determines the difficulty level of a test based on a test result for a subject.
[0002]
[Prior art]
Conventionally, questions that are given in order to determine the ability of the examinee are usually determined in advance by the subject in advance by subjectivity or by examination with the subject's colleagues. Alternatively, the difficulty level is determined by performing a trial test on the examinee in advance.
[0003]
[Problems to be solved by the invention]
However, the conventional difficulty level determination method has the following problems.
[0004]
When the difficulty level of a problem is determined by the subjectivity of the questioner, the objectivity is lacking, and there is a difference between the difficulty level of the problem indicated by the result of the examinee actually tackling the same problem. In addition, when the difficulty level of a question is determined based on the results of examinations between the questioner and his / her colleague, since the questioner and his / her colleague are at a level far from the examinee, Deviation occurs. Furthermore, when a trial test is performed on a subject who seems to be the same level as the examinee in advance, it takes time and cost, and the degree of difficulty is influenced by the characteristics of the subject.
[0005]
Due to this discrepancy in the difficulty level, you must work on a problem that can be answered correctly despite being a highly competent person, or a person who does not have sufficient ability. There were problems such as having to tackle problems that could not be answered at all.
[0006]
In other words, because there is a gap in the difficulty determination of the problem for determining the ability of the examinee, the current ability of the examinee could not be accurately determined.
[0007]
Therefore, an object of the present invention is to provide a difficulty level determination program that dynamically determines the difficulty level of a test based on a test result from a subject.
[0008]
[Means for Solving the Problems]
In order to solve the above problems, the present invention dynamically determines the difficulty level of a test problem based on the test result of a tested subject. On the computer Judgment Let In the difficulty determination program To the computer, Multiple test questions When Tested by matrix with multiple subjects Answering the problem Indicate correct or incorrect answer Stored in the storage area with By referring to the test question subject table, a counting procedure for counting the degree of correct answers for subjects who have also answered both test questions combined from the plurality of test questions, Degree A comparison procedure for comparing the degree of correct answer totaled for each of the two test questions based on the result of aggregation, and a higher degree of correct answer among the two test questions based on the comparison result by the comparison procedure In order of making the test questions easier than the other In the test question subject table above A difficulty order determination procedure for determining the order of difficulty by rearranging the order of the plurality of test questions in the matrix. Execute Configured as follows.
[0009]
In a computer system in which such a difficulty determination program is installed, the order of difficulty is determined based on the sum of test results of subjects who have received two tests.
[0010]
Therefore, since it is possible to determine the degree of difficulty more accurately without performing a trial test, the cost can be reduced. In addition, it is difficult to be biased by the ability characteristics of the answerer group, and more accurate difficulty determination can be performed.
[0011]
As means for solving the above problems, the present invention may be a difficulty level determination device that executes the difficulty level determination program. Moreover, it can also be set as the storage medium which memorize | stored the said difficulty determination program. Furthermore, it may be a difficulty level determination method executed by the difficulty level determination program.
[0012]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[0013]
A server computer in which a program according to an embodiment of the present invention is installed is configured as shown in FIG. 1, for example.
[0014]
FIG. 1 is a diagram illustrating a configuration example of a test server. In FIG. 1, a test server 100 is a server computer, and issues a problem to answerer terminals 21 to 24 (hereinafter referred to as answerer terminals 20) used by answerers connected via a network 35. And receive the answer to the question from the answerer's terminal.
[0015]
The test server 100 includes a communication control processing unit 101, an installer 102, an input control processing unit 103, a display control processing unit 104, an output control processing unit 105, a question / correct answer table 107, and a question / answer receiving program 108. And a student table 109, a correct answer determination program 110, and a problem difficulty level determination processing unit 115.
[0016]
The communication control processing unit 101 is a processing unit that controls data transmitted and received via the network 35, and includes a communication unit for connecting to a network via a telephone line or a LAN (Local Area Network).
[0017]
For example, the installer 102 reads the program according to the present invention from the CD-ROM 120 set in the CD-ROM drive, and installs the read program in, for example, an auxiliary storage device. When a problem difficulty level determination process, which will be described later, is started, a CPU (central processing unit) that controls the entire computer starts the process according to the program installed in the auxiliary storage device. The medium for storing the program is not limited to a CD-ROM, and any medium that can be read by a computer may be used.
[0018]
The input control processing unit 103 is a processing unit that controls data from an input unit such as a mouse and a keyboard, and is input by an administrator of the test server 100 to perform problem difficulty level determination processing and the like as described later. Control various necessary information.
[0019]
The display control processing unit 104 is a processing unit that controls data to be displayed on a display unit such as a display, and displays various types of information necessary for an administrator on the display unit under the control of the CPU.
[0020]
The output control processing unit 105 is a processing unit that controls data output to an output unit such as a printer, and causes the output unit to output a processing result or specified information.
[0021]
The question / correct answer table 107 is a table for managing a problem registered in advance and a correct answer for each question in association with each other.
[0022]
The question / answer receiving program 108 is started by the CPU, and issues a question to the answerer 20 via the network 35 based on the question / correct answer table 107 and receives an answer to the question given from the answerer 20.
[0023]
The student table 109 is a table for managing answerer information regarding an answerer who answers a problem as a student.
[0024]
The correct answer determination program 110 is activated by the CPU and refers to the question / correct answer table 107 to determine whether the answer from the answerer terminal 20 provided from the question / answer reception program 108 is a correct answer.
[0025]
The problem difficulty level determination processing unit 115 further includes a problem / answer person correct answer table 111, a problem difficulty level determination program 112, a problem difficulty level order table 113, and a level distribution table 114.
[0026]
The question / answerer correct answer table 111 is a table for managing the correct answer or incorrect answer of the answerer for each question based on the determination result in the correct answer determination program 110.
[0027]
The problem difficulty level determination program 112 determines the difficulty level of a problem based on information indicating the correct answer or incorrect answer of an answerer for each problem managed in the question / answerer correct answer table 111.
[0028]
The problem difficulty level order table 113 is a table for managing the difficulty levels of problems determined by the problem difficulty level determination program 112.
[0029]
The level distribution table 114 is a table that is referred to when the difficulty level determination program 112 updates the level of difficulty, and the level is determined corresponding to the relative position with respect to the total number of problems.
[0030]
Next, processing by the problem difficulty level determination program 112 will be described with reference to FIGS. 2, 3, and 4 to 9.
[0031]
2 and 3 are flowcharts for explaining the problem difficulty level determination program. 4 to 9 are diagrams showing examples of a question / answerer correct answer table for explaining a processing process in the problem difficulty level determination program.
[0032]
In FIG. 2, the problem difficulty level determination program 112 sets “1” to the starting point pointer ino in the question / answerer correct answer table 111 (step S15), and the starting point pointer ino subtracts “1” from the number of questions. It is determined whether it is larger (step S16). If larger, the process proceeds to step S34.
[0033]
On the other hand, if the starting point pointer ino is not larger than the number of problems subtracted by “1”, the starting point pointer ino added with “1” is set to the compared pointer jno (step S17), and the compared pointer jno is the number of problems. It is determined whether it is larger (step S18). If it is larger, the starting point pointer ino is incremented by “1”, the process returns to step S16, and it is determined whether or not the starting point pointer ino is larger than the number of problems obtained by subtracting “1”. Thereafter, the same processing as described above is performed.
[0034]
On the other hand, if the compared pointer jno is not larger than the number of questions, “0” is set to the common answerer number no_com_ans, the problem score ipoint indicated by the origin pointer ino, and the problem score jpoint indicated by the compared pointer jno. (Step S10). Further, the answerer pointer idp is set to “1”, and it is determined whether or not the answerer pointer idp is larger than the number of answerers (step S21). If larger than the number of answerers, the process proceeds to step S28.
[0035]
On the other hand, if the answerer pointer idp is not larger than the number of answerers, it is determined whether or not the answerer idp has answered the question ino (step S22). If not answered, the process proceeds to step S23. On the other hand, when answering, it is further determined whether or not the same answerer idp has answered the question jno (step S24). If not answered, the process proceeds to step S23.
[0036]
On the other hand, when answering, the common answerer number no_com_ans is increased by “1” (step S25). Further, the score of the answerer idp is added to the score ipoint of the question ino (step S26). Further, the score of the answerer idp is added to the score jpoint of the question jno (step S27), and the process proceeds to step S23.
[0037]
In step S23, the answerer pointer idp is incremented by "1", the process returns to step S21, and the determination as to whether or not the next answerer has answered the question ino and the question jno is repeated.
[0038]
If the answerer idp becomes larger than the number of answerers in step S21 by repeating the processes of steps S21 to S23 and S24 to S27, whether or not the common answerer number no_com_ans is “3” or more, that is, the problem It is determined whether or not three or more people have answered both ino and question jno (step S28). When three or more people do not answer, the question jno is increased by “1” (step S29), and the process returns to step S18 in FIG. That is, similarly to the above, the process of comparing the same problem ino with the next problem jno is repeated.
[0039]
On the other hand, when three or more people have answered, it is determined whether or not the score jpoint of the question jno is higher than the score ipoint of the question ino (step S28). If not, the problem jno is incremented by “1” (step S29), the process returns to step S18 in FIG. 2, and the process of comparing the same problem ino with the next problem jno is repeated.
[0040]
On the other hand, if it is higher, in the question / answerer correct answer table 111, the question jno is moved to the inoth, and after the question ino is shifted one by one (step S31). Then, ino is set in jno, that is, problem jno is set as a starting point pointer (problem ino) (step S32). Further, the problem jno is incremented by “1” (step S29), and the process returns to step S18 in FIG. 2 to repeat the process of comparing the problem ino with the next problem jno.
[0041]
If it is determined in step 18 of FIG. 1 that jno is larger than the number of problems, and if ino increased by “1” is larger than the number of problems subtracted by “1” (steps S33 and S16), step S34 is executed. The difficulty level of the problem is updated by the processing from step S34 to S36.
[0042]
In step S34, each time ino is set to "1" and ino is incremented by "1", steps S35 and S36 are repeated until ino reaches the number of problems. A value obtained by dividing ino by the number of problems is set as a relative position (step S35), the relative position level distribution table 114 is looked up, and the obtained level is set as the level position of each question (step S36). If it is determined in step S34 that ino has exceeded the number of problems, the processing in the problem difficulty level determination program is terminated.
[0043]
In step S28, it is determined whether or not the number of common answerers no_com_ans is “3” or more. However, it is only necessary to have a combination of a predetermined number of people that can accurately determine the correct answer rate. May be a natural number greater than “3” as the predetermined number of people.
[0044]
The configuration of the level distribution table 114 referred to in step S36 is such that the relative position obtained in step S35 is “0” as in the example 1141 of the level distribution table when the difficulty level is indicated by five levels. .0 to less than 0.4 ”corresponds to level 1, and if the relative position is within the range of“ 0.4 to less than 0.7 ”, it corresponds to level 2 and the relative position is“ 0. If it is within the range of “.7 to less than 1.0”, it corresponds to level 3.
[0045]
The level distribution table 114 may include a plurality of tables corresponding to the number of levels. Further, for example, a table indicating the number of levels and the number of problems for each level set by the administrator of the test server 100 may be used.
[0046]
Next, in the example of the question / answerer correct answer table 111, the processing steps in the problem difficulty level determination program will be described in detail. Assume that the question / answerer correct answer table 111 has contents as shown in FIG.
[0047]
In FIG. 4, the question / answerer correct answer table 111 includes a level indicating the level of difficulty of a question, a Probe indicating a question number for identifying the question, a list of answerer names indicating the answerers who answered the question, and a question. , The number of correct answers indicating the number of correct answerers, and the correct answer rate indicating the correct answer rate of the problem. In the question / answerer correct answer table 111 shown in the example of FIG. 4, nine questions are classified into levels 1 to 3, and Probno “11”, “12”, and “13” are classified as level 1. Probno “21”, “22”, and “23” are classified as level 2, and Probno “31”, “32”, and “33” are classified as level 3.
[0048]
The answerer name list lists answerers who answered at least one of the problems indicated by the above Probno. In this case, the answerers from “Fujitsu Ichiro” to “Fuji Shichiro” are listed. If the answered question is correct, “1” is recorded, and if it is incorrect, “0” is recorded.
[0049]
The number of answers indicates the number of persons who answered the corresponding question in the list of answerer names (that is, the sum of “0” and “1”), and the number of correct answers indicates the number of correct persons among the answerers ( That is, the sum of “1”). The correct answer rate is represented by the number of correct answers / the number of answers.
[0050]
When the problem difficulty level determination program 112 is activated, the starting point pointer ino points to Probno “11” in step S15 of FIG. 2, and the compared pointer jno points to Probno “12” in step S17. In step S20, the answerer pointer idp points to “Ichiro Fujitsu” shown at the top of the answerer name list. In steps S22 and S24 in FIG. 3, it is determined that “Fujitsu Ichiro” pointed to by the answerer pointer idp has not answered both “11” and “12” of Probno. In step S23, the answerer pointer idp Refers to the next answerer, “Fujitsu Jiro”.
[0051]
In this case, in steps S22 and S24, it is determined that “Fujitsu Jiro” pointed to by the answerer pointer idp is answering both “11” and “12” of Probno. The value of the common answerer number no_com_ans is increased by “1” (step S25). Further, the score of the problem ino (= Probno “11”) of “Fujitsu Jiro” is accumulated in the score ipoint of the problem ino. In this case, “1” is accumulated. Further, the score of the question jno (= Probno “12”) of “Fujitsu Jiro” is accumulated in the score jpoint of the question jno. In this case, “1” is accumulated.
[0052]
When answering both Probno “11” and “12” by shifting the answerer pointer idp one by one in step S23 of FIG. 3 and repeating the processing in steps S21 to S27, The number of common answerers no_com_ans, the score ipoint of the question ino (the score of Probno “11”), and the score jpoint of the question jno (the score of Probno “12”) are accumulated. In step S28 and S30, if the number of respondents answering both is three or more and the score jpoint of the question jno is higher than the score ipoint of the question ino, the question jno is determined as the position of the question ino. (Steps S31 and S32). In this case, “Fujitsu Jiro”, “Fujitsu Goro”, “Fujitsu Shichirou”, “Fujitsu Kuro” and “Fujitsu Juro” in the list of answerers answer both Probno “11” and Probno “12”. The score ipoint of the accumulated problem ino is “6”, and the score jpoint of the accumulated problem jno is “7”. Accordingly, since the correct answer rate of Probno “12” is high, Probno “12” moves to the position of Probno “11” in the question / answerer correct answer table 111, and after Probno “11”, it is shifted to the right one by one. As shown in FIG. 5, a question / answerer correct answer table 111 is configured.
[0053]
As shown in FIG. 5, by performing the same process as described above, in the comparison between Probno “12” and Probno “13”, the list of answerer names “Fujitsu Shichirou”, “Fujitsu Kuro”, “Fujitsu Juro”, “Fujiro Jiro” "Saburo Fuji" and "Fujisaburo" answer to both questions, the score ipoint of the accumulated problem ino is "5", and the score jpoint of the accumulated problem jno is "4" Therefore, the movement of Probno “13” is not performed.
[0054]
In the comparison between Probno “12” and Probno “21”, the answerer name list of “Fujitsu Goro”, “Fujitsu Shichirou”, “Fujitsu Kukuro”, “Fuji Jiro”, “Fujisaburo”, and “Fuji Nankuro” Since the person has answered both questions, the score ipoint of the accumulated problem ino is “5”, and the score jpoint of the accumulated problem jno is “4” (according to the determination in step S30 of FIG. Branch to “No”), and Probno “21” is not moved.
[0055]
In the comparison between Probno “12” and Probno “22”, only two people, “Jiro Fujitsu” and “Fujitsu Goro” in the list of answerers, answer both questions (steps in FIG. 3). Branching to “No” by the determination in S28), Probno “22” is not moved.
[0056]
In the comparison between Probno “12” and Probno “23”, four respondents, “Fujitsu Jiro”, “Fujitsu Goro”, “Fujitsu Kuro” and “Fujisaburo”, answered both questions. Since the score ipoint of the accumulated problem ino is “4” and the score jpoint of the accumulated problem jno is “3” (branch to “No” by the determination in step S30 of FIG. 3), Probno “23” Do not move.
[0057]
In the comparison between Probno “12” and Probno “31”, 6 of the answerer name lists “Fujitsu Jiro”, “Fujitsu Shichirou”, “Fujitsu Juro”, “Fuji Jiro”, “Fuji Saburo”, and “Fuji Nankuro” Since the person has answered both questions, the score ipoint of the accumulated problem ino is “5”, and the score jpoint of the accumulated problem jno is “6” (according to the determination in step S30 in FIG. Branch to “Yes”), move Probno “31” to the position of Probno “12”, and after Probno “12”, shift to the right one by one, and the question / answerer correct answer table 111 is configured as shown in FIG. Is done.
[0058]
Further, when the same processing as described above is continued with Probno “31” as the starting point pointer ino, each Probno “12”, “13”, “11”, “21”, “22”, “23”, “32” and “32” In comparison with “33”, branching to “No” is made according to the determination in step S28 or step S30 in FIG. 3, and thus Probno is not moved. The starting point pointer ino is incremented by “1” (step S33 in FIG. 2) and set to Probno “12”, and the same processing as described above is continued.
[0059]
As described above, when the comparison with the eighth question from the beginning as the starting point pointer ino is completed, a question / answerer correct answer table 111 is configured as shown in FIG.
[0060]
As shown in FIG. 7, in the question / answerer correct answer table 111, the questions are arranged in the order of difficulty, for example, Probno “31”, Probno “12”, Probno “22”, Probno “23”, Probno “13”, Probno “11”. , Probno “21”, Probno “32”, and Probno “33”.
[0061]
The level is updated by the processing in steps S34 to S36 in FIG. 2, and the difficulty level is set as shown in FIG. In FIG. 8, the Level “3” indicating the difficulty level is “Probno” “31” to the level “1”, the Level “2” is the Probe “22” to the level “1”, and the level “1”. The probe “13” is updated to the level “2”, the probe “11” which is the level “1” is updated to the level “2”, and the Probe “21” which is the level “2” is updated to the level “3”. It is stored in the problem difficulty level order table 113.
[0062]
Further, as can be seen from FIG. 8, at the updated level, a high accuracy rate is not always an easy problem and a low accuracy rate is not necessarily a more difficult problem. For example, level “2” includes Probno “23”, “13”, and “11”, and the correct answer rates are “85.71”, “62.50”, and “66.67”, respectively. “3” includes Probno “21”, “32”, and “33”, and the correct answer rates are “55.56”, “50.00”, and “73.33”, respectively. Probno “33” indicating higher accuracy than Probno “13” and “11” included in lvel “2” is included in lvel “3”.
[0063]
From the above, it is possible to dynamically update the difficulty level by, for example, starting the problem difficulty level determination processing unit 115 having the problem difficulty level determination program 112 at predetermined intervals. Moreover, since the difficulty level is determined based on the actual answer, it is not necessary to perform a trial test. Therefore, since it is not the subjective difficulty level determination of the questioner or the like, the difficulty level of the problem can be determined objectively.
[0064]
Next, a method for starting the problem difficulty level determination processing unit 115 by the administrator of the test server 100 will be described with reference to FIGS.
[0065]
FIG. 9 is a diagram showing an example of a test question level setting screen. In FIG. 9, a test question level setting screen example 200 includes a skill number input area 201 for inputting a skill number, a setting date display area 202 indicating a previous setting date for which a difficulty level is set, and a problem difficulty level determination program. 112, a difficulty level calculation button 203 for executing 112, an automatic setting button 204 for automatically setting the number of problems for each level, and a manual setting button 205 for an administrator to manually set the number of problems for each level , A level-specific input area 206 for setting the number of problems for each level, and a test result display area 209 for displaying test results.
[0066]
When the administrator of the test server 100 inputs a skill number for which the difficulty level of the problem is to be determined in the skill number input area 201, the problem difficulty level determination processing unit 115 receives the skill number input from the question / answerer correct answer table 111. The test result display area 209 displays a list of test results indicating the answerers who answered the question corresponding to the test results and their results. For example, when the administrator inputs “1245” in the skill number input area 201, a test result list indicating the answerers who answered the problem corresponding to the skill number “1245” and their results is displayed in the test result display area 209. The The test result list displayed in the test result display area 209 has the same data structure as the question / answerer correct answer table 111 shown in FIG.
[0067]
Further, the problem difficulty level determination processing unit 115 acquires the previous set date when the difficulty level of the problem corresponding to the skill number is updated from the problem difficulty level order table 113 and displays the acquired date in the set date display area 202.
[0068]
The administrator refers to the test result list displayed in the test result display area 209 and selects either the automatic setting button 204 or the manual setting button 205 when changing the level assignment. When the number of problems is automatically set for each level, the problem difficulty level determination program 112 is started by clicking the automatic setting button 204 and clicking the difficulty level calculation button 203. On the other hand, when manually setting the number of problems for each level, a manual setting button 205 is clicked. Then, the number of problems is assigned to each level in the input area 206 for each level where the level is shown in the upper stage and the number of problems is entered in the lower stage. From FIG. 9, for example, by assigning the number of questions “3” to levels 1 to 3 and setting the number of questions “0” to levels 4 to 5, the assignment is made to levels 1 to 3. When the administrator inputs the number of questions for each level in the level-specific input area 206 and clicks the difficulty level calculation button 203, the problem difficulty level determination processing unit 115 distributes the setting information in the level-specific input area 206 to the level distribution. The table 114 is stored in an auxiliary storage device or the like, and the problem difficulty level determination program 112 is executed.
[0069]
The difficulty level determination result obtained by executing the problem difficulty level determination program 112 is, for example, as shown in the screen example of FIG.
[0070]
FIG. 10 is a diagram illustrating an example of a test question level update instruction screen. In FIG. 10, the test question level update instruction screen example 210 includes a skill number display area 211 for displaying a skill number, a set date display area 212 for indicating a previous set date for which a difficulty level is set, and a calculated level. An update instruction button 213 for setting the difficulty level and a test result display area 219 for displaying a test result indicating the updated level are provided.
[0071]
The administrator of the test server 100 refers to the update level in the update instruction screen example 210 by referring to the result display area 219 in which the updated level of the problem corresponding to the skill number “1245” indicated in the skill number display area 211 is indicated. When the level indicated by (update-level) is set as the level (origin-level) before update, the update instruction button 213 is clicked. origin-level indicates the level updated on the previous set date indicated in the set date display area 212.
[0072]
When the administrator of the test server 100 clicks the update instruction button 213, the result of the level update is displayed, for example, as in the screen example of FIG.
[0073]
FIG. 11 is a diagram showing an example of a test question level update completion screen. In FIG. 11, the test question level update completion screen example 220 is set to a skill number display area 221 for displaying a skill number, a set date display area 222 for indicating a set date when the difficulty level is updated, and an updated level. A test result display area 229 for displaying a test result list;
[0074]
The administrator of the test server 100 refers to the update completion display area 229 in the update instruction screen example 220 and is set to the updated level of the problem corresponding to the skill number “1245” indicated in the skill number display area 221. Check the test result list. The set date display area 222 displays the current date.
[0075]
As described above, the test server 100 in which a problem is provided (answered) to the answerer terminal 20 via the Internet dynamically determines the difficulty level of the problem in a situation where the problem is randomly asked without specifying the time. Can be updated sequentially. In addition, as the participation of the answerer increases, the accuracy of the problem difficulty determination is improved. Therefore, since it is possible to determine the difficulty level of the problem more accurately, as a result, it becomes possible to accurately grasp the ability of the answerer.
[0076]
In addition, since the difficulty level determination with high accuracy can be performed, it is possible to perform an appropriate question according to the ability of the answerer. In other words, it is a person who has to work on a problem that can be answered correctly despite the fact that it is a person with high ability, which has been caused by a deviation in the conventional difficulty determination, or who has not achieved enough ability Nevertheless, problems such as having to tackle problems that cannot be answered at all can be avoided.
[0077]
In the above example, the processing from step S22 to S30 shown in FIG. 3 corresponds to the comparison procedure, and the processing in steps S31 and S32 shown in FIG. 3 corresponds to the order of difficulty order determination.
[0078]
Appendices.
(Supplementary note 1) In the difficulty determination program for dynamically determining the difficulty of a test problem based on the test result of a tested subject,
A comparison procedure for comparing the test results of each of the two common test questions that are aggregated for subjects who have received two common test questions in a combination of two tests of the plurality of tests;
A difficulty level determination program comprising: a difficulty level order determination procedure for determining the order of difficulty levels between the two test questions based on a comparison result by the comparison procedure.
(Appendix 2) In the difficulty determination program described in Appendix 1,
The difficulty determination program in which the comparison procedure does not compare the test results when the number of subjects who have received the two tests does not satisfy a predetermined number.
(Appendix 3) In the difficulty determination program described in Appendix 1 or 2,
The difficulty level determination procedure is a difficulty level determination program that determines a test problem with a higher percentage of correct answers in order of difficulty level that makes it easier than the other test problem based on the comparison result of the comparison procedure.
(Supplementary Note 4) In the difficulty determination program according to any one of Supplementary Notes 1 to 3,
A difficulty level determination program having a level assignment procedure for assigning a level indicating a level of difficulty level based on the difficulty level order of test questions determined by the difficulty level order determination procedure.
(Supplementary Note 5) In the difficulty level determination program according to any one of Supplementary Notes 1 to 5,
The level assignment procedure is a difficulty level determination program in which the test questions are assigned based on a level reference management table for managing the assignment reference to the level for each level.
(Appendix 6) In the difficulty determination program according to any one of appendices 1 to 5,
The comparison procedure includes a sum calculation procedure for acquiring a test result of a subject who has received the two test questions by the combination from the test result table for managing the test result by a matrix of the test question and the subject and calculating a sum. A difficulty determination program.
(Supplementary note 7) In the difficulty determination program according to any one of supplementary notes 1 to 6,
A difficulty level determination program having a result management procedure for managing a test result determined based on an answer to a test question transmitted from the subject via a network using the test result table.
(Additional remark 8) In the difficulty determination apparatus which determines the difficulty of a test problem dynamically based on the test result of the tested subject,
A comparison means for comparing test results of each of the two common test questions that are aggregated for subjects who have received two common test questions in a combination of two tests among a plurality of tests;
A difficulty level determination device having difficulty level order determination means for determining the order of difficulty levels between the two tests based on a comparison result by the comparison means.
(Additional remark 9) In the storage medium which stored the program for making a computer perform the process in the difficulty determination apparatus which determines the difficulty of a test problem dynamically based on the test result of the test subject,
A comparison procedure for comparing the test results of each of the two common test questions that are aggregated for subjects who have received two common test questions in a combination of two tests of the plurality of tests;
A storage medium storing a program having a difficulty order determination procedure for determining a difficulty order between the two tests based on a comparison result of the comparison procedure.
(Additional remark 10) In the difficulty determination method which determines the difficulty of a test problem dynamically based on the test result of the tested subject,
A comparison procedure for comparing the test results of each of the two common test questions that are aggregated for subjects who have received two common test questions in a combination of two tests of the plurality of tests;
A difficulty level determination method comprising: a difficulty level order determination procedure for determining a difficulty level order between the two tests based on a comparison result by the comparison procedure.
[0079]
【The invention's effect】
As described above, according to the present invention, it is possible to determine the degree of difficulty more accurately without performing a trial test, so that the cost can be reduced. In addition, since the order comparison is performed by combining a predetermined number of examinees who have answered the same two questions, it is difficult to be biased by the ability characteristics of the answerer group, and a more accurate difficulty determination can be performed. Furthermore, as the number of students increases, the accuracy of the difficulty level determination result of the problem group is successively increased by performing this comparison. That is, as the number of examinees increases, the accuracy of difficulty determination increases.
[0080]
In addition, it is possible to realize a problem difficulty level determination adapted to the Internet age, in which questions can be randomly asked.
[0081]
[Brief description of the drawings]
FIG. 1 is a diagram illustrating a configuration example of a test server.
FIG. 2 is a flowchart for explaining a problem difficulty level determination program;
FIG. 3 is a flowchart for explaining a problem difficulty level determination program;
FIG. 4 is a diagram illustrating an example of a processing process in a problem difficulty level determination program;
FIG. 5 is a diagram illustrating an example of a processing process in a problem difficulty level determination program;
FIG. 6 is a diagram illustrating an example of a processing process in a problem difficulty level determination program;
FIG. 7 is a diagram illustrating an example of a processing process in a problem difficulty level determination program;
FIG. 8 is a diagram illustrating an example of a processing process in a problem difficulty level determination program;
FIG. 9 is a diagram illustrating an example of a test question level setting screen.
FIG. 10 is a diagram illustrating an example of a test question level update instruction screen;
FIG. 11 is a diagram illustrating an example of a test question level update completion screen;
[Explanation of symbols]
20 Answerer terminal
35 network
100 test server
101 Communication control processing unit
102 Installer
103 Input control processing unit
104 Display control processing unit
105 Output control processing unit
107 question / correct answer table
108 Application / answer reception program
109 Student table
110 Correct answer determination program
111 Question / answerer correct answer table
112 Problem difficulty determination program
113 Problem difficulty order table
114 level distribution table
115 Problem difficulty determination processing section
120 CD-ROM

Claims (5)

Based on the tested subject test results, the dynamically difficulty determination program Ru is determined difficulty of test questions on a computer, in the computer,
When a test question is answered by a matrix of a plurality of test questions and a plurality of subjects, the test questions are indicated by indicating a correct or incorrect answer and referring to a test question subject table stored in a storage area. A totaling procedure for totaling the degree of correct answers for subjects who answered both test questions combined from the questions;
A comparison procedure for comparing the degree of correct answer calculated in each of the two test questions based on the result of calculating the degree of correct answer by the calculation procedure;
Based on the comparison result of the comparison procedure, the plurality of test problems in the matrix in the test problem subject table in order of making the test problem with the higher degree of correctness of the two test problems easier than the other test problem A difficulty determination program for executing a difficulty order determination procedure for rearranging the order of difficulty and determining the order of difficulty. The difficulty determination program according to claim 1, wherein the computer includes:
The subject number counting procedure for counting the number of subjects who have received the above two test questions is executed ,
The comparison procedure is a difficulty determination program in which the test results are not compared when the number of subjects does not satisfy a predetermined number. The difficulty determination program according to claim 1 or 2, wherein the computer includes:
By referring to the level distribution table in which the level indicating the level of difficulty is associated with the relative position with respect to the whole of the plurality of test questions, the level of the test questions in the sorted order of difficulty is determined. difficulty determination program was so that to execute the level determination procedure for determining the level. The difficulty determination program according to claim 1 or 2, wherein the computer includes:
An acquisition procedure to get the number of test questions from the user for each level indicating the level of difficulty,
According order of difficulty of the difficulty order determination procedure test questions determined by, based on the number of test questions for the each level, and to so that to execute the level assignment procedure to assign the levels to each test question Difficulty determination program. In the difficulty level determination device that dynamically determines the difficulty level of the test problem based on the test result of the tested subject,
When a test question is answered by a matrix of a plurality of test questions and a plurality of subjects, the test questions are indicated by indicating a correct or incorrect answer and referring to a test question subject table stored in a storage area. A counting means for counting the degree of correct answers for subjects who answered both test questions combined from the questions;
Comparing means for comparing the degree of correct answers calculated for each of the two test questions based on the result of calculating the degree of correct answers by the counting means;
Based on the comparison result by the comparison means, the plurality of test questions in the matrix in the test question subject table in the order in which the test question with the higher degree of correctness among the two test questions is easier than the other test question. A difficulty level determination device having difficulty level order determination means for rearranging the order of difficulty levels and determining the difficulty level order.

Images