JP2012088494A - Examination question evaluation system and method for controlling the same, program and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To efficiently and objectively evaluate an examination question.SOLUTION: A CPU 2 calculates a modified Ebel index which expresses difficulty and necessity degrees of an examination question based on the difficulty and necessity degrees of the examination question input when the question is prepared. The CPU 2 calculates a percentage of correct answers and discrimination index of the examination question based on data including answer contents that are a plurality of examinees' answers to the examination question. On the basis of the calculated modified Ebel index, the percentage of correct answers and the discrimination index, the CPU 2 calculates a question evaluation index that expresses quality of the examination question using a predetermined function and displays the calculated problem evaluation index on a display 6.

Description

  The present invention relates to a test question evaluation apparatus, a control method thereof, a program, and a recording medium for evaluating a test question used in an objective test repeatedly performed on a plurality of examinees.

  Objective tests that are repeatedly performed on multiple candidates, such as the doctor's national exam, the pharmacist's national exam, the nurse's national exam, and the driver's license exam. It is desirable that exams that give the same scoring results) promote the sound self-learning of candidates and improve their problem-solving ability. In addition, it is necessary to focus on the measurement of interpretation and problem-solving ability so that difficult questions and odd questions are eliminated and correct answers cannot be obtained by memorization alone. In addition, it is necessary to be able to distinguish between those who have learned and understood well and those who have not. Therefore, in the objective test, it is important to evaluate each test problem and review and update it appropriately and efficiently (see Patent Documents 1 and 2). Non-Patent Document 1 describes that an objective test test problem is evaluated by a modified ebel method (see Non-Patent Document 2) or based on a minimum pass level (MPL). Yes.

JP-A-2005-221895. JP2003-85296A.

Yutaka Hirano et al., “How to create high-quality exam questions and how to evaluate them”, Kinki University Medical Journal, Vol. 33, No. 4, pp. 323-328, 2008. Ushiba Okura et al., “Theory and Practice of Passing Test Levels”, Medical Education, Vol. 16, pp. 175-182, 1985.

  However, the evaluation of the test problem using only the modified ebel method or the minimum acceptable level has a problem that it is insufficient as an evaluation method for the test problem because it lacks objectivity and versatility.

  An object of the present invention is to solve the above-described problems and to provide a test problem evaluation apparatus, a control method thereof, a program, and a recording medium that can efficiently and objectively evaluate a test problem as compared with the prior art.

The test problem evaluation apparatus according to the first invention is:
Input means for inputting predetermined data input by the examiner of the test question;
Control means for executing question support processing for supporting creation of test questions and test question evaluation processing for evaluating the test questions;
A test problem evaluation apparatus comprising a storage means for storing in advance a modified ebel index calculation table showing a correspondence relationship between the difficulty level and necessity level of the test problem and the corrected ebel index indicating the necessity level and difficulty level of the test problem. There,
The control means includes
In the question support process, based on the difficulty level and necessity level of the test question input from the input means, the correction indicating the difficulty level and the necessity level of the test question with reference to the corrected ebel index calculation table Calculate the ebel index,
In the examination question evaluation process, the correct answer rate of the examination question and the higher grade examinees and the grades of the plurality of examinees are based on data including the contents of answers to the examination questions of a plurality of examinees. Calculate an identification index that represents the ability to distinguish lower grades from lower grades than upper grades, and based on the calculated corrected ebel index, correct answer rate, and identification index A problem evaluation index representing the quality of the test question is calculated and output using a predetermined function having the corrected ebel index, the correct answer rate, and the identification index as parameters.

  In the test question evaluation apparatus, the control means further classifies the test questions into a plurality of problem evaluation categories based on the calculated problem evaluation index in the test question evaluation process, and classifies the problem evaluations. The category is output.

  Further, in the test question evaluation apparatus, the control means is further classified into a problem evaluation category having a better problem evaluation index than a predetermined threshold value category among the plurality of question evaluation categories in the test question evaluation process. Test question data including the contents of the given test questions is stored in the storage means.

Furthermore, in the test problem evaluation apparatus, the test problem is a multiple-choice problem,
The control means further calculates a selection rate for each option of the multiple-choice question based on the data including the answer contents in the test question evaluation process, and classifies the test question into the plurality of question evaluation categories. After that, when there is an option with a predetermined selection rate or less, the classified problem evaluation category is changed so as to be lowered by one level.

Still further, in the test problem evaluation apparatus, the test problem is a multiple choice problem,
The control means further includes
In the questioning support process, the difficulty code representing the difficulty for each option of the multiple-choice question is input from the input means.
In the test question evaluation process, the input difficulty code is output together with the question evaluation index.

In the test question evaluation apparatus, the corrected ebel index is an expected correct answer rate used in the corrected ebel method,
The modified ebel index calculation table is used in the modified ebel method, and is a table showing the correspondence between the difficulty level and necessity level of the test questions and the expected correct answer rate.

The control method of the test question evaluation apparatus according to the second invention is:
Input means for inputting predetermined data input by the examiner of the test question;
Control means for executing question support processing for supporting creation of test questions and test question evaluation processing for evaluating the test questions;
A test problem evaluation apparatus comprising storage means for storing in advance a corrected ebel index calculation table indicating a correspondence relationship between the difficulty level and necessity level of a test problem and the corrected ebel index indicating the necessity level and difficulty level of the test problem. A control method,
In the questioning support process, the control means refers to the modified ebel index calculation table based on the difficulty level and necessity level of the test problem input from the input means, and determines the difficulty level of the test problem and Calculating a modified ebel index representing the degree of necessity;
The control means, in the test question evaluation process, based on the data including the answer contents for the test questions of a plurality of examinees, the correct answer rate of the test questions and Calculates an identification index that represents the ability to distinguish test takers from lower grades of lower grades than those of the higher grades, and calculates the corrected ebel index, correct answer rate, and discrimination And calculating and outputting a problem evaluation index representing the quality of the test question using a predetermined function having the corrected ebel index, correct answer rate, and identification index as parameters based on the index. Features.

  In the control method of the test question evaluation apparatus, the control means classifies the test questions into a plurality of question evaluation categories based on the calculated problem evaluation index in the test question evaluation process, and the classified The method further includes the step of outputting a problem evaluation category.

  Further, in the control method of the test problem evaluation apparatus, the control means has a problem evaluation category having a better problem evaluation index than a predetermined threshold value category among the plurality of problem evaluation categories in the test question evaluation process. The method further includes the step of storing the test question data including the contents of the test questions classified into the above-mentioned storage means.

Further, in the control method of the test problem evaluation apparatus, the test problem is a multiple choice problem,
In the test question evaluation process, the control means calculates a selection rate for each option of the multiple-choice question based on data including the answer contents, and classifies the test questions into the plurality of question evaluation categories. The method further includes a step of changing the classified problem evaluation category so as to be lowered by one step when there is an option having a predetermined selection rate or less.

Still further, in the control method of the test problem evaluation apparatus, the test problem is a multiple choice problem,
The control means, in the question support process, a step of inputting a difficulty level code representing a difficulty level for each option of the multiple-choice question from the input means;
The control means further includes a step of outputting the input difficulty code together with the problem evaluation index in the test question evaluation process.

Further, in the control method of the test question evaluation apparatus, the corrected ebel index is an expected correct answer rate used in the corrected ebel method,
The modified ebel index calculation table is used in the modified ebel method, and is a table showing the correspondence between the difficulty level and necessity level of the test questions and the expected correct answer rate.

  A program according to a third invention includes the steps of the control method for the test question evaluation apparatus.

  A computer-readable recording medium according to a fourth aspect of the present invention stores the above program.

  According to the test problem evaluation apparatus, the control method thereof, the program, and the recording medium according to the present invention, the corrected ebel index calculated based on the difficulty and necessity of the test problem input at the time of questioning, and the answer to the test problem Based on the correct answer rate and the identification index of the test questions calculated based on the data including the contents, the quality of the above test problem using a predetermined function with the corrected ebel index, the correct answer rate, and the identification index as parameters. A problem evaluation index that reflects both the evaluation contents of the test questions by the author and the objective numerical values obtained after the test can be automatically obtained. . For this reason, the test questions are automatically evaluated, and the quality of the test questions can be objectively determined as compared with the prior art.

It is a block diagram which shows the structure of the test question evaluation apparatus 1 which concerns on embodiment of this invention. It is a table which shows an example of the test question classification table 12 of FIG. It is a table which shows an example of the comment table 13 of FIG. It is a flowchart of the question support process performed by CPU2 of FIG. It is a flowchart of the test question evaluation process performed by CPU2 of FIG. 5 is a display example of a problem list window 100 displayed on the display 6 in step S1 of FIG. It is a display example of the problem input window 200 displayed on the display 6 in step S5 of FIG. It is an example of a display on the display 6 in step S18 of FIG.

  Hereinafter, embodiments according to the present invention will be described with reference to the drawings. In the following embodiments, the same reference numerals are assigned to the same components.

  FIG. 1 is a block diagram showing a configuration of a test question evaluation apparatus 1 according to an embodiment of the present invention, FIG. 2 is a table showing an example of the test question classification table 12 of FIG. 1, and FIG. 2 is a table showing an example of one comment table 13. In FIG. 1, a test question evaluation device 1 is a digital computer such as a personal computer, for example, and a terminal device for an author to create and evaluate a test question for a mock test in accordance with a doctor's national test. Used as In the present embodiment, each test question is a multiple choice question (hereinafter referred to as MCQ (Multiple Choice Question)) in which one option is selected from five options. The test question evaluation apparatus 1 includes a central processing unit (CPU) 2, a read only memory (ROM) 3, a random access memory (RAM) 4, a hard disk drive 5, a display 6, an operation input unit 7, a LAN. A (Local Area Network) interface 8 and an optical disk drive 20 are provided. The CPU 2 is connected to the ROM 3, RAM 4, hard disk drive 5, display 6, operation input unit 7, LAN interface 8, and optical disk drive 20 via a bus, and their respective operations and the overall operation of the test question evaluation apparatus 1. In addition to controlling the above, various software program processes (FIGS. 4 and 5) described later are executed.

  In FIG. 1, a display 6 is a display device such as a liquid crystal display device (LCD (Liquid Crystal Display)) or a CRT (Cathode Ray Tube) display, and displays the operation status of the test question evaluation device 1 and various GUIs. (Graphic User Interface) Functions as a display device for the program. Further, the operation input unit 7 includes, for example, a pointing device such as a mouse and character input means such as a keyboard. A user of the test question evaluation apparatus 1 such as a questioner and a test taker uses the operation input unit 7 to input data and instruction commands. Further, the LAN interface 8 is connected to the LAN 80 and receives signals and data from a plurality of M terminal devices 30-1 to 30-M connected to the LAN 80, while being connected to the LAN 80. Bidirectional interface processing related to LAN communication such as signal conversion and protocol conversion by transmitting signals and data from the CPU 2 to devices such as a plurality of M test taker terminal devices 30-1 to 30-M Execute. The optical disk drive 20 reads and outputs data and programs recorded on a computer-readable recording medium 21 such as a CD-ROM or DVD.

  In FIG. 1, the ROM 3 stores various software programs that are necessary for the operation of the test question evaluation apparatus 1 and executed by the CPU 2 in advance. Further, the hard disk drive 5 is a storage device with a built-in recording medium, and stores in advance a test question evaluation program 10 executed by the CPU 2, a modified ebel index calculation table 11, a test question classification table 12, and a comment table 13. To do. Here, the test question evaluation program 10 includes a question support processing program described in detail later with reference to FIG. 4 and a test question evaluation processing program described in detail later with reference to FIG. The hard disk drive 5 has N pieces (N is a positive integer) of test question data 14-1 to 14-N (hereinafter referred to as test question data 14-1 to 14) generated by the question support process. -N is not distinguished, it is called test question data 14). Further, the hard disk drive 5 includes a pool target test question data storage area 15 for storing pool (accumulation) target test question data 14 and test problem data that can be partially corrected (brushed up) to become a pool target problem. The test question storage area 16 for storing the test item 14 for storing the test item 14 and the test question data 14 that includes important corrections and can be a candidate for the subject to be re-executed by making corrections after thorough examination by the brush up. And a test subject storage area 17 to be brushed up including important corrections.

  Here, the modified ebel index calculation table 11 includes the difficulty (plain, medium, or difficult) and necessity (question, important, or essential) of the test questions set when the test question data 14 is generated by the questioner. The correspondence relationship with the modified ebel index is shown. Here, the modified ebel index is an index representing the difficulty and necessity of the test problem, and is set so as to increase as the difficulty decreases and the necessity increases. For example, an expected correct answer rate used in the modified ebel method (see Non-Patent Document 2) may be used as the modified ebel index. In this case, the modified ebel index calculation table 11 is set as follows.

  As shown in FIG. 2, the test question classification table 12 includes a correspondence relationship between a problem evaluation index representing the quality of the test question data 14 calculated by a test question evaluation process, which will be described in detail later, and a problem evaluation category of the test question. Indicates. Further, as shown in FIG. 3, the comment table 13 indicates a correspondence relationship between the problem evaluation category of the test question data 14 and the comment displayed on the display 6.

  Further, in FIG. 1, a RAM 4 is constituted by SRAM (Static RAM), DRAM (Dynamic RAM), SDRAM (Synchronous DRAM), etc., and is used as a working area of the CPU 2 to execute a program such as a test question evaluation program 10. Then, an execution program necessary for executing the function corresponding to the program to be executed, data necessary for executing the function, and temporary data generated at the time of execution are stored.

  Next, the question support process executed by the CPU 2 of FIG. 1 will be described with reference to FIG. FIG. 4 is a flowchart of the question support process executed by the CPU 2 in FIG. 1 to support the creation of the question questions of the questioner. The questioner uses the operation input unit 7 of the test question evaluation apparatus 1 to perform a predetermined operation (for example, on the display 6) for generating the test question data 14-n (n = 1, 2,..., N). When a predetermined icon displayed is clicked or a predetermined command is input in the console window displayed on the display 6), the CPU 2 responds to the test question evaluation program 10. The program for the question support process included in is executed.

  First, a problem list window 100 is displayed on the display 6 in step S1 of FIG. FIG. 6 is a display example of the problem list window 100 displayed on the display 6 in step S1 of FIG. As shown in FIG. 6, the question list window 100 has already been generated and stored in the hard disk drive 5 and a “new creation” button 101 for instructing to newly generate the test question data 14-n. A “problem correction” button 102 for instructing to correct the test question data 14-n and a list 103 of the test question data 14-n stored in the hard disk drive 5 are included. In step S2 of FIG. 4, it is determined whether or not the questioner has clicked the “New” button 101. If YES, the process proceeds to step S5. If NO, the process proceeds to step S3. Then, in step S3, it is determined whether or not the questioner has clicked the “correct problem” button 102. If YES, the process proceeds to step S4. If NO, the process returns to step S2. In step S 4, the problem data 14 -n selected in the list 103 of the problem list window 100 is read from the hard disk drive 5. Then, following step S4 or step S2, the question input window 200 is displayed on the display 6 in step S5.

  FIG. 7 is a display example of the problem input window 200 displayed on the display 6 in step S5 of FIG. In step S5, the interrogator performs an interactive question using the question input window 200 and the operation input unit 7 displayed on the display 6. As shown in FIG. 7, the question input window 200 includes a text box 201 for inputting a question sentence, text boxes 202-1 to 202-5 for inputting answer limbs for each option, and difficulty for each option. Select a drop-down list 23-1 to 23-5 for selecting and inputting a degree code, a drop-down list 204 for selecting and inputting a degree of necessity of an examination question, and a difficulty level of an examination question A drop-down list 205 for inputting and a “Save” button 206 are included. Here, the difficulty level code (see Non-Patent Document 1) is a code used for the lowest pass index (see Non-Patent Document 1), and indicates whether the option is correct and the difficulty level. The difficulty code is a difficulty code that indicates the correct answer (circled 2 (see Fig. 7)) and an inaccurate answer that is unavoidable even if the student with the lowest ability who can tolerate the acceptance cannot be distinguished from the correct answer. Difficulty level code (2) representing choices, and difficulty level code (1) representing choices of incorrect answers that may or may not be correct for students with the lowest ability that can be accepted. And a difficulty level code (0) representing an option selected by a student who does not seem to have learned the area related to the main examination question. In addition, the degree of necessity of the test questions is selected from among questions, important and essential. Furthermore, the difficulty level of the test questions is selected from among plain, medium and difficult. In the example of FIG. 7, the question sentence “Which is not appropriate as an informed consent?” Is entered in the text box 201. In addition, the following answering limbs and difficulty codes are input for each option.

[Table 1]
______________________________________________
Options Answering limbs difficulty code __________________________
a Explain the purpose of the therapeutic procedure. 0
b Explain therapeutic treatment options. 0
c Explain the risk of therapeutic treatment. 0
d Get a hospital waiver document signed. 2 representing the correct answer (circled 2)
e Get the consent document signed with consent. 0
______________________________________________

  Further, in FIG. 7, “required” is selected as the necessary degree using the drop-down list 204, and “easy” is selected as the difficulty level using the drop-down list 205. In step S3 in FIG. 4, the author clicks the “Problem Correction” button, and when the selected test question data 14-n is read from the hard disk drive 5 in step S4, the read is performed. In step S5, the question input window 200 displays the question text included in the test question data 14-n, the answer limbs and the difficulty level code for each option, and the necessity level and the difficulty level.

  Subsequent to step S5 of FIG. 4, in step S6, it is determined whether or not the questioner has clicked the “save” button 206 in the question input window 200. If YES, the process proceeds to step S7, while NO. If so, the process of step S6 is repeated. Next, in step S <b> 7, the CPU 2 calculates a corrected ebel index by referring to the corrected ebel index calculation table 11 based on the input necessity level and difficulty level. And in step S8, CPU2 is a test containing the inputted question sentence, the answer limb and difficulty code for every inputted option, the inputted necessity and difficulty, and the calculated corrected ebel index. The problem data 14-n is generated and stored in the hard disk drive 5, and the question support process is terminated.

  As described above, the question support data 14-n including the question sentence, the answer limb and difficulty code for each option, the necessity and difficulty, and the modified ebel index is obtained by the question support process of FIG. It can be generated and stored in the hard disk drive 5. In FIG. 1, each test taker terminal device 30-1 to 30 -M transmits the generated test question data 14 -n from the hard disk drive 5 to another test taker terminal device 30 via the LAN interface 8 and the LAN 80. -1 to 30-M are received and displayed on each display device of the examinee terminal devices 30-1 to 30-M. Each examinee answers the test questions in the test taker terminal devices 30-1 to 30-M, and the test taker terminal devices 30-1 to 30-M test the data including the answer contents via the LAN 80. It transmits to the problem evaluation device 1.

  Next, a test question evaluation process executed by the CPU 2 of FIG. 1 will be described with reference to FIG. FIG. 5 is a flowchart of the test question evaluation process executed by the CPU 2 of FIG. The questioner uses the operation input unit 7 of the test question evaluation apparatus 1 to click a predetermined operation (for example, a predetermined icon displayed on the display 6) for evaluating the test question data 14-n. Or a predetermined command is input in the console window displayed on the display 6), etc., the CPU 2 responds to this by the program for the test question evaluation process included in the test question evaluation program 10. Execute.

  First, in step S10, the CPU 2 receives data including answer contents for the test question data 14-n from the test taker terminal devices 30-1 to 30-M, and based on the received data, Each answer is scored, and the correct answer rate, the number of selectors for each option, the select rate for each option, and the identification index are calculated.

  Here, the correct answer rate of the test question data 14-n is a ratio (value of 0 or more and 1 or less) of test takers who correctly answered the test question data 14-n among all test takers. In addition, the identification index of the exam question data 14-n distinguishes among the examinees of the higher grades among all the examinees and the examinees of the lower grades of the grades lower than the above graded candidates. Represents ability. In the present embodiment, the identification index of the test question data 14-n is determined based on the correct answer rate of the test question data 14-n of the examinee with the highest grade of X% among all the test candidates. This is a value obtained by subtracting the correct answer rate of the test question data 14-n of the examinee of the lowest grade Y%, and is a numerical value of −1 or more and 1 or less. A test problem with a negative identification index may not be an appropriate problem, or may be measuring an ability that is different from the ability to measure in the test performed. Generally, it is preferable that the identification index exceeds 0.2. Further, the ratio X% of the highest grader and the percentage Y% of the lowest grader are, for example, 25%, 15%, 50%, etc., respectively, based on the overall score ranking including the exam question data 14-n. Is set to a predetermined value. Here, for example, when X = Y = 50%, the identification index of the test question data 14-n is lower than those of the higher grades of all the examinees and those of the higher grades. Describes the ability to distinguish lower grades from lower grades. For example, when X <50% and Y <50%, the identification index of the test question data 14-n is higher than those of the higher grades of all the examinees and those of the above higher grades. , Representing the ability to distinguish lower grades of lower grades through a predetermined number of examinees, where the higher grades are those who are above the first threshold rank, The candidate of the lower grade of the lower grade is a candidate who is lower than the second threshold rank lower than the first threshold rank, and therefore, identification of the test question data 14-n The index distinguishes among candidates who are higher grades above the first threshold rank and those who are lower grades below the second threshold rank. Represents the ability to

  Next, in step S11 following step S10, the CPU 2 uses a predetermined function to evaluate the problem evaluation index based on the corrected ebel index included in the test question data 14-n and the calculated correct answer rate and identification index. Is calculated. Here, the problem evaluation index E is expressed by the following equation.

[Equation 1]
E = f (x, y, z)

  Here, x is a modified ebel index, y is a correct answer rate, z is an identification index, and f is, for example, a linear combination of parameters x, y, and z each having a predetermined coefficient, or 2 It is a predetermined function that is combined by a higher-order equation of the order or higher. The problem evaluation index E calculated in this way represents the quality (good / bad) of the test problem. In this embodiment, the function f is set so that the problem evaluation index E of the test problem has a high value as the quality increases. The

  In FIG. 5, in step S12 following step S11, the CPU 2 refers to the problem classification table 12 based on the calculated problem evaluation index, and sets the test question data 14-n to the problem evaluation category A, B, or C. Classify. Here, the problem evaluation categories A, B, and C represent the quality of the test questions, and the quality deteriorates in the order of the problem evaluation categories A, B, and C. Specifically, the test question data 14-n classified in the problem evaluation category A is suitable for the pool target problem, and the test question data 14-n classified in the problem evaluation category B is partially corrected (brushed up). Can be a pooled problem. Further, the test question data 14-n classified in the problem evaluation category C needs to be significantly modified as compared with the test question data 14-n classified in the problem assessment category B. After reviewing the above, it can become a candidate for a problem to be re-implemented by correcting it.

  Next, in step S13, it is determined whether or not the test question data 14-n is classified into the problem evaluation category C. If YES, the process proceeds to step S16, and if NO, the process proceeds to step S14. Further, in step S14, it is determined whether or not there is an option with the number of selections of zero or an option with a selection rate of less than 2%. If YES, the process proceeds to step S15, whereas if NO, Proceed to step S16. In step S15, the problem evaluation category is lowered by one level (from problem evaluation category A to problem evaluation category B, or from problem evaluation category B to problem evaluation category C), and the process proceeds to step S16. In step S16, when the test question data 14-n is classified into the problem evaluation category A, it is stored in the pool target test question data storage area 15, and when it is classified into the problem evaluation category B, the brush-up target test question data is stored. If it is stored in the area 16 and is classified into the problem evaluation category C, it is stored in the test problem data storage area 17 to be brushed up including important corrections. By the process of step S16, the test problem data 14-n that is a pool target problem classified into the problem evaluation category A, the test problem data 14-n classified into the problem evaluation category B that needs partial correction, and the problem The test question data 14-n classified in the evaluation category C and requiring more important correction can be stored in different storage areas 15, 16 and 17, respectively. Next, in step S17, the option number of the examination question data 14-n, the difficulty code, the corrected ebel index, the correct answer rate, the number of selecters, the selection rate, the identification index, and the question are displayed on the display 6. The evaluation index and the problem evaluation category are displayed, the comment is displayed with reference to the comment table 13 based on the problem evaluation category, and the test question evaluation process is terminated. FIG. 8 is a display example on the display 6 in step S18 of FIG. In FIG. 8, a value (unit:%) obtained by multiplying the calculated correct answer rate by 100 is displayed as “correct answer rate”.

  Conventionally, the subjective evaluation of test questions using the modified ebel method and the evaluation of test questions based on objective values such as the correct answer rate obtained after the test are conducted independently. Based on this, the examiner himself had to evaluate the examination questions comprehensively. However, according to the present embodiment, based on the modified ebel index indicating the difficulty and necessity of the test questions set by the questioner at the time of writing, and the correct answer rate and identification index of the test questions obtained after the test is performed. The problem evaluation index is calculated, and the test questions are automatically evaluated based on the problem evaluation index. Therefore, it is possible to automatically obtain a problem evaluation index that reflects both the evaluation contents of the test questions by the questioner and the objective numerical values obtained after the test. For this reason, the test questions are automatically evaluated, and the quality of the test questions can be objectively determined as compared with the prior art.

  Further, as shown in FIG. 8, since the question evaluation classification of the test questions is displayed, the questioner is classified into the problem evaluation classification B based on the display, for example, in the examination problem storage area 16 to be brushed up. The stored test problem data 14 and the test problem data 14 classified in the problem evaluation category C and stored in the brush-up target test problem storage area 17 including important corrections can be examined and refined. Further, the test problem data 14-n classified into the problem evaluation category A (that is, having a problem evaluation index with a higher quality than the threshold category B and determined as a good question) is automatically pooled test questions. Since the data is stored in the data storage area 15, an objective test can be easily created as compared with the prior art. Therefore, according to the present embodiment, test creation can be assisted. Further, setting is made so that the test question data 14-n classified in the question evaluation category A and stored in the pool target test question data storage area 15 can be read from the terminal devices 30-1 to 30-M for the examinees. If this is done, the self-learning of the examinee can be promoted.

  Further, in the test question evaluation process of FIG. 5, when there is an option with the number of selections of zero or an option with a selection rate of less than 2%, the question evaluation category is lowered by one level (steps S14 and S15). Therefore, it is possible to perform a test question evaluation considering the selection rate for each option.

  In the above embodiment, the test question data 14 includes a multiple-choice question in which one option is selected from five options. However, the present invention is not limited to this, and may be a multiple-choice problem in which an arbitrary number of options are selected from an arbitrary number of options, or a discussion problem. However, in the case of a discussion problem, the difficulty level code cannot be set, and the process of step S18 is executed after the process of step S12 of FIG.

  In the above embodiment, the test question data 14 is classified into the problem evaluation categories A, B, and C based on the problem evaluation index. However, the present invention is not limited to this, and is divided into two or four or more problem evaluation categories. You may classify. For example, a problem evaluation category D representing a test problem that is too difficult or too easy to measure because it measures a different ability from the ability to be measured and cannot be a subject to be brushed up is added. It may be provided.

  Furthermore, the threshold value of the number of selected persons and the threshold value of the selection rate in step S14 and the threshold value of the problem evaluation index for classifying the test question data 14 in the test question classification table 12 are as described in this embodiment. It is not limited to the indicated value. These values may be changed so that the test question evaluation process is repeatedly executed and the test questions can be evaluated with higher accuracy.

  Furthermore, the minimum pass index (MPI (Minimum Pass Index), see Non-Patent Document 1) based on the difficulty code of each option set by the author in step S5 of the question support process of FIG. The test question data 14 that further includes the calculated minimum passing index may be generated. In this case, the minimum pass index is calculated by the following formula, for example.

[Equation 2]
Minimum passing index = 2 / (sum of values corresponding to difficulty code of each option)

  However, the value corresponding to the difficulty level code (2 circled) representing the correct answer is 2, the value corresponding to the difficulty level code (2) is 2, and the value corresponding to the difficulty level code (1). Is 1, and the value corresponding to the difficulty level code (0) is 0.

  In the above-described embodiment, the determined problem evaluation category A, B, or C is displayed on the display 6. However, the present invention is not limited to this, and printing output may be performed using an output unit such as a printer.

  Furthermore, in the said embodiment, the test question evaluation apparatus 1 was used in order for the questioner to create and evaluate the test question for the mock test based on the doctor national examination. However, the present invention is not limited to this, and may be used to create and evaluate test questions for objective tests in areas other than medicine, such as the pharmacist national exam or the nurse national exam.

  Furthermore, in the above-described embodiment, the test question evaluation program 10 and the tables 11 to 13 and data for the execution are stored in the hard disk drive 5 in advance. However, the present invention is not limited to this, and the test question evaluation program 10 recorded on the computer-readable recording medium 21 such as a CD-ROM or DVD, and the tables 11 to 13 and data for executing the program are stored. Each may be read by the optical disk drive 20 including a controller such as a computer and stored in the hard disk drive 5. Further, the test question evaluation program 10 and the tables 11 to 13 and data for executing the test question evaluation program 10 may be stored in the hard disk drive 5 from the external device of the test question evaluation device 1 via the Internet and the LAN interface 8. Good.

  Further, the CPU 2 displays the question input window 200 (see FIG. 7) on the display 6 in step S5 of the question support process of FIG. 4, but the present invention is not limited to this. For example, the CPU 2 may execute a support function for displaying a similar template problem together according to the problem type (in the example of FIG. 7, “Type A” as described above). Good. Further, the CPU 2 executes a guidance function at the time of problem creation (for example, a function that replaces the word “female” with the word “girl” when “3 years old” is entered when conforming to the core curriculum). May be.

  Furthermore, in the said embodiment, although the correct answer rate and the expected correct answer rate were values of 0 or more and 1 or less, this invention is not restricted to this, A percentage may be sufficient.

  As described above, according to the test problem evaluation apparatus, the control method thereof, the program, and the recording medium according to the present invention, the modified ebel index calculated based on the difficulty level and the necessity level of the test problem input at the time of writing And a predetermined function using the corrected ebel index, the correct answer rate, and the identification index as parameters, based on the correct answer rate and the identification index of the test question calculated based on the data including the answer contents for the test question. The problem evaluation index that expresses the quality of the above test questions is calculated and output, so a problem evaluation index that reflects both the evaluation contents of the test questions by the author and objective values obtained after the test is automatically performed. Can be obtained. For this reason, the test questions are automatically evaluated, and the quality of the test questions can be objectively determined as compared with the prior art.

1 ... Test question evaluation device,
2 ... CPU,
3 ... ROM,
4 ... RAM,
5. Hard disk drive,
6 ... Display,
7 ... operation input part,
8 ... LAN interface,
10 ... Exam question evaluation program,
11 ... Modified ebel index calculation table,
12 ... Exam question classification table,
13 ... Comment table,
14-1 to 14-N ... test question data,
15 ... Pool target test question data storage area,
16 ... Test question data storage area for brush-up,
17: Storage area for exam data subject to brush-up including important corrections,
20 ... Optical disc drive,
21. Recording medium,
31-1 to 31-M ... Terminal device for examinees,
80 ... LAN.

Claims (14)

Input means for inputting predetermined data input by the examiner of the test question;
Control means for executing question support processing for supporting creation of test questions and test question evaluation processing for evaluating the test questions;
A test problem evaluation apparatus comprising a storage means for storing in advance a modified ebel index calculation table showing a correspondence relationship between the difficulty level and necessity level of the test problem and the corrected ebel index indicating the necessity level and difficulty level of the test problem. There,
The control means includes
In the question support process, based on the difficulty level and necessity level of the test question input from the input means, the correction indicating the difficulty level and the necessity level of the test question with reference to the corrected ebel index calculation table Calculate the ebel index,
In the examination question evaluation process, the correct answer rate of the examination question and the higher grade examinees and the grades of the plurality of examinees are based on data including the contents of answers to the examination questions of a plurality of examinees. Calculate an identification index that represents the ability to distinguish lower grades from lower grades than upper grades, and based on the calculated corrected ebel index, correct answer rate, and identification index A test question evaluation apparatus characterized in that a problem evaluation index representing the quality of the test question is calculated and output using a predetermined function having parameters of a modified Ebel index, a correct answer rate, and an identification index.   In the test question evaluation process, the control means further classifies the test question into a plurality of question evaluation categories based on the calculated question evaluation index, and outputs the classified question evaluation categories. The test problem evaluation apparatus according to claim 1.   The control means further includes, in the test question evaluation process, a test including the contents of test questions classified into a problem evaluation category having a problem evaluation index having a quality higher than a predetermined threshold value category among the plurality of question evaluation categories. 3. The test problem evaluation apparatus according to claim 2, wherein problem data is stored in the storage means. The exam question is a multiple choice question,
The control means further calculates a selection rate for each option of the multiple-choice question based on the data including the answer contents in the test question evaluation process, and classifies the test question into the plurality of question evaluation categories. 4. The test question evaluation apparatus according to claim 2 or 3, wherein when there is an option having a predetermined selection rate or less, the classified question evaluation category is changed to be lowered by one step. The exam question is a multiple choice question,
The control means further includes
In the questioning support process, the difficulty code representing the difficulty for each option of the multiple-choice question is input from the input means.
5. The test question evaluation apparatus according to claim 1, wherein, in the test question evaluation process, the input difficulty code is output together with the question evaluation index. 6. The above modified ebel index is the expected correct answer rate used in the modified ebel method.
6. The corrected ebel index calculation table is used in the modified ebel method, and is a table showing a correspondence relationship between a difficulty level and a necessity level of an examination question and an expected correct answer rate. The test problem evaluation apparatus as described in any one. Input means for inputting predetermined data input by the examiner of the test question;
Control means for executing question support processing for supporting creation of test questions and test question evaluation processing for evaluating the test questions;
A test problem evaluation apparatus comprising storage means for storing in advance a corrected ebel index calculation table indicating a correspondence relationship between the difficulty level and necessity level of a test problem and the corrected ebel index indicating the necessity level and difficulty level of the test problem. A control method,
In the questioning support process, the control means refers to the modified ebel index calculation table based on the difficulty level and necessity level of the test problem input from the input means, and determines the difficulty level of the test problem and Calculating a modified ebel index representing the degree of necessity;
The control means, in the test question evaluation process, based on the data including the answer contents for the test questions of a plurality of examinees, the correct answer rate of the test questions and Calculates an identification index that represents the ability to distinguish test takers from lower grades of lower grades than those of the higher grades, and calculates the corrected ebel index, correct answer rate, and discrimination And calculating and outputting a problem evaluation index representing the quality of the test question using a predetermined function having the corrected ebel index, correct answer rate, and identification index as parameters based on the index. A control method for a test problem evaluation apparatus.   The control means further includes a step of classifying the test problem into a plurality of problem evaluation categories based on the calculated problem evaluation index and outputting the classified problem evaluation categories in the test question evaluation process. The control method of the test problem evaluation apparatus according to claim 7.   A test problem in which the control means includes the content of the test problem classified into a problem evaluation category having a problem evaluation index having a higher quality than a predetermined threshold value category among the plurality of problem evaluation categories in the test question evaluation process. 9. The method of controlling a test question evaluation apparatus according to claim 8, further comprising a step of storing data in the storage means. The exam question is a multiple choice question,
In the test question evaluation process, the control means calculates a selection rate for each option of the multiple-choice question based on data including the answer contents, and classifies the test questions into the plurality of question evaluation categories. The test problem evaluation apparatus according to claim 8, further comprising a step of changing the classified problem evaluation category to be lowered by one step when there is an option having a predetermined selection rate or less. Control method. The exam question is a multiple choice question,
The control means, in the question support process, a step of inputting a difficulty level code representing a difficulty level for each option of the multiple-choice question from the input means;
The control means further includes a step of outputting the input difficulty code together with the question evaluation index in the test question evaluation process. A control method for the test problem evaluation apparatus according to claim 1. The above modified ebel index is the expected correct answer rate used in the modified ebel method.
12. The corrected ebel index calculation table is used in the modified ebel method, and is a table showing a correspondence relationship between the difficulty level and necessity level of a test question and an expected correct answer rate. A method for controlling the test problem evaluation apparatus according to claim 1.   A program comprising the steps of the method for controlling a test question evaluation apparatus according to claim 7.   A computer-readable recording medium storing the program according to claim 13.

Images