JP2013076754A - Examination device, question management method, program, and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an examination device or the like which provides a method for statistically verifying the validity of questions to support preparation of high quality questions.SOLUTION: An examination device 1 is connected to examinee terminals 3 via a network 10. Actual questions 511 each of which one or more marks are allocated to in an examination and a temporary question 512 to which no marks are allocated in the examination are stored in a storage part 12 of the examination device 1. The examination device transmits questions including the temporary question 512 to the examinee terminals 3 and displays the questions as a question setting screen 60 not indicating the allocation of marks, to set the questions and receives answers to the questions including the temporary question 511, from the examinee terminals 3. Then, the examination device statistically analyzes marking results of answers to the temporary question 512 and determines whether the temporary question 512 should be taken as an actual question 511 or not in accordance with the analysis result and, when the temporary question 512 is taken as an actual question 511, records a value equal to one or more as marks to be allocated to this question in the examination.

Description

  The present invention relates to a test apparatus, a problem management method, a program, and a recording medium that give questions to examinees and manage problems according to the results.

  In recent years, an increasing number of tests are performed using computer systems. For example, the examinee displays a question on a computer and answers the question by selecting an option. In such a system, it is possible to efficiently perform a test without limiting the place and time. On the other hand, there is a test venue type (test center type) test system for tests that require strict management (such as fraud prevention) such as national tests. At the test site, examination management such as identity verification and examination progress monitoring is performed. Under such a mechanism, various tests are digitized. An example of such a system is described in Patent Document 1.

JP 2005-107378 A

  In general, it is necessary to prepare many problems in such a system. For example, in order to ensure fairness by avoiding the same problem from appearing multiple times.

  On the other hand, it is necessary to maintain the quality of the questions that are presented. In particular, it is necessary to pay more attention to the quality of the test questions in tests such as the above-mentioned national examinations that require strict management. For example, problems that are difficult to understand, problems that are too easy for most candidates to solve, and problems that are too difficult for most candidates to solve are undesirable. Thus, creating an appropriate question for a test is not easy and requires experience. It is also difficult to verify the validity of the problem.

  The present invention has been made in view of such problems, and provides a method for statistically verifying the validity of a problem, and an object thereof is to provide a test apparatus and the like that support the creation of a high-quality problem. To do.

  A first invention for achieving the above-described object is a test apparatus connected via a network to a test taker's terminal of a test taker who takes a test, and the problem is that the score at the time of the test is 1 or more. A storage means for storing questions to be given to the examinee including a temporary question with a score of 0 at the time of the question, together with a score at the time of the question, and sending the question including the temporary question to the test taker's terminal. Statistical analysis is performed on a question answering means for giving questions by displaying as a question question screen not shown, an answer receiving means for receiving an answer to the question including the temporary question from the examinee terminal, and a scoring result of the answer to the temporary question The problem analysis means to be performed, and whether to determine the temporary problem as the main problem according to the result of the statistical analysis of the scoring results. Is a temporary problem A test apparatus characterized by comprising the present issue setting means for recording one or more values as allocated points during question entitled, the.

  According to the first invention, in addition to this problem, the created temporary problem is given a score of 0 in an actual test. Candidates perform tests without knowing the score and solve them seriously regardless of the problem or provisional problem, so that statistical data that can be trusted as a verification material for the provisional problem can be obtained. Further, since the tentative question is assigned 0 points, the result of the answer to the temporary question whose validity is not verified does not affect the test result. Statistical analysis is performed on the scoring results of the answers to the provisional question obtained in this way, and the provisional question is determined as the main problem according to the result. It can be easily done on the basis of, and can assist in the creation of high-quality problems.

  The storage means stores, for each problem, the score assigned at the time of the question and the problem question score that is one or more scores, and the problem setting means determines that the temporary problem is the problem. It is preferable to record the score at the time of the question which is the provisional problem in the storage means with reference to the problem score.

  With the above configuration, for example, a provisional problem score, for example, “5 points”, is newly given to the temporary problem whose score was 0 at the time of the question as a score at the time of the question. Promoted to a problem. In this way, when this problem scoring is determined in advance and the temporary problem is regarded as this problem, a scoring can be given based on this.

  Further, it is preferable that the question-taking means selects questions so that the provisional questions are equal to or less than a predetermined ratio, and sends the questions to the examinee terminal to give questions.

  With the above configuration, it is possible to keep the number of provisional questions whose validity is not verified in a test to a certain number or less.

  In addition, for each problem, the storage means associates and stores the assignment score at the time of the question and the problem assignment score that is one or more assignment points, and the problem setting means sets the temporary problem as the problem. In this case, it is also desirable to record, in the storage means, a predetermined percentage of the main problem scoring points as a scoring point at the time of the question that is the provisional question according to the result of statistical analysis of the scoring results. .

  Depending on the result of the analysis of the temporary question, for example, a low score is given when the temporary question is a problem with a high correct answer rate, and a high score is given when the problem is a low correct answer rate. The score can be changed.

  The second invention is a problem management method in a test apparatus connected via a network to a test taker's terminal of a test taker who takes the test, wherein the test apparatus has a score of 1 or more at the time of a question. Storage means for storing questions to be taken to the examinee, including a temporary question with a score of 0 at the time of the question, together with a score at the time of the question, and transmitting the question including the temporary question to the test taker terminal. Statistics about the questioning step of giving questions by displaying as a questioning screen not showing scoring, the answer receiving step of receiving an answer to the question including the temporary question from the examinee terminal, and the scoring result of the answer to the temporary question A problem analysis step for performing a statistical analysis, and determining whether or not the temporary problem is to be the main problem according to a result of a statistical analysis of the scoring results. A stage, a problem management method and executes and a setting this problem step of recording one or more values as allocated points during question of the temporary problems in a problem.

The storage means stores, for each problem, the score at the time of the question and the problem score which is one or more scores, and the problem setting step includes the temporary problem as the problem. It is preferable to record the score at the time of the question which is the provisional problem in the storage means with reference to the problem score.
In the questioning step, it is desirable to select questions and send them to the test taker terminal so that the provisional questions are equal to or less than a predetermined ratio.
In addition, for each problem, the storage means associates and stores the score at the time of the question and the problem score that is one or more scores, and in the problem setting step, the temporary problem is set as the problem. In this case, it is also desirable to record, in the storage means, a predetermined percentage of the main problem scoring points as a scoring point at the time of the question that is the provisional question according to the result of statistical analysis of the scoring results. .

  A third invention is a program for causing a computer to function as the test apparatus of the first invention.

  The fourth invention is a storage medium storing a program for causing a computer to function as the test apparatus of the first invention.

  According to the present invention, it is possible to provide a method for statistically verifying the validity of a problem, and to provide a test apparatus that supports the creation of a high-quality problem.

The figure explaining the test system 2 using the test apparatus 1 The figure which shows the hardware constitutions of the test apparatus 1 and the examinee terminal 3 The figure explaining the functional composition of test device 1 Diagram showing example of problem data 51 (example of schema of relational database) Diagram showing examples of question data 54, scoring result data 55, and examinee data 56 (three points above, an example of a relational database schema) The figure explaining the flow of a process of the problem management method in the test apparatus 1 The figure shown about the example of the question screen 60 The figure shown about the example of scoring analysis data 57a and 57b Diagram showing another example of scoring result analysis

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a diagram for explaining a test system 2 using a test apparatus 1 according to an embodiment of the present invention. As shown in FIG. 1, in the test system 2, the test apparatus 1 is connected to a test taker terminal 3 used by a test taker via a network 10, transmits a problem to the test taker terminal 3 and performs a test. An answer to the question is received from the examinee terminal 3.

  FIG. 2A is a diagram illustrating a hardware configuration of the test apparatus 1. As shown in the figure, the test apparatus 1 includes a control unit 11, a storage unit 12, a media input / output unit 13, a communication control unit 14, an input unit 15, a display unit 16, a peripheral device I / F unit 17 and the like on a bus 18. It is the structure connected via.

The control unit 11 is a CPU (Central Processing Unit),
A ROM (Read Only Memory), a RAM (Random Access Memory), and the like are included.
The CPU calls and executes a program stored in the storage unit 12, ROM, storage medium, or the like to a work memory area on the RAM, drives and controls each device connected via the bus 18, and is performed by the test apparatus 1. The processing described later is realized. The ROM is a non-volatile memory and permanently stores programs such as a boot program and BIOS, data, and the like. The RAM is a volatile memory, and temporarily stores programs, data, and the like loaded from the storage unit 12, ROM, storage medium, and the like, and includes a work area used by the control unit 11 to perform each process.

The storage unit 12 is an HDD (hard disk drive) or the like, and stores a program executed by the control unit 11, data necessary for program execution, an OS (operating system), and the like. As for the program, a control program corresponding to the OS and an application program for causing the test apparatus 1 to execute a process described later are stored.
Each of these program codes is read by the control unit 11 as necessary, transferred to the RAM, read by the CPU, and executed as various means.

The media input / output unit 13 (drive device) inputs / outputs data, for example, media such as a CD drive (-ROM, -R, -RW, etc.), DVD drive (-ROM, -R, -RW, etc.) Has input / output devices.
The communication control unit 14 includes a communication control device, a communication port, and the like, and is a communication interface that mediates communication with devices such as other servers, and performs communication control with other devices via a network. The network may be wired or wireless.

The input unit 15 inputs data and includes, for example, a keyboard, a pointing device such as a mouse, and an input device such as a numeric keypad.
The display unit 16 includes a display device such as a CRT monitor and a liquid crystal panel, and a logic circuit for realizing a display function in cooperation with the display device.

The peripheral device I / F (interface) unit 17 is a port for connecting a peripheral device, and performs data transmission / reception with the peripheral device via the peripheral device I / F unit 17. The peripheral device I / F unit 17 is configured by a USB or the like, and usually includes a plurality of peripheral devices I / F. The connection form with the peripheral device may be wired or wireless.
The bus 18 is a path that mediates transmission / reception of control signals, data signals, and the like between the devices.

  The examinee terminal 3 is a personal computer or the like used by a user who takes the test. As shown in FIG. 2 (b), the tester terminal 3, the storage unit 32, the media input / output unit 33, the communication control unit 34, An input unit 35, a display unit 36, a peripheral device I / F unit 37, and the like are connected via a bus 38. The configuration of each part is the same as that in the test apparatus 1 described above.

Next, the functional configuration of the test apparatus 1 will be described with reference to FIG.
As shown in FIG. 3, the test apparatus 1 includes a questioning means 41, an answer receiving means 42, a problem analyzing means 43, a main problem setting means 44, and the like. The storage unit 12 stores question data 51, question data 54, scoring result data 55, examinee data 56, and the like, and functions as a storage means for these data.

The questioning means 41 is for the control unit 11 of the test apparatus 1 to give questions to the test taker by sending the question to the test taker terminal 3 and displaying it as a test question screen. This problem includes a provisional problem described later and the present problem.
The answer receiving means 42 is for the control unit 11 of the test apparatus 1 to receive an answer to the question that has been given from the examinee terminal 3.
In the problem analysis means 43, the control unit 11 of the test apparatus 1 performs a statistical analysis on the result of scoring the answer to the temporary problem.
The problem setting means 44 determines whether or not the control unit 11 of the test apparatus 1 sets the temporary problem as the main problem according to the result of the statistical analysis of the scoring results, and determines the temporary problem according to the determination result. This is set as a problem. When a provisional question is set as the main question, a value of 1 or more is recorded as a score when the question that is the provisional question is given, which will be described later.

The question data 51 is data of questions to be given to the examinee, and is stored by associating each question with a question ID, its score, and the like.
FIG. 4 shows an example of the problem data 51. The problem data 51 shown in FIG. 4 indicates the schema of the relational database, and the underlined item (“problem ID” in FIG. 4) indicates the primary key. The same applies to FIG. 5 described later.
As shown in the figure, as the problem data 51, a problem ID 510, a problem 513, an option 515, a correct answer 517, a scoring point 533, a temporary question flag 535, a main question scoring point 537, and the like are associated and stored.

The problem ID 510 is information for identifying each problem.
The problem 513 indicates the content of the problem.
The option 515 indicates the contents of the option for each option number as an answer to the question. In the present embodiment, an example of a problem in which a correct option is selected from a plurality of options and input is shown as the problem data 51, but a problem in which letters, numbers, and sentences are input as an answer may be used.
The correct answer 517 indicates the correct answer of the question 513 by the number of the options 515.
The score 533 indicates the problem score.
The temporary problem flag 535 indicates whether each problem is a main problem or a temporary problem. In the example of the figure, “0” is set for this problem, and “1” is set for a temporary problem.
This problem score 537 indicates a score when each problem is used as this problem.

In the present embodiment, the problem 511 and the temporary problem 512 are included in the problem data 51.
This question 511 is a normal question that is used in a test and is given a score of 1 or more as a score 533 (this question score 537) by answering correctly.
On the other hand, the provisional question 512 is a problem that is used in the test, but even if the answer is correct, no score is given to the examinee. That is, the problem is that the score 533 is zero.

The question data 54 is a record of a series of questions given to the examinee in one test and a pattern of the order of the questions. That is, in this embodiment, not only the number corresponding to one test but also a considerable number are prepared (thus, it is difficult to ensure the quality of the problem with the conventional method). Of these, questions can be selected at random by using the question ID 510 as a key, and questions can be given, and a question pattern can be set in advance. When questions are asked at random, problems can be managed by recording these question patterns. In the case of random questions, the question pattern increases for each question.
FIG. 5A shows an example of the question data 54.
As shown in the drawing, as the question data 54, a pattern number 541, a problem number 543, a problem ID 545, and the like are linked and recorded.

The pattern number 541 is a number for identifying the pattern.
The question number 543 is a number indicating the order of questions.
The problem ID 545 corresponds to the problem ID 510 of the problem data 51.

The scoring result data 55 indicates the scoring result of each examinee's answer to the question.
FIG. 5B shows an example of the scoring result data 55.
As the scoring result data 55, a question number 551, a correct / incorrect 555, and a score 557 are recorded in association with each examinee ID 550.

The examinee ID 550 is information for identifying the examinee, and corresponds to an examinee ID 561 described later.
The question number 551 is a question number of a series of questions given to the examinee, and corresponds to the question number 543 of the question data 54.
The correctness / incorrectness 555 is the correctness / incorrectness of the examinee's answer to the question with the question number 551.
The score 557 is a score given to the answer result of the question with the question number 551. When the correctness / incorrectness 555 is positive, the score of the question that has been given (the score 533 of the question data 51) is recorded as the score 557. In this case, 0 is recorded. The score of the question that has been given can be specified from the question number 551, the examinee ID 550, and the like.
In addition, an intermediate evaluation (partially correct answer or the like) can be prepared as the correct / incorrect 555. In this case, for example, if the score 533 is “4”, the score 557 is set to “2” which is half of the score 557, etc. It is also possible to record a score of a predetermined ratio of the score 533 as a score 557.

The examinee data 56 records information about the examinee such as the examinee ID and the date of the test.
An example of examinee data 56 is shown in FIG. As shown in the figure, the examinee data 56 is recorded with a candidate ID 561, a pattern number 562, a name 563, an examination date 565, a test score 567, and the like.

The examinee ID 561 is information for identifying the examinee.
The pattern number 562 is a pattern number of a series of questions given to the examinee, and corresponds to the pattern number 541 of the question data 54.
The name 563 is the name of the examinee.
The test date 565 indicates the test test date of the test taker.
The test score 567 indicates a score in the test of the examinee. The calculation of the test score 567 will be described later.

  Next, the flow of processing of the problem management method in the test apparatus 1 of the present embodiment will be described using FIG.

  First, the test taker inputs the test taker ID from the test taker terminal 3 and transmits it to the test apparatus 1, accesses the questioning site provided by the test apparatus 1, and takes the test. At this time, the control unit 11 of the test apparatus 1 transmits the question 513 (and the option 515) including the provisional question 512 to the test taker terminal 3, displays it as the test screen 60, and answers the test taker on the screen. Input (step 101).

FIG. 7 shows an example of the question screen 60.
A question 61 (question 513) is displayed on the question screen 60, and the examinee can select an answer to the question 61 by selecting a radio button 63 displayed corresponding to the option (option 515) on the screen. . By clicking the “Next” button 65 after selecting the answer, the screen shifts to the question screen 60 for the next question 61. Alternatively, by clicking the “Previous” button 67, the screen can be changed to the question screen 60 for the previous question 61 and the answer can be redone.

  The series of questions 513 that are given in this way include the main question 511 and the provisional question 512, but the question score 533 is not displayed on the questioning screen 60. Since the examinee does not know the score of the question 513 to be given, regardless of whether the question 511 or the provisional question 512, the examinee will solve it seriously without removing his hand.

  When the question is given, the control unit 11 of the test apparatus 1 randomly selects the question 513 of the question data 51 so as to include the provisional question 512 in addition to the main question 511 and transmits it to the examinee terminal 3 to send the question screen 60. Display as. The question ID 510 of the given question 513 is recorded as a question ID 545 of the question data 54 with a question number 543 indicating the order of questions and a linking pattern number 541. The number of provisional questions 512 is selected to be a predetermined ratio, for example, 10% or less, with respect to the number of a series of questions 513 to be presented in one test. The above ratio can be variously determined in advance.

  However, the method of setting questions such as the order of displaying the questions and the display method is not limited to this as long as the tentative questions 512 are included in the series of questions 513 in the test. For example, a problem in one test on one screen. All questions may be displayed and the questions may be given, or the answers to one question may be sequentially judged, and the questions may be given sequentially while changing the next question dynamically according to the result. .

  Returning to the description of FIG. When answering a series of questions 513 for one test, the examinee terminal 3 transmits an answer to each question 513 to the questioning apparatus 1 by an instruction operation of the examinee. The control unit 11 of the test apparatus 1 receives the answer from the examinee terminal 3 (step 102).

  The answer to each question 513 is scored by the control unit 11 of the test apparatus 1 by comparing with the correct answer 517 of each question 513 stored in advance as the question data 51, as shown in FIG. The scoring result data 55 as described above is created for each examinee and stored in association with the examinee ID (step 103). Note that scoring for the question 513 may be input as scoring result data 55 by the control unit 11 of the test apparatus 1 in accordance with an instruction operation by the scorer.

  As described above, a plurality of examinees are tested, and scoring result data 55 is created for each examinee. The control unit 11 of the test apparatus 1 performs a statistical analysis of the scoring result based on the scoring result data 55 and the like, and determines whether or not the temporary question 512 is set as the main question 511 according to the result (step 104).

  In the present embodiment, in step 104, when analyzing the scoring, the control unit 11 of the test apparatus 1 creates scoring analysis data 57a indicating scoring analysis information such as the correct answer rate and the answer rate of each question.

  An example of the scoring analysis data 57a is shown in FIG. As the scoring analysis data 57a, a question ID 571, a scoring point 572, a correct answer rate 573, and an answer rate 574 are linked. The scoring analysis data 57a is created by summing up the question data 54, scoring result data 55, and examinee data 56.

The problem ID 571 and the score 572 are the same as the problem ID 510 and the score 533 of the problem data 51, respectively.
The correct answer rate 573 is a ratio of correctly answered questions.
The answer rate 574 is a rate of answering the question, and it does not matter whether it is correct or incorrect. In the case of the mark sheet type test, it is the ratio of the mark input.

Then, the control unit 11 of the test apparatus 1 determines whether or not the temporary problem 512 is appropriate, that is, whether or not the temporary problem 512 is the main problem 511 based on a predetermined criterion.
Here, the validity of the provisional question 512 is determined based on whether or not the correct answer rate 573 is within a predetermined range. For example, in order to exclude problems that are too simple or problems that are too difficult, the predetermined range is set to 30% or more and less than 70%.

  In the example of FIG. 8A, it is determined that the provisional question 512 with the question ID 571 of “3” included in the above range with a correct answer rate of 50% is valid and is the main question 511. When it is determined that the temporary problem 512 is the main problem 511 (YES in step 105), the control unit 11 of the test apparatus 1 sets the temporary problem flag 535 corresponding to the problem ID 571 (problem ID 510) in the problem data 51 to the main problem 511. “0” indicating a problem is set, the problem score 537 is referred to, and the value of the problem score 537 is recorded in the score 533 (step 106). As a result, the provisional question 512 is promoted to the main problem 511, and is treated as the main problem 511 having one or more points in subsequent tests.

  On the other hand, the correct answer rate 573 of the temporary question 512 with the question ID 571 of “4” in FIG. 8A is 25%. The correct answer rate 573 is out of the above range, and it is not determined that the temporary question 512 is the main question 511 (NO in step 105). In this case, the above processing is not performed. Since the temporary problem 512 is too difficult, the administrator of the test system 2 corrects the problem to a simple one.

  By repeating the processing as described above, the validity of the temporary problem 512 is verified, and if it is valid, the problem 511 is changed to a problem having a non-zero score.

  In the same manner as described above, it is possible to determine the validity of the problem 511, that is, whether or not the problem 511 is to be the temporary problem 512. For example, for this question 511, it is determined whether the correct answer rate 573 is within a predetermined range. If the correct answer rate 573 is not within the predetermined range, the temporary question flag 535 is set to “1” indicating the temporary question 512 in the question data 51 and the score 533 is set. By setting the value to 0, the problem of the present problem 511 can be set as the temporary problem 512, and the administrator of the test system 2 can correct the problem.

In step 104 described above, scoring analysis data 57b indicating personal test results are also created.
An example of the scoring analysis data 57b is shown in FIG. As shown in the figure, as the scoring analysis data 57b, a question number 575, a scoring 576, a right / wrong 577, a score 578, and the like are associated with each examinee ID (taker ID 561) and pattern number (pattern number 562). .

The problem number 575 corresponds to the problem number 551 of the scoring result data 55.
The score 576 corresponds to the score 533 of the problem data 51.
The correctness / error 577 corresponds to the correctness / error 555 of the scoring result data 55.
The score 578 corresponds to the score 557 of the scoring result data 55.

  In step 104 described above, the control unit 11 of the test apparatus 1 calculates, for example, the sum of the assigned points 576 (“89” in the figure) as a full score 579, and the total of the scores 578 (“48” in the figure) 580, and the ratio (%) of the total score 580 to the full score 579 is calculated as a test score. Since the maximum score 579 may not be constant for a question that is given to each examinee in one test, the above test score is calculated as an evaluation of each examinee. This test score is recorded as examinee data 56 in association with the examinee ID 561.

  As described above, according to the present embodiment, in addition to the present problem 511, the created provisional problem 512 is given a score of 0 in an actual test. The examinee conducts the test without knowing the score and solves it seriously regardless of the main problem 511 or the temporary problem 512, so that reliable statistical data can be obtained as a verification material for the temporary problem 512. Further, since the tentative question 512 has 0 points, the result of the answer to the temporary question 512 before the validity is verified does not affect the test result. Statistical analysis is performed on the scoring result of the answer to the provisional question 512 obtained in this way, and the provisional question 512 is changed to the main question 511 according to the result, so that the validity of the provisional question 512 can be verified. This can be done easily based on sufficient data, and can help create high-quality problems.

In addition, since the problem question score 537 of the problem data 51 is determined in advance, when the temporary problem 512 is changed to the problem 511, a score 533 can be given based on the problem question 51.
Furthermore, since questions are selected and sent to the test taker's terminal 3 so that the provisional questions 512 are equal to or less than a predetermined ratio when the questions are given, the number of questions of the provisional questions 512 whose validity is not verified is constant in the test. It can be suppressed to a few or less.

Further, in the present embodiment, when the temporary problem 512 is set as the main problem 511, the main problem scoring point 537 is given as the scoring point 533. However, a score of a predetermined ratio of the main problem scoring point 537 may be given according to the analysis result.
For example, in the above example, when the correct answer rate 573 of the provisional question 512 is 30% or more and less than 70%, the present question 511 is assigned as the assignment point 533, and the correct answer rate 573 of the provisional question 512 is 60% or more. If the percentage is less than 70%, two points that are 40% of the current problem score 537 may be given as the score 533, and the value of the current problem score 537 may be given as the score 533 in other cases. As a result, for example, among the temporary problems 512 as the main problem 511, the simple problem score 533 can be kept low, or the difficult problem score 533 can be kept high.

Furthermore, the analysis of the scoring results in step 104 is not limited to that described in FIG. Next, another example of statistical analysis of scoring results will be described.
FIG. 9 is a graph showing an example thereof. In the example of FIG. 9, a test taker who takes the first test is tested in the same manner as described above, and an answer rate 587 and a correct answer rate 585 are shown for each provisional question 512 for each tester's initial test score zone. Is.

  In FIG. 9, the horizontal axis represents the score zone, and the vertical axis represents the answer rate 587 and the correct answer rate 585. As shown in FIG. 9, regarding the temporary question 512, the answer rate 587 is 20% for the examinees in the score zone of “0-20”, the correct answer rate 585 is 0%, and the answer rate 587 is for the examinees in the score zone of “21-40”. Is 40%, correct answer rate 585 is 10%, the answer rate 587 is 50% for those who scored "41-60", the answer rate 585 is 20%, the answer is for candidates who have a score rate "61-80" The rate 587 is 70%, the correct answer rate 585 is 50%, and the examinees who have scored "81 to 100" have an answer rate 587 of 90% and a correct answer rate 585 of 80%.

  For example, the control unit 11 of the test apparatus 1 creates the scoring result data 55 in step 103 in association with the examinee ID and the number of times taken (first time, second time, etc.), and in step 104, refers to the number of times taken. From the scoring result data 55 and the like, the scoring results for the first test performed by each test taker are totaled for each test taker's scoring zone, and the provisional question 512 has an answer rate 587 for each scoring zone as shown in FIG. The correct answer rate 585 is calculated.

  Then, the control unit 11 of the test apparatus 1 determines whether or not the temporary problem 512 is set as the present problem 511 based on a predetermined reference. Here, when the correct answer rate 585 is within a predetermined range, it is determined that the temporary question 512 is the current question 511. For example, when the predetermined range is set to 20% or more and less than 60%, the provisional question 512 is set as the main question 511 for the examinees having the score bands of “41 to 60” and “61 to 80”.

  For example, the question data 51 is linked to the question ID 510 of the present question 511, and information indicating which score zone (test score zone of the previous test) is given to the examinee is also linked and recorded. The first control unit 11 sets the problem that has been changed from the provisional question 512 to the main problem 511 as the main problem 511 in the same manner as described above, and records to which examinees the score zone should be given questions. . In the above example, it is recorded that questions are given to examinees in the score zones of “41-60” and “61-80”.

The control unit 11 of the test apparatus 1 refers to the above-mentioned examinee data 56 and the above-mentioned information and the like, and examinees who take the second and subsequent tests as a review according to the test score 567 of the previous test. You can select questions with different difficulty levels. If the test score 567 is in the "41-60" and "61-80" scoring belts, the problem from the provisional question 512 to the present question 511 may be given as a problem having one or more points. There will be. Note that the question, which is the provisional question 512, is selected only for the first test taker and can be given.
In addition to this, when performing an operation in which the test questions dynamically change according to the previous answer results, for example, the correct answer rate is calculated sequentially from the previous answer results, and the examination is taken with reference to the above information etc. It is also possible to select the problem that suits the level of the person.

It is also possible to verify the validity of the temporary question 512 by statistical analysis of the answer rate 574 (see FIG. 8A). In the case of a selection type question that has a penalty such as a deduction in the wrong answer, the answer rate 574 decreases if the question is too difficult or difficult to understand. For example, the answer rate 574 is greater than or equal to a predetermined value (the question itself) If it is easy to understand, the temporary problem 512 can be changed to the present problem 511 by the same processing as described above.
In addition, when the answer rate 574 is high but the correct answer rate 573 (see FIG. 8A) is low, it can be understood that the problem is “it seems difficult and difficult” or “gives misunderstanding”. The administrator of the test system 2 can examine the validity by matching the results of the answer rate 574 and the correct answer rate 573 with the contents of the question. From the above viewpoint, the validity of the provisional question 512 can be determined by the test apparatus 1 using predetermined reference values for the answer rate 574 and the correct answer rate 573.

  As mentioned above, although embodiment of this invention was described referring an accompanying drawing, the technical scope of this invention is not influenced by embodiment mentioned above. It is obvious for those skilled in the art that various modifications or modifications can be conceived within the scope of the technical idea described in the claims, and these are naturally within the technical scope of the present invention. It is understood that it belongs.

1. Test apparatus 2 ... Test system 3 ... Test taker terminal 41 ... Questioning means 42 ... Answer receiving means 43 ... Problem analysis means 44 ... This question setting means 51 ... ... Question data 55 ......... Scoring result data 60 ......... Question screen 511 ...... This question 512 ...... Temporary question

Claims (10)

A test device connected via a network to a test taker terminal of a test taker who takes a test,
Storage means for storing the questions to be given to the examinee, including the present question having a score of 1 or more at the time of the question and the provisional question having a score of 0 at the time of the question, together with the score at the time of the question,
A question-taking means for sending a question including the provisional question to the test taker's terminal and giving a question by displaying it as a question-taking screen not showing a score;
Answer receiving means for receiving an answer to the question including the provisional question from the examinee terminal;
A problem analysis means for performing a statistical analysis on the result of scoring the answer to the provisional question;
In accordance with the result of statistical analysis of the scoring results, it is determined whether or not the temporary problem is the main problem, and when the temporary problem is the main problem, the storage means stores the problem that is the temporary problem. This problem setting means for recording a value of 1 or more as a scoring point at the time of the question,
A test apparatus comprising: The storage means stores, for each problem, the score assigned at the time of the question and the question score assigned as one or more assigned scores.
The present problem setting means, when the temporary problem is regarded as the main problem, records in the storage means the score when the question that is the temporary problem is given with reference to the main problem score. The test apparatus according to claim 1.   3. The test apparatus according to claim 1, wherein the question-taking means selects questions so that the provisional questions are equal to or less than a predetermined ratio, and sends the questions to the examinee terminal to give questions. . The storage means stores, for each problem, the score assigned at the time of the question and the question score assigned as one or more assigned scores.
In the case where the temporary problem is determined to be the main problem, the main problem setting unit is configured to store, in the storage unit, according to a result of statistical analysis of the scoring result, 4. The test apparatus according to claim 1, wherein a score at a predetermined ratio of the problem score is recorded. A problem management method for a test apparatus connected via a network to a test taker terminal of a test taker,
The test apparatus is
Storage means for storing the questions to be given to the examinee, including the present question having a score of 1 or more at the time of the question and the provisional question having a score of 0 at the time of the question, together with the score at the time of the question,
A question-taking step for sending a question including the provisional question to the test taker's terminal and giving a question by displaying it as a question-taking screen not showing a score;
An answer receiving step for receiving an answer to the question including the provisional question from the examinee terminal;
A problem analysis step of performing a statistical analysis on the scoring result of the answer to the provisional question;
In accordance with the result of statistical analysis of the scoring results, it is determined whether or not the temporary problem is the main problem, and when the temporary problem is the main problem, the storage means stores the problem that is the temporary problem. This question setting step for recording a value of 1 or more as a scoring point at the time of the question,
The problem management method characterized by performing. The storage means stores, for each problem, the score assigned at the time of the question and the question score assigned as one or more assigned scores.
In the present problem setting step, when the temporary problem is determined to be the main problem, the score at the time of the question that is the temporary problem is recorded in the storage unit with reference to the main problem score. The problem management method according to claim 5.   The problem management according to claim 5 or 6, wherein, in the questioning step, questions are selected so that the provisional questions are equal to or less than a predetermined ratio set in advance, and the questions are sent to the examinee terminal. Method. The storage means stores, for each problem, the score assigned at the time of the question and the question score assigned as one or more assigned scores.
In the main question setting step, when the temporary question is set as the main question, the storage means is assigned with a score at the time of the question as the temporary question according to a result of the statistical analysis of the scoring result. The problem management method according to any one of claims 5 to 7, wherein a score of a predetermined ratio of the problem score is recorded.   The program for functioning a computer as a test apparatus in any one of Claims 1-4.   A storage medium storing a program for causing a computer to function as the test apparatus according to any one of claims 1 to 4.

Images