JP2003271050A - System, method, and program for creating examination question - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a system, a method, and a program for creating examination questions which yields a desired average score and pass rate. <P>SOLUTION: In an examination question DB, examination questions, the categories of the examination questions, the correct answer rate of the examination questions by each attribute of an examinee, examination questions themselves, etc., are previously stored. An examination question extracting section, when it receives examination question condition information which is the condition of examination questions selected via an input/output device or a communication interface, selects examination questions in compliance with the examination question condition information out of the examination question DB, and outputs the selected questions via the input/output device or the communication interface to other connected input/output devices, etc. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a test question creating system, method and program for creating a test question having an average score and a pass rate desired by a question making applicant.

[0002]

2. Description of the Related Art Conventionally, for test questions such as a written test or a mock written test for license acquisition, school entrance exam, test, etc., the average score and pass rate of the examinees are determined by the intuition and experience of the question creator. It is created and selected so that the score and the passing rate are as intended by the question creator.

[0003]

However, since the above-mentioned test questions are created and selected by human intuition or experience,
It was difficult to make the average score and pass rate of the examinees the intentions of the question preparers. Also, since it is based on human intuition, experience, etc., there were large variations among question preparers, and there were cases where test takers complained. The present invention has been made in view of such circumstances, and an object thereof is to provide a test question creating system, method, and program for creating a test question having an average score and a passing rate desired by a question making applicant. .

[0004]

The present invention has been made in order to achieve the above-mentioned object, and includes a storage means for storing a plurality of test questions and a correct answer rate of the test questions, and a test question to be selected. Extraction means for selecting a test question from the storage means based on the test question condition information indicating the condition and including the correct answer rate of the test question to be selected.

As a result, it is possible to select a test question having a correct answer rate desired by a person who wishes to make a question.

Further, in the present invention according to the above invention, the storage means further stores category information indicating a question field of the test question, and the extraction means further includes a test question condition including a question field of the test question. It is characterized in that a test question is selected from the storage means based on information.

As a result, it becomes possible to specify the question area and select the examination question, and it is possible to reduce the variation in the question area for each examination.

Further, in the present invention according to the above-mentioned invention, the storage means stores the correct answer rate for each attribute showing the characteristics of the examinee of the test question, and the extracting means stores the correct answer rate for each attribute of the examinee. The test question is selected from the storage means based on the test question condition information including.

As a result, it becomes possible to select the test question based on the correct answer rate for each attribute such as the sex, age, and number of times of the examinees of the examinees, and it is possible to reduce the variation in the correct answer rate between attributes for each test. It will be possible.

Further, in the present invention, the extraction means is
(A) The average of the correct answer rates of a predetermined number n of set questions (n is an integer of 2 or more) randomly selected from the storage means is within a specific range of the correct answer rate indicated by the test question condition information. If it is out of the specific range, a test question is randomly selected from the storage means again, and (b) the process of (a) is repeated a predetermined number of times. When the average of the correct answer rates of the test questions randomly selected is also outside the specific range, (n-1) test questions are randomly selected and the (n-1) test questions are selected. The average of the correct answer rates of the test questions is calculated, and the average of the correct answer rates of the (n-1) test questions and the correct answer rate of the other one question is set within the specific range of the correct answer rate. It is characterized by selecting one question.

Further, the present invention is characterized in that, in the above invention, the storage means stores the test question in an XML format, and the extraction means outputs the selected test question.

This makes it possible to output the selected exam question without converting it into a format that can be presented to the examinees of the exam.

Further, the present invention is the above-mentioned invention, which is a step for storing a plurality of test questions and a correct answer rate of the test questions, and test question condition information indicating conditions of the test questions to be selected. And a step of selecting a test question from the test questions stored in the above step based on the test question condition information including the correct answer rate of the power question.

The present invention is also the above-mentioned invention, wherein a plurality of steps for storing a test question and a correct answer rate of the test question are stored, and test question condition information indicating a condition of the test question to be selected is selected. It is a test question creating program for causing a computer to execute a step of selecting a test question from the test questions stored in the step based on the test question condition information including the correct answer rate of the power question.

[0015]

DETAILED DESCRIPTION OF THE INVENTION An embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing a functional development of the internal configuration of the test question creating system. In this figure, 1 is a test question creating system. An input / output device 11 is, for example, a keyboard, a mouse, a CRT (Cathode Ray Tube), a liquid crystal display device, a printing device, or the like. 12 is a communication interface,
It is connected to an information device, an input / output device (none of which is shown), etc. via a communication network (not shown). 1
Reference numeral 3 is an examination question information reception unit. 14 is the examination question DB
It is a (database) and stores test question information in advance. Reference numeral 15 is an examination question condition acceptance unit. Reference numeral 16 is a test question extraction unit.

FIG. 2 shows an example of the test question information. This exam question information is stored in the exam question DB 14 via the exam question information receiving unit 13. Here, the test question information includes information including a part or all of the identification information, the category, the correct answer rate for each attribute, the content, the registration date and time, and the like. In the example shown in FIG. 2, the test question DB 14 includes a question table and a question table. Furthermore, the test question DB 14 has a query for searching the data stored in these tables. The question table is a table showing the content of the question itself, and includes each item of question identification number, category, registration date and content. The primary key of the question table is the question identification number. The question table is a table showing the correct answer rate for each test execution, each question, and each (test taker) attribute, and each item of question identification number, attribute, correct answer rate, test identification number, test date, and number of examinees. Is included. The composite key of the question identification number, the attribute, and the examination identification number is the main key of the question table. In other words, this question table has information about which question was given to the examinees having the predetermined attribute in the examination on the specific execution day, and what was the correct answer rate of the question for the examinees having the attribute. . The question table and the question table are linked by using the question identification number as a key, and the record of the question table and the record of the question table are one-to-many (one-to-n).
It corresponds to. In addition, the query includes a performance correct answer rate calculation query. This performance correct answer rate calculation query extracts the corresponding records existing in the question table for the specified specific question identification number and Based on the correct answer rate and the number of examinees, an average actual correct answer rate is calculated. Here, the question identification information is information that uniquely identifies the test question. The category is information indicating the question area of the test question.
There are "signs", "signals", "traffic divisions", etc. This category may be further subdivided or may have a hierarchical structure. The correct answer rate for each attribute is the correct answer rate for each attribute of the examinee. What are the attributes of this examinee?
For example, "sex", "age", "number of times of examinations", "years of driving experience" if the test question is a driver's license department test, and "1" if the test question is a certification test. There are "class" and "second class". The correct answer rate for each attribute indicates information about the correct answer rate for each attribute of the examinee. The content is information such as the data of the test question itself and position information for storing the data of the test question such as a path name. The registration date and time is information indicating the date and time when the exam question was registered.

Next, the operation will be described with reference to FIG. The person who wants to make a question inputs the examination question condition information, which is the condition of the examination question, to the question making system 1 (step S10 in FIG. 3). The test question condition information is, for example, the category of questions to be asked, the number of set questions that is the number of questions to be asked in the category, the correct answer rate for each attribute of the desired examinee in the category, and the like. The person who wishes to create a question may input the test question condition information using the input / output device 11 or may input it via the communication interface 12. Upon receiving the test question condition information, the test question condition receiving unit 15 instructs the test question extracting unit 16 to extract the test question.

The test question extraction unit 16 extracts all the test questions in the category designated by the test question condition from the test question DB1.
4 is read (step S11 in FIG. 3). Hereinafter, the test question read here is referred to as a designated category test question. Next, the test question extracting unit 16 randomly selects from the designated category test questions, the number of set questions specified by the test question condition (step S1 in FIG. 3).
2). When the test question is selected, an average of the individual correct answer rate of the selected question and the actual correct answer rate of the entire question for each attribute designated by the test question condition is calculated (step S13 in FIG. 3).

The test question extraction unit 16 judges whether or not the calculated correct answer rate (assumed correct answer rate) is within a specific allowable range (for example, within ± 5%) of the correct answer rate designated by the test question conditions ( Step S14 in FIG. 3). This allowable range may be set in advance by the administrator of the test question creating system 1, or may be set by a person who wishes to create a question together with the test question condition information. If the assumed correct answer rate is within a specific allowable range of the correct answer rate specified in the test question condition, the test question extraction unit 1
6 judges that the test question selected in the above step S12 satisfies the test question condition, and completes the extraction of the test question (step S15 in FIG. 3).

If the assumed correct answer rate is outside the specific allowable range of the correct answer rate specified by the test question condition, the test question extraction unit 16
Again, randomly select the number of set questions from the designated category exam questions, calculate the average of the correct answer rates (assumed correct answer rate) for each attribute specified in the exam question conditions in the selected exam questions, It is judged whether the assumed correct answer rate is within a specific allowable range of the correct answer rate specified in the test question condition.
By repeating this operation from step S12 to step S14, a test question that matches the test question condition is extracted.

If the test questions that match the test question conditions cannot be extracted even after the above-described extraction of the test questions is repeated a specific number of times (for example, 10000 times), the test question extraction unit 16
From the designated category test questions, one less than the set number of test questions is randomly selected (step S17 in FIG. 3). More specifically, when the number of set questions is n (n is an integer of 1 or more), (n-1) exam questions are randomly selected from the designated category exam questions. Next, the test question extraction unit 16 calculates the average of the correct answer rates of the selected test questions for each attribute designated by the test question conditions (step S18 in FIG. 3).

Next, the test question extraction unit 16 performs step S
The correct answer rate (assumed correct answer rate) that can be obtained from the average of the correct answer rates obtained in 18 and the correct answer rate of another one of the test questions is within the specific allowable range of the correct answer rate for each attribute specified in the test question conditions ( For example, within the range of ± 5%), one test question other than the test question selected in step S17 is selected from the designated category test questions (step S1 in FIG. 3).
9). Explaining one example thereof concretely, step S17
When there are four test questions other than the test question selected in step S1, and the identification information of each is “01, 03, 05, 09”, the test question extraction unit 16 first determines the test question of the identification information “01”. An average (assumed correct answer rate) of the correct answer rate and the average of the correct answer rates acquired in step S18 is acquired, and whether the assumed correct answer rate is within the allowable range of the correct answer rate for each attribute specified in the test question condition. To determine. If it is not within the allowable range, the correct answer rate of the test question of the identification information “03” and step S18
Obtain the expected correct answer rate by the average of the correct answer rates obtained in
Judge whether the average is within the allowable range, etc.
Sequentially, test questions other than the test questions selected in step S17 are selected, and test questions whose assumed correct answer rate falls within the allowable range are extracted.

If there is a test question in which the assumed correct answer rate falls within a specific allowable range (step S20 in FIG. 3), the extraction of the test question ends. If there is no test question whose expected correct answer rate falls within the specific allowable range (step S20 in FIG. 3), the test question extracting unit 16 randomly selects again from the designated category test questions, one less than the set number of questions. To do. Explaining using the above-mentioned specific example, when the number of set questions is n, (n-1) test questions are randomly selected from the designated category test questions. Next, the test question extraction unit 16 calculates the average of the correct answer rates of the selected test questions for each attribute designated by the test question conditions, as described above, and selects (n-1) test questions. The average (assumed correct answer rate) of the correct answer rate of one of the other test questions and the average of the selected (n-1) correct answer rates is the specific allowance of the correct answer rate for each attribute specified in the test question conditions. To be within range
Select one test question other than the selected (n-1) test questions. By repeating the processes of steps S17 to S20, a test question having a correct answer rate close to the correct answer rate of the test question condition information is extracted.

If the test questions are not extracted even after repeating the steps S17 to S20, for example, when the operations of the steps S17 to S20 are repeated a specific number of times or more, the test question extracting unit 16 determines the correct answer rate. The allowable range may be expanded, for example, ± 5% to ± 10%, and the process may be started again from step S12.

When the test question is extracted in this way, the test question extraction unit 16 outputs the test question to the input / output device 11 or, via the communication interface 12,
It may be output to an information device such as a personal computer.

The test questions themselves stored in the test question DB 14 or the like are XML (Extensible Markup Lath).
nguage) or the like. In this case, for example, by using a format created in advance, a test question sheet that allows the test questions selected by the test question creating system 1 to be arranged and distributed to the examinees can be sent to the input / output device 11 or the communication device. It is possible to print immediately by using a printing device or the like (not shown) connected via the interface 12.

Further, the test question information receiving unit 13 uses the test result DB of the test question selected as described above, based on the test question DB.
The exam question information in 14 may be updated. In that case, the test question information receiving unit 13 converts the data in a predetermined format, which is input through the input / output device 11 or the communication interface 12, into a data structure in the test question DB 14, and the like. The data may be stored in the DB 14, or the test result data having the same data structure as the data structure in the test question DB 14, which is input via the input / output device 11 or the communication interface 12, may be used as the test question DB 14.
It may be stored in.

The examination question information receiving unit 13 also periodically checks examination questions that have passed a certain number of years such as 10 years after registration, and examines the examination question D
It may be deleted from B14. It should be noted that the deletion of the test question may be changed depending on the content, category, etc., of the number of years of deletion and whether or not the deletion can be executed.

The above-described allowable range of the correct answer rate and the number of times of repetition are examples, and the numerical values are not limited. The process of extracting the test question is an example, and the process is not limited to this.

The test question DB 14 is a non-volatile memory such as a hard disk device, a magneto-optical disk device, a flash memory, a read-only storage medium such as a CD-ROM, or a RAM (Random Access Memory). It is based on a volatile memory or a combination of these.

Each unit shown in FIG. 1 may be realized by dedicated hardware, and each unit is constituted by a memory and a CPU (central processing unit) to realize the function of each unit. The function may be realized by loading the program of (3) into the memory and executing it.

Further, a program for realizing the function of each unit in FIG. 1 is recorded in a computer-readable recording medium, and the program recorded in this recording medium is read by a computer system and executed. May be. The “computer system” mentioned here includes an OS and hardware such as peripheral devices. Also, "computer system" is W
If the WW system is used, the homepage providing environment (or display environment) is also included.

The "computer-readable recording medium" means a flexible disk, a magneto-optical disk,
A portable medium such as a ROM or a CD-ROM, or a storage device such as a hard disk built in a computer system. Furthermore, "computer-readable recording medium"
Means a program that dynamically holds a program for a short period of time, such as a communication line for transmitting a program through a network such as the Internet or a communication line such as a telephone line, and a server or client in that case. Such a volatile memory inside a computer system that holds a program for a certain period of time is also included. Further, the above program may be one for realizing some of the functions described above, and may be one that can realize the above functions in combination with a program already recorded in the computer system. The embodiment of the present invention has been described in detail above with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes design changes and the like without departing from the scope of the present invention.

[0034]

As described above, according to the test question creating system, method and program according to the present invention, a test question having a desired average score and a desired pass rate is created, and the variation of the correct answer rate depending on the test question creator. Therefore, it is possible to obtain the effect that the cost for creating the test question can be reduced.

[Brief description of drawings]

FIG. 1 is a diagram showing a configuration of a test question creating system in an embodiment of the present invention.

FIG. 2 is a diagram showing an example of information stored in a test question DB in the same embodiment.

FIG. 3 is a flowchart illustrating an operation of creating a test question in the same embodiment.

[Explanation of symbols]

1: Exam question creation system, 11: Input / output device, 12:
Communication interface, 13: Exam question information reception unit, 1
4: Exam question DB, 15: Exam question condition acceptance section, 16:
Exam question extraction section

Claims (7)

[Claims] 1. A storage unit for storing a plurality of test questions and a correct answer rate of the test question, and test question condition information indicating a condition of the test question to be selected, the correct answer rate of the test question to be selected. An examination question creating system, comprising: an extracting means for selecting an examination question from the storage means based on the included examination question condition information. 2. The storage means further stores category information indicating a question field of the test question, and the extracting means is stored in the storage means based on the test question condition information further including a question field of the test question. The test question creating system according to claim 1, wherein the test question is selected. 3. The storage means stores a correct answer rate for each attribute showing the characteristics of the examinee of the test question, and the extracting means is based on the test question condition information including the correct answer rate for each attribute of the examinee. The test question creating system according to claim 1 or 2, wherein the test question is selected from the storage means. 4. The extracting means comprises: (a) an average of correct answer rates of a predetermined number n of set questions (n is an integer of 2 or more) randomly selected from the storage means, It is determined whether or not the correct answer rate indicated by the information is within a specific range, and if the correct rate is outside the specific range, the test question is randomly selected again from the storage means, and (b) in (a) above. As a result of repeating the process a predetermined number of times, if the average of the correct answer rates of the randomly selected test questions is out of the specific range, randomly select (n-1) test questions. Then, the average of the correct answer rates of the (n-1) test questions is calculated, and the average of the correct answer rate of the (n-1) test questions and the correct answer rate of the other one question is the correct answer rate. 2. The other one question is selected so as to be within a specific range. The examination question creating system according to any one of 1 to 3. 5. The storage means stores the test questions in XML.
The test question creating system according to claim 1, wherein the test question is stored in a format, and the extraction unit outputs the selected test question. 6. A process of storing a plurality of test questions and a correct answer rate of the test question, and test question condition information indicating conditions of the test question to be selected, including the correct answer rate of the test question to be selected. A test question creating method comprising the step of selecting a test question from the test questions stored in the above step based on the test question condition information. 7. A test question and a step of storing a plurality of correct answer rates of the test question, and test question condition information indicating conditions of the test question to be selected, including the correct answer rate of the test question to be selected. A test question creating program that causes a computer to execute a step of selecting a test question from the test questions stored in the step based on the test question condition information.