JP2004029107A - System for processing marking of answer - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a system for processing marking of answers capable of rapidly performing processing of marking and performing more exact processing of marking in marking the answers by making combination use of a selection type examination and description type examination. <P>SOLUTION: The system is provided with a reading means 101 for reading answer sheets, a selection type answer memory means 302 for storing the answers of the selection type examination, a selection type examination marking means 401 for marking the answer data stored in the selection type answer memory means, a marking result memory means 306 for storing the marking results marked by the selection type examination marking means, a primary criterion memory means 309 for storing the criteria for narrowing down the persons to be marked of the description type examination, and a primary decision means 501 for determining the persons to be marked of the description type examination from the marking results of the selection type examination stored in the marking result memory means and the criteria stored in the primary criterion memory means and for storing the persons to be marked in the marking result memory means. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an answer scoring processing system, and more particularly, to an answer scoring processing system for scoring an answer using both a selective test and a written test.
[0002]
[Prior art]
2. Description of the Related Art In general, various written tests conducted by educational institutions and testing institutions can be broadly divided into descriptive tests and multiple-choice tests depending on the answering method. Also, a combined descriptive / selective test using both a descriptive test and a selective test has been widely conducted.
[0003]
The written test is a test in which, for each question, the test taker directly writes the answer to the question on the answer sheet. On the other hand, the multiple-choice test is a test in which the answers to individual questions are presented in advance as a plurality of options from the questioner, and the examinee selects one or more appropriate answers from among them and fills out the answer sheet. .
[0004]
In the multiple-choice test, a mark sheet system in which a predetermined position of an answer sheet determined for each answer is filled in black with a black pencil or the like to answer the answer is widely used. In the mark sheet method, a mark sheet reader that reads the answer sheet at high speed is used, and the mark sheet has a small number of erroneous readings, so that quick and accurate answer scoring can be performed.
[0005]
However, in the multiple-choice test, it is not always possible to accurately reflect the true ability of the examinee, because the correct answer by the examinee may happen by mistake. Therefore, in order to ask for more accurate knowledge and academic ability, a written test is often used together.
[0006]
On the other hand, in the written test, the examinee writes the answer in a predetermined answer position with handwritten characters, and even if the character recognition using OCR or the like is performed, the recognition rate is low and there are a plurality of correct answers. Due to various problems, such as in some cases, it is far from practical use of scoring processing using a machine.
[0007]
For this reason, conventionally, a grader directly grades the answer sheet, marks the score or correctness on the answer sheet, and performs reading again by the mark sheet reader, or inputs the score or correctness of each question from the terminal by key input. A method was adopted. In these methods, it cannot be denied that the scoring processing speed is reduced and that human errors such as scoring errors and transcription errors are more likely to occur.
[0008]
Accordingly, an example of an answer scoring processing system that solves the above-mentioned problems regarding the scoring of the description-type test is described in JP-A-9-68919 and JP-A-2000-122517. As shown in FIG. 14, this conventional answer scoring processing system includes a reading means 101, a storage means 300, and a descriptive test scoring means 201. The storage means 300 is composed of an answer sheet definition storage means 301, a descriptive answer image storage means 303, a descriptive model answer storage means 307, a descriptive scoring criterion storage means 308, and a scoring result storage means 306. Have been.
[0009]
The conventional answer scoring system having such a configuration generally operates as follows. That is, the answer sheet on which the answer is entered is optically read by the reading means 101 using an input device such as a scanner based on the individual answer position information stored in the answer sheet definition storage means 301, and the individual answer sheet is read. Partial image data is generated for each answer position and stored in the descriptive answer image storage unit 303.
[0010]
The descriptive test scoring unit 201 stores the partial image data of the answer to the specified question from the descriptive answer image storage unit 303 and the model answer of the specified question from the descriptive model answer storage unit 307 according to the instruction of the grader. Then, the scoring criterion of the designated question is read from the descriptive scoring criterion storage means 308, and displayed on a display device such as a screen of a processing terminal of the grader.
[0011]
Then, the grader grades the displayed answer based on the content displayed on the display device, and inputs the score or correctness using an input device such as a keyboard and a mouse. Next, the descriptive test scoring unit 201 stores the scoring result in the scoring result storage unit 306 based on the input contents and the scoring criterion, and displays the next examinee's data. In addition, in the case of an answer that needs to be examined in scoring, the descriptive test scoring means 201 has a function of suspending scoring.
[0012]
As described above, it is difficult to completely mechanize the scoring of the descriptive test, and even if the conventional answer scoring system is used, it is expected that the scoring process will be somewhat more efficient, After all, since the scoring process is performed manually, it does not lead to a significant improvement in work efficiency.
[0013]
Therefore, some testing organizations implement so-called cut-offs in the scoring process of the descriptive test. This means that even if the descriptive test is a perfect score based on the scoring result of the multiple-choice test, test takers who are unlikely to pass the test will not be scored for the descriptive test. Although it depends on the difficulty of the test itself, this has the advantage that the number of subjects who score the descriptive test can be reduced, and the time required for the scoring process can be reduced.
[0014]
[Problems to be solved by the invention]
However, in the conventional answer scoring processing systems described in both of the above publications, no consideration is given to cut-off, so the testing institution removes the answer sheets of examinees who meet certain criteria from all answer sheets. Either a scoring process or a scoring process must be performed for all members. The scoring result is marked in a predetermined column of the answer sheet and read again or registered by key input. Further, when the answer sheet is extracted, an operation of returning the answer sheet to the original position occurs. For this reason, there is a problem that it takes a long time for the scoring process of the selective test and the description test.
[0015]
Secondly, since there is no function for scoring the same answer by a plurality of graders, even if the grader makes a mistake in scoring or inputting a score, it can be checked. However, there was a problem that the accuracy of the scoring depends on the skill of the grader.
[0016]
Therefore, the present invention has been made in view of the problems in the above-described conventional answer scoring processing system, and can perform the scoring process of the selective test and the descriptive test quickly, thereby achieving a more accurate scoring process. An object of the present invention is to provide an answer scoring processing system that can be performed.
[0017]
[Means for Solving the Problems]
In order to achieve the above object, the present invention is an answer scoring processing system for scoring an answer using a combination of an optional test and a written test, and a reading means for reading an answer sheet in which an answer to the question has been entered, A selective answer storage means for storing the answers of the selective test read by the reading means, a selective test scoring means for scoring the answer data stored in the selective answer storage means, and the selective test scoring means Scoring result storage means for storing scoring results graded according to, a primary judgment criterion storage means for storing judgment criteria for narrowing down the scoring subjects of the descriptive test, and a selective test stored in the scoring result storage means Determining a person to be scored in the descriptive test from the scoring result of the above and the judgment criteria stored in the primary judgment criterion storage means, and storing the scoring person in the scoring result storage means. Characterized by comprising a determining means.
[0018]
Then, according to the present invention, after narrowing down the candidates for the descriptive test by the primary determination means, it is possible to score the descriptive test, so that all the examinees do not score the descriptive test. However, the pass / fail judgment can be appropriately performed, and the time required for the scoring process can be significantly reduced.
[0019]
In the answer scoring processing system, a descriptive answer image storage means for storing an answer image of a descriptive test read by the reading means, and the descriptive answer based on a primary determination result stored in the scoring result storage means. It is also possible to provide a descriptive test scoring means for displaying the answer image to be scored from the image storage means and storing the scoring result in the scoring result storage means.
[0020]
Further, in the above-mentioned answer scoring processing system, a scoring comparison means for detecting a disagreement of scoring may be further provided from the scoring result storage means storing the scoring results of the descriptive tests of a plurality of graders. According to this configuration, the scoring results of the descriptive test scored by a plurality of graders are stored in the scoring result storage means, and the scoring comparison means checks for inconsistencies in the scoring results of each grader. Thus, scoring of the descriptive test can be performed, and more accurate scoring processing can be performed.
[0021]
Furthermore, the answer scoring processing system may be configured to further include a pass / fail determination unit that performs a comprehensive pass / fail determination of the selective test and the descriptive test.
[0022]
BEST MODE FOR CARRYING OUT THE INVENTION
Next, embodiments of the present invention will be described in detail with reference to the drawings.
[0023]
FIG. 1 shows an embodiment of an answer scoring processing system according to the present invention. This answer scoring processing system is a reading means 101 for optically reading an answer sheet on which an answer is entered by an input device such as a mark sheet reader (not shown). And descriptive test scoring means 201 for scoring a descriptive test, storage means 300 for storing answer data of a selective test, an answer image of a descriptive test, a scoring result, etc., and selection for scoring a selective test Expression test scoring means 401, primary judgment means 501 for determining a person to be scored in a descriptive test, scoring comparison means 601 for comparing scoring results by a plurality of scorers, final judgment on pass / fail of the test and determination of results And a pass / fail determination means 701 for performing In this embodiment, the case where one reading unit 101 is used will be described. However, if a large number of answer sheets need to be read, a plurality of reading units may be provided.
[0024]
The storage means 300 includes answer sheet definition storage means 301 for storing answer reading position information of a descriptive test for obtaining mark reading position information and a partial image of the answer sheet, and a selection expression for storing answer data of a selection test. An answer storage means 302, a descriptive answer image storage means 303 for storing answer image data of a descriptive test, a selective correct answer storage means 304 for storing correct answer data for a selective test, and a scoring standard for the selective test. Selection type scoring criterion storage means 305, scoring result storage means 306 for storing scoring results, descriptive model answer storage means 307 for storing descriptive test example answers, and description for storing descriptive test scoring criteria A grading standard storage unit 308, a primary criterion storage unit 309 for storing a criterion for determining a person to be scored in a descriptive test, And a acceptance criteria storage means 310 for storing a criterion for determining whether.
[0025]
Although only one descriptive test scoring unit 201 is shown in FIG. 1, the scoring of the descriptive test by a plurality of graders is usually present in a plurality of processing terminals. However, processing can be performed with one processing terminal.
[0026]
Next, the operation of each means will be described in order.
[0027]
The reading means 101 optically reads the answer sheet on which the answer has been entered with an input device such as a mark sheet reader based on the mark reading position information and individual answer position information stored in the answer sheet definition storing means 301, and outputs the mark sheet. The identification code of the answer sheet automatically attached to the answer sheet by an input device such as a reader, or the bar code reading result that does not overlap with other answer sheets printed and pasted on the answer sheet is associated with the mark reading result The selected data is stored in the selectable answer storage means 302. Further, the partial image data of each answer position is stored in the descriptive answer image storage unit 303 in association with the identification code of the answer sheet or the reading result of the barcode.
[0028]
The descriptive test scoring means 201, based on the instructions of the grader, writes the answer image data of the designated question from the descriptive answer image storage means 303, the model answer from the descriptive model answer storage means 307, and the scoring criteria into the descriptive formula. Each is acquired from the scoring reference storage means 308 and displayed on a display device such as a CRT of a grader terminal (not shown). The grader grades the displayed answer image and inputs the graded result from an input device (not shown) such as a keyboard and a mouse. The descriptive test scoring unit 201 compares the input scoring result with the scoring standard, and stores the scoring result in the scoring result storage unit 306.
[0029]
The selective test scoring means 401 acquires the answer data of the selective test from the selective answer storage means 302, the correct data from the selective correct answer storage means 304, and the judgment criterion from the selective scoring reference storage means 305, respectively. Automatically, and the scoring result is stored in the scoring result storage means 306.
[0030]
The primary judgment unit 501 determines a person to be scored for the descriptive test from the scoring result stored in the scoring result storage unit 306 and the primary judgment criterion stored in the primary judgment storage unit 309, and stores it in the scoring result storage unit 306. Store the result.
[0031]
The scoring comparison means 601 compares the scoring results of the same questions graded by a plurality of graders and stores the results in the scoring result storage means 306. Further, the comparison result can be displayed on a display device such as a CRT of a grader terminal (not shown) or output to an output device such as a printer (not shown).
[0032]
The pass / fail determination unit 701 determines whether or not the final test based on the scoring result stored in the scoring result storage unit 306 and the pass / fail determination criterion stored in the pass / fail determination storage unit 310 is based on the combined test of the selective test and the descriptive test. Is determined, and the result is stored in the scoring result storage unit 306.
[0033]
Next, the overall operation of the answer scoring system will be described in detail with reference to the flowcharts of FIGS.
[0034]
First, in the reading means 101, the answer sheet is read by an input device such as a mark sheet reader (not shown) (step A1). Next, the selective test scoring means 401 performs a scoring process for the selective test (step A2). Subsequently, the primary determination unit 501 performs a primary determination process based on the scoring result of the multiple-choice test and the primary determination criterion, and determines a person to be scored for the descriptive test (step A3).
[0035]
Next, in the descriptive test scoring means 201, the grader performs a scoring process for the descriptive test (step A4). In this process, a plurality of graders can simultaneously grade different questions. In addition, the same question can be graded simultaneously by a plurality of graders. The scoring results of the descriptive test scored by a plurality of graders are checked by the scoring comparing means 601 to see if they match (step A5).
[0036]
Finally, the pass / fail judgment unit 701 performs final pass / fail judgment processing of the test based on the scoring result of the selective test, the scoring result of the descriptive test, and the pass / fail judgment criterion (step A6).
[0037]
Next, each operation of each step in FIG. 2 will be described in detail.
[0038]
FIG. 3 is a flowchart showing details of the operation of reading the answer sheet (step A1 in FIG. 2).
[0039]
First, a pre-registered answer sheet definition is acquired from the answer sheet definition storage unit 301 and transferred to an input device such as a mark sheet reader (not shown) (step B1).
[0040]
The operator sets a bundle of answer sheets on which the answers to be read are written in an input device such as a mark sheet reader (not shown) (step B2).
[0041]
Next, when the operator instructs to start reading (step B3), an input device such as a mark sheet reader (not shown) reads one answer sheet from the set of answer sheets (step B4). When the answer sheet is read, an input device such as a mark sheet reader (not shown) reads the mark information and barcode information according to the transferred answer sheet definition, and the reading means 101 stores the read result in the selectable answer storage means 302. It is stored (step B5). Further, an input device such as a mark sheet reader (not shown) acquires an image for each question for a portion where the descriptive answer is entered according to the answer sheet definition, and the reading means 101 stores the acquired image in a descriptive answer image storage means. 303 (step B6).
[0042]
An input device such as a mark sheet reader (not shown) repeats the processing from step B4 onward until reading of the set of answer sheets is completed (step B7). The operator repeats the process from step B2 until all the answer sheets have been read (step B8).
[0043]
FIG. 4 is a flowchart showing details of the operation of scoring (step A2 in FIG. 2) of the selective test.
[0044]
First, when the operator instructs the start of processing (step C1), the multiple-choice test scoring unit 401 reads the answer data of the multiple-choice test from the multiple-choice answer storage unit 302 (step C2). Subsequently, the pre-registered correct answer and the scoring reference are acquired from the selectable correct answer storage means 304 and the selectable scoring reference storage means 305 (step C3).
[0045]
Next, the selection type test scoring means 401 acquires answer data for one person from the read answer data (step C4), and acquires one correct answer / scoring standard from the read correct answer / scoring standard (step C4). (Step C5), a scoring process for the question is performed, and the scoring result is stored in the scoring result storage means 306 (step C6).
[0046]
The selection-type test scoring unit 401 repeatedly performs steps C5 and C6 until all questions have been scored (step C7). Then, when the grading process for all questions is completed, the grading results of the candidate's multiple-choice test are totaled, and the grading total results are stored in the grading result storage means 306 (step C8). The selection-type test scoring unit 401 repeatedly performs the processing from step C4 onward until all test takers are completed (step C9).
[0047]
FIG. 5 is a flowchart showing details of the operation of the primary determination process (step A3 in FIG. 2).
[0048]
First, when the operator instructs the start of the process (step D1), the primary determination unit 501 reads a previously registered primary determination criterion from the primary determination criterion storage unit 309 (step D2).
[0049]
Next, the primary judgment means 501 reads the total score of the selective examination of all the examinees from the scoring result storage means 306 (step D3), and performs the judgment processing by comparing with the previously read primary judgment criterion. The primary judgment result is stored in the scoring result storage means 306 (step D4).
[0050]
FIG. 6 is a flowchart showing the details of the operation of the scoring of the descriptive test (step A4 in FIG. 2).
[0051]
First, the grader inputs a grader code which has been given to himself in advance (step E1). Next, when the grader inputs the question number to be graded (step E2), the descriptive test scoring means 201 preliminarily registers from the descriptive model answer storage means 307 and the descriptive scoring criterion storage means 308. The model answer and the scoring criterion that have been performed are acquired (step E3).
[0052]
Next, the grader inputs a grade target (step E4). The scoring target here means all examinees, examinees who satisfy the primary judgment criteria, examinees who have suspended the scoring at the previous processing, etc., and the scorer performs the scoring process this time from among them. Enter the target person. Further, when there are a large number of examinees, it is desirable to be able to set narrowing-down conditions such as an examination number range in order to execute the scoring process in a distributed manner by a plurality of graders.
[0053]
When the scoring person is input, the descriptive test scoring unit 201 extracts scoring target data from the scoring result storage unit 306 (step E5). It is checked whether or not the data to be graded exists (step E6). If the data does not exist, the process returns to step E2, and the process is started again by specifying the question number.
[0054]
If there is scoring data, the descriptive answer image data of the question for one examinee is read from the descriptive answer image storage means 303 (step E7), and displayed on the scoring screen together with the model answer. (Step E8). Next, the grader compares the model answer with the answer image on the screen and inputs the scoring result (step E9).
[0055]
The descriptive test scoring unit 201 checks the validity of the input scoring result based on the scoring criterion (step E10). If there is a problem with the validity, the process returns to step E9, where the scoring result is input again (step E9). Step E11). On the other hand, if there is no problem in the validity check, a grading process is performed based on the input grading result and the grading standard, and the grading result is stored in the grading result storage unit 306 (step E12).
[0056]
Until the scoring process is completed for all the subjects, the process from step E7 is repeated (step E13). When the grading process for all the subjects has been completed for the question, an end confirmation message is displayed on the screen. If the process is not ended, the process returns to step E2 and inputs the question number (step E14).
[0057]
FIG. 7 is a flowchart showing details of the operation of the descriptive expression scoring check (step A5 in FIG. 2).
[0058]
First, when the grader instructs the start of the processing (step F1), the grade comparison means 601 checks whether there is a difference between the graded results of the same examinee made by a plurality of graders from the graded result storage means 306. (Step F2).
[0059]
As a result of the check, if there is no error, the process is terminated (step F3). If there is an error, the question and the examinee's answer image data are acquired from the descriptive answer image storage means 303, The results are displayed on the screen together with the results of the scoring by a plurality of graders (step F4).
[0060]
FIG. 8 is a flowchart showing details of the operation of the pass / fail determination processing (step A6 in FIG. 2).
[0061]
First, when the operator instructs the start of the process (step G1), the pass / fail determination unit 701 reads a pass / fail determination criterion registered in advance from the pass / fail determination criterion storage unit 310 (step G2).
[0062]
Next, the pass / fail judgment unit 701 reads the score totaling result of the selective test and the scoring result of the descriptive test of all examinees from the scoring result storage unit 306 (step G3), and compares the result with the pass / fail judgment criteria read earlier. In addition, the judgment processing is performed, and the result of the pass / fail judgment is stored in the scoring result storage means 306 (step G4).
[0063]
As described above, in the present embodiment, it is possible to narrow down the number of subjects to be scored in the descriptive test scoring means 201 based on the judgment result of the primary judgment means 501. Only the test taker who has a possibility of scoring can perform scoring of the descriptive test, and the scoring work can be made more efficient.
[0064]
Further, in the present embodiment, the descriptive test scoring means 201 can score the narrowed-down examinee's answer data on the screen, so that all the answer sheets to be scored for the descriptive test are searched for. After extracting and scoring, it is not necessary to return to the original position.
[0065]
Furthermore, in the present embodiment, the descriptive test scoring means 201 and the scoring comparing means 601 allow a plurality of graders to perform a scoring process on the same question of the same applicant, thereby enabling fair and accurate scoring. Become.
[0066]
Next, the operation of the answer scoring system according to the present invention will be described using a more specific embodiment.
[0067]
FIG. 9 shows an example of an answer sheet used in the present embodiment. The answer sheet includes a bar code, an examination number entry box, a selection-type test answer section, and a description-type test answer section.
[0068]
The bar code is assigned a different code for each answer sheet in order to identify the answer sheet. In addition, barcodes are extremely unlikely to be misread, and are used for identification of answer sheets, so that the grader does not know who the answer sheet is, so extremely fair scoring can be performed. .
[0069]
The examination number box marks the unique examination number assigned to each examinee. In the multiple-choice test answer column, the examinee selects from the options given in the question, and writes a mark in a place determined for each question and each option. The short answer column describes the answer to the question.
[0070]
In order to read the answer sheet by the reading means 101 (see FIG. 1), it is necessary to register information for reading the answer sheet in the answer sheet definition storage means 301 in advance. Here, the definition to be registered includes a sheet size, a sheet thickness, a barcode position, a mark reading position, an image acquisition position, an output layout of a barcode / mark reading result, and the like.
[0071]
The operator sets the answer sheet on an input device such as a mark sheet reader and reads the answer sheet. The input device such as a mark sheet reader used here can read a mark and a barcode, can acquire a plurality of partial images on the answer sheet, and needs to read a large amount of answer sheets. It is preferable to be able to load as many answer sheets as possible and to be able to input continuously and at high speed.
[0072]
The reading means 101 stores a barcode for identifying the answer sheet read by an input device such as a mark sheet reader, an examination number, and answer data of a selective test in the selective answer storage means 302.
[0073]
Further, the reading means 101 adds a barcode for answer sheet identification and question identification information to the answer images of the plurality of answering tests obtained by an input device such as a mark sheet reader, and writes the answering image storage means. 303.
[0074]
Subsequently, the multiple-choice test is scored. In this embodiment, after the operator reads the answer sheet, the operator instructs the scoring of the multiple-choice test again. However, the scoring process may be automatically performed when the multiple-choice answer data is stored.
[0075]
Before scoring the multiple-choice test, it is necessary to register the correct answer and scoring criterion for each question in the multiple-choice correct answer storage means 304 and the multiple-choice scoring reference storage means 305, respectively. The selection-type correct answer storage unit 304 stores the number assigned to the correct answer for each question. The selection type scoring standard storage unit 305 stores the scoring of each question, the scoring method, the field, and the like. The scoring method is a method of assigning points to each question, a method of assigning a score to each question, a method of assigning multiple questions as a group when all answers including the answer order are correct, and an answer order Regardless, there is a method of assigning points when all answers are correct.
[0076]
The selection-type test scoring unit 401 obtains a selection formula for each examinee from the answer data read from the selection-type answer storage unit 302, the correct answer data read from the selection-type correct answer storage unit 304, and the selection-type scoring criterion storage unit 305. The test is graded, and the graded result is stored in the graded result storage unit 306. The scoring results stored here are the score of each question, the score totaled for each field, the total score of the entire multiple choice test, and the like.
[0077]
Subsequently, a primary determination process is performed. In the present embodiment, the operator instructs the primary determination process again after scoring the multiple-choice test, but the determination may be automatically performed when the scoring result of the multiple-choice test is stored. .
[0078]
Prior to performing the primary determination process, it is necessary to register in advance in the primary determination criterion storage unit 309 a determination criterion for narrowing down the number of persons to be scored in the descriptive test.
[0079]
FIG. 10 shows an example of a perfect score, a primary criterion, a score of examinee A, and a score of examinee B of the multiple choice test.
[0080]
The primary judgment means 501 acquires the primary judgment criteria from the primary judgment criteria storage means 309, in this case, the criteria of 15 points in the A field, 10 points in the B field, and a total of 20 points of the selective test, and stores them in the scoring result storage means 306. The stored score for each examinee's field and the total score of the entire multiple-choice test are collated, and the primary judgment result is returned to the scoring result storage means 306. In the example shown in FIG. 10, since the test taker A satisfies all the criteria, the pass is returned as the primary judgment result. In addition, since the examinee B does not satisfy the criteria of the field B, the examinee B exceeds the examinee A in total, but a rejection is returned as the primary determination result. By this primary determination process, the total number of examinees who should score the descriptive test can be reduced, and the efficiency of the descriptive test scoring process can be increased.
[0081]
In this example, the total score of the two fields and the selection test is used as the criterion, but depending on the test, only the total score may be used. Also, the number of fields may increase.
[0082]
Next, scoring of the descriptive test based on the primary judgment result is performed.
[0083]
Before scoring the descriptive test, the model answer and the scoring criterion for each question need to be registered in the descriptive model answer storage means 307 and the descriptive scoring reference storage means 308, respectively. The descriptive model answer storage unit 307 stores a model answer of each question. The descriptive scoring criteria storage means 308 stores the points of each question, the presence or absence of an intermediate point, the field, and the like.
[0084]
FIG. 11 shows an example of a scoring screen for the descriptive test. The scoring screen includes a question field, a question number, an answer sheet identification number, the total number of extracted data and the number of scoring processes, a grader code, a model answer display area, an answer image display area, a scoring button and It has a text box, a grading hold button, a grading result registration button, and a grading end button. Note that this is an example of a scoring screen, and it is desirable to design a screen in which layout and display items are optimized for each test in which scoring is performed. In addition, in order to realize fair scoring processing, a system is provided in which the examinee cannot be identified by displaying the identification number of the answer sheet without displaying the examinee number.
[0085]
First, the grader A inputs the grader code “A”. Next, a field “Sector C” to be graded and a question number “Question 2” are input. Here, the descriptive test scoring unit 201 acquires the model answer and the scoring criterion of “C field-question 2” from the descriptive model answer storage unit 307 and the descriptive scoring criterion storage unit 308.
[0086]
Next, the grader A designates the examinee who satisfies the primary criterion as the scoring target, and further designates the examination number range. Then, the descriptive test scoring unit 201 extracts the examinees who are within the designated examination number range and who have passed the primary determination process.
[0087]
The descriptive test scoring means 201 obtains the answer image of the examinee who passed in the extracted primary judgment processing from the descriptive answer image storage means 303 and displays the answer image in the answer image display area of the scoring screen. The grader A grades the displayed model answer and the answer image, and inputs the scoring result using the scoring button and the score input text box. Then, when the grader A presses the grade registration button, the descriptive test grader 201 registers the grader code and the graded result in the graded result storage 306.
[0088]
At this time, the validity of the scoring result is also checked with reference to the scoring standard. For example, if a question does not have an intermediate point and an intermediate point has been entered, an error is returned. When the registration of the scoring result ends normally, the descriptive test scoring means 201 displays the answer image of the next examinee in the answer image display area.
[0089]
When the scoring process for the descriptive test is completed, the scoring results of each grader are compared before final pass / fail judgment is made. FIG. 12 shows an example of scoring in a descriptive test performed by a plurality of graders. In this example, the scoring process of the examinee A is performed by the scoring person A and the scoring person B, but the scoring result of the question 2 in the field C is different.
[0090]
The scoring comparison means 601 checks the scoring result storage means 306 for any inconsistency in all scoring results, and if any inconsistency is detected, the question number is displayed on a display device such as a screen or an output device such as a printer. A list of numbers and scoring results for each grader is output. The grader discusses based on this list, and re-registers a correct scoring result using the descriptive test scoring means 201.
[0091]
Finally, a pass / fail judgment process is performed. Before performing the pass / fail judgment processing, it is necessary to register the pass / fail judgment criteria in the pass / fail judgment reference storage means 310 in advance.
[0092]
FIG. 13 shows an example of the pass / fail judgment criteria, the score of examinee A, the score of examinee B, and the score of examinee C.
[0093]
The pass / fail judgment means 701 is based on the pass / fail judgment criteria stored in the pass / fail judgment criterion storage means 310. In this example, the criterion is 15 points in the A field, 10 points in the B field, a total of 20 points in the selection test, 25 points in the C field, and a total score of 70 points. The obtained score is collated with the total score, the score of the multiple choice test, and the total score of the entire test stored in the scoring result storage means 306 for each examinee's field, and the pass / fail judgment result is compared with the scoring result storage means 306. To return. In the example of FIG. 13, since the examinee A satisfies all the criteria, the pass is returned as the pass / fail judgment result. In addition, since the test taker B does not satisfy the criteria in the field B, the descriptive test is not graded, and a failure is returned as a pass / fail judgment result. In addition, the examinee C satisfies the criteria for each field, but does not reach the reference point in the total score, so that a failure is returned as the pass / fail judgment result.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a configuration of an embodiment of an answer scoring processing system according to the present invention.
FIG. 2 is a flowchart showing an overall operation of the answer scoring system of FIG. 1;
FIG. 3 is a flowchart showing an operation of reading the answer sheet of FIG. 2;
FIG. 4 is a flowchart showing a scoring operation of the selective test in FIG. 2;
FIG. 5 is a flowchart illustrating an operation of a primary determination process in FIG. 2;
FIG. 6 is a flowchart showing a scoring operation of the descriptive test in FIG. 2;
FIG. 7 is a flowchart showing an operation of a descriptive scoring check of FIG. 2;
FIG. 8 is a flowchart showing the operation of a pass / fail determination process in FIG. 2;
FIG. 9 is a diagram showing an example of an answer sheet used in the answer scoring processing system according to the present invention.
FIG. 10 is a diagram showing an example of a primary judgment criterion and an examinee's score in the answer scoring processing system according to the present invention.
FIG. 11 is a diagram showing an example of a scoring screen for a descriptive test used in the answer scoring system according to the present invention.
FIG. 12 is a diagram showing an example of a scoring result of a descriptive test performed by a plurality of graders in the answer scoring processing system according to the present invention.
FIG. 13 is a diagram showing an example of a pass / fail judgment criterion and an examinee's score in the answer scoring processing system according to the present invention.
FIG. 14 is a block diagram showing an example of a conventional answer scoring system.
[Explanation of symbols]
101 reading means
201 Descriptive test scoring method
300 storage means
301 answer sheet definition storage means
302 Selective answer storage means
303 Descriptive answer image storage means
304 Selective correct answer storage means
305 Optional scoring criteria storage
306 scoring result storage means
307 Descriptive model answer storage means
308 Descriptive scoring criteria storage means
309 Primary judgment criterion storage means
310 Pass / fail criterion storage means
401 Selective test scoring
501 Primary judgment means
601 Scoring comparison means
701 Pass / fail judgment means

Claims (4)

An answer scoring processing system for scoring an answer using both the elective test and the written test,
Reading means for reading an answer sheet on which answers to the questions have been entered;
Selective answer storage means for storing the answer of the selective test read by the reading means,
Selective test scoring means for scoring the answer data stored in the selective answer storage means;
Scoring result storage means for storing the scoring result scored by the selective test scoring means,
Primary criterion storage means for storing criterion for narrowing down the scored persons of the descriptive test;
From the scoring result of the multiple-choice test stored in the scoring result storage means and the criterion stored in the primary judgment criterion storage means, a person to be scored for the descriptive test is determined. An answer scoring processing system comprising: a primary determination unit for storing a person to be scored. Descriptive answer image storage means for storing the answer image of the descriptive test read by the reading means,
A descriptive test scoring unit that displays an answer image to be scored from the descriptive answer image storage unit based on the primary determination result stored in the scoring result storage unit, and stores the scoring result in the scoring result storage unit; 2. The answer scoring processing system according to claim 1, further comprising: 3. The answer scoring processing system according to claim 1, further comprising a scoring comparing means for detecting a disagreement of scoring from the scoring result storage means storing the scoring results of the descriptive tests of a plurality of graders. . 4. The answer scoring processing system according to claim 1, further comprising a pass / fail judgment means for making a comprehensive pass / fail judgment of the selective test and the written test.

Images