JP6832194B2 - Answer scoring method - Google Patents

Description

The present invention relates to an answer scoring method capable of efficiently scoring a large number of answers prepared for a descriptive question while ensuring the objectivity of the scoring by a plurality of graders.

In a descriptive question, the answer maker (examinee) is required to create an answer (answer) with a certain amount of free description to the question. The grader interprets the description of the answer and evaluates not only the correctness but also how close the answer is to the correct answer, for example, by giving partial points. On the other hand, it is also necessary to ensure the objectivity in this multi-step evaluation, that is, the assignment of partial points.

Here, depending on how the question is created, the variation of the answer description can be limited to a certain range, and the objectivity of the multi-step evaluation can be enhanced. However, the difference from the multiple-choice question in which the variation of the answer description is presented in advance and the answer creator (examinee) is made to select from among them is lost. Therefore, as long as the descriptive question is adopted, it is necessary to allow a certain degree of variation in the description of the answer. In addition, in large-scale examinations that target examinees of the same grade in one country and have various backgrounds of examinees, the variation of the answer description is limited to a certain range as the question creator intended. It is also well known that it cannot be limited. Furthermore, in a large-scale examination, it is required to complete the counting of the scores of a large number of answers within a predetermined period, so that multiple graders are required to score, and the objectivity in the judgment difference between the graders is improved. It is also necessary to secure it.

For example, in Patent Document 1, in a system in which a large number of answers created for a descriptive question from a plurality of terminal input devices connected via a network are scored by a plurality of graders, the scoring results of one grader are different. It discloses an answer scoring support system that can be re-evaluated and corrected while referring to the scoring grounds of the graders, and aims to ensure objectivity in the judgment difference between multiple graders. If the scoring results do not match and there is doubt about the objectivity of the scoring results, the scoring results can be reexamined while referring to the scoring grounds of other graders, and the scoring results once registered can be corrected.

Here, when the same answer is evaluated by two graders, it is not clear which grader's evaluation is more correct. Furthermore, if a large number of answers are to be graded quickly, the same answer will be evaluated by a plurality of graders, resulting in lack of work efficiency. In addition, it is very difficult to secure a large number of high-quality graders because of the understanding of the impact of scoring. Therefore, a proposal has been made to change the scoring method itself of the grader.

For example, in Patent Document 2, the grader answers a predetermined alternative question so as to aggregate the judgments of the grader, instead of limiting the variation of the description of the answer on the side of the answer creator. So to speak, it proposes a scoring method in which a "selective question" on the grader side is prepared. This method limits the variation of scoring on the grader side, but unlike the conventional serial partial scoring method that accumulates the scores set for each question, the grader's answers are patterned and aggregated. By doing so, the answers can be classified and scored in parallel.

Japanese Unexamined Patent Publication No. 2006-277086 Japanese Unexamined Patent Publication No. 2012-22185

When the scoring target is an answer other than the mark type and the score is given by a person (grader) instead of a machine, the person must also judge the correctness of the scoring result, and it is not easy to process this efficiently. Here, by having the grader take charge of scoring the appropriate answer according to the tendency of the grader, it is not necessary to verify the correctness of the scoring result of each answer more carefully, and the overall processing efficiency can be greatly improved. ..

The present invention has been made in view of such a situation, and an object of the present invention is to ensure the objectivity when scoring a large number of answers prepared for a descriptive question by a plurality of graders. Is also to provide an answer scoring method that can efficiently score.

In the answer scoring method according to the present invention, the selected answer information is transmitted from the host computer to the client computer, the scoring information input by the grader is returned in response to the answer information, and the score results for each answer are collected. It is an answer scoring method that adopts the highly reliable score result from among them, and the scoring information includes individual information for identifying specific answer information which is one of the answer information and the specific answer information. On the other hand, for the scoring set information consisting of the answer score information which is the score result by the score measurement based on the score and the grader information for identifying the grader who input the score, and the specific answer information. Adoption that includes answer format information consisting of answer patterns for a group of questions consisting of a plurality of affirmative or negative two-choice question sentences, filters the scoring set information with the answer format information, and adopts the score result. It is characterized by including steps.

According to such an invention, when filtering by answer format information can adopt only highly reliable score results corresponding to specific answer format information based on grader information, and a large number of answers are scored by a plurality of graders. Even if there is, it is possible to score efficiently while ensuring objectivity.

In the above invention, the scoring permission step for determining the answer pattern that allows the grader to give the score result is included, and the adoption step is a combination of the grader and the answer pattern permitted thereto. It may be characterized by performing filtering based on. According to such an invention, only the score result by the grader who is permitted based on the response pattern can be adopted, and the scoring can be performed efficiently while ensuring the objectivity.

In the above invention, by allowing the input of a plurality of graders corresponding to one of the answer information, the scoring information may include a plurality of the scoring set information with respect to the individual information of 1. It may be a feature. According to such an invention, it is possible to extract the score result by the authorized grader from a plurality of scoring set information for one individual information.

The invention described above may be characterized in that the individual information and the answer format information are prepared in advance in the scoring information. According to such an invention, the processing of the answer information can be determined based on the answer format information.

The invention described above may be characterized by including a step of transmitting the answer information to the grader who is permitted for the answer pattern of the answer format information corresponding thereto. According to such an invention, only the score results by the graders who are permitted based on the response pattern can be collected and adopted.

It is a block diagram of the answer scoring system used in the answer scoring method as an Example by this invention. It is a block diagram of the main part of the scoring system. It is a flow chart of the answer scoring method. It is a figure of the display example of the scoring information. It is a flow chart of another answer scoring method.

First, the answer scoring system used in the answer scoring method according to the present invention will be described with reference to FIG.

[System configuration]
As shown in FIG. 1, the answer scoring system 1 is a host computer 10 used by an administrator including a question creator and a plurality of clients connected to the host computer 10 via a communication line 20 such as an Internet line or a LAN. Includes computer 21. The client computer 21 includes input / output devices such as a monitor, a keyboard, and a mouse.

The host computer 10 includes a large-capacity storage device 11 such as a hard disk device, a CPU 12 as a control unit, a ROM 13 and a RAM 14, and a communication interface (not shown). Further, the host computer 10 is connected to an input / output device such as a monitor 10a, a keyboard 10b, and a scanner (not shown) that enables input of image data of an answer as a user interface.

The storage device 11 has a storage area 30 such as a program and a database (DB) area 40 for storing various data.

In the program storage area 30, data accommodating means 31 as a program executed by the CPU 12, answer information transmitting means 32, scoring information receiving means 33, and scoring information adopting means 34 are stored.

With reference to FIG. 2, the database area 40 is provided with at least an answer information storage area 41, a scoring reference information storage area 42, a scoring information storage area 43, and a scoring permission information storage area 44. The answer information storage area 41 stores an answer image 41b, which is an image of the answer created by the examinee, and individual information 41a, such as an identification code for identifying a specific answer. In the scoring standard information storage area 42, a measurement standard 42a, which is a so-called scoring standard, and a question group 42b composed of a plurality of two-choice question sentences are stored. Further, the scoring information 50 (see FIG. 3) is stored in the scoring information storage area 43. Each of the scoring information 50 includes the above-mentioned individual information 41a, formal information 45 indicating the type of the answer identified by the individual information 41a, the grader information 46a of the grader who graded the answer, and the score result of the scoring results. The set information (scoring set information) 52 (see FIG. 3) including the set of the score information (answer score information) 46b is included. Further, the scoring permission information stored in the scoring permission information storage area 44 includes the above-mentioned grader information 46a and the corresponding type information 47 indicating the type of the answer to which each grader is permitted to score. ..

With such a system configuration, after having a plurality of examinees take the question sentences in advance and collecting the answers, in the answer scoring system 1, the answer information storage area uses the answer as the answer information by the data storage means 31. It is stored in 41, which is transmitted to the client computers 21 used by a plurality of graders by the answer information transmitting means 32, and the scoring information receiving means 33 receives a reply of the scoring information 50 which is the scoring result of the grader for the answer information. It can be stored and stored in the scoring information storage area 43. Details of these operations will be described later.

[Creating a question sentence]
Prior to using the answer scoring system 1, the administrator prepares a question sentence to be given to the examinee as an examination question. The question sentence targeted here is a question sentence that requires scoring by a grader (person), and is a question sentence that cannot be scored by a machine, for example, a test in which an examinee prepares an answer by hand. At least, it does not cover mark sheet type question sentences that can be scored by machines. The created problem statement may be input from an input device such as a keyboard or a scanner of the host computer 10 as necessary, stored in the storage device 11, and appropriately referred to by the host computer 10 or the client computer 21. Good.

[Creation of scoring standard information]
The administrator then creates the scoring standard information and stores it in the scoring standard information storage area 42 by the data accommodating means 31. The scoring standard information includes a measurement standard 42a that presents the grader to measure the score of the answer to the question sentence according to a certain criterion, and a question group 42b consisting of a plurality of affirmative or negative two-choice question sentences regarding the description of the answer. And include.

The measurement standard 42a is a so-called scoring standard for substantially determining whether or not a specific content is described in the answer sheet, and is the same as the conventional one. For example, it includes examples of correct answers and points, and when partial points should be given, it includes conditions for the content of the answer to which partial points should be given, and points such as partial points to be added or deducted.

Each of the two-choice question sentences in the question group 42b is a question sentence that allows the grader to select an affirmative or negative alternative answer regarding the answer, and has contents that facilitate the judgment of the selection. is there. That is, the two-choice question sentence does not substantially judge whether or not a specific content is described in the answer, but can formally judge the description of the answer. As a result, an answer that excludes the subjective difference of each grader is obtained. In addition, a plurality of two-choice question sentences are created for one question sentence to form a question group 42b, and at least the answers can be classified into a plurality of types according to a combination of affirmative or negative answers (answer patterns) to the question group 42b. It is a thing.

[Example 1]
Next, a method of using the answer scoring system 1 will be described with reference to FIGS. 1, 2, and 4 along with FIG.

With reference to FIGS. 1 and 2 in FIG. 3, the data accommodating means 31 stores the answer information in the storage device 11 of the host computer 10 (S1). In detail, the administrator gives a created question sentence to a plurality of examinees and obtains an answer to the question in advance. The answer sheet group on which the answer is described is read as an answer image 41b as answer information by an input device such as a scanner (not shown) of the host computer 10. The read answer image 41b is identified by the data storage means 31 with an identification code for each examinee, and is stored in the answer information storage area 41. Here, the answer created by the examinee is a set for a plurality of question sentences, but the answer information is divided into answer images 41b for each question sentence, and the code of each question sentence is used as the identification code. Etc. are also stored with individual information 41a. Actually, the processing for a plurality of problem sentences may be performed in parallel, but the processing for one problem sentence will be described below.

Next, it is determined what type of answer the grader is allowed to score (S2). As described above, the answers can be classified into a plurality of types according to the answer patterns for the question group 42b. Details will be described later, but when scoring by a large number of graders, there are types of answers that are prone to erroneous scoring depending on the experience and ability of the graders. In other words, in order to ensure the objectivity of scoring, the type of answer that matches the experience and ability of the grader so that erroneous scoring does not occur is specified, and the score measurement (scoring) is permitted. Then, the data accommodating means 31 stores the type of the answer for which scoring is permitted by the grader identified by the grader information 46a as the type information 47 in the scoring permission information storage area 44. Here, the type information 47 corresponds to the format information 45, which is an answer pattern for the question group 42b. Since the answer pattern corresponding to the type information 47 of such an answer is determined by the question group 42b by the two-choice question sentence, the scoring permission (S2) may be performed at the time when the question group 42b is created.

Next, the answer information transmitting means 32 selects the answer information from the answer information storage area 41 and transmits it to the client computer 21 together with the scoring standard information of the scoring standard information storage area 42 (S3). Each client computer 21 is supported by a plurality of graders who use it, and each grader selects to distribute a plurality of answers to be processed, and finally performs scoring processing for all the answer information. Let them do it. The plurality of answer information may be transmitted together, or may be transmitted one by one for each scoring process. In addition, one answer information may be distributed to a plurality of graders at the same time.

The client computer 21 receives the answer information together with the scoring standard information (S3'). The scoring standard information includes the measurement standard 42a and the question group 42b as described above, and is used for the scoring work by the grader. When the answer information for one question sentence is received in a plurality of times, the scoring standard information becomes unnecessary after the first reception, so that the transmission from the host computer 10 can be omitted. Further, the scoring standard information may be distributed to each grader in advance, and the transmission of the scoring standard information itself from the host computer 10 accompanying the transmission of the answer information may be omitted.

With reference to FIG. 4, the grader performs scoring processing on the answer information according to the scoring standard information on the client computer 21, creates and inputs the scoring information 50 corresponding to each answer information. The scoring process includes score measurement (creation of score information 46b) and answers to question group 42b (creation of format information 45). The scoring information 50 displayed on the screen of the client computer 21 includes format information 45, set information 52, and individual information 41a attached to these to specify the answer information to be scored.

First, the grader prepares the score information 46b according to the measurement standard 42a. The score information 46b is a so-called score for the answer sheet and is obtained by general scoring. For example, the score information 46b is created by adding or subtracting the score based on the score such as the partial score shown in the measurement standard 42a. The work of creating the score information 46b is referred to as score measurement here.

Next, the grader creates the formal information 45 according to the question group 42b composed of a plurality of two-choice question sentences. As described above, each of the two-choice interrogative sentences facilitates the decision to select affirmative or negative regarding the description of the answer, and does not impose a heavy burden on the scoring process work. The grader selects the answer to each of the plurality of two-choice interrogative sentences from the affirmative "Y" or negative "N" check box 51, inputs a check, and answers. By such work, a combination of affirmative or negative answers (answer pattern) to the question group 42b is created as the formal information 45.

The grader attaches the scorer information 46a such as an ID that identifies himself / herself to the score information 46b which is the score result (scoring result) to form the set information 52, and identifies the format information 45 and the answer to be scored individually. Along with the information 41a, the scoring information 50 is returned from the client computer 21 to the host computer 10 (S4').

The host computer 10 stores the scoring information 50 received by the scoring information receiving means 33 in the scoring information storage area 43 (S4). The host computer 10 accumulates the received scoring information 50 and proceeds to the next process as needed. That is, the next process may be started before the score information 50 replies for all the answers are obtained.

Then, in the host computer 10, the scoring information adopting means 34 adopts the scoring information 46b of the scoring information 50 under a predetermined condition (S5). Here, the objectivity of scoring is ensured by referring to the scoring permission information storage area 44 and adopting the scoring information 46b, which is the scoring result by an appropriate grader, for the answer based on the scoring permission information. I am aiming. That is, the grader information 46a and the type information 47 in the scoring permission information are collated with the grader information 46a and the format information 45 in the scoring information 50, and only when the format information 45 matches the type information 47. The score information 46b is adopted as the score of the answer. In other words, the set information 52 including the score information 46b is filtered by the format information 45 based on the scoring permission information.

In scoring by the grader (score measurement), the scoring result may differ depending on the grader even if the answer is the same. For example, even in a multiple-choice question sentence that requires the writing of a simple answer in single letters, due to different writing habits for each examinee, scoring with this interpretation will cause some errors. .. In other words, the grader who grades the answer to such a question sentence is required to have the experience and ability to read a single character written by the examinee. Even for so-called descriptive questions that require the examinee to write a certain amount of free writing, the scoring result may differ depending on the grader because scoring involves a large number of judgments. In other words, in either case, the grader is required to have the experience and ability to objectively score according to the scoring standard (measurement standard). Therefore, in order to ensure the objectivity of scoring, it is necessary to adopt the scoring results by appropriate graders for such types of question sentences.

Furthermore, even for the same question sentence, the appropriate grader for scoring may change depending on the variation of the answer. For example, even if the answer is for a question sentence that requires the grader to have the ability to read a single character as described above, if it is a blank answer, the scoring result will hardly differ depending on the grader, and the grader will be given a single character. No readable experience or ability is required. In other words, even if there is a formal difference in the answer, the appropriate grader for the scoring may differ. Furthermore, in the case of a descriptive question, the variation is more diverse, so the answer is not erroneously scored due to formal differences such as the amount of the answer and the presence or absence of a specific character string or mathematical formula. Appropriate graders who can score can vary. In other words, in addition to the types of question sentences mentioned above, the appropriate graders differ depending on the formal type of answer. Then, it is preferable that the two-choice question sentence of the above-mentioned question group 42b asks formal differences in the description of the answer that can be classified into such an answer type.

Therefore, as described above, a grader who permits scoring of the answer according to the type of the answer to the question sentence is determined based on the experience and ability, and the scoring permission information storage area 44 is used as the scoring permission information. Remember it. Then, as described above, the objectivity of scoring can be ensured by filtering the set information 52 with the format information 45 based on the scoring permission information and determining the scoring information 46b to be adopted as the scoring result of the answer. ..

At this time, there may be no score information 46b that can be adopted for some of the answers. In this case, the answer that does not have the score information 46b that can be adopted is graded again, but the grader is selected so that the returned score information 46b can be adopted (S6). That is, even for an answer that does not have the score information 46b that can be adopted, the format information 45 indicating the type of each answer has already been clarified, so that the grader is selected based on the format information 45. That is, the grader who is permitted to grade the answer by inquiring the grader permission information is selected from the grader information 46a. Specifically, the grader information 46a may be selected from the scoring permission information including the type information 47 corresponding to the format information 45.

Then, the answer information of the corresponding answer is transmitted to the client computer 21 corresponding to the selected grader (S7).

The client computer 21 receives the answer information (S7'). If the scoring standard information has not been received in the past, it may be received here. In other words, it is possible to newly select a grader who did not participate in the initial scoring process.

With reference to FIG. 4, the selected grader processes the answer information in accordance with the scoring standard information on the client computer 21, creates and inputs the scoring information 50 corresponding to the answer information. Since the format information 45 has already been clarified, the grader may perform the score measurement for creating the score information 46b according to the measurement standard 42a as the scoring process. Then, the grader returns the set information 52 in which the scorer information 46a such as the ID that identifies himself / herself is added to the score information 46b which is the score result (scoring result) from the client computer 21 to the host computer 10 together with the individual information 41a. Let (S8').

The host computer 10 stores the set information 52 (grader information 46a and score information 46b) received by the scoring information receiving means 33 in addition to the scoring information 50 including the corresponding individual information 41a of the scoring information storage area 43 (S8). ). As a result, the format information 45 of the scoring information 50 and the grader information 46a for all the answers match the combination permitted in the scoring permission information. That is, the scoring information adopting means 34 can adopt the remaining score information 46b that was not adopted in the above-mentioned adoption of the score information (S5) (S9), and as a result, all the score information 46b can be adopted. The host computer 10 may appropriately total the accumulated scoring information 50 as needed.

As described above, according to the above-mentioned answer scoring method using the answer scoring system 1, it is possible to adopt the score information 46b by the grader who is permitted to score based on the format information 45 for all the answers. It is possible to ensure the objectivity of scoring. Further, in addition to the general score measurement (scoring) processing work for obtaining the score information 46b, the answer form information 45 can be obtained only by adding the answer to the question group 42b consisting of the formal two-choice question sentence. Based on this, it is only necessary to measure the score again for some of the answers, and the scoring process can be performed quickly. That is, even when a large number of answers created for a question sentence that requires scoring by the grader are graded by a plurality of graders, the scoring can be performed quickly while ensuring objectivity.

As added to the explanation of the transmission of answer information (S3), one answer information may be distributed to a plurality of graders at the same time so as to be duplicated. According to this, the score information 46b by the authorized grader can be extracted and adopted from the plurality of set information 52 for the answer information specified by one individual information 41a. That is, in the scoring information 50 after the initial scoring process (between S3'and S4'), the number of answers in which the score information 46b to be adopted does not exist can be reduced. Therefore, the number of answers to be scored in the second scoring process (between S7'and S8') is reduced. Therefore, it is possible to adjust the number of distributions including the duplication of the first answer as appropriate based on the scorers that can be secured and the schedule, so that the scoring can be performed more quickly.

[Example 2]
Further, another usage of the answer scoring system 1 will be described with reference to FIGS. 1, 2 and 4 along with FIG. In this embodiment, the format information 45 is obtained first, the grader is selected based on the format information 45, and the score information 46b is created.

With reference to FIGS. 1 and 2 in FIG. 5, the host computer 10 first stores the answer information (S11). Hereinafter, the process from the storage of the answer information (S1) to the reception of the answer information (S3') in the first embodiment is the same up to the reception of the answer information (S13'). However, the scoring standard information transmitted together with the answer information up to this point may include the question group 42b, and does not need to include the measurement standard 42a.

With reference to FIG. 4, the grader processes the answer information in accordance with the scoring standard information on the client computer 21, creates and inputs the scoring information 50 corresponding to the answer information. The scoring information 50 displayed on the screen of the client computer 21 includes format information 45, set information 52, and individual information 41a attached to these.

The grader creates the formal information 45 according to the question group 42b composed of a plurality of two-choice question sentences, but it is not necessary to create the score information 46b at this point. That is, the scoring process here includes the creation of the format information 45, but does not include the scoring measurement. As a result, the set information 52 does not include the score information 46b but includes the grader information 46a. Then, the grader causes the client computer 21 to return the format information 45 created together with the set information 52 and the individual information 41a for specifying the answer to the host computer 10 as the scoring information 50 (S14').

The host computer 10 stores the scoring information 50 received by the scoring information receiving means 33 in the scoring information storage area 43 (S14). The host computer 10 accumulates the received scoring information 50 and proceeds to the next process as needed. That is, the next process may be started before the score information 50 replies for all the answers are obtained.

The received scoring information 50 does not include the score information 46b, but includes the format information 45, and a grader who is permitted to score (score measurement) for the corresponding answer can be selected (S15). That is, the grader information 46a is selected from the scoring permission information including the type information 47 corresponding to the format information 45.

Then, as in the first embodiment, the answer information is transmitted to the client computer 21 corresponding to the selected grader (S16), and the client computer 21 receives the answer information (S16'). If the measurement reference 42a has not been received in the past, it may be received here.

Further, as in the first embodiment, the selected grader performs the score measurement for creating the score information 46b according to the measurement standard 42a. Then, the grader causes the client computer 21 to return the set information 52 obtained by adding the scorer information 46a to the score information 46b to the host computer 10 (S17').

The host computer 10 stores the set information 52 (scoring information 46a and the score information 46b) received by the scoring information receiving means 33 in addition to the scoring information 50 in the scoring information storage area 43 (S17). As a result, the format information 45 of the scoring information 50 and the grader information 46a for all the answers match the combination permitted in the scoring permission information, and all the score information 46b are collectively collected by the scoring information adoption means 34. Can be adopted (S18). The host computer 10 may appropriately total the accumulated scoring information 50 as needed. Others are the same as in Example 1.

As described above, according to the above-mentioned answer scoring method using the answer scoring system 1, only the score information 46b by the grader who is permitted to score based on the format information 45 can be collected. As a result, as in the first embodiment, the score information 46b by the grader who is permitted to score can be adopted for all the answers, and the objectivity of the scoring can be ensured. Further, in order to prepare the formal information 45 in advance for the processing work of the score measurement (scoring) for obtaining the score information 46b, the answer to the question group 42b consisting of the formal two-choice question sentence is added first as an additional work. All you have to do is do it, and the scoring process can be done quickly. That is, even when a large number of answers created for a question sentence that requires scoring by the grader are graded by a plurality of graders, the scoring can be performed quickly while ensuring objectivity.

In using the answer scoring method described above, the number of answer information and the number of graders are free, but objectivity can be guaranteed on the premise that the graders have different experiences and abilities. It is suitable when the number of graders is large. For example, it can be assumed that the number of graders who grade the answer to one question sentence is hundreds, and the number of examinees is hundreds of thousands. Even when such a large-scale scoring process is performed, scoring can be performed quickly while ensuring objectivity.

Although typical examples according to the present invention and modifications based on the present invention have been described so far, the present invention is not necessarily limited to these, and those skilled in the art can do so without departing from the scope of the attached claims. , Various alternative and modified examples can be found.

1 Answer scoring system 40 Database area 41 Answer information storage area 42 Scoring standard information storage area 42b Question group 43 Scoring information storage area 44 Scoring permission information 45 Format information (answer format information)
46 set information (scoring set information)
46a Grader information 46b Score information (answer score information)

Claims (5)

The selected answer information is sent from the host computer to the client computer, and the score results for each answer are collected in response to the reply of the score information input by the grader in response to this answer information, and the highly reliable score is obtained. It is an answer scoring method that adopts the results,
The scoring information is
Individual information that identifies specific answer information, which is one of the answer information, and
With respect to the specific answer information, scoring set information including answer score information which is the score result by scoring based on the score and grader information for identifying the grader who input the score, and
The specific answer information includes answer format information consisting of answer patterns for a group of questions consisting of a plurality of affirmative or negative two-choice question sentences.
The host computer is characterized in that the scoring information includes a hiring step of collating whether or not the answer pattern matches a pre-stored permission answer pattern, and adopting the score result when the answer pattern matches. Answer scoring method. Answer scoring method of claim 1, wherein the scoring permission step in advance by storing the authorization answer pattern characterized including permitting to give the score results for each of the scorers. The claim is characterized in that, by allowing the input of a plurality of graders corresponding to one of the answer information, the scoring information may include a plurality of the scoring set information with respect to the individual information of 1. 2 Answer scoring method described. The answer scoring method according to claim 2, wherein the individual information and the answer format information are prepared in advance in the scoring information. The answer scoring method according to claim 4, further comprising a step of transmitting the answer information to the grader selected from the answer patterns prepared in advance.

Images