KR102232599B1 - Computer program for evaluating study level of learner from an objective test and method using the same - Google Patents

Abstract

Disclosed are a computer program stored in a medium to evaluate a study level of a learner from a multiple-choice test by being coupled to hardware, which can correctly evaluate the learning or knowledge level of a learner. According to the present invention, the computer program comprises the following steps: receiving a multiple-choice answer sheet from an external device; determining whether there is only one answer or two answers in a question to be scored on the multiple-choice answer sheet; assigning a maximum value among scores set in the question to be scored when there is only one answer to the question to be scored and the single answer is correct and assigning a minimum value among them when the single answer is incorrect; and assigning a third point to the question to be scored when there are two answers to the question to be scored and the answer with the higher priority between two answers is correct, assigning a fourth score to the question to be scored when the answer with the lower priority between the two answers is correct, and assigning a fifth score to the question to be scored when both of the two answers are incorrect. The third score is smaller than the maximum value, the fourth score is smaller than the third score, and the fifth score is smaller than the fourth score and larger than the minimum value.

Description

A computer program that evaluates learners' learning level from a multiple-choice test and an evaluation method using it {COMPUTER PROGRAM FOR EVALUATING STUDY LEVEL OF LEARNER FROM AN OBJECTIVE TEST AND METHOD USING THE SAME}

The present invention relates to a method of evaluating a learner's learning level, and in particular, a computer program capable of accurately evaluating a learner's learning level from multiple-choice questions included in a multiple-choice test from the perspective of a questioner or evaluator, and an evaluation method using the computer program. will be.

The purpose of the test is to check the learner's learning maturity, and the best way to check the learning maturity is through evaluation of narrative or short answer questions. However, this method has the disadvantage that it is not objective because it takes a lot of time and cost as the number of learners increases, and evaluation of narrative or short answer questions may vary depending on the scorer. Therefore, as an alternative to evaluating narrative or short answer questions, a method of confirming the learner's learning completion level through multiple-choice questions has become common.

In the case of multiple-choice questions, the OMR card has the advantage that it is possible to process grades for many learners in a short time, and the evaluation of the multiple-choice questions does not change depending on the scorer. However, in the case of a multiple-choice test using multiple-choice questions, there is a problem of discrimination according to the difficulty of the multiple-choice test, and if the learner correctly answers the multiple-choice question, check whether the learner really knew the correct answer and whether it was correct or not. It is difficult to do. In addition, since the learner's learning completion level for the multiple-choice question is judged only in two ways, for example, the correct answer and the incorrect answer, it was difficult to accurately confirm the learning completion level of the learner.

Registered Patent Publication: Registration No. 10-1199029 (announced on November 8, 2012) Registered Patent Publication: Registration No. 10-0538743 (announced on December 26, 2005)

The technical task to be achieved by the present invention is (i) only one answer is displayed for the correct answer of each question to be scored (or a question to be scored) included in the multiple choice test, and if the answer is the one correct answer, a first score is given, and , (Ii) When two answers are displayed and the answer with a higher priority (for example, the first answer) among the two answers is the correct answer, a third score lower than the first score is given, and (iii) When two answers are displayed and the answer with a lower priority (e.g., the second answer) among the two answers is the correct answer, a fourth score lower than the third score is given, so that the learner gives each item to be scored ( Or, even if the correct answer to the question to be scored) is correct, the evaluator (or the scorer) can accurately evaluate what level of learning or knowledge the learner has for each of the questions to be scored based on the score given. It is to provide an evaluation method using this.

According to the present invention, a computer program combined with hardware and stored in a medium to evaluate a learner's learning level from a multiple-choice test includes the steps of receiving a multiple-choice answer sheet from an external device, and only one answer for the question to be scored included in the multiple-choice answer sheet. Determining whether or not there are two answers, and when there is only one answer in the question to be scored and the answer is correct, a maximum value is given from among the scores set in the question to be scored, and the The step of assigning a minimum value among the set scores to the question to be scored in which one answer is an incorrect answer, and when two answers exist in the question to be scored and the answer with a higher priority among the two answers is the correct answer. A third score is given to the question to be scored, and when the answer with a lower priority among the two answers is the correct answer, a fourth score is given to the question to be scored, and when both answers are incorrect, the score is scored. A step of assigning a fifth score to a target question is performed, and the scores are the maximum value, a third score less than the maximum value, a fourth score less than the third score, a fifth score less than the fourth score, And the minimum value smaller than the fifth score.

According to the present invention, a method of evaluating a learner's learning level from a multiple-choice test using a computer includes receiving a multiple-choice answer sheet from an external device, and whether there is only one answer in the question to be scored included in the multiple-choice answer sheet. Determining whether answers exist, and when there is only one answer in the question to be scored and the answer is correct, a maximum value is given from among the scores set in the question to be scored, and the one answer is an incorrect answer. The step of assigning a minimum value from among the set points to the one to be scored, and when two answers exist in the to be scored question and the answer with a higher priority among the two answers is the correct answer, the score is given to the question to be scored. A score of 3 is given, and when the answer with a lower priority among the two answers is the correct answer, a fourth score is given to the question to be scored, and when both answers are incorrect, a fifth score is given to the question to be scored. Assigning a score, wherein the scores are the maximum value, a third score less than the maximum value, a fourth score less than the third score, a fifth score less than the fourth score, and the fifth score Include the smaller the minimum value.

According to the present invention, a computer program combined with hardware and stored in a medium to evaluate a learner's learning level from a multiple-choice test sets the scores to be given to the question to be scored, and the scoring for the question to be scored included in the multiple-choice answer sheet. Based on the result, assigning any one of the set scores as a scoring score, and determining the number of answers to the scoring target question and the presence or absence of a correct answer based on the scoring score assigned to the scoring target question. Carry out.

In the computer program or evaluation method according to the present invention, for the correct answer of each question to be scored (or question to be scored) included in the multiple-choice test, (i) only one answer is displayed and the first score is given when the answer is one correct. And (ii) when two answers are displayed and the answer with a higher priority (for example, the first answer) among the two answers is the correct answer, a third score lower than the first score is given, and (iii ) When two answers are displayed and the answer with a lower priority (for example, the second answer) among the two answers is correct, a fourth score lower than the third score is given. Even if the correct answer to (or the question to be scored) is correct, the evaluator (or the questionnaire) has the effect of accurately evaluating which learning level or knowledge level the learner has for each of the points to be scored based on the score given. have.

In order to more fully understand the drawings cited in the detailed description of the present invention, a detailed description of each drawing is provided.
1 shows a learning level evaluation system capable of performing a learning level evaluation method using a computer program that evaluates a learner's learning level from a multiple-choice test according to embodiments of the present invention.
2 shows a learning level evaluation system capable of performing a learning level evaluation method using a computer program that evaluates a learner's learning level from a multiple-choice test according to embodiments of the present invention.
3 shows an embodiment of a learning level evaluation method using a computer program for evaluating a learner's learning level from a multiple-choice test according to embodiments of the present invention.
4 shows another embodiment of a learning level evaluation method using a computer program for evaluating a learner's learning level from a multiple-choice test according to embodiments of the present invention.
5 shows an embodiment of a document including categories, scores, and evaluation opinions for each question.
6 shows an embodiment of a document including the sum of scores and evaluation opinions accordingly.
7 shows an embodiment of a document including a total of scores for each category and an evaluation opinion.
8 is a flow chart of a learning level evaluation system that provides a learning service using items to which each score is assigned according to embodiments of the present invention.
9 is a flow chart of a learning level evaluation system that provides a learning service using items to which each score is assigned according to embodiments of the present invention.
10 is a flow chart of a learning level evaluation system that provides a learning service using items to which each score is assigned according to embodiments of the present invention.

A learning level evaluation computer program (hereinafter referred to as'computer program') that automatically and accurately evaluates a learner's learning level (or knowledge level) from a multiple-choice test (or multiple-choice questions) according to the present invention is combined with a computer (or hardware) The learning level of the learner can be automatically evaluated from the multiple-choice test described herein, and is stored in a storage medium (e.g., a medium storing data, a data storage medium, or a memory device), and the computer (or hardware) Can be implemented by

In the present invention, the learning level (or knowledge level) is whether the corresponding multiple-choice question (or multiple-choice question) is accurately understood and one correct answer is correct, whether the correct answer is correct while considering two selectable items, or two items that can be selected. This refers to whether the correct answer was not corrected while thinking about the subject, did not find the correct answer due to lack of learning volume, misunderstood the correct answer, did not answer the correct answer by mistake, and/or did not understand correctly but did not get the correct answer. .

A computer means hardware (or computing device) capable of executing a computer program, and the hardware (or computing device) is a personal computer (PC), a laptop computer, a tablet PC, an Internet Mobile Device (MID), It means a smartphone, a processor, or a server.

A computer program executed by hardware (or computing device) may be implemented as an application (or application program) or software such as a mobile app. The computer program uses an artificial intelligence (AI) algorithm, a machine learning algorithm, or a deep learning algorithm to provide a learner's multiple choice questions and/or answers to each of the multiple choice questions. (Or correct answer) can be analyzed automatically.

A computer program using machine learning extracts and analyzes the learner's data (e.g., the learning level of the multiple-choice questions included in each of the multiple-choice tests that the learner took in the past and/or present) using a machine learning algorithm (or Evaluation), and self-learning through analysis (or evaluation), and can accurately judge or predict the learning level (or knowledge level) of the learner based on the self-learned content.

Computer programs using deep learning use deep learning algorithms (or artificial neural networks) to determine learner's data (e.g., the multiple choice questions included in each of the multiple choice tests the learner took in the past and/or present). Learning level) can be extracted and analyzed (or evaluated), self-learning through analysis (or evaluation), and the learning level of the learner can be accurately judged or predicted based on the self-learned content.

The computer program may use the learner's data as big data to evaluate the learning level of the multiple-choice questions included in each of the multiple-choice tests that the learner took in the past and/or the present. Therefore, the computer program analyzes the change of the learner's weekly, monthly, quarterly, semiannual, and/or yearly learning volume or grades using the big data, and analyzes the results of the analysis to the learner and/or the above in various forms. It can be provided online to the learner's guardian.

In the present specification, that a computer program sends and receives signals (data or information) with another computing device means the other computing device through a wired transceiver or a wireless transceiver operating under control of a processor (or control device) executing the computer program. It means to send and receive signals (data or information) with the transceiver of

In the present specification, for convenience of explanation, an embodiment in which one or two answers from among five options (or items, for example, five or two) for each question (or each question) is selected is shown. Although described and described, the present invention is an embodiment in which one or two answers can be selected from among multiple choices for each question (or each question), or six items for each question (or each question) It can be transformed into an embodiment that allows one to three answers to be selected from among them.

1 shows a learning level evaluation system capable of performing a learning level evaluation method using a computer program that evaluates a learner's learning level from a multiple-choice test according to embodiments of the present invention. Referring to FIG. 1, the learning level evaluation system includes a computer and a scanner 200A.

The computer includes a computer body 100A, an input device 130, and an output device 140, and the computer body 100A includes a processor (or CPU 110) capable of executing the computer program 115, A computer program 115 and a memory device 120 capable of storing data generated by the computer program 115 are included. The output device 140 may refer to a printer capable of outputting a multiple-choice test questionnaire.

The memory device 120 includes a nonvolatile memory device such as a hard disk drive (HDD) or a solid state drive (SDD), and a volatile memory device such as DRAM or SRAM. The memory device 120 stores multiple-choice test questionnaires for various fields of study, and stores correct answers to each of the multiple-choice test questionnaires.

The scanner 200A refers to a device capable of acquiring (or scanning) one answer or two answers for each question from the first question to the last question included in the paper answer sheet (or multiple choice answer sheet; 210A). When the multiple choice answer sheet 210A is an optical mark reader (OMR) card, the scanner 200A may be an optical mark reader (OMR), but is not limited thereto.

The computer program 115 can identify (or distinguish) a first answer (for example, an answer indicating that the learner has a high priority) and a second answer (for example, an answer indicating that the learner has a low priority). I can. For example, when a first answer with a high priority is marked (or marked) with a first mark (e.g., a circle), and a second answer with a low priority is marked with a second mark (e.g., a triangle), a computer program ( 115) has a function of identifying (or distinguishing) the first mark and the second mark displayed in each question. Further, when the first answer is displayed in a first color and the second answer is displayed in a second color different from the first color, the computer program 115 selects the first color and the second color displayed in each question. It has the ability to identify (or distinguish).

The characteristics of each of the first and second marks displayed on each of the questions (eg, shape and size) may be different, and the characteristics of each of the first and second colors displayed on each of the questions (eg, shape, size, Saturation, and/or brightness) may be different.

However, the computer program 115 self-learns the characteristics of the first mark (e.g., shape and size) and/or the second mark (e.g., shape and size) displayed on each of the questions, Even if the displayed features are different from each other, according to the learning result, a mark having the same (or similar) characteristics as the first answer and a mark having the same (or similar) characteristics as the second mark You can judge (or decide) yourself as the second answer.

In addition, the computer program 115 is a characteristic of the first color (e.g., shape, size, brightness, and/or saturation) displayed in each of the items, and/or the characteristic of the second color (e.g., shape, size, brightness, And/or saturation) by self-learning, and even if the features displayed in the questions are different from each other, a color having the same (or similar) characteristic to the first color according to the learning result is selected as the first answer and the second Colors that have the same (or similar) characteristics as the color characteristics can be judged (or determined) by themselves as the second answer.

Regardless of whether the first answer is correct, it is determined that the learner who submitted the answer sheet (210A) has a relatively higher probability of being the correct answer than the second answer, and thus means the answer marked with the first mark or the first color, and the second Regardless of whether the answer is correct or not, it is assumed that the learner is determined to have a relatively lower probability of being the correct answer than the first answer, and thus means an answer marked with a second mark or a second color. Despite the name, it is assumed that the probability that the first answer is the correct answer from the learner's point of view is higher than the probability that the second answer is the correct answer.

2 shows a learning level evaluation system capable of performing a learning level evaluation method using a computer program that evaluates a learner's learning level from a multiple-choice test according to embodiments of the present invention. 2, the learning level evaluation system includes a service server 100B and a user computer 200B.

The service server 100B and the user computer 200B may transmit or receive signals (data or information) through a communication network, such as the Internet or an intranet.

The service server 100B includes a processor (or CPU 110) capable of executing the computer program 115, and a database 300 capable of storing data generated by the computer program 115 and the computer program 115 Includes.

When the service server 100B is a computer of a service provider according to embodiments, the computer of the service provider includes the computer body 100A, an input device 130, and an output device 140 described with reference to FIG. 1. It could be a computer.

The user computer 200B includes a processor capable of executing the program 220, and the program 220 executed by the processor includes a test questionnaire (eg, multiple choice test questionnaire) including the first question to the last question. A signal (data) corresponding to an answer sheet (or multiple choice answer sheet; 210B) provided to the user (or learner) through the display device of the user computer 200B and including one answer or two answers input by the user for each question Alternatively, information) may be transmitted to the computer program 115 of the service server 100B through a communication network, such as the Internet or an intranet. The computer program 115 may store a signal (data or information) corresponding to the answer sheet (or multiple choice answer sheet; 210B) in the database 300.

3 shows an embodiment of a learning level evaluation method using a computer program that evaluates a learner's learning level from a multiple-choice test according to embodiments of the present invention. Shows an example of the document.

The evaluator may use the computer program 115 to set points (eg, the first score to the fifth score) to be applied to all questions included in the multiple-choice answer sheet. The evaluator may increase the difference between the first score and the second score and/or the difference between the third score and the fourth score in order to accurately assess the learning level. According to embodiments, the evaluator may make the difference between the first score and the second score larger than the difference between the third score and the fourth score.

1 to 3, and 5, the computer program, for example, the application 115 is the answer information displayed (or marked) on the answer sheet (210A or 210B) (hereinafter, for convenience of explanation, the'multiple choice answer sheet ') is received from the external device 200A or 200B.

The application 115 uses at least one of the first mark and the second mark and/or at least one of the first color and the second color, and includes the correct answer of each question and the multiple choice answer sheet from the first question to the last question. The answers (or answers) of each scored question are compared from the first question to the last question, and according to the comparison result, the correct (correct) or incorrect (incorrect) answer of each scored question is judged.

For example, the application 115 determines whether only the first answer marked with the first mark (or first color) exists in the question to be scored from the first question to the last question included in the multiple-choice answer sheet, and then whether the first answer is the correct answer. It is determined (S110 and S115).

As a result of the operation of the application 115, it is assumed that the question to be scored is'question 1'and there is only one answer (that is, the first answer indicated by the first mark) and the first answer is the correct answer (or the application 115 Judge.). This is an example where the learner has confidence in the answer to question 1 and displays only one answer. For example, the application 115 may read five items for'Question 1'at a time and determine that only the first answer indicated by the first mark (circle) in'Question 1'exists.

Since there is only the first answer in question 1 (YES in S110) and the first answer is correct (YES in S115), the application 115 is the maximum value (the first A score (eg, +3 in FIG. 5) is given (S120).

As a result of the operation of the application 115, it is assumed that the question to be scored is'Question 2'and that there is only one answer (i.e., the first answer) marked with the first mark, and that the first answer is not the correct answer (i.e., it is an incorrect answer). (Or the application 115 determines.). This is an example where the learner displays only one answer without being confident in the answer to question 2. For example, the application 115 may read five items for'Question 2'at a time and determine that only the first answer indicated by the first mark (circle) in'Question 2'exists.

Since there is only the first answer in question 2 (YES in S110) and the first answer is incorrect (NO in S115), the application 115 is the minimum value (the second score (For example, -1 in FIG. 5) is given (S125).

In order to accurately evaluate the learner's learning level, the application 115 displays only one answer to the corresponding question (or the corresponding question), assigns a maximum value when the one answer is correct, and displays only one answer to the corresponding question. However, when one answer is an incorrect answer, two answers are displayed, but a score lower than when both answers are incorrect, that is, a minimum value (e.g., deduction or penalty (penalty)) is given.

If the learner displays only one answer to the question (or the question), but does not give a penalty or penalty when the one answer is incorrect, the learner considers and displays two answers even if he or she is not familiar with the question. Rather than the following, only one answer may be displayed without careful consideration in order to receive a score higher than the score (for example, the first score) that can be received when any one of the two answers is the correct answer. When one answer selected by the learner is an incorrect answer, it may be the learner's mistake, but in more cases, the answer may be the answer selected by the learner with absolutely wrong knowledge.

Also, as the difference between the maximum value (for example, the first score) and the minimum value (for example, the second score) increases, the learner will display only one answer for the question (or problem) that they know exactly. Therefore, compared to the conventional evaluation method in which the same score (or points) is assigned to each of all questions, the evaluation method according to the present invention can accurately evaluate the learner's learning level from the standpoint of the evaluator (or the scorer). Is effective in not displaying only one answer for questions that are not accurately known.

For example, when the first score is the reference score, the application 115 deducts the first score (for example, 4 points) from the first score and gives a second score.

As a result of the operation of the application 115, the question to be scored is'Question 3', and there are two answers, namely, the first answer indicated by the first mark (circle) and the second answer indicated by the second mark (triangle). It is assumed that the first answer indicated by the first mark and having a high priority is the correct answer (or the application 115 determines). This is an example where the learner is not confident in each answer from Question 3 to Question 5 and displays two answers. For example, the application 115 reads five items for each of'Question 3','Question 4', and'Question 5'at a time and puts them in each of'Question 3','Question 4', and'Question 5'. You can judge that there are four answers.

In question 3, the first answer marked with the first mark and the second answer marked with the second mark exist (NO in S110), and the first answer with a higher priority is the correct answer (YES in S130), so the application 115 is the question 3 A third score (eg, +2 in FIG. 5) is assigned to (S135).

For example, when the first score is the reference score, the application 115 deducts a second score (for example, 1 point) from the first score and gives a third score.

As a result of the operation of the application 115, the question to be scored is'Question 4', and there are two answers, that is, the first answer marked with the first mark and the second answer marked with the second mark, and are marked with the second mark and have priority. It is assumed that the second answer with a lower value is the correct answer (or the application 115 determines).

In question 4, the first answer marked with the first mark and the second answer marked with the second mark exist (NO in S110), and the first answer with a higher priority is not the correct answer (NO in S130), and the second answer with a lower priority. Since the answer is the correct answer (YES in S140), the application 115 gives a fourth score (eg, +1) to the question 4 (S145). For example, when the first score is the reference score, the application 115 deducts a third score (for example, 2 points) from the first score and gives a fourth score.

As a result of the operation of the application 115, the question to be scored is'Question 5', and there are two answers, that is, a first answer marked with a first mark and a second answer marked with a second mark, and the first answer and the second answer are present. It is assumed that not all of the answers are correct (or the application 115 determines).

Question 5 has a first answer marked with a first mark and a second answer marked with a second mark (NO in S110), and the first answer is an incorrect answer (NO in S130) and the second answer is an incorrect answer (NO in S140). , The application 115 gives a fifth score (eg, 0 in FIG. 5) to item 5 (S150). For example, when the first score is the reference score, the application 115 deducts a fourth deduction score (eg, 3 points) from the first score and gives a fifth score.

Although the probability of correct answer when writing two answers to one question (or question) is greater than the probability of correct answer when writing one answer to one question (or question), the one answer is incorrect. The second score given when is less than the fifth score given when both of the two answers are incorrect. The reason is that, as described above, when the learner does not know the answer to the corresponding question (or question) accurately, the learner is prevented from selecting only one answer for the corresponding question, so that the learning level of the learner who solves the question is determined. This is to evaluate accurately.

According to embodiments, the first to fourth deduction scores may be the same or different from each other.

As described above, the application 115 assigns any one of the first to fifth points described above for each item from the first question to the last question for each item to be scored.

For the correct answer of each question to be scored (or question to be scored) included in the multiple-choice test, the application 115 (i) displays only one answer and gives a first score when the answer is the correct answer, and (ii) If two answers are displayed and the answer with a higher priority (for example, the first answer) among the two answers is the correct answer, a third score lower than the first score is given, and (iii) the two answers are If the answer (e.g., the second answer) with a lower priority among the two answers is displayed, a fourth score lower than the third score is given, so that the learner ) Even if the correct answer is correct, the application 115 or the evaluator (or the scorer) can accurately evaluate what learning level or knowledge level the learner has for each item to be scored based on the score given. There is.

When points (or points) are assigned to all the items, the application 115 calculates the sum of the points assigned from the first item to the last item (S155).

The application 115 may select any one of the first to fifth scores as a reference score, and add or subtract a specific score from the reference score to give the remaining scores.

For example, when the third score is selected as the reference score by the application 115, the application 115 calculates the first score by adding the first specific score to the third score, and calculates the second score from the third score. A fourth score may be calculated by subtracting a specific score, a fifth score may be calculated by subtracting a third specific score from the third score, and a second score may be calculated by subtracting a fourth specific score from the third score. According to embodiments, the first specific score to the fourth specific score may be the same or different from each other.

6 shows an embodiment of a document including the sum of scores and evaluation opinions accordingly. 1 to 3, and 6, the application 115 counts the number of item(s) to which a first score (eg, +3 in FIG. 5) is assigned from among items 1 to 40. One count value (WCNT1) is calculated, or the total number of first scores (WSUM1=3*WCNT1) corresponding to the first count value (WCNT2) is calculated (S160).

In addition, the application 115 counts the number of item(s) to which a second score (for example, -1 in FIG. 5) is assigned among items 1 to 40 to calculate a second count value (WCNT2) or to calculate a second count value (WCNT2). The sum of the second score (WSUM2 = (-1) * WCNT2) corresponding to the count value (WCNT2) is calculated (S160). In addition, the application 115 counts the number of item(s) to which a third score (e.g., 2 in FIG. 5) is assigned among items 1 to 40, and calculates a third count value (WCNT3) or a third count. The sum of the third score (WSUM3=2*WCNT3) corresponding to the value WCNT3 is calculated (S160). In addition, the application 115 counts the number of item(s) to which the fourth score (for example, 1 in FIG. 5) is assigned among the items 1 to 40, and calculates the fourth count value (WCNT4) or calculates the fourth count. The sum of the fourth score (WSUM4 = WCNT4) corresponding to the value (WCNT4) is calculated (S160). In addition, the application 115 counts the number of item(s) to which a fifth score (for example, 0 (zero) in FIG. 5) is assigned among items 1 to 40 and calculates the fifth count value (WCNT5), or The sum of the fourth score (WSUM5=0) corresponding to the fifth count value WCNT5 is calculated (S160).

7 shows an embodiment of a document including a total score for each category and an evaluation opinion. 1 to 3, 5, and 7, the application 115 can select each of the items 1 to 40 from among a plurality of categories (e.g., speech, grammar, writing, non-literature, and complex areas). Classified into the category of (S160). Here, the category of FIG. 7 may be a major category or a sub category of FIG. 5, but for convenience of explanation, it is assumed that the category of FIG. 7 is a major category of FIG. 5.

As exemplarily shown in FIG. 5, by the application 115, Question 1 is classified as'Speech Method', Question 2 is classified as'Grammar', Question 3 is classified as'Composition', and Question 4 is It is classified as'nonliterature', question 5 is classified as'complex domain', and question 40 is classified as'grammar'. In this way, the application 115 classifies each of the items 1 to 40 into one of a plurality of categories (eg, speech, grammar, composition, non-literature, and complex areas) (S160).

The application 115 calculates the first total CSUM1 by counting the number of question(s) classified as a first category (eg, grammar) among questions 1 to 40 and that are correct answers (S160). The application 115 calculates a second sum (CSUM2) by counting the number of question(s) classified as a second category (eg, speech method) among questions 1 to 40 and that are correct answers (S160). The application 115 calculates a third total (CSUM3) by counting the number of question(s) that are classified into a third category (eg, composition) among questions 1 to 40 and that are correct answers (S160). The application 115 calculates a fourth sum (CSUM4) by counting the number of question(s) that are classified into a fourth category (eg, non-literary) among questions 1 to 40 and that are correct answers (S160). The application 115 calculates a fifth sum (CSUM5) by counting the number of item(s) that are classified into a fifth category (eg, a composite area) from among items 1 to 40 and that are correct answers (S160).

When the total (CSUM1-CSUM5) is selected (or clicked) by the evaluator or the scorer, the application 115 provides information on the corresponding score (WCNT1 to CCNT5 and/or SWUM1 to WSUM5) described with reference to FIG. Can be displayed. For example, if the first total (CSUM1) is selected (or clicked) by the evaluator or the scorer, the application 115 may display information (WCNT1 and/or SWUM1) on the corresponding score described with reference to FIG. 6. have.

According to embodiments, the application 115 performing an artificial intelligence algorithm, a machine learning algorithm, or a deep learning algorithm analyzes the score given to each item by analyzing the evaluation opinion shown in FIG. 5 and automatically (or By themselves) or by analyzing each count value (WCNT1 to WCNT5) and/or the total score (WSUM1 to WSUM5) shown in FIG. 6 and automatically (or by themselves) according to the analysis result, or Each sum (CSUM1~CSUM5) can be analyzed and automatically (or self) created according to the analysis result (S160).

According to embodiments, the evaluator or scorer checks the score assigned to each item shown in FIG. 5 and then inputs the evaluation opinion into the application 115, or each count value (WCNT1 to WCNT5) shown in FIG. 6 and/or After checking the sum total of each score (WSUM1 to WSUM5), the evaluation opinion is entered into the application 115, or if the evaluation opinion is entered into the application 115 after checking the sum total (CSUM1 to CSUM5) shown in FIG. 7, the application ( 115) may transmit the analysis document (AD1, AD2, and/or AD3) containing the evaluation comments to the learner's computer or the learner's guardian's computer.

According to embodiments, the application 115 is an analysis document (AD1, AD2, and/or analysis documents AD1, AD2, and/or via a display device or a printer connected to the computer body 100A, the service server 100B), or a service provider's computer. AD3) can be printed.

4 shows another embodiment of a learning level evaluation method using a computer program for evaluating a learner's learning level from a multiple-choice test according to embodiments of the present invention. 1, 2, 4, and 5, the evaluation computer program, for example, the application 115, the answer information displayed on the answer sheet (210A or 210B) (hereinafter,'multiple choice answer sheet' for convenience of explanation) ) Is received from the external device 200A or 200B.

The application 115 determines whether the first answer indicated by the first mark of the question to be scored from the first question to the last question included in the multiple-choice answer sheet is the correct answer (S210).

As a result of the operation of the application 115, it is assumed that the question to be scored is'question 1'and the first answer indicated by the first mark is the correct answer (or the application 115 determines).

When the first answer indicated by the first mark is the correct answer (YES in S210) and the second answer does not exist (NO in S215), the application 115 gives a first score (eg, +3) to Question 1 ( S220).

As a result of the operation of the application 115, it is assumed that the question to be scored is'question 2'and that the first answer indicated by the first mark is not the correct answer (or the application 115 determines).

When the first answer indicated by the first mark is not the correct answer (NO in S210) and there is no second answer (NO in S230), the application 115 gives a second score (eg -1) to Question 2 (S235).

As a result of the operation of the application 115, the question to be scored is'Question 3', and there are two answers, namely, the first answer marked with the first mark and the second answer marked with the second mark, and the first answer with high priority. It is assumed that this is the correct answer (or the application 115 determines).

When there is a first answer marked with the first mark and the correct answer in question 3 (YES in S210) and there is a second answer marked with the second mark instead of the correct answer (YES in S215), the application 115 is displayed in question 3 with the third answer. A score (eg, +2) is given (S225).

As a result of the operation of the application 115, it is assumed that the question to be scored is'Question 4', and there are two answers, namely, the first answer marked with the first mark and the second answer marked with the second mark, and the second answer is the correct answer. (Or the application 115 determines).

When the first answer indicated by the first mark in question 4 is not the correct answer (NO in S210) and the second answer indicated by the second mark exists (YES in S230), and the second answer is the correct answer (YES in S240), The application 115 gives a fourth score (eg, +1) to question 4 (S245).

As a result of the operation of the application 115, the question to be scored is'Question 5', and there are two answers, that is, a first answer marked with a first mark and a second answer marked with a second mark, and the first answer and the second answer are present. It is assumed that not all of the answers are correct (or the application 115 determines). When the first answer marked with the first mark in question 5 is not the correct answer (NO in S210), there is a second answer marked with the second mark (YES in S230), and the second answer is not the correct answer (NO in S240 ), the application 115 gives a fifth score (eg, 0) to item 5 (S250).

The application 115 assigns any one of the first to fifth points from the first question to the last question for each item to be scored. When the corresponding scores are assigned to all the items, the application 115 calculates the sum of the scores given from the first item to the last item (S255).

1, 2, 4, and 6, the application 115 counts the number of item(s) to which a first score (eg, +3) is assigned among items 1 to 40, Calculate the first count value (WCNT1) or calculate the total number of first scores (WSUM1=3*WCNT1) corresponding to the first count value (WCNT2), and the second score (e.g.,- 1) Calculate the second count value (WCNT2) by counting the number of item(s) assigned, or calculate the total number of second points (WSUM2=(-1)*WCNT2) corresponding to the second count value (WCNT2). And, by counting the number of item(s) to which a third score (e.g., 2) is assigned from among the items 1 to 40, the third count value (WCNT3) is calculated or corresponds to the third count value (WCNT3). Calculate the sum of the third score (WSUM3 = 2 * WCNT3), count the number of item(s) to which a fourth score (e.g., 1) is assigned from among the items 1 to 40, and the fourth count value ( WCNT4) or the total of the fourth score (WSUM4 = WCNT4) corresponding to the fourth count value (WCNT4), and the item to which the fifth score (e.g., 0) is assigned from item 1 to item 40 ( S) is counted to calculate the fifth count value (WCNT5) or the total sum of fourth scores (WSUM5 = 0) corresponding to the fifth count value (WCNT5) (S260).

1, 2, 4, 5, and 7, the application 115 is a plurality of categories (e.g., speech, grammar, composition, non-literature, and complex areas) for each of the items 1 to 40 It is classified into any one of the categories (S260).

The application 115 calculates the first total (CSUM1) by counting the number of question(s) that are classified as a first category (eg, grammar) among questions 1 to 40 and that are correct answers, and calculates the first total (CSUM1), and The second total (CSUM2) is calculated by counting the number of item(s) classified as the second category (e.g., speech method) and the correct answer out of 40, and the third category (e.g., The third total (CSUM3) is calculated by counting the number of question(s) that are classified as writing) and the correct answer, and is classified as a fourth category (e.g., non-literary) among the items 1 to 40 and the correct answer ( S) is counted to calculate the fourth total (CSUM4), and the number of item(s) classified as the fifth category (e.g., complex area) among the items 1 to 40 and the correct answer is counted, The total of 5 (CSUM5) is calculated (S260).

When the corresponding total (CSUM1 to CSUM5) is selected (or clicked) by the evaluator, the application 115 can display information (WCNT1 to CCNT5 and/or SWUM1 to WSUM5) for the corresponding score described with reference to FIG. have. For example, when the first total CSUM1 is selected (or clicked) by the evaluator, the application 115 may display information (WCNT1 and/or SWUM1) on the corresponding score described with reference to FIG. 6.

According to embodiments, the application 115 performing an artificial intelligence algorithm, a machine learning algorithm, or a deep learning algorithm analyzes the score given to each item by analyzing the evaluation opinion shown in FIG. 5 and automatically writes it according to the analysis result, or , Each count value (WCNT1 to WCNT5) shown in FIG. 6 and/or the total score (WSUM1 to WSUM5) are analyzed and automatically created according to the analysis result, or each total (CSUM1 to CSUM5) shown in FIG. It can be analyzed and automatically created according to the analysis result (S260).

According to embodiments, the evaluator checks the score assigned to each item shown in FIG. 5 and then enters the evaluation opinion into the application 115, or each count value (WCNT1 to WCNT5) and/or each score shown in FIG. 6 After checking the total (WSUM1 to WSUM5), the evaluation opinion is entered into the application 115, or if the evaluation opinion is entered into the application 115 after checking each total (CSUM1 to CSUM5) shown in FIG. 7, the application 115 May transmit the analysis document (AD1, AD2, and/or AD3) containing the evaluation comments to the learner's computer or the learner's guardian's computer.

According to embodiments, the application 115 is an analysis document (AD1, AD2, and/or analysis documents AD1, AD2, and/or via a display device or a printer connected to the computer body 100A, the service server 100B), or a service provider's computer. AD3) can be printed.

The analysis performed by the computer program 115 may vary. For example, the computer program 115 analyzes the number of questions that received the fifth score among the questions included in the current multiple-choice answer sheet (210A or 210B) and/or the categories to which the questions that received the fifth score belong. Depending on the result, it is possible to generate an evaluation opinion, for example, an evaluation opinion that the theory study for the corresponding category should be re-studied rather than continually solving the problems for the corresponding category. In addition, the computer program 115 may generate information on a lecture provided by the operator of the computer or service server 100B for the theory study on the corresponding category.

For example, the computer program 115 analyzes the number of items that received a second score among the questions included in the current multiple-choice answer sheet (210A or 210B) and/or the categories to which the items that received the second score belong. Depending on the result, it is possible to generate evaluation opinions, such as not studying the category, attempting to solve a problem quickly but not reading the above problem incorrectly, or thinking the opposite of what is right and wrong.

For example, the computer program 115 is the number of items that received a third score and a fourth score among the questions currently included in the multiple-choice answer sheet (210A or 210B) and/or the third score and the fourth score. Analyzing the categories to which the questions belong, and according to the result of the analysis, depending on the situation where the evaluation opinion, for example, the incorrect answer instead of the correct answer is selected, further study of the theory for the corresponding category or solving more problems for the corresponding category will improve the grade. You can generate an evaluation opinion that you can.

According to embodiments, the computer program 115 uses the learning level analysis results of the questions included in the current multiple-choice answer sheet (210A or 210B) and the learning level analysis results of the questions included in the previous multiple-choice answer sheets as big data. It can be used to analyze whether the learner is able to solve the questions in which category well or not, and whether the grades in the field in which category have risen or decreased for a certain period of time.

As described above, the computer program 115 capable of using an artificial intelligence algorithm, a machine learning algorithm, or a deep learning algorithm includes a first mark (or first color) and a first mark (or first color) for each item to be scored included in the multiple choice answer sheet (or answer information). / Or it is determined whether a second mark (or second color) exists, and according to the result of the determination, whether the first answer indicated by the first mark (or first color) is the correct answer or the second mark (or the second color) It is determined whether the second answer indicated by) is the correct answer, and according to the result of the determination, as described with reference to FIG. 3 or 4, any one of the first score to the fifth score is assigned to each scored question, and the scoring It is possible to analyze the scores given for each subject question, and automatically (or self) create evaluation opinions according to the results of the analysis.

8 is a flow chart of a learning level evaluation system that provides a learning service using items to which points are assigned according to embodiments of the present invention.

1 to 8, the computer program 115 is assigned a score according to the results of performing the steps (S110 to S150) shown in FIG. 3 or the steps (S210 to S250) shown in FIG. Information on each item is received from the data storage device 120 or 300 (S310). For example, the analysis document AD1 shown in FIG. 5 may be stored in the data storage device 120 or 300 together with a multiple-choice test questionnaire based on the generation of the analysis document AD1 and a multiple-choice answer sheet for the multiple-choice test questionnaire. have.

The computer program 115 extracts the items to which the second score is assigned from among the items to which scores are assigned (S315), and generates a multiple-choice test questionnaire (hereinafter referred to as a'retest questionnaire') including the extracted items. (S320).

In FIGS. 8 and 9, for convenience of explanation, an embodiment of extracting items with a second score from among items with a first score to a fifth score is shown. However, according to the embodiments, a computer program 115 ) Extracts the items to which at least one of the first score, the third score, the fourth score, and the fifth score is assigned, and generates a multiple-choice test questionnaire (e.g.,'retest questionnaire') including the extracted items. Yes (S320).

Here, the'retest questionnaire' may be provided to the learner in the form of paper as described with reference to FIG. 1 or may be provided to the user computer 200B in the form of an electronic document (or file) as described with reference to FIG. 2. . The retest questionnaire refers to a second multiple-choice test questionnaire that includes only items with a second score (e.g., questions that the learner did not answer correctly) among the questions included in the multiple-choice test questionnaire first provided to the learner. .

The computer program 115 may receive a multiple-choice answer sheet (hereinafter referred to as'retest answer sheet') including each answer for each question included in the retest questionnaire through an external device 200A or 200B (S325). . Only one answer is displayed for each question on the retest answer sheet.

The computer program 115 determines whether one answer displayed for each question is the correct answer (S330). When one answer displayed on the scoring target question is not the correct answer (NO in S330), the computer program 115 maintains the second score assigned to the scoring target question as it is (S335).

However, when one answer displayed on the scoring target question is the correct answer (YES in S330), the computer program 115 gives an identification mark to the scoring target question (S340). The identification mark indicates that the learner did not answer the correct answer in the first multiple-choice test, but the learner corrects the answer in the second multiple-choice test.

The computer program 115 includes a first multiple-choice answer sheet (or information on the first multiple-choice answer sheet) assigned a first score to a fifth score, and a second multiple-choice answer sheet (or Based on the information on the second multiple-choice answer sheet), questions that are given a second score and a fifth score from the questions included in the first and second multiple-choice test questions (e.g., questions in which the learner is wrong) ), and classify each of the extracted items into a large category and/or a subcategory as illustrated in FIG. 5 (S345), and among the classified items, the items without the identification mark (that is, in the second multiple-choice test) Wrong questions) are selected (S350).

The computer program 115 selects a learning video related to each of the items without an identification mark from the learning videos stored in the data storage device 120 or 300, and provides information on the selected learning video to the learner (S355). Accordingly, the learner can access the computer providing the learning video using his or her computer (eg, a PC, a smart phone, or a tablet PC) to view the learning video selected by the computer program 115. That is, the computer providing the learning video may provide the learning service to the learner (S355).

For example, when an item without an identification mark is item '2' in FIG. 5, the computer program 115 transmits information on a learning video related to a large category (grammar) or a small category (tense) to the learner's computer or the learner's guardian. Can be transferred to a computer. Accordingly, a learner can use his or her computer to access a computer that provides a learning video and listen to a learning video related to a large category (grammar) or a small category (tense).

9 is a flow chart of a learning level evaluation system that provides a learning service using items to which points are assigned according to embodiments of the present invention.

8 and 9, the computer program 115, a first multiple-choice answer sheet (or information on the first multiple-choice answer sheet) assigned a first score to a fifth score, and an identification mark and a second score Based on the second multiple-choice answer sheet (or information on the second multiple-choice answer sheet) that remains intact, a third, fourth, and identification mark from the questions included in the first and second multiple-choice questionnaires. The items to which are assigned are extracted, and each of the extracted items is classified into a large category and/or a small category as illustrated in FIG. 5 (S370).

The computer program 115 selects a learning video related to each of the items with identification marks from learning videos stored in the data storage device 120 or 300, and provides information on the selected learning video to the learner (S375). . Accordingly, the learner can view the selected video by accessing a computing device that provides the selected learning video using his or her computing device (eg, a PC, a smartphone, or a tablet PC). That is, the computing device providing the selected learning video may provide the learning service to the learner (S375).

For example, when the item to which the identification mark is assigned is the item '2' of FIG. 5, the computer program 115 transmits information on a learning video related to a large category (grammar) or a subcategory (tense) to the learner's computing device or the learner's It can be transferred to the guardian's computing device. Accordingly, the learner may use his or her own computing device to access a computing device that provides a learning video and listen to a learning video related to a large category (grammar) or a small category (tense) (S375).

According to embodiments, the computer program 115 selects a learning video related to each of the questions to which a third score or a fourth score is assigned from the learning videos stored in the data storage device 120 or 300, and selects the learning video to the learner. Information about the video is provided (S375).

10 is a flow chart of a learning level evaluation system that provides a learning service using items to which points are assigned according to embodiments of the present invention.

The computer program 115 executed in the computer main body 100A of FIG. 1 or the service server 100B of FIG. 2 receives a multiple-choice answer sheet from each learner through an external device 200A or 200B (S410).

The computer program 115 calculates an average (average score) of scores for each item (S415). For example, assuming that 100 learners have solved Question 1 and the sum of the scores for Question 1 is 273, the computer program 115 calculates the average score for Question 1 as 2.73. In this way, the computer program 115 calculates an average score for each question from the second question to the last question (S415).

As exemplarily shown in FIG. 5, the major category of item 1 is'speech method', the sub category is'presentation/appropriateness, strategy', the major category of question 2 is'grammar', and the sub category is'tense', and The major classification is'grammar' and the small classification is'the structure of words'.

Explaining the example of item 1, the computer program 115 is stored in the data storage device 120 or 300, and the main category is'speech method' and the sub-category is'presentation/appropriateness, strategy'.(1) Average score Items with difficulty corresponding to (2.73), (2) items with difficulty lower than the average score (2.73), or (3) items with difficulty higher than the average score (2.73) are extracted and extracted A multiple-choice questionnaire including selected items may be provided in the form of a paper or an electronic document (S420).

The computer program 115 may determine a learning level from past test answer sheets for each learner, and generate a customized multiple-choice test questionnaire for each learner according to the determination result.

For example, assuming that the learning level of the first learner is the first level and the learning level of the second learner is the second level higher than the first level, the computer program 115 learns from the past test answer sheets of the first learner. The level is determined, and a first multiple-choice test questionnaire including questions corresponding to the first level is generated to the first learner according to the determination result, and the computer program 115 is used from the past test answer sheets of the second learner. The learning level is determined, and a second multiple-choice test questionnaire including questions corresponding to the second level is generated to the second learner according to the determination result.

In addition, the computer program 115 provides a learning video corresponding to the first level to the first learner, and provides a learning video corresponding to the second level to the second learner.

After the learner has taken the multiple-choice test, the computer program 115 provides the learner and/or the learner's guardian in various forms (e.g., graphs, etc.) of analysis results of the multiple-choice tests that the learner has currently and previously viewed. can do.

Provided herein may mean providing using an output device (eg, a display device such as a printer or a monitor).

As described with reference to FIGS. 1 to 10, the computer program 115, which is combined with hardware and stored in the medium, in order to evaluate the learner's learning level from the multiple-choice test, is input from the evaluator or the grader and points to be assigned to the item to be scored. (For example, the first score to the fifth score) is set, and the set score for the score target question based on the scoring result for the score target question included in the multiple-choice answer sheet (for example, whether the answer is correct or incorrect) Any one of these is assigned as a scoring score (e.g., one of the first to fifth points), and the number of answers to the scoring question based on the scoring score assigned to the scoring target question (e.g. For example, whether there is one answer or two) and whether there is a correct answer (for example, whether the answer is correct or incorrect) is judged.

The computer program 115 determines that the number of answers to the scored question is one and one answer is correct when the scoring score assigned to the scoring target question is the maximum value (for example, the first score) among the scores. , When the scoring score assigned to the scoring target question is the minimum value (for example, the second score) among the scores, it is determined that the number of answers to the scoring question is one and one answer is an incorrect answer.

The scores are the maximum value (for example, the first score), a third score less than the maximum value, a fourth score less than the third score, a fifth score less than the fourth score, and the fifth score When the smaller the minimum value (for example, the second score) is included, the computer program 115 determines the score of the item to be scored when the score assigned to the item to be scored is the third score among the scores. The number of answers is two (e.g., the first answer and the second answer), and the answer with the highest priority among the two answers (e.g., the first answer) is judged to be the correct answer, and is assigned to the question to be scored. When the scored score is the fourth score among the scores, the number of answers to the question to be scored is two (for example, the first answer and the second answer), and the answer with a lower priority among the two answers ( For example, when it is determined that the first answer is the correct answer, and the scoring score assigned to the scoring question is the fifth among the scores, the number of answers to the scoring question is two (for example, The first answer and the second answer), and both answers are judged to be incorrect. The computer program 115 performs the above-described process from the first question to the last question included in the multiple-choice answer sheet.

The examples shown and described herein are examples for explaining the technical idea of the present invention, and the technical idea of the present invention is not limited to the examples.

The present invention has been described with reference to the embodiments shown in the drawings, but these are only exemplary, and those of ordinary skill in the art will understand that various modifications and equivalent other embodiments are possible therefrom. Therefore, the true technical protection scope of the present invention should be determined by the technical idea of the attached registration claims.

100A: computer body
100B: service server
110: processor
115: computer program or application
120: memory device
130: input device
140: output device
200A: scanner, OCR
200B: User (learner) computer
210A, 210B, 210C: Answer sheet
220: program

Claims (7)

In a computer program stored in a medium to evaluate a learner's learning level from a multiple-choice test combined with hardware,
The computer program stored in the medium,
Receiving a multiple-choice answer sheet from an external device;
Determining whether only one answer exists or two answers exist in the question to be scored included in the multiple choice answer sheet;
When there is only one answer in the scoring target question and the one answer is correct, the maximum value is given from among the scores set for the scoring target question, and the set score for the scoring target question when the one answer is an incorrect answer Assigning a minimum value among them; And
When there are two answers in the scoring target question and the answer with a higher priority among the two answers is the correct answer, a third score is given to the scored question, and the answer with a lower priority among the two answers is When the answer is correct, assigning a fourth score to the question to be scored, and assigning a fifth score to the question to be scored when both answers are incorrect,
The scores are in a medium including the maximum value, a third score less than the maximum value, a fourth score less than the third score, a fifth score less than the fourth score, and the minimum value less than the fifth score. Stored computer programs. The method of claim 1, wherein the computer program,
A computer program stored in a medium for determining an answer with a higher priority and an answer with a lower priority from among the two answers based on a characteristic of a mark displayed on each of the two answers. In the method of evaluating a learner's learning level from a multiple-choice test using a computer,
Receiving a multiple-choice answer sheet from an external device;
Determining whether only one answer exists or two answers exist in the question to be scored included in the multiple choice answer sheet;
When there is only one answer in the scoring target question and the one answer is correct, the maximum value is given from among the scores set for the scoring target question, and the set score for the scoring target question when the one answer is an incorrect answer Assigning a minimum value among them; And
When there are two answers in the scoring target question and the answer with a higher priority among the two answers is the correct answer, a third score is given to the scored question, and the answer with a lower priority among the two answers is When the answer is correct, assigning a fourth score to the question to be scored, and assigning a fifth score to the question to be scored when both of the two answers are incorrect,
The scores include the maximum value, a third score less than the maximum value, a fourth score less than the third score, a fifth score less than the fourth score, and the minimum value less than the fifth score. How to assess your level of learning. The method of claim 3,
A method of evaluating a learner's learning level in which the difference between the maximum value and the minimum value is greater than the difference between the third score and the fourth score. delete In a computer program stored in a medium to evaluate a learner's learning level from a multiple-choice test combined with hardware,
The computer program stored in the medium,
Setting points to be assigned to the item to be scored;
Assigning any one of the set scores as a scoring score based on a scoring result for the question to be scored included in a multiple-choice answer sheet; And
Performing a step of determining the number of answers and the presence or absence of correct answers to the scoring target question based on the scoring score assigned to the scoring target question,
The step of determining the number of answers to the question to be scored and whether there is a correct answer,
When the scoring score assigned to the scoring target question is the maximum value among the scores, it is determined that the number of answers to the scoring target question is one and one answer is the correct answer,
A computer program stored in a medium that determines that the number of answers to the scored question is one and one answer is an incorrect answer when the scoring score assigned to the scoring target question is the minimum value among the scores. The method of claim 6,
When the scores include the maximum value, a third score less than the maximum value, a fourth score less than the third score, a fifth score less than the fourth score, and the minimum value less than the fifth score,
The step of determining the number of answers to the question to be scored and whether there is a correct answer,
When the scoring score assigned to the scoring target question is the third score among the scores, the number of answers to the scoring target question is two, and it is determined that the answer with the highest priority among the two answers is the correct answer,
When the scoring score assigned to the scoring target question is the fourth score among the scores, the number of answers to the scoring target question is two, and it is determined that the answer with a lower priority among the two answers is the correct answer,
When the scoring score assigned to the scoring target question is the fifth score among the scores, the number of answers to the scoring target question is two, and the computer program stored in the medium determines that both answers are incorrect.

Images