WO2003049063B1 - Test result analysis apparatus, method, and program, and learning support system and method - Google Patents

Abstract

It is possible to analyze and evaluate a test result precisely from a different viewpoint from the conventional one and perform an excellent education/learning support as compared to the conventional support for students preparing for an exam and educators. According to answer information (D2) of respective students obtained via the Internet (3), a test result analysis apparatus (20) performs analysis and evaluation of academic achievement and competence of each individual using an analysis method based on a viewpoint which does not exist in the conventional method. Moreover, the apparatus performs other analysis and evaluation including teacher’s evaluation. More specifically, according to the relationship between the total points and the right answer ratio of each problem, competence of each student is evaluated for each group of students having the same total points. Thus, it is possible to analyze and evaluate test results precisely from a different viewpoint from the conventional one.

Claims

45 Claim Scope of Request for Amendment 範 囲 Voice Claim Form Scope of Claim [2 0 0 3 5 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 5-19, 21 and 22 have been corrected; claims in the original claim 3, 4 and 20 have been withdrawn; new claims 2-34 have been added; (1 3 page)]

1. (After correction) A test result analyzer for analyzing the test results for multiple students, obtained by conducting a test that includes multiple problems with each being assigned a point,

 Response information storage means for storing response information for each subject indicating whether or not each question has been correctly answered, obtained by performing the test;

 Based on the answer information of at least a part of the examinees stored in the answer information storage means, for each examinee group belonging to the same score range or the same score as the total score obtained as a result of the test, Question-specific correct answer rate calculation means for calculating a value indicating the rate of the number of correct students who answered correctly to each question in the test student group as the correct answer rate for each question;

 The calculated correct answer rate for each question is summarized for all the test student groups for each question, and a curve indicating the relationship between the total score and the correct answer rate for each question is obtained by this method. Correct answer rate curve calculation means to be determined as another correct answer rate curve;

 An evaluation means for evaluating the ability of the examinee for each question based on the question-specific correct answer rate curve for each question and the answer information for each question of the examinee to be evaluated, and outputting the evaluation result

 The test result analyzer characterized by having.

 2. (After correction) The evaluation means

 Based on the question-specific correct answer rate curve and the answer information for each question of the examinee to be evaluated,

 For questions answered correctly by the student, the lower the percentage of correct answers in the test student group that has the same total score as the student, the larger the value is calculated.

 For questions that the student has made a wrong answer, the higher the percentage of correct answers in the test student group that has the same total score as the student, the smaller the value is.

A corrected form that outputs the obtained correct answer index and incorrect answer index as the evaluation result (Article 19 of the Convention) The test result analysis apparatus according to claim 1, characterized in that

3. (Deleted)

4. (Deleted)

5 (After correction) A capability element database for storing data of capability element maps, which are hierarchically configured by classifying into a plurality of capability elements to be tested in the test, and

 A control table database storing data of correspondence between each problem and the ability factor map, indicating how much each ability factor in the ability factor map is related to each problem.

 And further

 The evaluation means further includes

 By referring to the comparison table database, the question-specific correct answer index and the wrong answer index of the test student to be evaluated are divided into ability elements to which each question is related, and the result is obtained. An index value is calculated by ability factor, and it is determined as an achievement index by ability factor of the student.

 The test result analysis apparatus according to claim 2, characterized in that

6. (After correction) The evaluation means

 The achievement index according to the ability element is determined from a plurality of test results

 Test result analysis apparatus according to claim 5, characterized in that

7 (after correction)

 Based on the question-specific correct answer index and the wrong answer index or the ability factor specific achievement index for each student, the correct answer index and the wrong answer index or the ability factor achievement academic index belongs to the same numerical range A means of extraction that considers a group as a group of students with similar academic tendency

Analysis of test results according to claim 5 or 6 characterized in that the corrected form (Article 19 of the Convention)

8. (After correction) The evaluation means further includes

 It has a function to evaluate each problem based on the curve shape of the question-specific correct answer rate curve.

 The test result analyzer according to claim 1, wherein the test result is analyzed.

 9 (After correction) The above-mentioned plurality of students are in charge of different teachers for each group of 2 or more students,

 The evaluation results by the evaluation means are summarized for each teacher in charge of each student group, and the evaluation results of each teacher are compared to further provide means for analyzing and evaluating each teacher.

 The test result analyzer according to claim 1 or 2, or 5 or 6, characterized in that:

 1 0. (After correction)

 7. A means for distributing the evaluation result by the evaluation means to the test student through a communication line, the method according to any one of claims 1 or 2 or 5 or 6. Test results analyzer.

 1 1. (After correction) Comment storage means for storing multiple comments according to the student's academic ability,

 Means for automatically generating a comment on each student's academic ability by extracting a comment according to the student's academic ability from among the plurality of comments stored in the comment storage means based on the evaluation result by the evaluation unit And further equipped with

 The test result analyzer according to claim 1 or 2, or 5 or 6, characterized in that:

 1 2 (After correction) The system further comprises means for distributing the evaluation result by the evaluation means and the comment on the academic ability to the examinee via a communication line.

 The test result analyzer according to claim 11, characterized in that:

1 3 (After correction) A test result analysis method for analyzing the test results for multiple students, obtained by conducting a test that includes multiple problems for which each point has been allocated, Completed form (Article 19 of the Convention) 48

 The answer information storage means stores answer information for each subject indicating whether or not each question has been correctly answered, obtained by performing the test;

 Based on the answer information of at least a part of the examinees stored in the answer information storage means, for each examinee group belonging to the same score range or the same score as the total score obtained as a result of the test, A step of the problem-based correct answer rate calculating means calculating, as the correct answer rate of each question, a value indicating the ratio of the number of examinees correctly answering each question in the examinee group;

 The calculated correct answer rate for each question is summarized for every student group for each question, and a curve indicating the relationship between the total score and the correct answer rate obtained by the result is a correct answer rate curve Determining the calculation means as a problem-specific correct answer rate curve;

 Based on the question-specific correct answer rate curve for each question and the answer information for each question of the examinee to be evaluated, the evaluation means evaluates the ability of the examinee for each question and outputs the evaluation result Step and

 A test result analysis method characterized in that it comprises:

 1 4 (After correction) A test result analysis program for analyzing test results for multiple students, obtained by conducting a test that contains multiple questions with each being assigned a point,

 Computer,

 Response information storage means for storing response information for each subject indicating whether or not each question has been correctly answered, obtained by performing the test;

 Based on the answer information of at least a part of the examinees stored in the answer information storage means, for each examinee group belonging to the same score range or the same score as the total score obtained as a result of the test, Question-specific correct answer rate calculation means for calculating a value indicating the rate of the number of correct students who answered correctly to each question in the test student group as the correct answer rate for each question;

The calculated correct answer rate for each question is summarized for all the test student groups for each question, and a curve indicating the relationship between the total score and the correct answer rate for each question is obtained by this method. Means for calculating the correct answer rate curve to be calculated as a separate correct answer rate curve 49

 Evaluating means for evaluating the ability of the examinee according to each question based on the question-specific correct answer rate curve for each question and the answer information for each question of the examinee to be evaluated, and outputting the evaluation result

 Be a program to function as

 Test result analysis program characterized by

 1 5 (After correction) A plurality of terminal devices that output answer data for each student's question, obtained by conducting a test that includes a plurality of questions with each point being allocated, and

 A test result analyzer for analyzing the test results of each examinee based on the answer data of each examinee outputted from each of the terminal devices;

 Equipped with

 The test result analyzer is

 Answer information storage means for storing the answer information for each student indicating whether or not each question was correctly answered;

 Based on the answer information of at least a part of the examinees stored in the answer information storage means, for each examinee group belonging to the same score range or the same score as the total score obtained as a result of the test, Question-specific correct answer rate calculation means for calculating a value indicating the rate of the number of correct students who answered correctly to each question in the test student group as the correct answer rate for each question;

 The calculated correct answer rate for each question is summarized for every student group for each question, and the curve showing the relationship between the total score and the correct answer rate for each question obtained by that is the correct answer for each question Correct answer rate curve calculation means to be determined as a rate curve;

 An evaluation means for evaluating the ability of the examinee according to each question based on the question-specific correct answer rate curve for each question and the answer information for each question of the examinee to be evaluated, and outputting the evaluation result;

 Means for distributing the evaluation result by the evaluation means to each of the terminal devices via a communication line;

 A learning support system characterized by having.

16 (After correction) The above-mentioned plurality of terminal devices are means for receiving broadcast waves, connection to communication lines Corrected form (Article 19 of the Convention) 50

Means or recording medium reading means,

 The learning support system according to claim 15, wherein the problem is provided via a broadcast network, a communication line or a recording medium.

 (After correction) The broadcast system further comprises a broadcasting means for multiplexing the main broadcast part and the sub broadcast part into one broadcast channel,

 The broadcasting means is adapted to perform broadcasting including the test problem data in the sub-broadcast part,

 The plurality of terminal devices have receiving means for receiving problem data included in the broadcast wave.

 The learning support system according to claim 15, characterized in that:

 18 (After correction) The broadcast means is adapted to broadcast the learning course program related to the problem for the test as program content in the main broadcast part or the sub broadcast part of one broadcast channel. ing

 The learning support system according to claim 17, characterized in that:

 (After correction) The plurality of terminal devices are connected to the first communication network,

 An information server for acquiring and collecting response data from each of the terminals connected to the first communication network, and transmitting the collected response data to the test result analyzer via the second communication network; Equipped

 A learning support system according to any one of claims 15 to 18 characterized in that.

2 0. (Deleted)

2 1. (After correction) A plurality of terminal devices for outputting answer data for each question of each student, obtained by conducting a test including a plurality of problems with each point being allocated, and the above-mentioned terminal devices A learning support method applied to a learning support system including a test result analysis device that analyzes test results of each student based on the answer data of each student output from the computer.

A step of storing answer information for each student indicating whether each question has been correctly answered, answer information storage means in the test result analysis apparatus, and a corrected form (Article 19 of the Convention) 51

 Based on the answer information of at least a part of the examinees stored in the answer information storage means, for each examinee group belonging to the same score range or the same score as the total score obtained as a result of the test, Calculating a value indicating the ratio of the number of examinees correctly answering each question in the examinee group, the question-specific correct answer ratio calculation means in the test result analysis apparatus as the correct answer rate of each question;

 The calculated correct answer rate for each question is summarized for every student group for each question, and a curve indicating the relationship between the total score and the correct answer rate for each question obtained thereby is obtained as the test result. Obtaining the correct answer rate curve calculation means in the analyzer as a question-based correct answer rate curve;

 The evaluation means in the test result analysis device evaluates the ability of the examinee for each question based on the question-specific correct answer rate curve for each question and the answer information for each question of the examinee to be evaluated. Output evaluation results and

 Distributing the evaluation result by the evaluation means to the respective terminal devices by the test result analysis device via a communication line;

 A learning support method characterized by including.

 2 2 (After correction) The learning support system further comprises a broadcast means for multiplexing the present broadcast portion and the sub broadcast portion and broadcasting them in one broadcast channel,

 The broadcasting means performs broadcasting including the test problem data in the sub broadcast part;

 The plurality of terminal devices receiving data of a problem included in the broadcast wave by a receiving unit;

 Further include

 The learning support method according to claim 21, characterized in that:

2 3 (Addition) This is a test result analyzer that analyzes test results for multiple students who were obtained by conducting a test that includes multiple questions each of which has been assigned a point and set the problem area. There,

 Response information storage means for storing response information for each subject indicating whether or not each question has been correctly answered, obtained by performing the test;

A corrected form based on the answering information of at least some of the examinees stored in the answering information storage means (Article 19 of the Convention) 52

The total number of questions that belong to the same question area and the questions that each student answered correctly in the question area A value representing the ratio to the number averaged for the same student group, or a value representing the ratio of the sum of the allotments of all problems belonging to the same problem area to the score obtained by each student in the problem area Correct answer rate that calculates the average value of the group as the correct answer rate for each problem area or the score rate for each question area for each student group, and the score rate calculation means, and the correct answer rate for each problem area calculated above Or The score rate for each problem area is summarized for all student groups for each problem area, which is obtained by The curve showing the relationship between the score and the correct answer rate for each problem area or the curve showing the relationship between the total score and the score rate for each problem area The correct answer to be obtained as another score rate curve · Means for calculating the score rate curve,

 Based on the problem area correct answer rate curve or the question area score rate curve and the answer information for each question of the student under evaluation, the ability of the student is evaluated according to the question area, and the evaluation results Evaluation means to output

 Test result analyzer that is specially equipped with.

 2 4 (Addition) The evaluation means is

 Compare the correct answer rate by problem area of the individual subject to be evaluated or the score rate by problem area with the correct answer rate by problem area or the score rate by problem area for the student group to which the examinee belongs ,

 The index value is set such that the value increases as the correct answer rate or the score rate of the examinee individual increases relative to the correct answer rate or the score rate for the examinee group, and conversely, the value decreases as the value decreases. Obtained as an achievement index according to the problem area, and output the obtained achievement index as the evaluation result

 Test result analysis according to claim 23 characterized in that

2 5 (Addition) The evaluation means is

Corrected form to obtain the Achievement Index according to the problem area from multiple test results (Article 19 of the Convention) 53

 Test result analysis according to claim 24 characterized in that

2 6 (Addition) Further,

 An extraction means for extracting candidate students having the same academic ability tendency as a candidate student group having a similar academic tendency tendency based on the achievement index for each question student based on the achievement index for each question area

 The test result analyzer according to claim 24 or 25 characterized by comprising:

 2 7 (Addition) The multiple students are assigned different teachers for each group of two or more students.

 The evaluation results by the evaluation means are summarized for each teacher in charge of each student group, and the evaluation results of each teacher are compared to further provide means for analyzing and evaluating each teacher.

 The test result analyzer according to any one of claims 23 to 25 characterized in that. ,

 2 8. (Addition) Furthermore,

 The test result analysis according to any one of claims 23 to 25, further comprising means for distributing the evaluation result by the evaluation means to the examinee through the communication line. apparatus.

 2 9 (Addition) Comment memory to memorize multiple comments according to the student's academic ability,

 Means for automatically generating a comment on each student's academic ability by extracting a comment according to the student's academic ability from among the plurality of comments stored in the comment storage means based on the evaluation result by the evaluation unit And further equipped with

 The test result analyzer according to any one of claims 23 to 25 which is specifically referred to.

 3 0. (Addition) A means for distributing the evaluation result by the evaluation means and the comment on the academic ability to the student through the communication line

The test result analyzer according to claim 29, characterized in that: Amended paper (Article 19 of the Convention) 54

 3 1. (Additional) The test result analysis method to analyze the test results for multiple students who were obtained by conducting the test that includes multiple questions, each of which is assigned a point and set the problem area. There,

 The answer information storage means stores answer information for each subject indicating whether or not each question has been correctly answered, obtained by performing the test;

 Based on the answer information of at least a part of the examinees stored in the answer information storage means, for each examinee group belonging to the same score range or the same score as the total score obtained as a result of the test, A value indicating the ratio of the total number of questions belonging to the same problem area to the number of questions answered correctly by each student in that problem area, averaged for the same student student, or the sum of the allotments of all questions belonging to the same problem area The average score for the same student group is a value that shows the ratio of the score to each student's score in each question area, and the correct answer · score rate calculation means is the correct answer rate by problem area for each student student Or Step to calculate the score rate by problem area,

 The calculated correct answer rate for each problem area or the score rate for each problem area is summarized for all student groups for each problem area, and the total score and the correct answer for each problem area obtained thereby A curve showing the relationship with the rate or a curve showing the relationship between the total score and the score rate according to each problem area, correct answer · score rate curve calculation means, each problem area correct answer rate curve or problem Step of determining as a score rate curve by category;

 The evaluation means evaluates the ability of the student according to the problem area based on the question area correct answer rate curve or the question area score rate curve and the answer information for each question of the student to be evaluated. Outputting the evaluation result and

 A test result analysis method characterized in that it comprises: .

3 2. (Addition) In the test result analysis program for analyzing the test results for multiple students who were obtained by conducting the test that includes multiple questions each of which has been assigned a point and set the problem area. There,

 Computer,

Each amended form, obtained by carrying out the above-mentioned test, indicating whether or not each question has been answered correctly (Article 19 of the Convention) 55

Response intelligence storage means for storing response information for each student;

 Based on the answer information of at least a part of the examinees stored in the answer information storage means, for each examinee group belonging to the same score range or the same score as the total score obtained as a result of the test, A value indicating the ratio of the total number of questions belonging to the same problem area to the number of questions answered correctly by each student in the problem area averaged over the same student student, or the sum of all points allocated to all questions belonging to the same problem area The value which shows the ratio to the score which each examinee earned in the problem field is averaged for the same student group, and it is calculated as the correct answer rate by problem area for each examinee group or the score rate by problem area respectively. Correct answer · score rate calculation means and the correct answer rate for each question area calculated in the above or the score rate for each question area A summary of all student groups, obtained by it, a curve showing the relationship between the total score and the correct answer rate for each problem area, or the total score and the score rate for each problem area A correct answer for obtaining a curve representing the relationship as the correct answer rate curve according to the problem area or the score rate curve according to the problem area · score point curve calculation means,

 Based on the problem area correct answer rate curve or the question area score rate curve and the answer information for each question of the student under evaluation, the ability of the student is evaluated according to the question area, and the evaluation results Evaluation means to output

 Be a program to function as

 Test result analysis program characterized by

 3 3 (Addition) Multiple terminal devices that output the response data for each question of each student, obtained by conducting a test that includes multiple questions each of which has been assigned a point and set the problem area. When,

 A test result analyzer for analyzing the test results of each examinee based on the answer data of each examinee outputted from each of the terminal devices;

 Equipped with

 The test result analyzer is

Means of storing answer information for storing the answer information for each student indicating whether or not each question was correctly answered, and a corrected form (Article 19 of the Convention) 56

 Based on the answer information of at least a part of the examinees stored in the answer information storage means, for each examinee group belonging to the same score range or the same score as the total score obtained as a result of the test, A value indicating the ratio of the total number of questions belonging to the same problem area to the number of questions answered correctly by each student in the problem area averaged over the same student student, or the sum of all points allocated to all questions belonging to the same problem area The value which shows the ratio to the score which each examinee earned in the problem field is averaged for the same student group, and it is calculated as the correct answer rate by problem area for each examinee group or the score rate by problem area respectively. Correct answer · score rate calculation means and the correct answer rate for each question area calculated in the above or the score rate for each question area A summary of all student groups, obtained by it, a curve showing the relationship between the total score and the correct answer rate for each problem area, or the relationship between the total score and the score rate for each problem area The correct answer · score point curve calculation means for obtaining the curve representing the point as the question field correct answer rate curve or the question field specific point rate curve

 Based on the problem area correct answer rate curve or the question area score rate curve and the answer information for each question of the student under evaluation, the ability of the student is evaluated according to the question area, and the evaluation results Evaluation means for outputting

 Means for distributing the evaluation result by the evaluation means to each of the terminal devices via a communication line;

 A learning support system characterized by having.

 (Addition) A plurality of terminal devices for outputting answer data for each question of each student, obtained by conducting a test that includes a plurality of questions in which each point allocation and the problem area are set. A learning support method applied to a learning support system comprising: a test result analysis device for analyzing a test result of each examinee based on an answer data of each examinee output from each of the terminal devices;

 A step of storing answer information for each examinee indicating whether each question has been correctly answered, answer information storage means in the test result analysis device;

A form in which the same or the total score of the total score obtained as a result of the test is the same is corrected based on the answer information of at least a part of the examinees stored in the answer information storage means. ) 57

A value indicating the ratio of the total number of questions belonging to the same problem area to the number of questions correctly answered by each student in each question area for each group of students belonging to the dot width, or the same problem The test result analysis device calculates the correct answer · score ratio calculation means by averaging the value showing the ratio of the total of the point allocation of all the problems belonging to the field and the score obtained by each student in the question field for the same student group Calculating the correct answer rate by problem area or the score rate by problem area for each student group respectively;

 The calculated correct answer rate for each problem area or the score rate for each problem area is summarized for all student groups for each problem area, and the total score and the each problem area obtained thereby are obtained. The correct answer in the test result analyzer and the score rate curve calculation means have problems with the curve showing the relationship with the correct answer rate, or the curve showing the relationship between the total score and the score rate according to each problem area. Obtaining as a field-specific correct answer rate curve or a question area-specific score rate curve,

 The evaluation means in the test result analysis device is based on the problem area correct answer rate curve or the question area score rate curve and the answer information for each question of the examinee to be evaluated. Evaluate the ability by problem area and output the evaluation result,

 Distributing the evaluation result by the evaluation means to the respective terminal devices by the test result analysis device via a communication line;

 A learning support method characterized by including.

Amended paper (Article 19 of the Convention)

 58

Statement based on Article 19 (1) of the Convention The scope of the claims was amended as a whole to clarify the scope and interrelationship of the various items used in the claims. In particular, at the time of filing, the two items “right answer rate for each problem” and “right answer rate or score rate for each problem area” were included in one claim, but this time In order to make it clearer, we made corrections to divide each claim into independent claims. The former matters are described in claims 1 to 22 and the latter matters are described in claims 23 to 34. Claims 2 3 to 3 4 are claims that are newly added by division.

 These amendments are intended to clarify the description of the scope of claims and are amendments made within the scope of the disclosure of the international application at the time of filing.