KR100625120B1 - Service Method and system for studying evaluation and clinic - Google Patents

Abstract

The present invention is to provide a learning evaluation clinic service method and system using the Internet, and to analyze and classify the attributes of each item in advance to build a problem bank DB, and to match the classified attributes diagnosis and advice DB and learning After building the data DB, the learners take the test on / offline and input the answer to the result, score it and analyze the result file so that the comprehensive analysis and the strength and weakness of each sector appear according to the classification area. It is characterized by constructing and providing an online system to automatically generate and provide clinic information such as grade analysis and sectoral learning plan, diagnosis, and advice of relevant learners through analysis of weak sectors.

Learning, Assessment, Clinic, Internet, Language, Analysis, Consulting, Korean, Diagnosis, Educational Evaluation

Description

Service method and system for studying evaluation and clinic

1 is a block diagram of a learning evaluation clinic service system according to the present invention

2 is a flow chart showing a learning evaluation clinic service method according to the present invention

Figure 3 is a flow chart for explaining the test answer information input method process according to the present invention

Figure 4a is an explanatory diagram for explaining a comprehensive analysis process according to the present invention.

4b is a detailed flowchart of a comprehensive analysis process according to the present invention;

Figure 4c and Figure 4d is an exemplary report showing the results of a comprehensive analysis according to the present invention

5A is an explanatory diagram of a result file analysis process according to the present invention;

5b is an example of a result file analysis report

Figure 6a is an explanatory diagram for explaining the analysis process for each vulnerable sector according to the present invention

Figure 6b and Figure 6c is an illustration of a clinic report for the analysis and learning measures for each vulnerable sector sanctions according to the present invention

6D is an illustration of the Sanctions and Behavioral Areas Crosstabulation Report.

7 is an explanatory diagram for explaining the creation of a clinic report according to the present invention.

<Description of the symbols for the main parts of the drawings>

10: Client 20: Internet

100: web service server 210: member management unit

220: exam questions 230: comprehensive analysis unit

240: result file analysis unit 250: vulnerable sector analysis unit

260: clinic report generator 310: member DB

320: Question Bank DB 330: Diagnosis and Advice DB

340: Learning Materials DB

The present invention relates to a learning evaluation clinic service method and system, and in particular, to analyze the test results for each language area by type of area to provide analysis results and information for further study, etc. A learning assessment clinic service method and system thereof.

Recently, along with the rapid increase of the Internet user population, first-line education sites have proposed new learning methods using the Internet, which has led to a rapid growth of learning-related sites on the Internet.

However, currently operating Internet test-related sites simply adopt a method of downloading and solving test questions to a user's PC, and transmitting the result to the Internet test-related site and scoring the score. Based on the results, the individual's grades are simply accumulated.

However, rather than providing the candidate's overall data on the test results, the test taker provides an objective, comprehensive, in-depth, detailed, and individualized assessment of his or her ability by providing only a summary of the individual's scores. There was a disadvantage of not being able to.

In addition, learners have a desire to evaluate their learning achievements efficiently, objectively, systematically and scientifically. In particular, candidates need an objective evaluation and diagnosis of areas they are good at and areas lacking, and thus require field-specific clinics to supplement them with deep learning.

However, even in schools and academies, it is difficult to provide an analysis or evaluation of each domain for each student and a clinic about it, and there was no means for evaluating and diagnosing it.

The present invention improves the problems of the learning evaluation method as described above, to evaluate the test results for each individual learner and group, and to improve the learning efficiency by providing the analysis of each area and the clinic information on the analysis results It is to provide a learning evaluation clinic service method and a system thereof.

The present invention provides a comprehensive score report and a grade based on a student's test scoring result to perform an objective assessment diagnosis, and to analyze the strengths and weaknesses of each area to serve as a clinic information.

In addition, the present invention by comparing the analysis of individual learning evaluation information for each period to provide a grade change trend, by providing a comparison of the grades of other learners compared with the learner as a comparison information, by providing diagnosis and advice as a clinic information This is to increase learners' motivation to learn.

In addition, the present invention is to increase the learning efficiency of similar problems by providing the incorrect answer notes and incorrect answer clinic services for each learner's area.

In addition, the present invention is to enable the service as a personalized information for the test questions and learning information for the field of weakness and deep learning by the learner's evaluation analysis.

In addition, the present invention described above is to provide a report offline together with the online service so that learners can utilize the learning evaluation clinic intensively and more effectively.

According to the present invention, a question bank DB is constructed by analyzing and classifying the attributes of each item in advance, and a diagnosis and advice DB and a learning material DB are constructed to match the classified attributes, and the learner performs the test through on / offline. If you enter an answer to the results of the report, the results are scored and analyzed based on the classification area, and the result file is displayed so that the strength and weakness of each sector can be displayed. It is characterized by constructing and providing an online system to create and provide clinic information such as learning plan, diagnosis and advice.

The present invention can generate the test questions in accordance with any test conditions in the question bank DB to provide the test questions through on / offline, and for the external test not in the question bank DB based on the classification criteria arbitrarily defined for each question Classify the area, evaluation area and intersection area, and classify attributes to match the diagnosis, advice, and learning material information, and generate clinic reports by analyzing test scores, synthesis, result files, and vulnerable areas. It is characterized by the provision.

In constructing a question bank DB, the present invention categorizes a problem, an attribute classifying an evaluation area for each item, link information for learning materials, lecture information for each problem, a question number, and a question information as item information. It is characterized by managing it with a database.

The present invention provides a web service server for registering and managing learners as individuals and groups, and providing a clinic report according to a question question and a learner's answer input and analysis result; The test area is divided into the content area and the action area for each test question and subdivision into subdivisions for each classification area, and the problem types are classified and coded as the attribute information of the item to solve problem descriptions, similar problems, and difficulty. Question bank DB to store and manage to include; By storing each diagnosis and advice information about each area, strength and weakness, problem type, etc. according to each item and analysis result in advance as a database, it manages to search and combine item property information by using the analysis result and automatically generate them. Diagnostic and advice DB; Learning to manage learning materials, recommendation books, lectures / lectures, and solution settings for each item, classified area, and grades of learners as a database to automatically provide learning materials based on the analysis results. Data DB; Test questions are submitted through the web service server, and the members' answers are graded and graded, and comprehensive grade analysis, area analysis of content area / behavior area, cross analysis by area, and analysis of vulnerable areas according to each analysis result, etc. An analysis system for performing; Diagnosis and advice for each analysis result and comprehensive analysis from the diagnosis and advice DB, and learning data information from the learning data DB are automatically extracted from each analysis result in the analysis system to diagnose tables / tables and graphs for each analysis result. And constructing a learning evaluation clinic service system as a clinic information generating means provided through the web service server by generating advices and recommendation materials as individual customized reports.

The analysis system includes: a test question generation unit configured to extract a test question from the question bank DB based on the evaluation analysis information and the test condition of the learner or group and present a test question; Students receive the answers to the test and score them according to the correct / incorrect answer of the question bank DB. The strengths and weaknesses are scored for the overall scores for the scores, the scores and the scores for the content area and the action area that are pre-categorized by each question. A comprehensive analysis unit that automatically generates and provides analysis of each evaluation area to be analyzed, cumulative grade analysis by comparison with previous grades, and diagnosis and advice accordingly; The information provided for the self-diagnosis study plan is provided by providing the learner's noon answer for each question scored by the comprehensive analysis unit, the correct answer rate of the total test takers, the response rate for each question answer, and the classification information for each evaluation area of the corresponding question. A result file analysis unit provided; Based on the analysis result of the result file, each student's scores and ratios, internal scores, and high scorers and tied scores It includes a weak sector analysis department that provides averages to identify learner's strengths and weaknesses.

In addition, the service method according to the present invention,

A grading process of classifying the test items and scoring the inputs of the learner's answers to an arbitrary test in which each attribute code value is stored in advance; Comprehensive scores on scores scored based on the scoring results, and analysis of evaluation areas by analyzing strengths and weaknesses of scores and points by content area and behavior area that are pre-categorized by each item of the corresponding test questions, and transfer scores. Comprehensive analysis process that automatically generates and provides a cumulative analysis by comparison with the field, and the resulting diagnosis and advice; In the comprehensive analysis process, the result file analysis is provided to enable the self-diagnosis learning plan to be provided by providing learner's noon answer for each question, the correct answer rate of all the test takers, the response rate for each questionnaire, and the classification information for each evaluation area of the corresponding question. Process; A weak section analysis process for identifying learner's strengths and weaknesses by providing learners' scores and ratios, internal scores, predetermined scores of high scorers, and average scores based on the analysis results of the result file; A cross analysis process for each area that provides a comparative analysis of areas intersecting each other with respect to content areas and behavior areas classified for each item using the result file analysis information; The information analyzed in each analysis process is provided in the form of tables and graphs respectively, and the diagnosis and advice is automatically diagnosed and advised for each analysis result from a diagnosis and advice DB that manages each diagnosis and advice in a database in association with the attribute information for each item. Extracts the results, and automatically extracts the learning materials for the vulnerable sectors according to the analysis results from the learning data DB, and generates a clinic report together with the result analysis information to provide a clinic report providing process for each learner and learning group. Characterized in that made.

Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a learning evaluation clinic service system according to the present invention.

As shown in this, the learning evaluation clinic service system according to the present invention,

Web service server 100 for providing test questions, member management and individual and group learning clinic services through web services by connecting to client systems 10 of individual and group members through the Internet 20 and the like. ; Member management unit 210 for managing the member-specific test management and analysis information and clinic information for the previous test; A member DB 310 which stores and manages information of members and various evaluation and clicknic information on previous test results of the members; A question bank DB 320 constructed as attribute information by analyzing and linking major classification, middle classification, small classification, and cross-section information and learning information for each area in advance for each item in the correct / incorrect and evaluation areas; Diagnosis and advice on content area, behavior area, and comprehensive grade analysis according to the evaluation area for each item, analysis of learning plan, etc., matching the code with the question bank DB (320), and a diagnosis built in a database in advance And advice DB 330; The question bank DB 320 and the diagnosis and advice DB 330 match the similarity classification code for each item and the learning material for each classification area with the learning material DB 340 that is constructed as a database. ; A test question making unit 220 for extracting a test question from the question bank DB 320 based on the evaluation analysis information and the test condition of the learner or the group to produce a test question; The student receives the answers to the test and scores the scores based on the correct / incorrect answers of the question bank DB (320). A comprehensive analysis unit 230 for automatically generating and providing an analysis for each evaluation area for analyzing the strengths and weaknesses, a grade accumulation analysis based on comparison with previous grades, and a diagnosis and advice accordingly; The self-study learning plan can be established by providing the learner's noon answer for each question scored by the comprehensive analysis unit 230, the correct answer rate of the total test takers, the response rate for each question answer, and the classification information for each evaluation area of the corresponding question. A result file analyzer 240 for providing information so as to provide information; Based on the analysis result of the result file, the content area classified for each item and the area for evaluation and the areas that intersect each other are compared and analyzed. A weak sector analysis unit 250 for providing a mean to check the strength and weakness of the learner; The information analyzed in each part is provided in the form of tables and graphs respectively, and the results of diagnosis and advice are automatically generated for each analysis result, and the clinic report is generated by attaching learning materials and the like, and the corresponding information is provided through on / offline. It is configured to include a clinic report generation unit 260 provided for each learner and learning group.

2 is a flowchart illustrating a learning evaluation clinic service method according to the present invention.

As shown therein, a scoring process (S10) of receiving a student's answer to any test and scoring the input; Comprehensive scores on scores scored based on the scoring results, and analysis of evaluation areas by analyzing the strengths and weaknesses of scores and points by content area and behavior area that are pre-categorized by each item of the corresponding test questions, and transfer scores. Comprehensive analysis process (S20) for automatically generating and providing a cumulative analysis, and the diagnosis and advice according to the comparison with the field; In the comprehensive analysis process (S20), the learner's noon answer for each question, the correct answer rate for all the test takers, the response rate for each question and the like, and the classification information for each evaluation area of the corresponding question are provided so that a self-diagnostic learning plan can be made. A result file analysis process (S30); Based on the analysis of the result file, the weak section analysis process (S40) that provides the learner's score and ratio, the internal score, the predetermined score of the top scorer score, and the average score of the tied scores to check the strength and weakness of the learner (S40). and; A cross analysis process (S50) for each area, which provides a comparative analysis of areas intersecting each other with respect to the content area and the action area classified for each item by using the result file analysis information; Customized information providing process according to client's request (S60) providing the corresponding learning information by client's request and information analyzed in each analysis process are provided in the form of table and graph, respectively, and automatically for each analysis result Diagnosis and advice to produce a result, and attached to the learning material, such as a clinic report is generated by providing a clinic report providing process (S70) for each learner and learning group through on / offline.

The question bank DB 320 of the present invention stores and manages the test questions as a database. Each item is classified in advance by assigning the property value to each item, and the property values for analysis are stored as code values. Attribute values for each item are classified and managed as information on grade, semester, difficulty, year of entry, multiple choice / suffix, SAT / internal, item-specific answers, incorrect answers, scoring, problem type, and item commentary.

An embodiment of the present invention describes a clinic service for learning evaluation, diagnosis and advice on a language area as an embodiment. In the language area, the evaluation area is divided into a content area and an action area, and the content area is' speaking / listening, It is classified by sanctions such as writing, reading (literature), reading (non literary), etc., and the detailed classification is classified as 'modern poetry, classical poetry, modern novel, classical prose, essay play', etc. And 'humanities, society, science, technology, art, and living language'.

Behavioral domains are categorized into 'vocabulary / grammar, factual understanding, inferential understanding, critical understanding, creative understanding' and so on. The classification criteria as described above systematically classify the areas that are the evaluation criteria in view of the trends of the test questions so far.

In addition, the question types for each item are classified into 300 types such as content identification, content inference, etc., and the types of questions to be asked in the question are classified.

In addition, each item stores matching information on similarity, deepening, and supplementary items, which can be assigned codes manually, but by comparing the relations with other items as attribute values, the code values for each area and problem type. It is automatically generated by comparing and saves and manages each item.

On the other hand, when the difficulty is initially inputted and stored at the time of classifying the predicted difficulty, the difficulty is automatically adjusted and compared with the overall level of the candidate by the respondents 'response and the percentage of respondents' correct answers according to the questions.

The problem bank DB 320 as described above is applied as a key element in the present invention. When the problem is initially classified for each problem and given attribute values, a code is automatically generated and managed by the code. To generate and provide analysis, matching diagnosis and advice.

On the other hand, the diagnosis and advice DB 330 is diagnosed and matched with the item attribute codes to automatically generate the diagnosis and advice by the evaluation area, the problem type, etc. and the attribute value of the items and the degree of membership, etc. Store the advice in a database in advance. Each diagnosis and advice is managed and stored in a database in consideration of the content area and behavior area by item and sanction, the learner's grade (percentage), the average of tied students, and the increase / down of the grade.

And, in the learning material DB (340), the code is matched to be automatically generated by the item classification information and member information for each item, storing and managing various learning materials and lecture recommendation books, textbooks, recommended lecture files, etc. It is classified and managed by area, problem type and learning countermeasure.

Referring to the embodiment of the present invention configured as described above are as follows.

3 is a flowchart illustrating a method of inputting test answer information according to the present invention.

First, when logging in to the website provided by the web service server 100, the member management unit 210 reads the information of the member from the member DB 310, and selects the conditions for the test or automatic questions, etc. If selected, the test questions questions unit 220 questions questions that meet the conditions of the member.

The test question questions unit 220, the question bank DB (320) matching the noon answer DB, question DB, commentary DB, etc. to test questions, based on the member data of the member DB (310) to fit the member Test questions will be asked. Here, the member may be an individual member or a group member, and the question may be set by setting the difficulty level, the number of questions, and the range according to the member's condition input, and the previous question stored in the member DB 310. You can also submit questions automatically by using the evaluation information. In other words, it is possible to make customized exams according to the learning progress, weaknesses and learning plans of members.

Although the exam questions can be taken online directly, the test questions can be taken in the administrator mode for the group test and printed offline to take the test, and only the test answer can be entered. How to input the test answer, when taking the test offline, you can create an OMR card and receive the answer input through the OMR reading data processor, and if the online test is taken, enter directly from the Internet Web service server (100 ) Processes the data and stores and manages the answer data for each member.

4A is an explanatory diagram for explaining a comprehensive analysis process according to the present invention, and FIG. 4B is a detailed flowchart of the comprehensive analysis process according to the present invention. 4c and 4d are exemplary reports showing the results of comprehensive analysis according to the present invention.

When receiving the test answer data of the members as shown in FIG. 3, the comprehensive analysis unit 230 performs a scoring and comprehensive analysis process.

The question attribute DB, item commentary DB, question area (that is, evaluation area) classification DB, problem type DB, etc. of the question bank DB 320 is input and analyzed the classification attribute value of each question. In addition, by utilizing the thinking area DB, problem type and learning measures DB, recommended textbook / course DB from the learning material DB (340), and also using the diagnosis and advice DB (330) to process a comprehensive analysis.

Comprehensive Analysis Results The result file for each student is created, the student-specific evaluation clinic information is provided, and the group-specific result file and the group-specific evaluation clinic information are provided.

Comprehensive analysis process (S20) is scored for the scoring results as shown in the composite score report of Figure 4c after performing the scoring step (S21) to score the answer data for each member based on the noon answer DB as shown in Figure 4b And performing a comprehensive score report generation step (S22) of evaluating the scores and the scores, the percentiles, and the grades for the standard scores and the standard scores and providing them as a comprehensive score report.

Subsequently, the analysis is performed for each evaluation area as shown in FIG. 4C, which is analyzed for each content area and behavior area among the evaluation areas, and the number of points matched with the number of questions in each area Score point Score point Average (score / scoring rate), score of the top 4% The strength and weakness analysis step for each content area (S23) and the strength and weakness analysis step (S24) for each action area are analyzed. The analysis results by area shows the classification of each area, the scores and grades according to each area, and the scores of the top 4% as a table, and the score rate by area is graphically displayed for the score, the average of the candidates, and the top 4%. Analyze and provide your strengths and weaknesses.

That is, as a comprehensive score report,-Raw scores (scores / scoring) and standard scores, percentiles, grades,

By analysis table by evaluation area

Analysis of strengths and weaknesses by content area: Provides the number of items and scores / scoring / scoring rate, the average of candidates, the top 4% scores and the scoring rate by content area * (two types of tables and graphs) * Four major categories 4c Report example)

Analysis of strengths and weaknesses by behavioral area: Provides the number of items and scores / scores / scoring rate, average of candidates, top 4% scores and scoring rate by behavioral areas * (two types of tables and graphs) * 5 major classifications (reports) See)

And, as shown in Figure 4d, by comparing with the previous month grades generated scores for each score for the raw scores, standard scores, percentiles, grades of the previous exams and the highest / lowest scores of the entire series as a comparison table, the scores per number The previous month provides a graph showing the trend of change and showing the average of the scores received in this test and the average of the candidates in this test as tables and graphs to compare the results with other test takers. Perform a comparison step with the grade (S25).

The comparison with the previous month's grades provides a comparison table, which provides raw scores, standard scores (100 points, 200 points), percentiles, grades, high scores, low scores, and graphs of the change in scores. , The average of the scores given by the previous month by students who received the same score as the previous month, the score I received in the previous month, the score I received this time, the average of the candidates taken by this test, and the score by the students who received the same score as the previous month Provide averages (two tables and graphs).

Subsequently, the diagnosis and advice generation step (S26) is performed. The diagnosis and advice are evaluated for the result of comparing the rise / down of the grades of the previous month, and the standard score of the student compared with the student who received the same score the previous month. Evaluate upwards / downwards, generate diagnostics and advice for both results, and generate advice on how to learn. Such diagnosis and advice generation, by generating the conditions corresponding to each item based on the analysis results and automatically extracted from the diagnosis and advice DB 330 according to the conditions to generate the personalized diagnosis and advice information for each individual.

For diagnosis and advice, if the previous month's grades cannot be compared (first-time test taker), as a diagnosis and advice, ① percentiles, ② my standard scores and the standard score average comparison, ③ my current grade, the score needed to raise one more grade ( * The perfect score and the zero score will be different, the number of cases: 6 kinds.)

If you have the previous month's scores (two or more test takers), as a diagnosis and advice, ① the percentile change, ② the comparison with the previous month's tie score (based on the standard score), ③ the score required to raise one more level from my current grade. (* The perfect score and the zero score will be different, and the number of cases: 20 kinds.) * The actual number of advice: 26 * 5 or more = 130 can be around.

5A is an explanatory diagram of a result file analysis process according to the present invention, and FIG. 5B is an exemplary view of a result file analysis report.

In the result file analysis, when a result file for each group is generated by the information analyzed in the comprehensive analysis process, the result file is analyzed.

From the question bank DB (320) using the noon answer DB, commentary DB, question DB, problem type DB, thinking area (evaluation area) DB, the test taker, that is, the answer data for each item entered by the member is analyzed.

To analyze the type of vulnerability by student / group, the item analysis is analyzed by using the item number, scoring, correct answer, grading, candidate correct answer rate, content area, problem type, behavior area, and self-diagnosis as shown in FIG. 5B. The analysis by sanctions is conducted by item, fingerprint, distribution, and score by 17 sanction classifications, cross-analysis of content and action areas, and cross classification of 25 sanctions / behavior areas. Analyze by scoring, scoring, and item type. Here, the cross analysis may be performed together in the result file analysis, or may be performed as a cross analysis process (S50) of the content area and the action area as an independent process. The detailed description will be made in the description of the cross analysis process (S50).

In this way, through the analysis of questions and sanctions, analysis of vulnerable types by students and groups is provided, along with recommended textbooks and course information.

And, based on the analysis results provide customized advice for each student / group, diagnosis based on grade, grade, recommendation books and textbook / course classification, sanctions, problem types, behavioral areas, questions trends and learning measures And advice DB 330 and learning data DB 340 to automatically find and provide diagnostic and advice information.

By analyzing the result file, the clinic report includes information on language clinic report and incorrect clinic (similarity / supplementary / intensive question).

And self-diagnosis, as shown in Figure 5b, the self-diagnosis, the learner who has taken the test completely understand and correct for each question, the right but confusing questions, the wrong but not answered and understood, the questions that do not know and do not understand It provides advice on how to use self-diagnosis to check and self-diagnose the results.

Figure 6a is an explanatory diagram for explaining the analysis process for each vulnerable sector according to the present invention, Figure 6b and 6c is an illustration of a clinic report for analysis and learning measures for each vulnerable section sanctions according to the present invention. 6D is an exemplary diagram of the Sanctions and Behavioral Areas Crosstabulation Report.

Vulnerable sector analysis process (S40) utilizes the results of the result file analysis and comprehensive performance analysis, and provides analysis so that the weak sectors at a glance through analysis by sanctions.

For first-time students, the results are analyzed using a comprehensive score report, raw scores (scores / scores), standard scores, percentiles, grades, and test taker averages. It provides trends of trends such as change of white level, trend of grade change, trend of highest score, trend of lowest score, trend of top 4% or 10%, and trend of tied score last month.

Content area (by sanctions) analysis by student / group provides, by content area, student / group scores / scores, average scores, tie scores, grades / scores, and top 4% scores / scores. .

Student / group behavior area analysis and sanction / action area cross-analysis, conducts cross-analysis of action area and sanction / behavior area, scoring / scoring rate by student / group, average score of respondents, average of tied scores, scoring / scoring rate by grade , The top 4% score / scoring rate, etc.

Based on the results analyzed as above, the vulnerable sanctions and behavior areas are selected and the corresponding diagnosis and advice are generated and provided.

If such an analysis presents one individual vulnerable sanction, the criteria for screening vulnerable sanctions are:

① By comparing the scores by sanctions and the scores by sanctions between me and tied players (based on raw scores), I choose one of the weakest sanctions,

② When there are two or more sanctions with equal score

-1st priority: choose the weakest score among my sanctions

-2nd priority: Select the weakest points in the scoring rate of all students

-Rank 3: Select the most vulnerable in the sanctions by sanctions of students who are one level above me

③ Perfect score: Sanction with the lowest scoring rate of 1st grade

④ In case of 0 scorers: Sanctions with the highest scores for all candidates (for easy scoring)

Diagnosis and advice include: ① presenting selected vulnerable sanctions, ② recent trends in SAT sanctions and learning measures, ③ learning methods by grade, and ④ reading books by grade.

That is, as shown in Figure 6b, the number of questions, the number of questions, the number of questions, the number of points, scoring, scoring, speaking / listening to the score, writing, literature, inscriptions, etc. It is provided in a table and a graph so that you can see at a glance, and shows the top 4% of the score and the average of the tied score. Diagnostics and advice are automatically generated and provided for these results.

FIG. 6C is an exemplary diagram of a weak sanction analysis and a study countermeasure result report. If the vocabulary and phrases are selected as the weakest part of the analysis result, the number of questions, correct questions, and scoring scores for the sanctions are shown in the table and diagram. Display the graph to compare with the strongest area (eg, speaking / listening) among other areas, and compare the score by displaying the top score and the top 4% and the average score of the tied score in the sanction.

In addition, it provides information on trends and predictions on the relevant sanctions, and provides information on recommended textbooks / lectures on learning measures.

On the other hand, the weak part may not be provided for only one sanction, but may provide analysis information as shown in FIG. 6C for each of two or more areas.

How to suggest vulnerable sanctions / behavior

1. By comparing me and my scorers' scores by sanctions / behavior area (25) and my scores by sanctions / behavior area, I chose one of the most vulnerable areas,

2. When there are two or more sanctions with equal scoring points

① 1st: Choose the weakest among my sanctions

② 2nd priority: Select the weakest points among all students by scoring

③ 3rd place: Select the most vulnerable among the sanction rate by sanctions of students who are higher than me

3. In case of perfect score: select the lowest scoring class

4. In case of 0-point score: Select the category with the highest score for the candidate.

Diagnosis and advice are as follows: ① Presenting weak sanctions / behavior area, ② Presenting types corresponding to the applicable sanctions / behavior area, recent trends and types of similar questions, and ③ Learning methods by grade according to the types.

※ Type presentation method is a. 1 wrong: The student presents the actual wrong type, b. 2 or more wrong cases: Representative type, c. Perfect score: present the item with the lowest percentage of correct answers, d. 0-point scale: present the item with the highest percentage of correct answers, e. Type: Over 200 types (divided by content area and behavior area)

On the other hand, in the weak sanction analysis, the cross-analysis process (S50) of the content area and the action area is classified by item type, and analyzed by DB of the types in which the content area and the action area cross each other. As shown in FIG. 6D, the information area (a sanction) such as listening, writing, and reading, and the information (overlapping classification) of the action area such as vocabulary, grammar, factual understanding, inferential understanding, etc. are used. It provides the number of questions, the scoring, the scoring rate, and the content area (listening, writing, reading) of the action area (vocabulary and grammar). Provide scores in graph form.

 In addition, by detecting a good part and a poor part about the cross analysis in the scoring rate, generating and providing diagnosis and advice on the corresponding sanctions (content area) and behavior area, and providing personalized information on learning measures, recommendation books, and trend information. Produce and provide as.

7 is an explanatory diagram for explaining the clinic report generation according to the present invention.

Select vulnerable sanctions and behavior areas, sanctions / behavior cross sections, and item types analyzed in the vulnerable sector analysis process to present selected vulnerable sectors, provide customized diagnosis and advice for each of the vulnerable sector questions, and learn countermeasures. Students will learn how to learn by grade, and recommend reading books and courses / textbooks. It generates the results generated in the analysis process of each sector as a report, and provides clinic information with tables / tables, graph diagnostics, etc., and includes learning materials DB, diagnosis and advice DB, member DB, and question bank DB. Using the information, the report is automatically generated and provided according to each analysis result.

The clinic report may be printed together with an online offer to serve as an offline offer.

The Clinic Report provides incorrect answer notes to check and learn for self-diagnosis and self-learning. The incorrect answer note presents the percentage of correct answers to the most incorrect questions on the test and the percentage of incorrect answers chosen by the most students. Provides problems and similar problems together to use as incorrect answer clinic information. In addition, the analysis results provide similar problems, problem descriptions, learning materials, deep learning and supplementary materials, etc., for vulnerable sanctions, etc., so that they can be managed and used as incorrect notes.

In the present invention, when the learners look at the test on / offline and analyze the test result, the comprehensive analysis, the weak area analysis, and the cross-sectional analysis by area can be performed to compare their scores and tie scores at a glance. And, compared with previous test results, it is effective to determine the performance trend.

In addition, since a clinic report is automatically generated and provided for learning materials and learning methods as well as diagnosis and advice according to each analysis result, learning plans and learning methods can be helped.

In addition, the present invention systematically classifies the content area and the action area by sanction in consideration of the specificity of the language area and classifies them in detail by subdividing them. It has the effect of automatically generating diagnosis and advice on vulnerable sanctions and automatically generating clinic reports.

Claims (6)

In the learning evaluation method system utilizing the Internet, A web service server that manages learners by registering members and groups and provides clinic reports according to test questions, learners' answers, and analysis results; The test area is divided into the content area and the action area for each test question and subdivision into subdivisions for each classification area, and the problem types are classified and coded as the attribute information of the item to solve problem descriptions, similar problems, and difficulty. Question bank DB to store and manage to include; By storing each diagnosis and advice information about each area, strength and weakness, problem type, etc. according to each item and analysis result in advance as a database, it manages to search and combine item property information by using the analysis result and automatically generate them. Diagnostic and advice DB; Learning to manage learning materials, recommendation books, lectures / lectures, and solution settings for each item, classified area, and grades of learners as a database to automatically provide learning materials based on the analysis results. Data DB; Test questions are submitted through the web service server, and the members' answers are graded and graded, and comprehensive grade analysis, area analysis of content area / behavior area, cross analysis by area, and analysis of vulnerable areas according to each analysis result, etc. An analysis system for performing; Diagnosis and advice for each analysis result and comprehensive analysis from the diagnosis and advice DB, and learning data information from the learning data DB are automatically extracted from each analysis result in the analysis system to diagnose tables / tables and graphs for each analysis result. And clinic information generating means for generating advice and recommendation materials, etc. as individual customized reports and providing them through the web service server. The analysis system, A test question making unit 220 for extracting a test question from the question bank DB 320 based on the evaluation analysis information and the test condition of the learner or the group to produce a test question; The student receives the answers to the test and scores the scores based on the correct / incorrect answers of the question bank DB (320). A comprehensive analysis unit 230 for automatically generating and providing an analysis for each evaluation area for analyzing the strengths and weaknesses, a grade accumulation analysis based on comparison with previous grades, and a diagnosis and advice accordingly; The self-study learning plan can be established by providing the learner's noon answer for each question scored by the comprehensive analysis unit 230, the correct answer rate of the total test takers, the response rate for each question answer, and the classification information for each evaluation area of the corresponding question. A result file analyzer 240 for providing information so as to provide information; Based on the analysis result of the result file, the content area classified for each item and the area for evaluation and the areas that intersect each other are compared and analyzed. Learning evaluation clinic service system, characterized in that it comprises a weak sector analysis unit 250 to provide the average and the learner's strength and weakness. delete The method of claim 1, wherein the question bank DB (320) Each item is assigned a property value for each item and classified in advance to store the property values for analysis as a code value.In addition, the diagnosis, advice and learning data can be analyzed by the property code in connection with the diagnosis and advice DB and the learning material DB. Manages automatic extraction, Property values for each item are classified and managed by information such as grade, semester, difficulty, year of entry, multiple choice / suffix, SAT / internal type, correct / incorrect answer for each item, scoring, problem type, item commentary, etc. In the language area, the evaluation area is divided into the content area for classifying the field of content and the action area for classifying the logical trend of the problem. Each question type is classified into hundreds of items such as content identification, content inference, etc. to distinguish what type of question you want to ask in the question. Matching information about similar, deepening, and supplementary items for each item is automatically generated by comparing the code relationship for each area and problem type by comparing the relations with other items as attribute values, and storing and managing each item. , The difficulty level is inputted and stored at the time of predicting difficulty at the time of item classification, and the degree of difficulty is automatically adjusted according to the respondents' responses and the percentage of the respondents according to the questions of the questions. Clinic Service System. In the learning evaluation clinic service method using the Internet, A scoring process (S10) of classifying test questions and receiving a student's answer for an arbitrary test in which each attribute code value is stored in advance; Comprehensive scores on scores scored based on the scoring results, and analysis of evaluation areas by analyzing strengths and weaknesses of scores and points by content area and behavior area that are pre-categorized by each item of the corresponding test questions, and transfer scores. Comprehensive analysis process (S20) for automatically generating and providing a cumulative analysis, and the diagnosis and advice according to the comparison with the field; In the comprehensive analysis process (S20), the learner's noon answer for each question, the correct answer rate for all the test takers, the response rate for each question and the like, and the classification information for each evaluation area of the corresponding question are provided so that a self-diagnostic learning plan can be made. A result file analysis process (S30); Based on the analysis of the result file, the weak section analysis process (S40) that provides the learner's score and ratio, the internal score, the predetermined score of the top scorer score, and the average score of the tied scores to check the strength and weakness of the learner (S40). and; A cross analysis process (S50) for each area, which provides a comparative analysis of areas intersecting each other with respect to the content area and the action area classified for each item by using the result file analysis information; The information analyzed in each analysis process is provided in the form of tables and graphs respectively, and the diagnosis and advice is automatically diagnosed and advised for each analysis result from a diagnosis and advice DB that manages each diagnosis and advice in a database in association with the attribute information for each item. Clinic report providing process of extracting the results, and automatically extracts the learning data for the vulnerable areas according to the analysis result from the learning data DB to generate a clinic report with the result analysis information and provide them by learners and learning groups (S70). Including, The comprehensive analysis process (S20) Scoring step (S21) for scoring the member-specific answer data based on the noon answer DB, Comprehensive score report generation step (S22) for evaluating the scoring and scoring and percentiles and percentiles and grades for scoring and scoring and standard scores for the scoring results and providing them as a comprehensive score report (S22), Number of points that fit the number of questions in each area by analyzing content area and behavior area among evaluation areas Score point Score point Average (score / scoring rate), the strength and weakness analysis step (S23) by content area analyzing the score of the top 4% Strength and weakness analysis step by area (S24), By comparing with the previous month's scores, scores for each raw scores, standard scores, percentiles, and grades of previous tests and the highest / lowest scores among all the sessions are generated as a comparison table. The comparison between last month's grades, which provides students with the same grades as the previous month, shows the average of the scores given in this exam and the average of the candidates in this test in tables and graphs to compare their grades with other test takers (S25 )Wow, Evaluate the results of the previous month's rise / down, compare the student's score with the same score last month, evaluate the rise / down of the standard score, and generate diagnosis and advice on the above two results. Learning assessment clinic service method comprising the step of generating a diagnosis and advice generating advice on the learning method (S26). The method of claim 4, wherein the question bank DB that classifies and stores the attribute information of each item is used to automatically generate a test question by using information about test conditions and previous tests of the learner and to make a test as a personalized test question. Learning evaluation clinic service method characterized in that it further comprises the exam questions process. delete

Images