CN106296503A

CN106296503A - Evaluation of teacher's method and system

Info

Publication number: CN106296503A
Application number: CN201510386080.3A
Authority: CN
Inventors: 苏喻; 陈志刚; 胡国平; 胡郁; 刘庆峰
Original assignee: iFlytek Co Ltd
Current assignee: iFlytek Co Ltd
Priority date: 2015-06-29
Filing date: 2015-06-29
Publication date: 2017-01-04

Abstract

The invention discloses a kind of evaluation of teacher's method and system, the method includes: obtain each class student examination achievement of each subject examination question and corresponding described examination question；Each subject examination question is carried out difficulty analysis, obtains each subject item difficulty score；Each class based on each subject item difficulty score and corresponding described examination question student examination achievement determines the non-teacher influence factor of each class；For each subject teacher of each class, determine the teaching ability of this subject teacher according to the non-teacher influence factor of this class.Utilize the present invention, it is possible to achieve teacher is evaluated more accurately.

Description

Evaluation of teacher's method and system

Technical field

The present invention relates to data mining technology field, be specifically related to a kind of evaluation of teacher's method and system.

Background technology

Evaluation of teacher is the judgement being worth individual teacher, is the important content of educational evaluation.To teachers ' teaching The evaluation of quality, can make school's teaching management department and teacher understand teaching affairs, pinpoint the problems, Summing up experience improvement, to reach the purpose finally improved the quality of teaching.Thus it is the most fair public Just, the problem that scientificity, always educational circles are explored exactly.

Method currently, with respect to evaluation of teacher mainly has following several: evaluate based on student or colleague's marking, Based on the simple comparative evaluation of student examination achievement.First evaluation methodology based on student or colleague's marking needs design The evaluation index of teacher, then collects student or colleague's marking in these indexs, finally adds up these dozens Divide and provide the evaluation of teacher.Based on student examination achievement simple comparative evaluation teacher, it is that China's majority is local The method taked with school, especially middle and primary schools, its evaluation index is that class is in some large-scale examinations Average mark or the proportion of students entering schools of a higher grade.

In above-mentioned traditional evaluation of teacher's method, based on student or the evaluation methodology of colleague's marking, though can be from Multi-angle scientificity, but its operation is relatively complicated, and because some artificial subjective factors are (as intratype competition is beaten Point on the low side etc.), it is impossible to the verity of the result that guarantees to give a mark；It is based only upon the height of student examination achievement simply The method that teacher makes evaluation, is unilateral and irrational, it is true that the height of student examination achievement is subject to Many factors affects, the such as level of effort of student self, home environment and school environment etc.；Therefore, adopt By traditional evaluation of teacher's method, it is difficult to teacher is made just, accurate, comprehensively evaluate.

Summary of the invention

The embodiment of the present invention provides a kind of evaluation of teacher's method and system, to realize evaluating teacher more accurately.

To this end, the embodiment of the present invention following technical scheme of offer:

A kind of evaluation of teacher's method, including:

Obtain each class student examination achievement of each subject examination question and corresponding described examination question；

Each subject examination question is carried out difficulty analysis, obtains each subject item difficulty score；

Each class based on each subject item difficulty score and corresponding described examination question student examination achievement determines respectively The non-teacher influence factor of class；

For each subject teacher of each class, determine this subject according to the non-teacher influence factor of this class The teaching ability of teacher.

Preferably, described each subject examination question is carried out difficulty analysis, obtains each subject item difficulty score and include:

Utilize IRT model that each subject examination question is carried out difficulty analysis, obtain each subject item difficulty score.

Preferably, described based on each subject item difficulty score and each class student examination of corresponding described examination question Achievement determines that the non-teacher influence factor of each class includes:

Based on each subject item difficulty score, each student's Ge Ke purpose total marks of the examination are normalized, Obtain normalized student examination achievement；

For each subject, this section's purpose is paid attention to by school to utilize described normalized student examination achievement to determine Degree；

Utilize school to each section of the purpose each class of attention degree normalization of each section purpose score, obtain full section of each class Ability, and using complete for described class section ability as the non-teacher influence factor of described class.

Preferably, described method also includes:

Calculate each class grasp ability to knowledge point and/or technical ability；

According to each class, knowledge point and/or technical ability are grasped the teaching energy of ability subject each to each class teacher Power is optimized.

Preferably, the grasp ability of knowledge point and/or technical ability is included by each class of described calculating:

Obtain knowledge point and/or the markup information of technical ability in exam pool；

Obtaining test question information, described test question information includes: item difficulty score and examination question score matrix；

According to described markup information and described test question information, calculate each class to knowledge point and/or the palm of technical ability Hold ability.

A kind of Teacher Evaluation System, including:

Data obtaining module, becomes for obtaining each class student examination of each subject examination question and corresponding described examination question Achievement；

Difficulty analyzes module, for each subject examination question is carried out difficulty analysis, obtains each subject item difficulty and obtains Point；

Non-teacher influence factor determines module, for based on each subject item difficulty score and corresponding described examination question Each class student examination achievement determine the non-teacher influence factor of each class；

Evaluation module, for each subject teacher for each class, affects according to the non-teacher of this class Factor determines the teaching ability of this subject teacher.

Preferably, described difficulty analyzes module, specifically for utilizing IRT model that each subject examination question is carried out difficulty Degree is analyzed, and obtains each subject item difficulty score.

Preferably, described non-teacher influence factor determines that module includes:

Normalized unit, for taking an examination to each student's Ge Ke purpose based on each subject item difficulty score Achievement is normalized, and obtains normalized student examination achievement；

Attention degree determines unit, for for each subject, utilizes described normalized student examination achievement true Determine school to this section's purpose attention degree；

Full section capacity calculation unit, is used for utilizing school to each subject of the purpose each class of attention degree normalization of each section Score, obtain full section of each class ability, and using complete for described class section ability as the non-teacher of described class Influence factor.

Preferably, described system also includes:

Computing module, for calculating each class grasp ability to knowledge point and/or technical ability；

Optimize module, for according to the grasp ability section each to each class to knowledge point and/or technical ability of each class The teaching ability of mesh teacher is optimized.

Preferably, described computing module includes:

Markup information acquiring unit, for obtaining knowledge point and/or the markup information of technical ability in exam pool；

Test question information acquiring unit, is used for obtaining test question information, and described test question information includes: item difficulty obtains Divide and examination question score matrix；

Computing unit, for according to described markup information and described test question information, calculates each class to knowledge point And/or the grasp ability of technical ability.

Evaluation of teacher's method and system that the embodiment of the present invention provides, it is right to be automatically performed according to student examination achievement The evaluation of each class difference subject teacher, and eliminate non-teacher influence factor when evaluating, so that Evaluation to teacher is more accurate.

Further, examine when the grasp situation of each knowledge point and/or technical ability being included in evaluation of teacher by student The factor considered to the evaluation of teacher more comprehensively.

Accompanying drawing explanation

In order to be illustrated more clearly that the embodiment of the present application or technical scheme of the prior art, below will be to enforcement In example, the required accompanying drawing used is briefly described, it should be apparent that, the accompanying drawing in describing below is only Some embodiments described in the present invention, for those of ordinary skill in the art, it is also possible to according to these Accompanying drawing obtains other accompanying drawing.

Fig. 1 is a kind of flow chart of embodiment of the present invention evaluation of teacher's method；

Fig. 2 is the another kind of flow chart of embodiment of the present invention evaluation of teacher's method；

Fig. 3 is a kind of structural representation of embodiment of the present invention Teacher Evaluation System；

Fig. 4 is the another kind of structural representation of embodiment of the present invention Teacher Evaluation System.

Detailed description of the invention

In order to make those skilled in the art be more fully understood that the scheme of the embodiment of the present invention, below in conjunction with the accompanying drawings With embodiment, the embodiment of the present invention is described in further detail.

For the shortcoming of prior art, the embodiment of the present invention provides a kind of evaluation of teacher's method and system, according to Student examination achievement is automatically performed the evaluation to each class difference subject teacher, and eliminates non-when evaluating Teacher influence factor, so that the evaluation to teacher is more accurate.

Evaluation of teacher's method and system that the embodiment of the present invention provides, both can be in different campus context Each section teacher is evaluated, it is also possible to be evaluated for each section teacher in same campus context.

As it is shown in figure 1, be a kind of flow chart of embodiment of the present invention evaluation of teacher's method, comprise the following steps:

Step 101, obtains each class student examination achievement of each subject examination question and corresponding described examination question.

Described student examination achievement is for the achievement data once taken an examination, and these data are through pre-place Valid data after reason (remove useless even disturb data), such as, filter out be manually entered mistake and point The data etc. that number is too low.

Step 102, carries out difficulty analysis to each subject examination question, obtains each subject item difficulty score.

In actual applications, can be right according to IRT (Item Response Theory, item response theory) Each subject examination question carries out difficulty analysis, obtains difficulty score.

The basic thought of described IRT is: for arbitrary examinee, can one examination question (i.e. project) correctly return Answering the probability of (i.e. reflection), depend on two aspects: one is self-ability, this is subjective factors；Two are By the examination question situation of the index reflections such as difficulty and discrimination, this is objective factor.

Specific in this embodiment, for objective item, answer result can be labeled as 0 and 1,0 expression Answering mistake, 1 represents and answers questions, and obtains answer matrix as IRT mode input, then can estimate based on maximum likelihood Meter Algorithm for Training one-level IRT model.For subjective item, different brackets can be labeled as by answer mark, as One exercise question total score is 10 points, and answer mark divides at 0-3 and is labeled as grade one, and 4-7 divides and is labeled as grade two, 8-10 divides and is labeled as grade three, then uses multistage IRT model to be trained, and IRT model is output as learning (a, b), wherein (a b) represents (examination question for raw parameter θ (representing student's whole capability) and examination question parameter Difficulty, examination question discrimination).

Step 103, each class based on each subject item difficulty score and corresponding described examination question student examination becomes Achievement determines the non-teacher influence factor of each class.

In embodiments of the present invention, can using complete for class section ability as the non-teacher influence factor of described class, Certainly, according to the practical situation of each class of different schools, it is also contemplated that some other factor, this is sent out Bright embodiment does not limits.

The calculating process of full section of each class ability is as follows:

1) based on each subject item difficulty score, each student's Ge Ke purpose total marks of the examination are normalized place Reason, obtains normalized student examination achievement.

Owing to each section purpose item difficulty is different, the total marks of the examination point spread between different subject can be caused bigger. Therefore to it is abnormal to eliminate the total marks of the examination caused because of item difficulty difference, in embodiments of the present invention, permissible By described item difficulty score, each student's Ge Ke purpose total marks of the examination are normalized, obtain normalizing The student examination achievement changed, formula specific as follows:

Wherein, S_{Student p, subject t}Represent student p score on subject t, D_{Subject t}Represent that the examination question of subject t is difficult Degree, typically being all worth to by question difficulty coefficient,It is by the score after item difficulty normalization.

It is of course also possible to from class's level analysis, section each to class purpose average achievement does normalized.

2) in order to avoid major subject and the vice section chief difference impact in full section of statistics class ability in school, need Numerology proofreads each section purpose attention degree.

First, based on the student performance score after above-mentioned normalization, the flat of each school each subject achievement is calculated All scores, are designated as:

Mean_{School s, subject 1},…,Mean_{School s, subject t},…,Mean_{School s, subject T}

Then, numerology proofreads each section purpose attention degree, and the attention degree of subject t is by school s:

In general, certain subject is more paid attention to by school, then these section's purpose total marks of the examination can be the highest.

3) utilize school to each section purpose attention degree normalization student's subject score, eliminate this impact, To full section of each class ability.

Generally, all sections purpose average mark of a class, represent the full section ability of this class, by single Each section of school s single class c divides equally, and is designated as:

Means_{School s, class c, subject 1},…,Means_{School s, class c, subject t},…,Means_{School s, class c, subject T}

In order to eliminate the impact that different subject attention degree differences are brought by school, in embodiments of the present invention, Can according to the following equation (3) calculate class full section ability:

Further, in order to make the most above-mentioned calculating more accurate, it is also possible to remove the singular value in statistical significance, Will be optimized for shown in formula (4) by above-mentioned formula (3):

Wherein, T expression section purpose quantity, " deducting minimax " represents and removes set {Means_{School s, class c, subject t}*(1-E_{School s, subject t}) in maxima and minima.

Step 104, for each subject teacher of each class, according to the non-teacher influence factor of this class Determine the teaching ability of this subject teacher.

Full section ability according to the above-mentioned class calculated, can calculate c section of s class of school as follows The power of influence of mesh t teacher:

Influence_{School s, class c, subject t}

=Means_{School s, class c, subject t}-w₁*Ability_{School s, class c} (5)

Wherein, parameter w₁Measure full section of class's raw score i.e. class ability and calculate teacher with actual score To proportion during class's power of influence, its value is typically between 0 to 1, and concrete value can be according on a small quantity Labeled data training obtains, it is also possible to rule of thumb set.

According to each subject teacher power of influence to Suo Jiao class, teacher's power of influence can be ranked up, more lean on Front teacher is the biggest to the power of influence of class's achievement, and also just the teaching ability of explanation teacher is the strongest.Described teacher Power of influence sequence can be that school of same institute sorts with subject teacher, it is also possible to is that different school is with subject teacher Sequence, its Main Basis practical situations determines.

Evaluation of teacher's method that the embodiment of the present invention provides, is automatically performed each class according to student examination achievement The evaluation of different subject teachers, and eliminate non-teacher influence factor when evaluating, to teacher Evaluation more accurate.

It addition, when carrying out evaluation of teacher, it is also possible to by student's grasp feelings to each knowledge point and/or technical ability Condition is included in the factor considered during evaluation of teacher to the evaluation of teacher more comprehensively.Wherein, knowledge Point is two kinds of different investigation dimensions with technical ability, and a knowledge point can comprise multiple technical ability, and a technical ability also may be used To comprise multiple knowledge point, illustrate in case of only considering knowledge point or one dimension of technical ability below.

As in figure 2 it is shown, be the another kind of flow chart of embodiment of the present invention evaluation of teacher's method, including following step Rapid:

Step 201, obtains each class student examination achievement of each subject examination question and corresponding described examination question.

Step 202, carries out difficulty analysis to each subject examination question, obtains each subject item difficulty score.

Step 203, each class based on each subject item difficulty score and corresponding described examination question student examination becomes Achievement determines the non-teacher influence factor of each class.

Step 204, for each subject teacher of each class, according to the non-teacher influence factor of this class Determine the teaching ability of this subject teacher.

Step 205, calculates each class grasp ability to knowledge point or technical ability.

Detailed process is as follows:

1) knowledge point or the markup information of technical ability in exam pool is obtained.

Described markup information can directly obtain from exam pool, and by Q matrix description knowledge-ID or technical ability Examination situation.

Described Q matrix can be the knowledge-ID once taken an examination or technical ability investigation situation, it is also possible to is repeatedly The knowledge-ID of examination or technical ability investigate situation.For latter event, all data can be combined in one Rise as an examination data.

In described exam pool, the markup information of knowledge point or technical ability can be to use artificial mark with reference to examination outline Mode is labeled, it is also possible to be to use on the basis of the mark of knowledge point or technical ability allows certain error Machine mark, this this case is not construed as limiting.

Described Q matrix is expressed as follows:

Q_{m \times n} = [\begin{matrix} 1 & ... & 0 \\ ... & ... & ... \\ 0 & ... & 1 \end{matrix}]

Wherein, m represents the quantity of examination examination question, and n represents the number of the knowledge point involved by examination question or technical ability Mesh.

2) obtaining test question information, described test question information includes: item difficulty score and examination question score matrix.

Described test question information includes item difficulty score and examination question score matrix, and item difficulty information is by IRT Model obtains, and examination question score information is then obtained by exam pool mark.

Item difficulty score and examination question score matrix are the most as follows:

Wherein,Representing the difficulty of m-th examination question, its span is 0-1, and in this case, exercise question is more difficult to,Value the biggest；Represent the score value of m-th examination question.

3) according to described markup information and described test question information, each class is calculated to knowledge point or the palm of technical ability Hold ability.

The paper examination question scoring event assuming this class student p is:

s_{p} = [\begin{matrix} {av}_{p, I_{1}} \\ ... \\ {av}_{p, I_{m}} \end{matrix}]

Then this student p in the scoring rate on the knowledge point or technical ability j of subject t is:

So, certain class (-1 class of such as A middle school) is in the knowledge point of subject t or the average of technical ability j Rate is:

Step 206, grasps ability subject each to each class teacher's according to each class to knowledge point or technical ability Teaching ability is optimized.

Power of influence according to the above-mentioned class subject t teacher calculated and this class are on knowledge point or technical ability j Scoring rate, calculates subject t teacher to knowledge point or the power of influence of technical ability j:

knowInfluence_{School s, class c, subject t, knowledge point/technical ability j} =Influence_{School s, class c, subject t}+w2*sr_jt (8)

Wherein, parameter w2 has measured teacher to flat on certain knowledge point or technical ability of class's power of influence and class All proportion between scoring rate, concrete value can obtain according to the training of a small amount of labeled data, it is also possible to according to warp Test setting.

According to the teacher calculated to knowledge point or the power of influence of technical ability, can be to same subject teacher in each knowledge Power of influence ranking on point or technical ability, explanation teacher religion on this single knowledge point or technical ability that ranking is the most forward The best；For all knowledge points or technical ability, the power of influence distribution of single teacher can be given, therefrom find Which knowledge point of this teacher or technical ability are taught preferably, and which knowledge point or skill teaching need to improve.

In like manner, the power of influence of knowledge point or technical ability is sorted by described teacher can be that school of same institute is taught with subject Teacher sorts, it is also possible to being that different school sorts with subject teacher, its Main Basis practical situations determines.

If consider student's grasp situation to knowledge point and technical ability simultaneously, when teacher is evaluated, can Respectively teacher's power of influence on knowledge point and technical ability is made an appraisal, it is also possible to based on teacher in knowledge point With the overall merit that the power of influence in technical ability makes teacher's capacity.Described integrated evaluating method can be that weighting is asked With, and its weights can rule of thumb, actual application scenarios is set, it is also possible to be additive method, right This this case is not construed as limiting.

It should be noted that in actual applications, above two evaluation of teacher (comprehensive and careful) mode can To be individually given, it is also possible to be given simultaneously, depending on practical situations.

Correspondingly, the embodiment of the present invention also provides for a kind of Teacher Evaluation System, as it is shown on figure 3, be this system A kind of structural representation.

In this embodiment, described system includes:

Data obtaining module 301, examines for obtaining each class student of each subject examination question and corresponding described examination question Examination achievement；

Difficulty analyzes module 302, for each subject examination question is carried out difficulty analysis, obtains each subject examination question difficult Degree score；

Non-teacher influence factor determines module 303, for described based on each subject item difficulty score and correspondence Each class student examination achievement of examination question determines the non-teacher influence factor of each class；

Evaluation module 304, for each subject teacher for each class, according to the non-teacher of this class Influence factor determines the teaching ability of this subject teacher.

Above-mentioned difficulty is analyzed module 302 and specifically can be utilized IRT model that each subject examination question is carried out difficulty analysis, Obtain each subject item difficulty score.

As a example by using full section of class ability as the non-teacher influence factor of described class, non-teacher influence factor is true A kind of corresponding construction of cover half block 303 can include following unit:

The concrete calculating process of relevant parameter be can refer to above in the inventive method embodiment by above-mentioned each unit Description, do not repeat them here.

The Teacher Evaluation System that the embodiment of the present invention provides, is automatically performed each class according to student examination achievement The evaluation of different subject teachers, and eliminate non-teacher influence factor when evaluating, to teacher Evaluation more accurate.

It addition, when carrying out evaluation of teacher, it is also possible to by student's grasp feelings to each knowledge point and/or technical ability Condition is included in the factor considered during evaluation of teacher to the evaluation of teacher more comprehensively.

As shown in Figure 4, it is the another kind of structural representation of embodiment of the present invention Teacher Evaluation System.

Difference with embodiment illustrated in fig. 3 is, in this embodiment, described system also includes:

Computing module 401, for calculating each class grasp ability to knowledge point and/or technical ability；

Optimize module 402, for each to each class to the grasp ability of knowledge point and/or technical ability according to each class The teaching ability of subject teacher is optimized.

A kind of concrete structure of described computing module 401 includes following unit:

Computing unit, for according to described markup information and described test question information, calculates each class to knowledge point And/or the grasp ability of technical ability, concrete calculating process can be found in the description in above the inventive method embodiment, Do not repeat them here.

The Teacher Evaluation System of the embodiment of the present invention, not remove only non-teacher influence factor when evaluating, and And the grasp situation of each knowledge point and/or technical ability is included in by student to the factor considered during evaluation of teacher, Make the evaluation to teacher more comprehensively.

Each embodiment in this specification all uses the mode gone forward one by one to describe, phase homophase between each embodiment As part see mutually, what each embodiment stressed is the difference with other embodiments. For system embodiment, owing to it is substantially similar to embodiment of the method, so describing to compare Simply, relevant part sees the part of embodiment of the method and illustrates.System embodiment described above is only Being only illustrative, the wherein said unit illustrated as separating component can be or may not be physics Upper separate, the parts shown as unit can be or may not be physical location, i.e. may be located at One place, or can also be distributed on multiple NE.Can select wherein according to the actual needs Some or all of module realize the purpose of the present embodiment scheme.Those of ordinary skill in the art are not paying In the case of going out creative work, i.e. it is appreciated that and implements.

Being described in detail the embodiment of the present invention above, detailed description of the invention used herein is to this Bright being set forth, the explanation of above example is only intended to help to understand the method and system of the present invention；With Time, for one of ordinary skill in the art, according to the thought of the present invention, in detailed description of the invention and application All will change in scope, in sum, this specification content should not be construed as limitation of the present invention.

Claims

1. evaluation of teacher's method, it is characterised in that including:

Method the most according to claim 1, it is characterised in that described each subject examination question is carried out difficulty Degree is analyzed, and obtains each subject item difficulty score and includes:

Method the most according to claim 1, it is characterised in that described based on each subject item difficulty Each class student examination achievement of score and corresponding described examination question determines the non-teacher influence factor bag of each class Include:

4. according to the method described in any one of claims 1 to 3, it is characterised in that described method is also wrapped Include:

Method the most according to claim 4, it is characterised in that each class of described calculating is to knowledge point And/or the grasp ability of technical ability includes:

6. a Teacher Evaluation System, it is characterised in that including:

System the most according to claim 6, it is characterised in that

Described difficulty analyzes module, specifically for utilizing IRT model that each subject examination question is carried out difficulty analysis, Obtain each subject item difficulty score.

System the most according to claim 6, it is characterised in that described non-teacher influence factor determines Module includes:

9. according to the system described in any one of claim 6 to 8, it is characterised in that described system is also wrapped Include:

System the most according to claim 9, it is characterised in that described computing module includes: