CN109711371A - A kind of Estimating System of Classroom Teaching based on human facial expression recognition - Google Patents

A kind of Estimating System of Classroom Teaching based on human facial expression recognition Download PDF

Info

Publication number
CN109711371A
CN109711371A CN201811639123.4A CN201811639123A CN109711371A CN 109711371 A CN109711371 A CN 109711371A CN 201811639123 A CN201811639123 A CN 201811639123A CN 109711371 A CN109711371 A CN 109711371A
Authority
CN
China
Prior art keywords
expression
time
student
teacher
teaching
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN201811639123.4A
Other languages
Chinese (zh)
Inventor
李国琛
王立峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong Xu Xing Network Technology Co Ltd
Original Assignee
Shandong Xu Xing Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong Xu Xing Network Technology Co Ltd filed Critical Shandong Xu Xing Network Technology Co Ltd
Priority to CN201811639123.4A priority Critical patent/CN109711371A/en
Publication of CN109711371A publication Critical patent/CN109711371A/en
Withdrawn legal-status Critical Current

Links

Abstract

The invention discloses a kind of Estimating System of Classroom Teaching based on human facial expression recognition, including monitoring module, face monitoring modular, expression library, database, data analysis module, timing unit, achievement acquisition module, processor, display module, memory module, data interaction unit and the mutual moved end of teacher;The mutual moved end of teacher includes sub-controller, cue module, display, input module and recording unit;The monitoring module is constituted by the indoor several cameras of religion are arranged in;The present invention monitors the image data in classroom of upper class hour in real time by monitoring module, and image data is analyzed by face monitoring modular, changes in emotional of the perception student in classroom is analyzed by micro- Expression Recognition technology, reflect that student to the interest-degree of instant classroom instruction, realizes quick, full automatic classroom teaching evaluation.

Description

A kind of Estimating System of Classroom Teaching based on human facial expression recognition
Technical field
The invention belongs to teaching evaluation fields, are related to a kind of human facial expression recognition technology, specifically a kind of based on facial table The Estimating System of Classroom Teaching of feelings identification.
Background technique
Expression Recognition, which refers to, isolates specific emotional state from given still image or dynamic video sequence, thus Determine the mental emotion of identified object.
With the fast development of computer technology and artificial intelligence technology and its related discipline, the automation journey of entire society Degree is continuously improved, and demand of the people to the human-computer interaction of people and people's exchange way is similar to is increasingly strong.Computer and robot If can have the ability for understanding and showing emotion as the mankind, it will fundamentally change the pass between people and computer System enables a computer to preferably service for the mankind.Expression Recognition is the basis of affective comprehension, is computer understanding people's emotion Premise and people explore and understand intelligence effective way.
Facial expression recognition, which refers to, isolates specific emotional state from given still image or dynamic video sequence, So that it is determined that the mental emotion of identified object, realizes understanding and identification of the computer to human face expression, fundamentally changes people With the relationship of computer, to reach better human-computer interaction.Therefore facial expression recognition is in psychology, intelligent robot, intelligence There is very big potential using value in the fields such as energy monitoring, virtual reality and synthesis animation.
And it is current with the development of technology, Expression Recognition this technology also slowly be referred to other field;And it educates It is the current universal focus of people, for student performance, the teaching method and content of teacher can also play student very big It influences, whether conscientiously only can probably determine only according to achievement currently for student;So for the quality of instruction of teacher, Multiple angles may be needed to go to determine;Currently we then it is hoped that there will be one kind to be understood on student in real time by Expression Recognition technology Class state forms a good system evaluated for teachers ' teaching quality in combination with other factors;In order to realize Above-mentioned conception, now provides a solution.
Summary of the invention
The purpose of the present invention is to provide a kind of Estimating System of Classroom Teaching based on human facial expression recognition.
The technical problems to be solved by the invention are as follows:
(1) how to classify to the expression of attending class of student, these expressions for the content of courses reaction why sample;
(2) how all kinds of real-time expressions that basis is attended class make evaluation to the quality of instruction of teacher.
The purpose of the present invention can be achieved through the following technical solutions:
A kind of Estimating System of Classroom Teaching based on human facial expression recognition, including monitoring module, face monitoring modular, expression Library, database, data analysis module, timing unit, achievement obtain module, processor, display module, memory module, data and hand over Mutual unit and the mutual moved end of teacher;
Wherein, the mutual moved end of the teacher includes sub-controller, cue module, display, input module and recording unit;
Wherein, the monitoring module is constituted by the indoor several cameras of religion are arranged in, for obtaining upper class hour in classroom Real-time imaging data, the database purchase has the total data of face and curriculum information of all students of class;The total data of face For the face data of all students of the class;Curriculum information is course and corresponding teacher;
The monitoring module is used to image data being transferred to face monitoring modular;
Wherein, the expression library prestores the expression library of listening to the teacher of student, and the expression library of listening to the teacher includes being greater than certain amount Two major classes expression sample when listening to the teacher;Two major classes expression sample specifically:
A: class of actively listening to the teacher, class of actively listening to the teacher expression are to understand expression and listen attentively to expression;
A1: understanding that expression is that student understands the generally reaction of course, when student understands Current Content or itself can Positive participates in education activities, such as answer a question and participate in discussion in situation when can betray and understand expression, acquisition is big Sample database is formed in a certain number of expression samples;
A2: listening attentively to expression is normal expression of the student when listening to the teacher, and when student is interested in the content of courses, is ready to listen teacher It says class hour, the expression listened attentively to can be betrayed, acquisition is greater than a certain number of expression samples and forms sample database;
B: passiveness is listened to the teacher class, and passiveness class expression of listening to the teacher includes doubt expression and resists expression;
B1: doubt expression does not understand the content of courses for student and there are when query, can betray query expression;
B2: resisting expression is that student feels the excessively difficult human-subject test beyond oneself of the content of courses, too simple Or when loseing interest in learning Content, resistance expression can be betrayed;
The face monitoring modular is also used to the stage at school and expression library and timing unit is combined to carry out image data Student's focus is analyzed, and steps are as follows for concrete analysis:
Step 1: the real-time expression of all students is got;
Step 2: the real-time expression of student is compared with expression library;
Step 3: it gets each student and occurs understanding expression, listen attentively to expression, doubt expression and resisting expression on course The time accounting of respective expression;Specific obtaining step are as follows:
S1: any student is obtained;
S2: and select any subject;
S3: total course time of the course is obtained;
S4: obtaining the student and correspond to the subject and the understanding time for understanding expression occur, it will be understood that the time is divided by total course Time is understood the understanding time accounting of expression appearance;
S5: obtain that the student corresponds to that expression occurs listening attentively in the subject listens attentively to the time, will listen attentively to the time divided by total course What the time obtained listening attentively to expression appearance listens attentively to time accounting;
S6: obtaining the student and correspond to the subject and the doubt time of doubt expression occur, and the time that will feel uncertain is divided by total course Time obtains the doubt time accounting of doubt expression appearance;
S7: obtaining the student and correspond to the resistance time that resistance expression occurs in the subject, will resist the time divided by total course Time obtains resisting the resistance time accounting that expression occurs;
S8: selected lower a branch of instruction in school repeats step S3-S7, until obtaining all kinds of expressions that all courses of the student occur Time accounting;
S9: it selectes next student and repeats step S2-S8 until obtaining all kinds of tables that all students occur on all courses The time accounting of feelings;
SS1: it will be understood that time accounting is labeled as Qij, i=1...m, j=1...n;Qij is expressed as corresponding student i in class Understanding time accounting when journey j;
SS2: will listen attentively to time accounting and be labeled as Pij, i=1...m, j=1...n;Pij is expressed as corresponding student i in class Time accounting is listened attentively to when journey j;
SS3: the time accounting that will feel uncertain is labeled as Hij, i=1...m, j=1...n;Hij is expressed as corresponding student i in class Doubt time accounting when journey j;
SS4: will resist time accounting and be labeled as Kij, i=1...m, j=1...n;Kij is expressed as corresponding student i in class Resistance time accounting when journey j;
The face monitoring modular is used to for student each expression time accounting Qij, Pij, Hij and Kij to be transferred to data point Analyse module;The data analysis module is used to that Qij, Pij, Hij and Kij to be combined to count teachers ' classroom teaching, statistic procedure It is as follows:
Step 1: Qij, Pij, Hij and Kij are got;
Step 2: because appearance of attending class is felt uncertain, time and resistance time are different on the influence of class-teaching of teacher quality, therefore here Correction value is added to calculate the passive teaching rate W1j that different courses correspond to teacher;Utilize formulaX1+X2=1, wherein X2 > X1, and X1 and X2 It is preset value;The passive teaching rate W1j of the corresponding teacher of course j is calculated;
Step 3: because attend class occur listening attentively to the time with understand that the time is different on the influence of class-teaching of teacher quality, therefore here Correction value is added to calculate the positive teaching rate W2j that different courses correspond to teacher;Utilize formulaX1 > X2, X1+X2=1, and X1 and X2 are Preset value;The positive teaching rate W2j of the corresponding teacher of course j is calculated;
The data analysis module is used to passive teaching rate W1j and positive teaching rate W2j being transferred to processor, the place Reason device is used to for passive teaching rate W1j and positive teaching rate W2j being transferred to display and memory module, and the display is for real When show passiveness teaching rate W1j and positive teaching rate W2j, the memory module is used for according to passive teaching rate W1j and actively religion Rate W2j combines corresponding teacher that the two data fusion is formed teaching record and real-time storage.
Further, the processor is also used to passive teaching rate W1j and positive teaching rate through data interaction unit W2j is transferred to sub-controller, and the sub-controller is used to mention when passive teaching rate W1j is more than preset value to cue module transmission Show signal, the cue module can issue prompt when receiving the standby signal of sub-controller transmission automatically;
The sub-controller is for passive teaching rate W1j and positive teaching rate W2j to be transferred to display and be shown in real time Show;The sub-control system is also used to for passive teaching rate W1j and positive teaching rate W2j being transferred to recording unit and forms teaching record.
Further, the input module be used for the input monitoring period, monitoring the period be test teachers ' teaching quality when Between the stage;The input module will be for that will monitor periodic transfer to sub-controller, and the sub-controller is for passing through data interaction Unit will monitor periodic transfer to processor, and the processor will be for that will monitor periodic transfer to face detection module.
Beneficial effects of the present invention:
(1) present invention prestores the expression library of listening to the teacher of student by the expression library, and expression of listening to the teacher library includes being greater than centainly Two major classes expression sample when listening to the teacher of quantity, and specifically expression is divided into and understands expression, listen attentively to expression, doubt expression and resistance Expression;Understand that expression is that student understands the generally reaction of course, when student understands Current Content or itself can be positive Participate in education activities, such as answer a question and participate in discussion in situation when can betray and understand expression, acquisition is greater than certain The expression sample of quantity forms sample database;Listening attentively to expression is normal expression of the student when listening to the teacher, when student is to content of courses sense Interest is ready that teacher is listened to say class hour, can betray the expression listened attentively to, acquire and be greater than a certain number of expression samples formation sample Library;Doubt expression does not understand the content of courses for student and there are when query, can betray query expression;Resistance expression is student Feel the excessively difficult human-subject test beyond oneself of the content of courses, too simple or when loseing interest in learning Content, meeting Betray resistance expression;To obtain a series of corresponding reaction of student's expressions;
(2) present invention carries out processing analysis to Qij, Pij, Hij and Kij by data analysis module combination dependency rule, And the corresponding passiveness teaching rate W1j and positive teaching rate W2j of every subject is calculated by correlation formula, and pass through passive religion Rate and positive teaching rate evaluate the teaching of teacher.
Detailed description of the invention
In order to facilitate the understanding of those skilled in the art, the present invention will be further described below with reference to the drawings.
Fig. 1 is system block diagram of the invention.
Specific embodiment
As shown in Figure 1, a kind of Estimating System of Classroom Teaching based on human facial expression recognition, as the embodiment of the present invention One: obtaining mould including monitoring module, face monitoring modular, expression library, database, data analysis module, timing unit, achievement Block, processor, display module, memory module, data interaction unit and the mutual moved end of teacher;
Wherein, the mutual moved end of the teacher includes sub-controller, cue module, display, input module and recording unit;
Wherein, the monitoring module is constituted by the indoor several cameras of religion are arranged in, for obtaining upper class hour in classroom Real-time imaging data, the database purchase has the total data of face and curriculum information of all students of class;The total data of face For the face data of all students of the class;Curriculum information is course and corresponding teacher;
The monitoring module is used to image data being transferred to face monitoring modular;
Wherein, the expression library prestores the expression library of listening to the teacher of student, and the expression library of listening to the teacher includes being greater than certain amount Two major classes expression sample when listening to the teacher;Two major classes expression sample specifically:
A: class of actively listening to the teacher, class of actively listening to the teacher expression are to understand expression and listen attentively to expression;
A1: understanding that expression is that student understands the generally reaction of course, when student understands Current Content or itself can Positive participates in education activities, such as answer a question and participate in discussion in situation when can betray and understand expression, acquisition is big Sample database is formed in a certain number of expression samples;
A2: listening attentively to expression is normal expression of the student when listening to the teacher, and when student is interested in the content of courses, is ready to listen teacher It says class hour, the expression listened attentively to can be betrayed, acquisition is greater than a certain number of expression samples and forms sample database;
B: passiveness is listened to the teacher class, and passiveness class expression of listening to the teacher includes doubt expression and resists expression;
B1: doubt expression does not understand the content of courses for student and there are when query, can betray query expression;
B2: resisting expression is that student feels the excessively difficult human-subject test beyond oneself of the content of courses, too simple Or when loseing interest in learning Content, resistance expression can be betrayed;
The face monitoring modular is also used to the stage at school and expression library and timing unit is combined to carry out image data Student's focus is analyzed, and steps are as follows for concrete analysis:
Step 1: the real-time expression of all students is got;
Step 2: the real-time expression of student is compared with expression library;
Step 3: it gets each student and occurs understanding expression, listen attentively to expression, doubt expression and resisting expression on course The time accounting of respective expression;Specific obtaining step are as follows:
S1: any student is obtained;
S2: and select any subject;
S3: total course time of the course is obtained;
S4: obtaining the student and correspond to the subject and the understanding time for understanding expression occur, it will be understood that the time is divided by total course Time is understood the understanding time accounting of expression appearance;
S5: obtain that the student corresponds to that expression occurs listening attentively in the subject listens attentively to the time, will listen attentively to the time divided by total course What the time obtained listening attentively to expression appearance listens attentively to time accounting;
S6: obtaining the student and correspond to the subject and the doubt time of doubt expression occur, and the time that will feel uncertain is divided by total course Time obtains the doubt time accounting of doubt expression appearance;
S7: obtaining the student and correspond to the resistance time that resistance expression occurs in the subject, will resist the time divided by total course Time obtains resisting the resistance time accounting that expression occurs;
S8: selected lower a branch of instruction in school repeats step S3-S7, until obtaining all kinds of expressions that all courses of the student occur Time accounting;
S9: it selectes next student and repeats step S2-S8 until obtaining all kinds of tables that all students occur on all courses The time accounting of feelings;
SS1: it will be understood that time accounting is labeled as Qij, i=1...m, j=1...n;Qij is expressed as corresponding student i in class Understanding time accounting when journey j;
SS2: will listen attentively to time accounting and be labeled as Pij, i=1...m, j=1...n;Pij is expressed as corresponding student i in class Time accounting is listened attentively to when journey j;
SS3: the time accounting that will feel uncertain is labeled as Hij, i=1...m, j=1...n;Hij is expressed as corresponding student i in class Doubt time accounting when journey j;
SS4: will resist time accounting and be labeled as Kij, i=1...m, j=1...n;Kij is expressed as corresponding student i in class Resistance time accounting when journey j;
The face monitoring modular is used to for student each expression time accounting Qij, Pij, Hij and Kij to be transferred to data point Analyse module;The data analysis module is used to that Qij, Pij, Hij and Kij to be combined to count teachers ' classroom teaching, statistic procedure It is as follows:
Step 1: Qij, Pij, Hij and Kij are got;
Step 2: because appearance of attending class is felt uncertain, time and resistance time are different on the influence of class-teaching of teacher quality, therefore here Correction value is added to calculate the passive teaching rate W1j that different courses correspond to teacher;Utilize formulaX1+X2=1, wherein X2 > X1, and X1 and X2 It is preset value;The passive teaching rate W1j of the corresponding teacher of course j is calculated;
Step 3: because attend class occur listening attentively to the time with understand that the time is different on the influence of class-teaching of teacher quality, therefore here Correction value is added to calculate the positive teaching rate W2j that different courses correspond to teacher;Utilize formulaX1 > X2, X1+X2=1, and X1 and X2 are Preset value;The positive teaching rate W2j of the corresponding teacher of course j is calculated;
The data analysis module is used to passive teaching rate W1j and positive teaching rate W2j being transferred to processor, the place Reason device is used to for passive teaching rate W1j and positive teaching rate W2j being transferred to display and memory module, and the display is for real When show passiveness teaching rate W1j and positive teaching rate W2j, the memory module is used for according to passive teaching rate W1j and actively religion Rate W2j combines corresponding teacher that the two data fusion is formed teaching record and real-time storage.
As the embodiment of the present invention two: including monitoring module, face monitoring modular, expression library, database, data analysis Module, timing unit, achievement obtain module, processor, display module, memory module, data interaction unit and the mutual moved end of teacher;
Wherein, the mutual moved end of the teacher includes sub-controller, cue module, display, input module and recording unit;
Wherein, the monitoring module is constituted by the indoor several cameras of religion are arranged in, for obtaining upper class hour in classroom Real-time imaging data, the database purchase has asking for leave for the total data of face of all students of class, curriculum information and student Information;The total data of face is the face data of all students of the class;Curriculum information is course and corresponding teacher;It asks for leave packet It includes and asks for leave the time and ask dummy, false information and the face data of student is asked to correspond;
The monitoring module is used to for image data being transferred to face monitoring modular, and the face monitoring modular receives monitoring The image data of module transfer simultaneously carries out roll-call operation in combined data library, specific steps are as follows:
Step 1: getting the image data in the monitoring period, and is therefrom truncated to all in the people for learning student in classroom Face information;
Step 2: the total data of face for all students that face information and databases are stored up is compared, is obtained To the face information not occurred and it is marked as absent pupils;
Step 3: absent pupils are compared with false information is asked, weed out the student that asks for leave in absent pupils;
Step 4: the absent pupils after student that rejecting is asked for leave are labeled as the student that plays truant;Obtain the student couple that plays truant at this time The curriculum information that should be played truant;The curriculum information that student and correspondence are played truant that will play truant forms record of playing truant;
Step 5: the rate of playing truant that each subject corresponds to student, calculation method are got are as follows:
S1: an optional student;
S2: and select any subject;
S3: the corresponding selected course of the student is got in total course number in monitoring period;
S4: the course number that the corresponding selected course of the student is played truant is got, course number is obtained into divided by total course number The rate of playing truant of the raw corresponding course;
S5: optional next course repeats play truant rate of the step S3-S4 until obtaining all courses of the student;
S6: optional next student repeats step S2-S5 and directly acquires the rate of playing truant that all students correspond to all courses;
S7: the corresponding student of curriculum information is played truant into rate labeled as Tij, i=1...m, j=1...n;Tij is expressed as learning The corresponding course j of life i plays truant rate as Tij;
The face detection module is used to detect that the student that can will play truant when playing truant student is transferred to processor, the place Reason device is used to be transferred to sub-controller by the data interaction unit student that will play truant, and the sub-controller receives data interaction list Student's Shi Huixiang cue module transmission alerting signal of playing truant of member transmission, the cue module receive the prompting of sub-controller transmission Prompting can be issued when signal;The sub-controller be also used to play truant student be transferred to display carry out real-time display;
The face monitoring modular is used to the student rate Tij that plays truant being transferred to data analysis module;
Wherein, the expression library prestores the expression library of listening to the teacher of student, and the expression library of listening to the teacher includes being greater than certain amount Two major classes expression sample when listening to the teacher, certain amount can be greater than 10,000 kinds expression samples;Two major classes expression sample is specific Are as follows:
A: class of actively listening to the teacher, class of actively listening to the teacher expression are to understand expression and listen attentively to expression;
A1: understanding that expression is that student understands the generally reaction of course, when student understands Current Content or itself can Positive participates in education activities, such as answer a question and participate in discussion in situation when can betray and understand expression, acquisition is big Sample database is formed in a certain number of expression samples;
A2: listening attentively to expression is normal expression of the student when listening to the teacher, and when student is interested in the content of courses, is ready to listen teacher It says class hour, the expression listened attentively to can be betrayed, acquisition is greater than a certain number of expression samples and forms sample database;
B: passiveness is listened to the teacher class, and passiveness class expression of listening to the teacher includes doubt expression and resists expression;
B1: doubt expression does not understand the content of courses for student and there are when query, can betray query expression;
B2: resisting expression is that student feels the excessively difficult human-subject test beyond oneself of the content of courses, too simple Or when loseing interest in learning Content, resistance expression can be betrayed;
The face monitoring modular is also used to the stage at school and expression library and timing unit is combined to carry out image data Student's focus is analyzed, and steps are as follows for concrete analysis:
Step 1: the real-time expression of all students is got;
Step 2: the real-time expression of student is compared with expression library;
Step 3: it gets each student and occurs understanding expression, listen attentively to expression, doubt expression and resisting expression on course The time accounting of respective expression;Specific obtaining step are as follows:
S1: any student is obtained;
S2: and select any subject;
S3: total course time of the course is obtained;
S4: obtaining the student and correspond to the subject and the understanding time for understanding expression occur, it will be understood that the time is divided by total course Time is understood the understanding time accounting of expression appearance;
S5: obtain that the student corresponds to that expression occurs listening attentively in the subject listens attentively to the time, will listen attentively to the time divided by total course What the time obtained listening attentively to expression appearance listens attentively to time accounting;
S6: obtaining the student and correspond to the subject and the doubt time of doubt expression occur, and the time that will feel uncertain is divided by total course Time obtains the doubt time accounting of doubt expression appearance;
S7: obtaining the student and correspond to the resistance time that resistance expression occurs in the subject, will resist the time divided by total course Time obtains resisting the resistance time accounting that expression occurs;
S8: selected lower a branch of instruction in school repeats step S3-S7, until obtaining all kinds of expressions that all courses of the student occur Time accounting;
S9: it selectes next student and repeats step S2-S8 until obtaining all kinds of tables that all students occur on all courses The time accounting of feelings;
SS1: it will be understood that time accounting is labeled as Qij, i=1...m, j=1...n;Qij is expressed as corresponding student i in class Understanding time accounting when journey j;
SS2: will listen attentively to time accounting and be labeled as Pij, i=1...m, j=1...n;Pij is expressed as corresponding student i in class Time accounting is listened attentively to when journey j;
SS3: the time accounting that will feel uncertain is labeled as Hij, i=1...m, j=1...n;Hij is expressed as corresponding student i in class Doubt time accounting when journey j;
SS4: will resist time accounting and be labeled as Kij, i=1...m, j=1...n;Kij is expressed as corresponding student i in class Resistance time accounting when journey j;
The face monitoring modular is used to for student each expression time accounting Qij, Pij, Hij and Kij to be transferred to data point Analyse module;The data analysis module is used to that Tij, Qij, Pij, Hij and Kij to be combined to count teachers ' classroom teaching, counts Steps are as follows:
Step 1: Tij, Qij, Pij, Hij and Kij are got;
Step 2: because rate of playing truant, appearance of attending class are felt uncertain, time and resistance time influence class-teaching of teacher quality different, therefore Correction value is added to calculate the passive teaching rate W1j that different courses correspond to teacher;Utilize formulaX1+X2+X3=1, wherein X3 > X2 > X1, and X1, X2 and X3 are preset value;The passive teaching rate W1j of the corresponding teacher of course j is calculated;
Step 3: because attend class occur listening attentively to the time with understand that the time is different on the influence of class-teaching of teacher quality, therefore here Correction value is added to calculate the positive teaching rate W2j that different courses correspond to teacher;Utilize formulaX1 > X2, X1+X2=1, and X1 and X2 are Preset value;The positive teaching rate W2j of the corresponding teacher of course j is calculated;
The data analysis module is used to passive teaching rate W1j and positive teaching rate W2j being transferred to processor, the place Reason device is used to for passive teaching rate W1j and positive teaching rate W2j being transferred to display and memory module, and the display is for real When show passiveness teaching rate W1j and positive teaching rate W2j, the memory module is used for according to passive teaching rate W1j and actively religion Rate W2j combines corresponding teacher that the two data fusion is formed teaching record and real-time storage;
The processor is also used to be transferred to passive teaching rate W1j and positive teaching rate W2j by data interaction unit Sub-controller, the sub-controller are used to transmit standby signal, institute to cue module when passive teaching rate W1j is more than preset value Prompt can be issued automatically by stating when cue module receives the standby signal of sub-controller transmission;
The sub-controller is for passive teaching rate W1j and positive teaching rate W2j to be transferred to display and be shown in real time Show;The sub-control system is also used to for passive teaching rate W1j and positive teaching rate W2j being transferred to recording unit and forms teaching record.
The input module is used for the input monitoring period, and the monitoring period is the time phase for testing teachers ' teaching quality;Institute Input module is stated for periodic transfer will to be monitored to sub-controller, the sub-controller is used to monitor by data interaction unit Periodic transfer is to processor, and the processor will be for that will monitor periodic transfer to face detection module.
A kind of Estimating System of Classroom Teaching based on human facial expression recognition, it is at work, real-time by monitoring module first The teaching affairs in classroom of upper class hour are obtained, the student's facial information stored up later according to face recognition and databases compares The case where obtaining student absent from school, and the student that plays truant is determined in conjunction with dependency rule, each student is calculated and corresponds to different courses Rate of playing truant;Each student corresponds to all kinds of definition tables of different courses appearance when being got at school by face monitoring modular later The time of feelings obtains this four groups of data of Qij, Pij, Hij and Kij in combination with dependency rule, finally utilizes data analysis module The passive teaching rate W1j and positive teaching rate W2j that every a branch of instruction in school corresponds to teacher is calculated in conjunction with correlation formula, passes through passiveness Teaching rate and positive teaching rate carry out judge analysis to teachers ' teaching quality.
Beneficial effects of the present invention are as follows:
(1) real-time imaging data in classroom when the present invention is attended class by monitoring module real time monitoring in example 2, And image data is analyzed by face monitoring modular, absent student is acquired by face alignment technology, later Absent student is compared with the student that asks for leave, later by student that is absent and not asking for leave labeled as the student that plays truant, and is combined All courses calculate the rate of playing truant that student corresponds to the subject with the course played truant;
(2) present invention prestores the expression library of listening to the teacher of student by the expression library, and expression of listening to the teacher library includes being greater than centainly Two major classes expression sample when listening to the teacher of quantity, and specifically expression is divided into and understands expression, listen attentively to expression, doubt expression and resistance Expression;Understand that expression is that student understands the generally reaction of course, when student understands Current Content or itself can be positive Participate in education activities, such as answer a question and participate in discussion in situation when can betray and understand expression, acquisition is greater than certain The expression sample of quantity forms sample database;Listening attentively to expression is normal expression of the student when listening to the teacher, when student is to content of courses sense Interest is ready that teacher is listened to say class hour, can betray the expression listened attentively to, acquire and be greater than a certain number of expression samples formation sample Library;Doubt expression does not understand the content of courses for student and there are when query, can betray query expression;Resistance expression is student Feel the excessively difficult human-subject test beyond oneself of the content of courses, too simple or when loseing interest in learning Content, meeting Betray resistance expression;To obtain a series of corresponding reaction of student's expressions;
(3) present invention by data analysis module combination dependency rule to Qij, Pij, Hij and Kij or Tij, Qij, These factors of Pij, Hij and Kij carry out processing analysis, and the corresponding passive religion of every subject is calculated by correlation formula Rate W1j and positive teaching rate W2j, and the teaching of teacher is evaluated by passive teaching rate and positive teaching rate.
Above content is only to structure of the invention example and explanation, affiliated those skilled in the art couple Described specific embodiment does various modifications or additions or is substituted in a similar manner, without departing from invention Structure or beyond the scope defined by this claim, is within the scope of protection of the invention.

Claims (3)

1. a kind of Estimating System of Classroom Teaching based on human facial expression recognition, which is characterized in that monitored including monitoring module, face Module, expression library, database, data analysis module, timing unit, achievement obtain module, processor, display module, storage mould Block, data interaction unit and the mutual moved end of teacher;
Wherein, the mutual moved end of the teacher includes sub-controller, cue module, display, input module and recording unit;
Wherein, the monitoring module is constituted by the indoor several cameras of religion are arranged in, for obtaining the reality of upper class hour in classroom When image data, the database purchase has the total data of face and curriculum information of all students of class;The total data of face is should The face data of all students of class;Curriculum information is course and corresponding teacher;
The monitoring module is used to image data being transferred to face monitoring modular;
Wherein, the expression library prestores the expression library of listening to the teacher of student, and the expression library of listening to the teacher includes being greater than a certain number of tins The two major classes expression sample of class hour;Two major classes expression sample specifically:
A: class of actively listening to the teacher, class of actively listening to the teacher expression are to understand expression and listen attentively to expression;
A1: understanding that expression is that student understands the generally reaction of course, when student understands Current Content or itself can be positive Participate in education activities, such as answer a question and participate in discussion in situation when can betray and understand expression, acquisition is greater than one The expression sample of fixed number amount forms sample database;
A2: listening attentively to expression is normal expression of the student when listening to the teacher, and when student is interested in the content of courses, is ready that teacher is listened to teach When, the expression listened attentively to can be betrayed, acquisition is greater than a certain number of expression samples and forms sample database;
B: passiveness is listened to the teacher class, and passiveness class expression of listening to the teacher includes doubt expression and resists expression;
B1: doubt expression does not understand the content of courses for student and there are when query, can betray query expression;
B2: resisting expression is that student feels the excessively difficult human-subject test beyond oneself of the content of courses, too simple or right When learning Content is lost interest in, resistance expression can be betrayed;
The face monitoring modular is also used to the stage at school and expression library and timing unit is combined to carry out student to image data Focus is analyzed, and steps are as follows for concrete analysis:
Step 1: the real-time expression of all students is got;
Step 2: the real-time expression of student is compared with expression library;
Step 3: it gets each student and occurs understanding expression on course, listens attentively to expression, doubt expression and resist expression respectively The time accounting of expression;Specific obtaining step are as follows:
S1: any student is obtained;
S2: and select any subject;
S3: total course time of the course is obtained;
S4: obtaining the student and correspond to the subject and the understanding time for understanding expression occur, it will be understood that the time is divided by total course time It is understood the understanding time accounting of expression appearance;
S5: obtain that the student corresponds to that expression occurs listening attentively in the subject listens attentively to the time, will listen attentively to the time divided by total course time Obtain listening attentively to expression appearance listens attentively to time accounting;
S6: obtaining the student and correspond to the subject and the doubt time of doubt expression occur, and the time that will feel uncertain is divided by total course time Obtain the doubt time accounting of doubt expression appearance;
S7: obtaining the student and correspond to the resistance time that resistance expression occurs in the subject, will resist the time divided by total course time It obtains resisting the resistance time accounting that expression occurs;
S8: selected lower a branch of instruction in school repeats step S3-S7, until obtaining the time for all kinds of expressions that all courses of the student occur Accounting;
S9: it selectes next student and repeats step S2-S8 until obtaining all kinds of expressions that all students occur on all courses Time accounting;
SS1: it will be understood that time accounting is labeled as Qij, i=1...m, j=1...n;Qij is expressed as corresponding student i in course j When understanding time accounting;
SS2: will listen attentively to time accounting and be labeled as Pij, i=1...m, j=1...n;Pij is expressed as corresponding student i in course j When listen attentively to time accounting;
SS3: the time accounting that will feel uncertain is labeled as Hij, i=1...m, j=1...n;Hij is expressed as corresponding student i in course j When doubt time accounting;
SS4: will resist time accounting and be labeled as Kij, i=1...m, j=1...n;Kij is expressed as corresponding student i in course j When resistance time accounting;
The face monitoring modular is used to for student each expression time accounting Qij, Pij, Hij and Kij being transferred to data analysis mould Block;The data analysis module is used to that Qij, Pij, Hij and Kij to be combined to count teachers ' classroom teaching, and statistic procedure is as follows:
Step 1: Qij, Pij, Hij and Kij are got;
Step 2: because appearance of attending class is felt uncertain, time and resistance time are different on the influence of class-teaching of teacher quality, therefore are added Correction value calculates the passive teaching rate W1j that different courses correspond to teacher;Utilize formulaWherein X2 > X1, and X1 and X2 is preset value;The passive teaching rate W1j of the corresponding teacher of course j is calculated;
Step 3: because attend class occur listening attentively to the time with understand that the time is different on the influence of class-teaching of teacher quality, therefore be added Correction value calculates the positive teaching rate W2j that different courses correspond to teacher;Utilize formulaAnd X1 and X2 It is preset value;The positive teaching rate W2j of the corresponding teacher of course j is calculated;
The data analysis module is used to passive teaching rate W1j and positive teaching rate W2j being transferred to processor, the processor For passive teaching rate W1j and positive teaching rate W2j to be transferred to display and memory module, the display is for aobvious in real time Show passive teaching rate W1j and positive teaching rate W2j, the memory module is used for according to passive teaching rate W1j and positive teaching rate W2j combines corresponding teacher that the two data fusion is formed teaching record and real-time storage.
2. a kind of Estimating System of Classroom Teaching based on human facial expression recognition according to claim 1, which is characterized in that institute It states processor to be also used to that passive teaching rate W1j and positive teaching rate W2j are transferred to sub-controller by data interaction unit, institute Sub-controller is stated for transmitting standby signal, the cue module to cue module when passive teaching rate W1j is more than preset value Prompt can be issued automatically when receiving the standby signal of sub-controller transmission;
The sub-controller, which is used to for passive teaching rate W1j and positive teaching rate W2j to be transferred to display, carries out real-time display;Institute The sub-control system of stating is also used to for passive teaching rate W1j and positive teaching rate W2j being transferred to recording unit and forms teaching record.
3. a kind of Estimating System of Classroom Teaching based on human facial expression recognition according to claim 1, which is characterized in that institute Input module is stated for the input monitoring period, monitoring the period is the time phase for testing teachers ' teaching quality;The input module For that will monitor periodic transfer to sub-controller, the sub-controller is used to arrive by data interaction unit by periodic transfer is monitored Processor, the processor will be for that will monitor periodic transfer to face detection module.
CN201811639123.4A 2018-12-29 2018-12-29 A kind of Estimating System of Classroom Teaching based on human facial expression recognition Withdrawn CN109711371A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811639123.4A CN109711371A (en) 2018-12-29 2018-12-29 A kind of Estimating System of Classroom Teaching based on human facial expression recognition

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811639123.4A CN109711371A (en) 2018-12-29 2018-12-29 A kind of Estimating System of Classroom Teaching based on human facial expression recognition

Publications (1)

Publication Number Publication Date
CN109711371A true CN109711371A (en) 2019-05-03

Family

ID=66260154

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811639123.4A Withdrawn CN109711371A (en) 2018-12-29 2018-12-29 A kind of Estimating System of Classroom Teaching based on human facial expression recognition

Country Status (1)

Country Link
CN (1) CN109711371A (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110533335A (en) * 2019-09-02 2019-12-03 西南大学 A kind of classroom cognitive load measurement method and system
CN110533333A (en) * 2019-09-02 2019-12-03 西南大学 A kind of Method of Teaching Appraisal and device
CN110533336A (en) * 2019-09-02 2019-12-03 西南大学 A kind of instructional decisions matching process and device
CN110533992A (en) * 2019-09-02 2019-12-03 西南大学 A kind of learning effect prediction technique and system
CN110826510A (en) * 2019-11-12 2020-02-21 电子科技大学 Three-dimensional teaching classroom implementation method based on expression emotion calculation
CN111325645A (en) * 2020-03-18 2020-06-23 温州洪启信息科技有限公司 Teaching comprehensive analysis system based on education big data
CN112732770A (en) * 2021-02-05 2021-04-30 嘉兴南洋职业技术学院 Educational administration management system and method based on artificial intelligence
CN113256464A (en) * 2021-05-28 2021-08-13 智慧校园(广东)教育科技有限公司 Online education course automatic distribution system and method based on cloud computing
CN110533333B (en) * 2019-09-02 2022-08-19 西南大学 Teaching evaluation method and device

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110533335A (en) * 2019-09-02 2019-12-03 西南大学 A kind of classroom cognitive load measurement method and system
CN110533333A (en) * 2019-09-02 2019-12-03 西南大学 A kind of Method of Teaching Appraisal and device
CN110533336A (en) * 2019-09-02 2019-12-03 西南大学 A kind of instructional decisions matching process and device
CN110533992A (en) * 2019-09-02 2019-12-03 西南大学 A kind of learning effect prediction technique and system
CN110533333B (en) * 2019-09-02 2022-08-19 西南大学 Teaching evaluation method and device
CN110826510A (en) * 2019-11-12 2020-02-21 电子科技大学 Three-dimensional teaching classroom implementation method based on expression emotion calculation
CN111325645A (en) * 2020-03-18 2020-06-23 温州洪启信息科技有限公司 Teaching comprehensive analysis system based on education big data
CN112732770A (en) * 2021-02-05 2021-04-30 嘉兴南洋职业技术学院 Educational administration management system and method based on artificial intelligence
CN113256464A (en) * 2021-05-28 2021-08-13 智慧校园(广东)教育科技有限公司 Online education course automatic distribution system and method based on cloud computing
CN113256464B (en) * 2021-05-28 2022-03-04 智慧校园(广东)教育科技有限公司 Online education course automatic distribution system and method based on cloud computing

Similar Documents

Publication Publication Date Title
CN109711371A (en) A kind of Estimating System of Classroom Teaching based on human facial expression recognition
Moyles Observation as a research tool
Thornton et al. Training to improve observer accuracy.
Häggström Teaching systems of linear equations in Sweden and China: What is made possible to learn?
Ijaiya et al. Teacher education in Africa and critical thinking skills: Need and strategies
CN108182837A (en) A kind of ideological and political education intelligent tutoring system
CN108009754A (en) Method of Teaching Quality Evaluation
CN109697682A (en) A kind of on-line education system based on mobile intelligent terminal
CN110457641A (en) A kind of practical teaching classroom Assessment on teaching effect system
Randeniya et al. Virtual reality based maintenance training effectiveness measures–a novel approach for rail industry
Osadebe et al. Undergraduate Business Education Students' Perception on Information and Communication Technology Use in Teaching and Learning.
Simonson Attitude measurement: Why and how
CN108304779B (en) Intelligent regulation and control method for student education management
CN111626647A (en) Classroom teaching evaluation system based on facial expression recognition
CN108985988A (en) One kind being based on online teaching school work growing algorithm
Johnson et al. Examining Interrater Agreement Analyses of a Pilot Special Education Observation Tool.
CN107886791A (en) A kind of intelligent sharing method and its system based on teaching data
Medley The language of teacher behavior: Communicating the results of structured observations to teachers
Wolfschwenger et al. Learning under Lockdown: The Conditions in Austria in a Global Context.
CN108538123A (en) One kind being based on wisdom classroom instruction student's case exercise system
Anderson et al. The components of family policy education
Bennett et al. The development of a computer-based alternate assessment system
CN110968138B (en) Information interaction method based on control system
Ibrahim et al. Utilizing Learning Analytics in Measuring Students’ Learning Outcomes: Re-examining an Online Course Grounded in the Cognitive-Affective Theory of Learning with Media (CATLM)
Zhang et al. Analysis of the cores of these improvements of online teaching system and model-based on the evaluation and feedback on the online teaching model and teaching platform

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication
WW01 Invention patent application withdrawn after publication

Application publication date: 20190503