CN109711371A - A kind of Estimating System of Classroom Teaching based on human facial expression recognition - Google Patents
A kind of Estimating System of Classroom Teaching based on human facial expression recognition Download PDFInfo
- Publication number
- CN109711371A CN109711371A CN201811639123.4A CN201811639123A CN109711371A CN 109711371 A CN109711371 A CN 109711371A CN 201811639123 A CN201811639123 A CN 201811639123A CN 109711371 A CN109711371 A CN 109711371A
- Authority
- CN
- China
- Prior art keywords
- expression
- time
- student
- teacher
- teaching
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The invention discloses a kind of Estimating System of Classroom Teaching based on human facial expression recognition, including monitoring module, face monitoring modular, expression library, database, data analysis module, timing unit, achievement acquisition module, processor, display module, memory module, data interaction unit and the mutual moved end of teacher；The mutual moved end of teacher includes sub-controller, cue module, display, input module and recording unit；The monitoring module is constituted by the indoor several cameras of religion are arranged in；The present invention monitors the image data in classroom of upper class hour in real time by monitoring module, and image data is analyzed by face monitoring modular, changes in emotional of the perception student in classroom is analyzed by micro- Expression Recognition technology, reflect that student to the interest-degree of instant classroom instruction, realizes quick, full automatic classroom teaching evaluation.
Description
Technical field
The invention belongs to teaching evaluation fields, are related to a kind of human facial expression recognition technology, specifically a kind of based on facial table
The Estimating System of Classroom Teaching of feelings identification.
Background technique
Expression Recognition, which refers to, isolates specific emotional state from given still image or dynamic video sequence, thus
Determine the mental emotion of identified object.
With the fast development of computer technology and artificial intelligence technology and its related discipline, the automation journey of entire society
Degree is continuously improved, and demand of the people to the human-computer interaction of people and people's exchange way is similar to is increasingly strong.Computer and robot
If can have the ability for understanding and showing emotion as the mankind, it will fundamentally change the pass between people and computer
System enables a computer to preferably service for the mankind.Expression Recognition is the basis of affective comprehension, is computer understanding people's emotion
Premise and people explore and understand intelligence effective way.
Facial expression recognition, which refers to, isolates specific emotional state from given still image or dynamic video sequence,
So that it is determined that the mental emotion of identified object, realizes understanding and identification of the computer to human face expression, fundamentally changes people
With the relationship of computer, to reach better human-computer interaction.Therefore facial expression recognition is in psychology, intelligent robot, intelligence
There is very big potential using value in the fields such as energy monitoring, virtual reality and synthesis animation.
And it is current with the development of technology, Expression Recognition this technology also slowly be referred to other field；And it educates
It is the current universal focus of people, for student performance, the teaching method and content of teacher can also play student very big
It influences, whether conscientiously only can probably determine only according to achievement currently for student；So for the quality of instruction of teacher,
Multiple angles may be needed to go to determine；Currently we then it is hoped that there will be one kind to be understood on student in real time by Expression Recognition technology
Class state forms a good system evaluated for teachers ' teaching quality in combination with other factors；In order to realize
Above-mentioned conception, now provides a solution.
Summary of the invention
The purpose of the present invention is to provide a kind of Estimating System of Classroom Teaching based on human facial expression recognition.
The technical problems to be solved by the invention are as follows:
(1) how to classify to the expression of attending class of student, these expressions for the content of courses reaction why sample；
(2) how all kinds of real-time expressions that basis is attended class make evaluation to the quality of instruction of teacher.
The purpose of the present invention can be achieved through the following technical solutions:
A kind of Estimating System of Classroom Teaching based on human facial expression recognition, including monitoring module, face monitoring modular, expression
Library, database, data analysis module, timing unit, achievement obtain module, processor, display module, memory module, data and hand over
Mutual unit and the mutual moved end of teacher；
Wherein, the mutual moved end of the teacher includes sub-controller, cue module, display, input module and recording unit；
Wherein, the monitoring module is constituted by the indoor several cameras of religion are arranged in, for obtaining upper class hour in classroom
Real-time imaging data, the database purchase has the total data of face and curriculum information of all students of class；The total data of face
For the face data of all students of the class；Curriculum information is course and corresponding teacher；
The monitoring module is used to image data being transferred to face monitoring modular；
Wherein, the expression library prestores the expression library of listening to the teacher of student, and the expression library of listening to the teacher includes being greater than certain amount
Two major classes expression sample when listening to the teacher；Two major classes expression sample specifically:
A: class of actively listening to the teacher, class of actively listening to the teacher expression are to understand expression and listen attentively to expression；
A1: understanding that expression is that student understands the generally reaction of course, when student understands Current Content or itself can
Positive participates in education activities, such as answer a question and participate in discussion in situation when can betray and understand expression, acquisition is big
Sample database is formed in a certain number of expression samples；
A2: listening attentively to expression is normal expression of the student when listening to the teacher, and when student is interested in the content of courses, is ready to listen teacher
It says class hour, the expression listened attentively to can be betrayed, acquisition is greater than a certain number of expression samples and forms sample database；
B: passiveness is listened to the teacher class, and passiveness class expression of listening to the teacher includes doubt expression and resists expression；
B1: doubt expression does not understand the content of courses for student and there are when query, can betray query expression；
B2: resisting expression is that student feels the excessively difficult human-subject test beyond oneself of the content of courses, too simple
Or when loseing interest in learning Content, resistance expression can be betrayed；
The face monitoring modular is also used to the stage at school and expression library and timing unit is combined to carry out image data
Student's focus is analyzed, and steps are as follows for concrete analysis:
Step 1: the real-time expression of all students is got；
Step 2: the real-time expression of student is compared with expression library；
Step 3: it gets each student and occurs understanding expression, listen attentively to expression, doubt expression and resisting expression on course
The time accounting of respective expression；Specific obtaining step are as follows:
S1: any student is obtained；
S2: and select any subject；
S3: total course time of the course is obtained；
S4: obtaining the student and correspond to the subject and the understanding time for understanding expression occur, it will be understood that the time is divided by total course
Time is understood the understanding time accounting of expression appearance；
S5: obtain that the student corresponds to that expression occurs listening attentively in the subject listens attentively to the time, will listen attentively to the time divided by total course
What the time obtained listening attentively to expression appearance listens attentively to time accounting；
S6: obtaining the student and correspond to the subject and the doubt time of doubt expression occur, and the time that will feel uncertain is divided by total course
Time obtains the doubt time accounting of doubt expression appearance；
S7: obtaining the student and correspond to the resistance time that resistance expression occurs in the subject, will resist the time divided by total course
Time obtains resisting the resistance time accounting that expression occurs；
S8: selected lower a branch of instruction in school repeats step S3-S7, until obtaining all kinds of expressions that all courses of the student occur
Time accounting；
S9: it selectes next student and repeats step S2-S8 until obtaining all kinds of tables that all students occur on all courses
The time accounting of feelings；
SS1: it will be understood that time accounting is labeled as Qij, i=1...m, j=1...n；Qij is expressed as corresponding student i in class
Understanding time accounting when journey j；
SS2: will listen attentively to time accounting and be labeled as Pij, i=1...m, j=1...n；Pij is expressed as corresponding student i in class
Time accounting is listened attentively to when journey j；
SS3: the time accounting that will feel uncertain is labeled as Hij, i=1...m, j=1...n；Hij is expressed as corresponding student i in class
Doubt time accounting when journey j；
SS4: will resist time accounting and be labeled as Kij, i=1...m, j=1...n；Kij is expressed as corresponding student i in class
Resistance time accounting when journey j；
The face monitoring modular is used to for student each expression time accounting Qij, Pij, Hij and Kij to be transferred to data point
Analyse module；The data analysis module is used to that Qij, Pij, Hij and Kij to be combined to count teachers ' classroom teaching, statistic procedure
It is as follows:
Step 1: Qij, Pij, Hij and Kij are got；
Step 2: because appearance of attending class is felt uncertain, time and resistance time are different on the influence of class-teaching of teacher quality, therefore here
Correction value is added to calculate the passive teaching rate W1j that different courses correspond to teacher；Utilize formulaX1+X2=1, wherein X2 > X1, and X1 and X2
It is preset value；The passive teaching rate W1j of the corresponding teacher of course j is calculated；
Step 3: because attend class occur listening attentively to the time with understand that the time is different on the influence of class-teaching of teacher quality, therefore here
Correction value is added to calculate the positive teaching rate W2j that different courses correspond to teacher；Utilize formulaX1 > X2, X1+X2=1, and X1 and X2 are
Preset value；The positive teaching rate W2j of the corresponding teacher of course j is calculated；
The data analysis module is used to passive teaching rate W1j and positive teaching rate W2j being transferred to processor, the place
Reason device is used to for passive teaching rate W1j and positive teaching rate W2j being transferred to display and memory module, and the display is for real
When show passiveness teaching rate W1j and positive teaching rate W2j, the memory module is used for according to passive teaching rate W1j and actively religion
Rate W2j combines corresponding teacher that the two data fusion is formed teaching record and real-time storage.
Further, the processor is also used to passive teaching rate W1j and positive teaching rate through data interaction unit
W2j is transferred to sub-controller, and the sub-controller is used to mention when passive teaching rate W1j is more than preset value to cue module transmission
Show signal, the cue module can issue prompt when receiving the standby signal of sub-controller transmission automatically；
The sub-controller is for passive teaching rate W1j and positive teaching rate W2j to be transferred to display and be shown in real time
Show；The sub-control system is also used to for passive teaching rate W1j and positive teaching rate W2j being transferred to recording unit and forms teaching record.
Further, the input module be used for the input monitoring period, monitoring the period be test teachers ' teaching quality when
Between the stage；The input module will be for that will monitor periodic transfer to sub-controller, and the sub-controller is for passing through data interaction
Unit will monitor periodic transfer to processor, and the processor will be for that will monitor periodic transfer to face detection module.
Beneficial effects of the present invention:
(1) present invention prestores the expression library of listening to the teacher of student by the expression library, and expression of listening to the teacher library includes being greater than centainly
Two major classes expression sample when listening to the teacher of quantity, and specifically expression is divided into and understands expression, listen attentively to expression, doubt expression and resistance
Expression；Understand that expression is that student understands the generally reaction of course, when student understands Current Content or itself can be positive
Participate in education activities, such as answer a question and participate in discussion in situation when can betray and understand expression, acquisition is greater than certain
The expression sample of quantity forms sample database；Listening attentively to expression is normal expression of the student when listening to the teacher, when student is to content of courses sense
Interest is ready that teacher is listened to say class hour, can betray the expression listened attentively to, acquire and be greater than a certain number of expression samples formation sample
Library；Doubt expression does not understand the content of courses for student and there are when query, can betray query expression；Resistance expression is student
Feel the excessively difficult human-subject test beyond oneself of the content of courses, too simple or when loseing interest in learning Content, meeting
Betray resistance expression；To obtain a series of corresponding reaction of student's expressions；
(2) present invention carries out processing analysis to Qij, Pij, Hij and Kij by data analysis module combination dependency rule,
And the corresponding passiveness teaching rate W1j and positive teaching rate W2j of every subject is calculated by correlation formula, and pass through passive religion
Rate and positive teaching rate evaluate the teaching of teacher.
Detailed description of the invention
In order to facilitate the understanding of those skilled in the art, the present invention will be further described below with reference to the drawings.
Fig. 1 is system block diagram of the invention.
Specific embodiment
As shown in Figure 1, a kind of Estimating System of Classroom Teaching based on human facial expression recognition, as the embodiment of the present invention
One: obtaining mould including monitoring module, face monitoring modular, expression library, database, data analysis module, timing unit, achievement
Block, processor, display module, memory module, data interaction unit and the mutual moved end of teacher；
Wherein, the mutual moved end of the teacher includes sub-controller, cue module, display, input module and recording unit；
Wherein, the monitoring module is constituted by the indoor several cameras of religion are arranged in, for obtaining upper class hour in classroom
Real-time imaging data, the database purchase has the total data of face and curriculum information of all students of class；The total data of face
For the face data of all students of the class；Curriculum information is course and corresponding teacher；
The monitoring module is used to image data being transferred to face monitoring modular；
Wherein, the expression library prestores the expression library of listening to the teacher of student, and the expression library of listening to the teacher includes being greater than certain amount
Two major classes expression sample when listening to the teacher；Two major classes expression sample specifically:
A: class of actively listening to the teacher, class of actively listening to the teacher expression are to understand expression and listen attentively to expression；
A1: understanding that expression is that student understands the generally reaction of course, when student understands Current Content or itself can
Positive participates in education activities, such as answer a question and participate in discussion in situation when can betray and understand expression, acquisition is big
Sample database is formed in a certain number of expression samples；
A2: listening attentively to expression is normal expression of the student when listening to the teacher, and when student is interested in the content of courses, is ready to listen teacher
It says class hour, the expression listened attentively to can be betrayed, acquisition is greater than a certain number of expression samples and forms sample database；
B: passiveness is listened to the teacher class, and passiveness class expression of listening to the teacher includes doubt expression and resists expression；
B1: doubt expression does not understand the content of courses for student and there are when query, can betray query expression；
B2: resisting expression is that student feels the excessively difficult human-subject test beyond oneself of the content of courses, too simple
Or when loseing interest in learning Content, resistance expression can be betrayed；
The face monitoring modular is also used to the stage at school and expression library and timing unit is combined to carry out image data
Student's focus is analyzed, and steps are as follows for concrete analysis:
Step 1: the real-time expression of all students is got；
Step 2: the real-time expression of student is compared with expression library；
Step 3: it gets each student and occurs understanding expression, listen attentively to expression, doubt expression and resisting expression on course
The time accounting of respective expression；Specific obtaining step are as follows:
S1: any student is obtained；
S2: and select any subject；
S3: total course time of the course is obtained；
S4: obtaining the student and correspond to the subject and the understanding time for understanding expression occur, it will be understood that the time is divided by total course
Time is understood the understanding time accounting of expression appearance；
S5: obtain that the student corresponds to that expression occurs listening attentively in the subject listens attentively to the time, will listen attentively to the time divided by total course
What the time obtained listening attentively to expression appearance listens attentively to time accounting；
S6: obtaining the student and correspond to the subject and the doubt time of doubt expression occur, and the time that will feel uncertain is divided by total course
Time obtains the doubt time accounting of doubt expression appearance；
S7: obtaining the student and correspond to the resistance time that resistance expression occurs in the subject, will resist the time divided by total course
Time obtains resisting the resistance time accounting that expression occurs；
S8: selected lower a branch of instruction in school repeats step S3-S7, until obtaining all kinds of expressions that all courses of the student occur
Time accounting；
S9: it selectes next student and repeats step S2-S8 until obtaining all kinds of tables that all students occur on all courses
The time accounting of feelings；
SS1: it will be understood that time accounting is labeled as Qij, i=1...m, j=1...n；Qij is expressed as corresponding student i in class
Understanding time accounting when journey j；
SS2: will listen attentively to time accounting and be labeled as Pij, i=1...m, j=1...n；Pij is expressed as corresponding student i in class
Time accounting is listened attentively to when journey j；
SS3: the time accounting that will feel uncertain is labeled as Hij, i=1...m, j=1...n；Hij is expressed as corresponding student i in class
Doubt time accounting when journey j；
SS4: will resist time accounting and be labeled as Kij, i=1...m, j=1...n；Kij is expressed as corresponding student i in class
Resistance time accounting when journey j；
The face monitoring modular is used to for student each expression time accounting Qij, Pij, Hij and Kij to be transferred to data point
Analyse module；The data analysis module is used to that Qij, Pij, Hij and Kij to be combined to count teachers ' classroom teaching, statistic procedure
It is as follows:
Step 1: Qij, Pij, Hij and Kij are got；
Step 2: because appearance of attending class is felt uncertain, time and resistance time are different on the influence of class-teaching of teacher quality, therefore here
Correction value is added to calculate the passive teaching rate W1j that different courses correspond to teacher；Utilize formulaX1+X2=1, wherein X2 > X1, and X1 and X2
It is preset value；The passive teaching rate W1j of the corresponding teacher of course j is calculated；
Step 3: because attend class occur listening attentively to the time with understand that the time is different on the influence of class-teaching of teacher quality, therefore here
Correction value is added to calculate the positive teaching rate W2j that different courses correspond to teacher；Utilize formulaX1 > X2, X1+X2=1, and X1 and X2 are
Preset value；The positive teaching rate W2j of the corresponding teacher of course j is calculated；
The data analysis module is used to passive teaching rate W1j and positive teaching rate W2j being transferred to processor, the place
Reason device is used to for passive teaching rate W1j and positive teaching rate W2j being transferred to display and memory module, and the display is for real
When show passiveness teaching rate W1j and positive teaching rate W2j, the memory module is used for according to passive teaching rate W1j and actively religion
Rate W2j combines corresponding teacher that the two data fusion is formed teaching record and real-time storage.
As the embodiment of the present invention two: including monitoring module, face monitoring modular, expression library, database, data analysis
Module, timing unit, achievement obtain module, processor, display module, memory module, data interaction unit and the mutual moved end of teacher；
Wherein, the mutual moved end of the teacher includes sub-controller, cue module, display, input module and recording unit；
Wherein, the monitoring module is constituted by the indoor several cameras of religion are arranged in, for obtaining upper class hour in classroom
Real-time imaging data, the database purchase has asking for leave for the total data of face of all students of class, curriculum information and student
Information；The total data of face is the face data of all students of the class；Curriculum information is course and corresponding teacher；It asks for leave packet
It includes and asks for leave the time and ask dummy, false information and the face data of student is asked to correspond；
The monitoring module is used to for image data being transferred to face monitoring modular, and the face monitoring modular receives monitoring
The image data of module transfer simultaneously carries out roll-call operation in combined data library, specific steps are as follows:
Step 1: getting the image data in the monitoring period, and is therefrom truncated to all in the people for learning student in classroom
Face information；
Step 2: the total data of face for all students that face information and databases are stored up is compared, is obtained
To the face information not occurred and it is marked as absent pupils；
Step 3: absent pupils are compared with false information is asked, weed out the student that asks for leave in absent pupils；
Step 4: the absent pupils after student that rejecting is asked for leave are labeled as the student that plays truant；Obtain the student couple that plays truant at this time
The curriculum information that should be played truant；The curriculum information that student and correspondence are played truant that will play truant forms record of playing truant；
Step 5: the rate of playing truant that each subject corresponds to student, calculation method are got are as follows:
S1: an optional student；
S2: and select any subject；
S3: the corresponding selected course of the student is got in total course number in monitoring period；
S4: the course number that the corresponding selected course of the student is played truant is got, course number is obtained into divided by total course number
The rate of playing truant of the raw corresponding course；
S5: optional next course repeats play truant rate of the step S3-S4 until obtaining all courses of the student；
S6: optional next student repeats step S2-S5 and directly acquires the rate of playing truant that all students correspond to all courses；
S7: the corresponding student of curriculum information is played truant into rate labeled as Tij, i=1...m, j=1...n；Tij is expressed as learning
The corresponding course j of life i plays truant rate as Tij；
The face detection module is used to detect that the student that can will play truant when playing truant student is transferred to processor, the place
Reason device is used to be transferred to sub-controller by the data interaction unit student that will play truant, and the sub-controller receives data interaction list
Student's Shi Huixiang cue module transmission alerting signal of playing truant of member transmission, the cue module receive the prompting of sub-controller transmission
Prompting can be issued when signal；The sub-controller be also used to play truant student be transferred to display carry out real-time display；
The face monitoring modular is used to the student rate Tij that plays truant being transferred to data analysis module；
Wherein, the expression library prestores the expression library of listening to the teacher of student, and the expression library of listening to the teacher includes being greater than certain amount
Two major classes expression sample when listening to the teacher, certain amount can be greater than 10,000 kinds expression samples；Two major classes expression sample is specific
Are as follows:
A: class of actively listening to the teacher, class of actively listening to the teacher expression are to understand expression and listen attentively to expression；
A1: understanding that expression is that student understands the generally reaction of course, when student understands Current Content or itself can
Positive participates in education activities, such as answer a question and participate in discussion in situation when can betray and understand expression, acquisition is big
Sample database is formed in a certain number of expression samples；
A2: listening attentively to expression is normal expression of the student when listening to the teacher, and when student is interested in the content of courses, is ready to listen teacher
It says class hour, the expression listened attentively to can be betrayed, acquisition is greater than a certain number of expression samples and forms sample database；
B: passiveness is listened to the teacher class, and passiveness class expression of listening to the teacher includes doubt expression and resists expression；
B1: doubt expression does not understand the content of courses for student and there are when query, can betray query expression；
B2: resisting expression is that student feels the excessively difficult human-subject test beyond oneself of the content of courses, too simple
Or when loseing interest in learning Content, resistance expression can be betrayed；
The face monitoring modular is also used to the stage at school and expression library and timing unit is combined to carry out image data
Student's focus is analyzed, and steps are as follows for concrete analysis:
Step 1: the real-time expression of all students is got；
Step 2: the real-time expression of student is compared with expression library；
Step 3: it gets each student and occurs understanding expression, listen attentively to expression, doubt expression and resisting expression on course
The time accounting of respective expression；Specific obtaining step are as follows:
S1: any student is obtained；
S2: and select any subject；
S3: total course time of the course is obtained；
S4: obtaining the student and correspond to the subject and the understanding time for understanding expression occur, it will be understood that the time is divided by total course
Time is understood the understanding time accounting of expression appearance；
S5: obtain that the student corresponds to that expression occurs listening attentively in the subject listens attentively to the time, will listen attentively to the time divided by total course
What the time obtained listening attentively to expression appearance listens attentively to time accounting；
S6: obtaining the student and correspond to the subject and the doubt time of doubt expression occur, and the time that will feel uncertain is divided by total course
Time obtains the doubt time accounting of doubt expression appearance；
S7: obtaining the student and correspond to the resistance time that resistance expression occurs in the subject, will resist the time divided by total course
Time obtains resisting the resistance time accounting that expression occurs；
S8: selected lower a branch of instruction in school repeats step S3-S7, until obtaining all kinds of expressions that all courses of the student occur
Time accounting；
S9: it selectes next student and repeats step S2-S8 until obtaining all kinds of tables that all students occur on all courses
The time accounting of feelings；
SS1: it will be understood that time accounting is labeled as Qij, i=1...m, j=1...n；Qij is expressed as corresponding student i in class
Understanding time accounting when journey j；
SS2: will listen attentively to time accounting and be labeled as Pij, i=1...m, j=1...n；Pij is expressed as corresponding student i in class
Time accounting is listened attentively to when journey j；
SS3: the time accounting that will feel uncertain is labeled as Hij, i=1...m, j=1...n；Hij is expressed as corresponding student i in class
Doubt time accounting when journey j；
SS4: will resist time accounting and be labeled as Kij, i=1...m, j=1...n；Kij is expressed as corresponding student i in class
Resistance time accounting when journey j；
The face monitoring modular is used to for student each expression time accounting Qij, Pij, Hij and Kij to be transferred to data point
Analyse module；The data analysis module is used to that Tij, Qij, Pij, Hij and Kij to be combined to count teachers ' classroom teaching, counts
Steps are as follows:
Step 1: Tij, Qij, Pij, Hij and Kij are got；
Step 2: because rate of playing truant, appearance of attending class are felt uncertain, time and resistance time influence class-teaching of teacher quality different, therefore
Correction value is added to calculate the passive teaching rate W1j that different courses correspond to teacher；Utilize formulaX1+X2+X3=1, wherein
X3 > X2 > X1, and X1, X2 and X3 are preset value；The passive teaching rate W1j of the corresponding teacher of course j is calculated；
Step 3: because attend class occur listening attentively to the time with understand that the time is different on the influence of class-teaching of teacher quality, therefore here
Correction value is added to calculate the positive teaching rate W2j that different courses correspond to teacher；Utilize formulaX1 > X2, X1+X2=1, and X1 and X2 are
Preset value；The positive teaching rate W2j of the corresponding teacher of course j is calculated；
The data analysis module is used to passive teaching rate W1j and positive teaching rate W2j being transferred to processor, the place
Reason device is used to for passive teaching rate W1j and positive teaching rate W2j being transferred to display and memory module, and the display is for real
When show passiveness teaching rate W1j and positive teaching rate W2j, the memory module is used for according to passive teaching rate W1j and actively religion
Rate W2j combines corresponding teacher that the two data fusion is formed teaching record and real-time storage；
The processor is also used to be transferred to passive teaching rate W1j and positive teaching rate W2j by data interaction unit
Sub-controller, the sub-controller are used to transmit standby signal, institute to cue module when passive teaching rate W1j is more than preset value
Prompt can be issued automatically by stating when cue module receives the standby signal of sub-controller transmission；
The sub-controller is for passive teaching rate W1j and positive teaching rate W2j to be transferred to display and be shown in real time
Show；The sub-control system is also used to for passive teaching rate W1j and positive teaching rate W2j being transferred to recording unit and forms teaching record.
The input module is used for the input monitoring period, and the monitoring period is the time phase for testing teachers ' teaching quality；Institute
Input module is stated for periodic transfer will to be monitored to sub-controller, the sub-controller is used to monitor by data interaction unit
Periodic transfer is to processor, and the processor will be for that will monitor periodic transfer to face detection module.
A kind of Estimating System of Classroom Teaching based on human facial expression recognition, it is at work, real-time by monitoring module first
The teaching affairs in classroom of upper class hour are obtained, the student's facial information stored up later according to face recognition and databases compares
The case where obtaining student absent from school, and the student that plays truant is determined in conjunction with dependency rule, each student is calculated and corresponds to different courses
Rate of playing truant；Each student corresponds to all kinds of definition tables of different courses appearance when being got at school by face monitoring modular later
The time of feelings obtains this four groups of data of Qij, Pij, Hij and Kij in combination with dependency rule, finally utilizes data analysis module
The passive teaching rate W1j and positive teaching rate W2j that every a branch of instruction in school corresponds to teacher is calculated in conjunction with correlation formula, passes through passiveness
Teaching rate and positive teaching rate carry out judge analysis to teachers ' teaching quality.
Beneficial effects of the present invention are as follows:
(1) real-time imaging data in classroom when the present invention is attended class by monitoring module real time monitoring in example 2,
And image data is analyzed by face monitoring modular, absent student is acquired by face alignment technology, later
Absent student is compared with the student that asks for leave, later by student that is absent and not asking for leave labeled as the student that plays truant, and is combined
All courses calculate the rate of playing truant that student corresponds to the subject with the course played truant；
(2) present invention prestores the expression library of listening to the teacher of student by the expression library, and expression of listening to the teacher library includes being greater than centainly
Two major classes expression sample when listening to the teacher of quantity, and specifically expression is divided into and understands expression, listen attentively to expression, doubt expression and resistance
Expression；Understand that expression is that student understands the generally reaction of course, when student understands Current Content or itself can be positive
Participate in education activities, such as answer a question and participate in discussion in situation when can betray and understand expression, acquisition is greater than certain
The expression sample of quantity forms sample database；Listening attentively to expression is normal expression of the student when listening to the teacher, when student is to content of courses sense
Interest is ready that teacher is listened to say class hour, can betray the expression listened attentively to, acquire and be greater than a certain number of expression samples formation sample
Library；Doubt expression does not understand the content of courses for student and there are when query, can betray query expression；Resistance expression is student
Feel the excessively difficult human-subject test beyond oneself of the content of courses, too simple or when loseing interest in learning Content, meeting
Betray resistance expression；To obtain a series of corresponding reaction of student's expressions；
(3) present invention by data analysis module combination dependency rule to Qij, Pij, Hij and Kij or Tij, Qij,
These factors of Pij, Hij and Kij carry out processing analysis, and the corresponding passive religion of every subject is calculated by correlation formula
Rate W1j and positive teaching rate W2j, and the teaching of teacher is evaluated by passive teaching rate and positive teaching rate.
Above content is only to structure of the invention example and explanation, affiliated those skilled in the art couple
Described specific embodiment does various modifications or additions or is substituted in a similar manner, without departing from invention
Structure or beyond the scope defined by this claim, is within the scope of protection of the invention.
Claims (3)
1. a kind of Estimating System of Classroom Teaching based on human facial expression recognition, which is characterized in that monitored including monitoring module, face
Module, expression library, database, data analysis module, timing unit, achievement obtain module, processor, display module, storage mould
Block, data interaction unit and the mutual moved end of teacher；
Wherein, the mutual moved end of the teacher includes sub-controller, cue module, display, input module and recording unit；
Wherein, the monitoring module is constituted by the indoor several cameras of religion are arranged in, for obtaining the reality of upper class hour in classroom
When image data, the database purchase has the total data of face and curriculum information of all students of class；The total data of face is should
The face data of all students of class；Curriculum information is course and corresponding teacher；
The monitoring module is used to image data being transferred to face monitoring modular；
Wherein, the expression library prestores the expression library of listening to the teacher of student, and the expression library of listening to the teacher includes being greater than a certain number of tins
The two major classes expression sample of class hour；Two major classes expression sample specifically:
A: class of actively listening to the teacher, class of actively listening to the teacher expression are to understand expression and listen attentively to expression；
A1: understanding that expression is that student understands the generally reaction of course, when student understands Current Content or itself can be positive
Participate in education activities, such as answer a question and participate in discussion in situation when can betray and understand expression, acquisition is greater than one
The expression sample of fixed number amount forms sample database；
A2: listening attentively to expression is normal expression of the student when listening to the teacher, and when student is interested in the content of courses, is ready that teacher is listened to teach
When, the expression listened attentively to can be betrayed, acquisition is greater than a certain number of expression samples and forms sample database；
B: passiveness is listened to the teacher class, and passiveness class expression of listening to the teacher includes doubt expression and resists expression；
B1: doubt expression does not understand the content of courses for student and there are when query, can betray query expression；
B2: resisting expression is that student feels the excessively difficult human-subject test beyond oneself of the content of courses, too simple or right
When learning Content is lost interest in, resistance expression can be betrayed；
The face monitoring modular is also used to the stage at school and expression library and timing unit is combined to carry out student to image data
Focus is analyzed, and steps are as follows for concrete analysis:
Step 1: the real-time expression of all students is got；
Step 2: the real-time expression of student is compared with expression library；
Step 3: it gets each student and occurs understanding expression on course, listens attentively to expression, doubt expression and resist expression respectively
The time accounting of expression；Specific obtaining step are as follows:
S1: any student is obtained；
S2: and select any subject；
S3: total course time of the course is obtained；
S4: obtaining the student and correspond to the subject and the understanding time for understanding expression occur, it will be understood that the time is divided by total course time
It is understood the understanding time accounting of expression appearance；
S5: obtain that the student corresponds to that expression occurs listening attentively in the subject listens attentively to the time, will listen attentively to the time divided by total course time
Obtain listening attentively to expression appearance listens attentively to time accounting；
S6: obtaining the student and correspond to the subject and the doubt time of doubt expression occur, and the time that will feel uncertain is divided by total course time
Obtain the doubt time accounting of doubt expression appearance；
S7: obtaining the student and correspond to the resistance time that resistance expression occurs in the subject, will resist the time divided by total course time
It obtains resisting the resistance time accounting that expression occurs；
S8: selected lower a branch of instruction in school repeats step S3-S7, until obtaining the time for all kinds of expressions that all courses of the student occur
Accounting；
S9: it selectes next student and repeats step S2-S8 until obtaining all kinds of expressions that all students occur on all courses
Time accounting；
SS1: it will be understood that time accounting is labeled as Qij, i=1...m, j=1...n；Qij is expressed as corresponding student i in course j
When understanding time accounting；
SS2: will listen attentively to time accounting and be labeled as Pij, i=1...m, j=1...n；Pij is expressed as corresponding student i in course j
When listen attentively to time accounting；
SS3: the time accounting that will feel uncertain is labeled as Hij, i=1...m, j=1...n；Hij is expressed as corresponding student i in course j
When doubt time accounting；
SS4: will resist time accounting and be labeled as Kij, i=1...m, j=1...n；Kij is expressed as corresponding student i in course j
When resistance time accounting；
The face monitoring modular is used to for student each expression time accounting Qij, Pij, Hij and Kij being transferred to data analysis mould
Block；The data analysis module is used to that Qij, Pij, Hij and Kij to be combined to count teachers ' classroom teaching, and statistic procedure is as follows:
Step 1: Qij, Pij, Hij and Kij are got；
Step 2: because appearance of attending class is felt uncertain, time and resistance time are different on the influence of class-teaching of teacher quality, therefore are added
Correction value calculates the passive teaching rate W1j that different courses correspond to teacher；Utilize formulaWherein X2 > X1, and X1 and
X2 is preset value；The passive teaching rate W1j of the corresponding teacher of course j is calculated；
Step 3: because attend class occur listening attentively to the time with understand that the time is different on the influence of class-teaching of teacher quality, therefore be added
Correction value calculates the positive teaching rate W2j that different courses correspond to teacher；Utilize formulaAnd X1 and X2
It is preset value；The positive teaching rate W2j of the corresponding teacher of course j is calculated；
The data analysis module is used to passive teaching rate W1j and positive teaching rate W2j being transferred to processor, the processor
For passive teaching rate W1j and positive teaching rate W2j to be transferred to display and memory module, the display is for aobvious in real time
Show passive teaching rate W1j and positive teaching rate W2j, the memory module is used for according to passive teaching rate W1j and positive teaching rate
W2j combines corresponding teacher that the two data fusion is formed teaching record and real-time storage.
2. a kind of Estimating System of Classroom Teaching based on human facial expression recognition according to claim 1, which is characterized in that institute
It states processor to be also used to that passive teaching rate W1j and positive teaching rate W2j are transferred to sub-controller by data interaction unit, institute
Sub-controller is stated for transmitting standby signal, the cue module to cue module when passive teaching rate W1j is more than preset value
Prompt can be issued automatically when receiving the standby signal of sub-controller transmission；
The sub-controller, which is used to for passive teaching rate W1j and positive teaching rate W2j to be transferred to display, carries out real-time display；Institute
The sub-control system of stating is also used to for passive teaching rate W1j and positive teaching rate W2j being transferred to recording unit and forms teaching record.
3. a kind of Estimating System of Classroom Teaching based on human facial expression recognition according to claim 1, which is characterized in that institute
Input module is stated for the input monitoring period, monitoring the period is the time phase for testing teachers ' teaching quality；The input module
For that will monitor periodic transfer to sub-controller, the sub-controller is used to arrive by data interaction unit by periodic transfer is monitored
Processor, the processor will be for that will monitor periodic transfer to face detection module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811639123.4A CN109711371A (en) | 2018-12-29 | 2018-12-29 | A kind of Estimating System of Classroom Teaching based on human facial expression recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811639123.4A CN109711371A (en) | 2018-12-29 | 2018-12-29 | A kind of Estimating System of Classroom Teaching based on human facial expression recognition |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109711371A true CN109711371A (en) | 2019-05-03 |
Family
ID=66260154
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811639123.4A Withdrawn CN109711371A (en) | 2018-12-29 | 2018-12-29 | A kind of Estimating System of Classroom Teaching based on human facial expression recognition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109711371A (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110533333A (en) * | 2019-09-02 | 2019-12-03 | 西南大学 | A kind of Method of Teaching Appraisal and device |
| CN110533335A (en) * | 2019-09-02 | 2019-12-03 | 西南大学 | A kind of classroom cognitive load measurement method and system |
| CN110533992A (en) * | 2019-09-02 | 2019-12-03 | 西南大学 | A kind of learning effect prediction technique and system |
| CN110533336A (en) * | 2019-09-02 | 2019-12-03 | 西南大学 | A kind of instructional decisions matching process and device |
| CN110826510A (en) * | 2019-11-12 | 2020-02-21 | 电子科技大学 | Three-dimensional teaching classroom implementation method based on expression emotion calculation |
| CN111027865A (en) * | 2019-12-12 | 2020-04-17 | 山东大学 | Classroom teaching analysis and quality assessment system and method based on intelligent behavior and expression recognition |
| CN111178263A (en) * | 2019-12-30 | 2020-05-19 | 湖北美和易思教育科技有限公司 | Real-time expression analysis method and device |
| CN111325645A (en) * | 2020-03-18 | 2020-06-23 | 温州洪启信息科技有限公司 | Teaching comprehensive analysis system based on education big data |
| CN111882305A (en) * | 2020-05-09 | 2020-11-03 | 北京文香信息技术有限公司 | Behavior analysis device and behavior monitoring analysis system |
| CN112732770A (en) * | 2021-02-05 | 2021-04-30 | 嘉兴南洋职业技术学院 | Educational administration management system and method based on artificial intelligence |
| CN112967162A (en) * | 2021-02-02 | 2021-06-15 | 河南工业职业技术学院 | Accounting teaching method and accounting teaching device |
| CN113256464A (en) * | 2021-05-28 | 2021-08-13 | 智慧校园(广东)教育科技有限公司 | Online education course automatic distribution system and method based on cloud computing |
| CN113256454A (en) * | 2020-02-07 | 2021-08-13 | 顾得科技教育股份有限公司 | Class course management system |
| CN114596748A (en) * | 2022-03-12 | 2022-06-07 | 重庆师范大学 | Interactive computer remote education system |
-
2018
- 2018-12-29 CN CN201811639123.4A patent/CN109711371A/en not_active Withdrawn
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110533333A (en) * | 2019-09-02 | 2019-12-03 | 西南大学 | A kind of Method of Teaching Appraisal and device |
| CN110533335A (en) * | 2019-09-02 | 2019-12-03 | 西南大学 | A kind of classroom cognitive load measurement method and system |
| CN110533992A (en) * | 2019-09-02 | 2019-12-03 | 西南大学 | A kind of learning effect prediction technique and system |
| CN110533336A (en) * | 2019-09-02 | 2019-12-03 | 西南大学 | A kind of instructional decisions matching process and device |
| CN110533333B (en) * | 2019-09-02 | 2022-08-19 | 西南大学 | Teaching evaluation method and device |
| CN110826510A (en) * | 2019-11-12 | 2020-02-21 | 电子科技大学 | Three-dimensional teaching classroom implementation method based on expression emotion calculation |
| CN111027865A (en) * | 2019-12-12 | 2020-04-17 | 山东大学 | Classroom teaching analysis and quality assessment system and method based on intelligent behavior and expression recognition |
| CN111027865B (en) * | 2019-12-12 | 2024-04-02 | 山东大学 | Teaching analysis and quality assessment system and method based on behavior and expression recognition |
| CN111178263A (en) * | 2019-12-30 | 2020-05-19 | 湖北美和易思教育科技有限公司 | Real-time expression analysis method and device |
| CN111178263B (en) * | 2019-12-30 | 2023-09-05 | 武汉美和易思数字科技有限公司 | Real-time expression analysis method and device |
| CN113256454A (en) * | 2020-02-07 | 2021-08-13 | 顾得科技教育股份有限公司 | Class course management system |
| CN111325645A (en) * | 2020-03-18 | 2020-06-23 | 温州洪启信息科技有限公司 | Teaching comprehensive analysis system based on education big data |
| CN111882305A (en) * | 2020-05-09 | 2020-11-03 | 北京文香信息技术有限公司 | Behavior analysis device and behavior monitoring analysis system |
| CN112967162A (en) * | 2021-02-02 | 2021-06-15 | 河南工业职业技术学院 | Accounting teaching method and accounting teaching device |
| CN112732770A (en) * | 2021-02-05 | 2021-04-30 | 嘉兴南洋职业技术学院 | Educational administration management system and method based on artificial intelligence |
| CN113256464A (en) * | 2021-05-28 | 2021-08-13 | 智慧校园(广东)教育科技有限公司 | Online education course automatic distribution system and method based on cloud computing |
| CN113256464B (en) * | 2021-05-28 | 2022-03-04 | 智慧校园(广东)教育科技有限公司 | Online education course automatic distribution system and method based on cloud computing |
| CN114596748A (en) * | 2022-03-12 | 2022-06-07 | 重庆师范大学 | Interactive computer remote education system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109711371A (en) | A kind of Estimating System of Classroom Teaching based on human facial expression recognition | |
| Thornton et al. | Training to improve observer accuracy. | |
| CN108182837A (en) | A kind of ideological and political education intelligent tutoring system | |
| CN109697682A (en) | A kind of on-line education system based on mobile intelligent terminal | |
| MacGeorge et al. | The influence of learning characteristics on evaluation of audience response technology | |
| Osadebe et al. | Undergraduate Business Education Students' Perception on Information and Communication Technology Use in Teaching and Learning. | |
| CN110457641A (en) | A kind of practical teaching classroom Assessment on teaching effect system | |
| CN108304779B (en) | Intelligent regulation and control method for student education management | |
| CN115170369A (en) | Live course online watching intelligent management system based on mobile internet | |
| Yang et al. | A systematic review of technology-enhanced self-regulated language learning | |
| Johnson et al. | Examining Interrater Agreement Analyses of a Pilot Special Education Observation Tool. | |
| Simonson | Attitude measurement: Why and how | |
| CN109388687A (en) | A kind of learning data analysis method and system | |
| Wolfschwenger et al. | Learning under Lockdown: The Conditions in Austria in a Global Context. | |
| CN108734612A (en) | A kind of Classroom Teaching device based on multi-aspect information acquisition | |
| CN111626647A (en) | Classroom teaching evaluation system based on facial expression recognition | |
| CN108985988A (en) | One kind being based on online teaching school work growing algorithm | |
| CN107886791A (en) | A kind of intelligent sharing method and its system based on teaching data | |
| Böheim et al. | A longitudinal study of student hand raising: Stability and reciprocal dynamics with cognitive elaboration and academic self-concept. | |
| Miles et al. | Training in the skills needed for in-service education programs | |
| Moon et al. | Development of the system for observing virtual real time lessons in physical education (SOVRTL-PE): A tool to support preservice teachers’ applied learning experiences | |
| Wang | Research on Classroom Teaching Quality Evaluation Method Based on Machine Vision Analysis | |
| Dönmez et al. | How signaling principle affects learning: An eye tracking study | |
| Bennett et al. | The development of a computer-based alternate assessment system | |
| DeBacy | The effect of viewing videotapes of a selected sport skill performed by self and others on self-assessment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20190503 |