CN107767313A - A kind of intelligent interaction tutoring system with emotion recognition function - Google Patents
A kind of intelligent interaction tutoring system with emotion recognition function Download PDFInfo
- Publication number
- CN107767313A CN107767313A CN201710350291.0A CN201710350291A CN107767313A CN 107767313 A CN107767313 A CN 107767313A CN 201710350291 A CN201710350291 A CN 201710350291A CN 107767313 A CN107767313 A CN 107767313A
- Authority
- CN
- China
- Prior art keywords
- mobile terminal
- teaching
- teachers
- intelligent
- interaction platform
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 23
- 230000008909 emotion recognition Effects 0.000 title claims abstract description 9
- 238000000034 method Methods 0.000 claims abstract description 12
- 230000014509 gene expression Effects 0.000 claims abstract description 8
- 230000002452 interceptive effect Effects 0.000 claims abstract description 8
- 230000006870 function Effects 0.000 claims description 8
- 230000008569 process Effects 0.000 claims description 6
- 230000001815 facial effect Effects 0.000 claims description 5
- 230000000694 effects Effects 0.000 claims description 4
- 238000003012 network analysis Methods 0.000 claims description 3
- 230000008921 facial expression Effects 0.000 claims description 2
- 230000004044 response Effects 0.000 claims description 2
- 230000008451 emotion Effects 0.000 abstract description 4
- 230000036541 health Effects 0.000 abstract description 2
- 235000013399 edible fruits Nutrition 0.000 description 2
- 230000036651 mood Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
- G06Q50/205—Education administration or guidance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Strategic Management (AREA)
- Theoretical Computer Science (AREA)
- Educational Administration (AREA)
- Tourism & Hospitality (AREA)
- Economics (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Educational Technology (AREA)
- Multimedia (AREA)
- General Business, Economics & Management (AREA)
- Development Economics (AREA)
- Entrepreneurship & Innovation (AREA)
- Human Computer Interaction (AREA)
- Marketing (AREA)
- Quality & Reliability (AREA)
- Operations Research (AREA)
- Game Theory and Decision Science (AREA)
- Primary Health Care (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The invention discloses a kind of intelligent interaction tutoring system with emotion recognition function, including a database, one group of face tracking system, one intelligent analysis system, one terminal interaction platform, the data of face tracking system tracks are passed through into inverse operation, draw face feature point information, characteristic point information is compared with the standard faces model set in database, assessment draws corresponding expression, and assessment result is sent to the teachers ' teaching mobile terminal into interaction platform, it is easy to teacher to adjust teaching method, and information sharing is carried out with linking up with parent's interactive mobile terminal on interaction platform, fully concern students' emotions of the invention, promote intelligent instructional device more hommization, realize the effective communication of school and family, lift quality of instruction, be advantageous to student health growth and development.
Description
Technical field
The present invention relates to teaching field, and being imparted knowledge to students more particularly to a kind of intelligent interaction with emotion recognition function is
System.
Background technology
With the development of electronic information technology and network technology, intelligent instructional device obtains extensively should in daily teaching
With in today that education is increasingly information-based so that teaching process is optimised, and efficiency of teaching is improved, with more rich exhibition
Existing form, has promoted the raising of quality of instruction.Paying attention to today of quality-oriented education, social, school and family by the emphasis of concern
The applications being placed on by all kinds of teaching equipments more, more preferable academic environment is created for student, cultivates wider hobby, is learned
Raw education resource is extremely abundant, but pressure is also aggravated therewith.
Many concern study ignores student individuality, the phenomenon of mood so that education deviates its essence with chasing after at all in itself
Ask, and many human factors such as the experience with students of teacher in itself also play certain restrictive function for student's emotion judgment,
So as to have influence on Students ' Learning and growth, lack effective information to judge concrete condition of the student during the study of school.
Therefore, how informationization technology is combined with education and instruction so that teaching process more hommization, to give student more complete
The education and culture in face, turn into the emphasis problem of education sector concern.
The content of the invention
It is an object of the invention to by it is a kind of with the intelligent interaction tutoring system of emotion recognition function come more than solving
The problem of background section is mentioned.
To achieve the above object, the present invention uses following technical scheme.
A kind of intelligent interaction tutoring system with emotion recognition function, including a database, one group of face tracking system
System, an intelligent analysis system, a terminal interaction platform.
Standard faces model is provided with the database, standard faces model is three-dimensional facial model, includes multiple expressions
Numerical variable.The face tracking system includes being applied to one group of intelligent high definition camera that classroom uses, and passes through the intelligence
The tracing program that high-definition camera is set through inside, can be to the facial table for the student for being putd question to or being answered a question on classroom
Feelings are tracked.
The database is compared, commented by the intelligent analysis system with the data that the face tracking system uploads
Estimate, its process can be described as：The data of the face tracking system tracks are being passed through into inverse operation, are showing that face feature point is believed
Breath, characteristic point information is compared with the interior standard faces model set, and assessment draws corresponding expression, and assessment result is sent
Teachers ' teaching mobile terminal into the interaction platform.
The interaction platform includes teachers ' teaching mobile terminal and parent's interactive mobile terminal.The teachers ' teaching movement is eventually
End after the conclusion that the intelligent analysis system evaluates is received, can according to student response, judge Students ' Learning state with
Situations such as state of listening to the teacher, and with regard to teaching method on this adjustment class or certain prompting is given, to ensure quality of instruction and classroom order
Sequence.
The teachers ' teaching mobile terminal can also combining with teaching experience and classroom site environment situation, according to assess tie
Fruit provides overall merit, and overall merit includes network analysis result and teachers'comments, and teacher can be moved eventually by teachers ' teaching
Information and parent's interactive mobile terminal are shared in end, and can be linked up in detail between two terminals, so as to parent more
Good grasps concrete condition of the child in the study of school and activity.
Fully concern students' emotions of the invention, promote intelligent instructional device more hommization, and that realizes school and family has
Effect is linked up, and lifts quality of instruction, is advantageous to student health growth and development.
Brief description of the drawings
Fig. 1 is a kind of intelligent interaction tutoring system with emotion recognition function of the present invention.
Embodiment
The present invention is best understood from for those skilled in the art, the invention will be further described with reference to the accompanying drawings and examples,
Further need exist for illustrating, for the ease of description, part related to the present invention rather than full content are illustrate only in accompanying drawing.
Refer to shown in Fig. 1, the present embodiment provides a kind of intelligent interaction tutoring system with emotion recognition function, including
One database（1）, one group of face tracking system（2）, an intelligent analysis system（3）, a terminal interaction platform（4）.
The database（1）Interior to be provided with standard faces model, standard faces model is three-dimensional facial model, includes multiple tables
Feelings numerical variable.The face tracking system（2）Including the one group of intelligent high definition camera used suitable for classroom, by described
The tracing program that intelligent high definition camera is set through inside, can be to the face for the student for being putd question to or being answered a question on classroom
Portion's expression is tracked.
The intelligent analysis system（3）By the database and the face tracking system（2）The data of upload are compared
To, assess, its process can be described as：By the face tracking system tracks（2）Data pass through inverse operation, draw facial spy
Sign point information, characteristic point information is compared with the interior standard faces model set, and assessment draws corresponding expression, and is tied assessing
Fruit is sent to the interaction platform（4）In teachers ' teaching mobile terminal（4-1）.
The interaction platform（4）Including teachers ' teaching mobile terminal（4-1）And parent's interactive mobile terminal（4-2）.It is described
Teachers ' teaching mobile terminal（4-1）Receiving the intelligent analysis system（3）, can be anti-according to student after the conclusion evaluated
Should, judge Students ' Learning state and listen to the teacher state situations such as, and with regard to teaching method on this adjustment class or give certain prompting, with
Ensure quality of instruction and classroom discipline.
The teachers ' teaching mobile terminal（4-1）Can also combining with teaching experience and classroom site environment situation, according to
Assessment result provides overall merit, and overall merit includes network analysis result and teachers'comments, and teacher can pass through teachers ' teaching
Mobile terminal（4-1）By information and parent's interactive mobile terminal（4-2）Shared, and can be carried out between two terminals in detail
Link up, so that parent preferably grasps concrete condition of the child in the study of school and activity.
Present invention can apply to daily teaching in classroom, long-distance education is also applied for, utilizes the long-range religion of integrated tracing program
Educate camera-shooting and recording device to complete facial expression data tracking and collect, and Emotion identification is completed by above-mentioned identification process, add class
Hall validity, teacher can adjust teaching method by immediate feedback, be advantageous to improve quality of distance education.
Claims (5)
1. the invention discloses a kind of intelligent interaction tutoring system with emotion recognition function, including a database, one group
Face tracking system, an intelligent analysis system, a terminal interaction platform, the data of the face tracking system tracks are passed through
Inverse operation is crossed, draws face feature point information, characteristic point information is compared with the standard faces model set in the database
Right, assessment draws corresponding expression, and assessment result is sent to the teachers ' teaching mobile terminal in the interaction platform, is easy to teach
Teacher adjusts teaching method, and carries out information sharing with linking up with parent's interactive mobile terminal on the interaction platform.
2. according to claim 1, it is characterised in that be provided with standard faces model, standard faces model in the database
For three-dimensional facial model, comprising multiple expression numerical variables, the face tracking system includes being applied to one group that classroom uses
Intelligent high definition camera, the tracing program set by the intelligent high definition camera through inside, can be to carrying out on classroom
The facial expression for the student for puing question to or answering a question is tracked.
3. according to claim 2, it is characterised in that the intelligent analysis system is by the database and the face tracking
The data that system uploads are compared, assessed, and its process can be described as：Pass through by the data of the face tracking system tracks
Inverse operation, face feature point information is drawn, characteristic point information is compared with the interior standard faces model set, assessment is drawn pair
Expression is answered, and assessment result is sent to the teachers ' teaching mobile terminal in the interaction platform.
4. according to claim 3, it is characterised in that the interaction platform includes teachers ' teaching mobile terminal and parent is interactive
Mobile terminal, the teachers ' teaching mobile terminal, being capable of bases after the conclusion that the intelligent analysis system evaluates is received
Student response, judge Students ' Learning state and listen to the teacher state situations such as, and with regard to teaching method on this adjustment class or give certain
Remind, to ensure quality of instruction and classroom discipline.
5. according to claim 4, it is characterised in that the teachers ' teaching mobile terminal can also combining with teaching experience and
Classroom site environment situation, overall merit is provided according to assessment result, overall merit includes network analysis result and commented with teacher
Language, teacher can be shared information and parent's interactive mobile terminal by teachers ' teaching mobile terminal, and can be in two terminals
Between linked up in detail, so as to parent preferably grasp child the study of school and activity concrete condition.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710350291.0A CN107767313A (en) | 2017-05-18 | 2017-05-18 | A kind of intelligent interaction tutoring system with emotion recognition function |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710350291.0A CN107767313A (en) | 2017-05-18 | 2017-05-18 | A kind of intelligent interaction tutoring system with emotion recognition function |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107767313A true CN107767313A (en) | 2018-03-06 |
Family
ID=61265187
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710350291.0A Pending CN107767313A (en) | 2017-05-18 | 2017-05-18 | A kind of intelligent interaction tutoring system with emotion recognition function |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107767313A (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108564073A (en) * | 2018-06-20 | 2018-09-21 | 四川文理学院 | A kind of classroom environment middle school student Emotion identification method and device |
| CN108615211A (en) * | 2018-04-20 | 2018-10-02 | 山东英才学院 | A kind of children quality conduct education guide platform system |
| CN108694679A (en) * | 2018-05-15 | 2018-10-23 | 北京中庆现代技术股份有限公司 | A kind of method student's learning state detection and precisely pushed |
| CN108764047A (en) * | 2018-04-27 | 2018-11-06 | 深圳市商汤科技有限公司 | Group's emotion-directed behavior analysis method and device, electronic equipment, medium, product |
| CN108876676A (en) * | 2018-06-15 | 2018-11-23 | 四川文理学院 | A kind of robot teaching's method and system based on scene |
| CN109165578A (en) * | 2018-08-08 | 2019-01-08 | 盎锐（上海）信息科技有限公司 | Expression detection device and data processing method based on filming apparatus |
| CN109284713A (en) * | 2018-09-21 | 2019-01-29 | 上海健坤教育科技有限公司 | A kind of Emotion identification analysis system based on camera acquisition expression data |
| CN109523852A (en) * | 2018-11-21 | 2019-03-26 | 合肥虹慧达科技有限公司 | The study interactive system and its exchange method of view-based access control model monitoring |
| CN110008886A (en) * | 2019-03-29 | 2019-07-12 | 联想(北京)有限公司 | A kind of information processing method and information processing unit |
| CN110609619A (en) * | 2019-08-27 | 2019-12-24 | 格局商学教育科技（深圳）有限公司 | Multi-screen live broadcast interactive system based on panoramic immersion type teaching |
| CN111476217A (en) * | 2020-05-27 | 2020-07-31 | 上海乂学教育科技有限公司 | Intelligent learning system and method based on emotion recognition |
| CN112735213A (en) * | 2020-12-31 | 2021-04-30 | 奇点六艺教育科技股份有限公司 | Intelligent teaching method, system, terminal and storage medium |
| CN113823134A (en) * | 2021-09-23 | 2021-12-21 | 黑龙江大学 | Online classroom interaction device with student emotion analysis function and method thereof |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105931158A (en) * | 2016-05-05 | 2016-09-07 | 北京爱提分博乐教育科技有限公司 | Teacher teaching flow monitoring system |
| CN106023693A (en) * | 2016-05-25 | 2016-10-12 | 北京九天翱翔科技有限公司 | Education system and method based on virtual reality technology and pattern recognition technology |
| CN106097801A (en) * | 2016-08-30 | 2016-11-09 | 四川汉博德信息技术有限公司 | A kind of wisdom classroom system being beneficial to improve learning interest |
-
2017
- 2017-05-18 CN CN201710350291.0A patent/CN107767313A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105931158A (en) * | 2016-05-05 | 2016-09-07 | 北京爱提分博乐教育科技有限公司 | Teacher teaching flow monitoring system |
| CN106023693A (en) * | 2016-05-25 | 2016-10-12 | 北京九天翱翔科技有限公司 | Education system and method based on virtual reality technology and pattern recognition technology |
| CN106097801A (en) * | 2016-08-30 | 2016-11-09 | 四川汉博德信息技术有限公司 | A kind of wisdom classroom system being beneficial to improve learning interest |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108615211A (en) * | 2018-04-20 | 2018-10-02 | 山东英才学院 | A kind of children quality conduct education guide platform system |
| CN108764047A (en) * | 2018-04-27 | 2018-11-06 | 深圳市商汤科技有限公司 | Group's emotion-directed behavior analysis method and device, electronic equipment, medium, product |
| CN108694679A (en) * | 2018-05-15 | 2018-10-23 | 北京中庆现代技术股份有限公司 | A kind of method student's learning state detection and precisely pushed |
| CN108876676A (en) * | 2018-06-15 | 2018-11-23 | 四川文理学院 | A kind of robot teaching's method and system based on scene |
| CN108564073A (en) * | 2018-06-20 | 2018-09-21 | 四川文理学院 | A kind of classroom environment middle school student Emotion identification method and device |
| CN109165578A (en) * | 2018-08-08 | 2019-01-08 | 盎锐（上海）信息科技有限公司 | Expression detection device and data processing method based on filming apparatus |
| CN109284713A (en) * | 2018-09-21 | 2019-01-29 | 上海健坤教育科技有限公司 | A kind of Emotion identification analysis system based on camera acquisition expression data |
| CN109523852A (en) * | 2018-11-21 | 2019-03-26 | 合肥虹慧达科技有限公司 | The study interactive system and its exchange method of view-based access control model monitoring |
| CN110008886A (en) * | 2019-03-29 | 2019-07-12 | 联想(北京)有限公司 | A kind of information processing method and information processing unit |
| CN110609619A (en) * | 2019-08-27 | 2019-12-24 | 格局商学教育科技（深圳）有限公司 | Multi-screen live broadcast interactive system based on panoramic immersion type teaching |
| CN111476217A (en) * | 2020-05-27 | 2020-07-31 | 上海乂学教育科技有限公司 | Intelligent learning system and method based on emotion recognition |
| CN112735213A (en) * | 2020-12-31 | 2021-04-30 | 奇点六艺教育科技股份有限公司 | Intelligent teaching method, system, terminal and storage medium |
| CN113823134A (en) * | 2021-09-23 | 2021-12-21 | 黑龙江大学 | Online classroom interaction device with student emotion analysis function and method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107767313A (en) | A kind of intelligent interaction tutoring system with emotion recognition function | |
| Yufeia et al. | Review of the application of artificial intelligence in education | |
| Ayob et al. | A Review of Research on Creative Teachers in Higher Education. | |
| Elman et al. | Learning through research: Using data to train undergraduates in qualitative methods | |
| CN107194845A (en) | Based on internet classroom Education Administration Information System | |
| CN107591049A (en) | The teaching method given lessons using video | |
| Yu et al. | Teaching system of smart learning environment for aerobics course | |
| CN107067855B (en) | Autonomous lesson preparation system and unmanned teaching system thereof | |
| Kuo | The current situation of AI foreign language education and its influence on college Japanese teaching | |
| CN109615960A (en) | A kind of teaching combination patten school eduaction method | |
| CN104077932A (en) | Interactive television teaching method, system and device based on broadcast television network | |
| Amiel et al. | A project oriented learning experience for teaching electronics fundamentals | |
| CN108154732A (en) | Online teaching study growth management system based on big data technology | |
| Xia et al. | Teaching strategies of biological experiments in middle schools based on VR technology | |
| Sonthitham et al. | Development and efficiency validation of training course on smart farm based on STEM education: A case study of abalone mushroom | |
| Maruyama et al. | Design and validation of leadership education integrating simulation and project based learning | |
| CN107705654A (en) | A kind of ideology and politics net work teaching system and method | |
| Wu | Networking college’s smart education system based on omnidirectional interaction model | |
| CN110021207A (en) | A kind of teaching combination patten school eduaction method | |
| Calico et al. | Knowledge and perceptions of agricultural communications pilot curriculum in Arkansas secondary agricultural classrooms | |
| Yuan et al. | Effect Analysis and Method Suggestions of Online Learning under the Public Epidemic Crisis | |
| Zhang | Research on Blending Teaching Model Innovation of College English Based on Mobile Learning | |
| CN205016087U (en) | Multimedia interactive teaching system | |
| Li | Research on the Application of Constructivism in China in the New Media Environment-Taking Educational Psychology as a Case Study | |
| Ren et al. | Research and practice of flipped classroom based on rain classroom under the background of big data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20180306 |
|
| WD01 | Invention patent application deemed withdrawn after publication |