CN107871416A - A kind of online course learning system caught based on face recognition expression - Google Patents
A kind of online course learning system caught based on face recognition expression Download PDFInfo
- Publication number
- CN107871416A CN107871416A CN201711077917.1A CN201711077917A CN107871416A CN 107871416 A CN107871416 A CN 107871416A CN 201711077917 A CN201711077917 A CN 201711077917A CN 107871416 A CN107871416 A CN 107871416A
- Authority
- CN
- China
- Prior art keywords
- module
- expression
- data
- terminal
- giving lessons
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
- G09B5/14—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Business, Economics & Management (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The invention discloses a kind of online course learning system caught based on face recognition expression, terminal is aided in including learning terminal, network transmission module, terminal of giving lessons, third party, learning terminal includes facial expression acquisition module, expressive features analysis module, central processing unit, online log-in module, terminal of giving lessons includes facial expression display module, aids in terminal to include online payment module, data displaying terminal, material upload module, data pushing module with reference to expression selecting module, with reference to Expression analysis module, data processor, third party.The present invention is by gathering and analyzing to the expression of learner so that the person of giving lessons can recognize the learning state of student in real time during whole give lessons, so as to flexibly adjust mode of giving lessons, more there is actual application value, improve the learning efficiency of learner, be worthy to be popularized and use.
Description
Technical field
The invention belongs to online course learning field, more particularly to a kind of online course caught based on face recognition expression
Learning system.
Background technology
On-line study, also referred to as Web education, i.e. E-Learning, are a kind of e-learning modes, i.e. student passes through
PC surfs the Net, and logs in on-line study system platform, by the way that network carries out curricula-variable, listening to the teacher, fulfiling assignment and taking an examination learnt to realize
A kind of brand-new mode of learning of journey.Using the rapidity and convenience of video transmission, the wide-scale distribution for process of giving lessons is realized,
And the problem of being directed to the teaching feedback deficiency that video one way propagation is brought, introduce interactive exercise.But interactive exercise is carried
The teaching feedback ability of confession still is apparent not enough compared with process of being given lessons below traditional wire.Under line in course, the person of giving lessons can pass through
Raw facial expression and by being fed back to student question, so as to make timely teaching readjustment, online course learning also without
Method accomplishes this point.
The content of the invention
It is an object of the invention to overcome problem above existing for prior art, there is provided one kind is caught based on face recognition expression
The online course learning system caught, on-line study state that can be to student are understood in time.
To realize above-mentioned technical purpose and the technique effect, the present invention is achieved through the following technical solutions：
It is a kind of based on face recognition expression catch online course learning system, including learning terminal, network transmission module,
Give lessons terminal, third party aid in terminal, learning terminal include facial expression acquisition module, expressive features analysis module, centre
Manage device, online log-in module, terminal of giving lessons include facial expression display module, with reference to expression selecting module, with reference to Expression analysis
Module, data processor, third party aid in terminal to include online payment module, data displaying terminal, material upload module, data
Pushing module；
The facial expression acquisition module is used to be acquired the real-time face expression of learner and send to expression spy
Levy analysis module；
The expressive features analysis module is used to receive the real-time face expression from facial expression acquisition module and carried out
Feature extraction, student's expressive features value is formed, then transmit student's expressive features value and real-time face expression to center
Processor；
The central processing unit is connected with expressive features analysis module, online log-in module, network transmission module respectively；
The online log-in module is logged in and watches the video of giving lessons for the person of giving lessons online on computers for learner；
The both-way communication connection that the network transmission module is used to establish learning terminal between terminal of giving lessons；
The data processor is used to receive student's expressive features value and real-time face expression from network transmission module
And handled；
The facial expression display module is used to receive the real-time face expression from data processor and shown；
It is described all real-time face expressions to be selected for the person of giving lessons with reference to expression selecting module, and by the reality of selection
When facial expression sent as real-time reference expression to reference to Expression analysis module；
It is described to be used for reference to Expression analysis module to carrying out feature from the real-time reference expression with reference to expression selecting module
Analysis, and formed and sent with reference to expression characteristic value to data processor；
After data processor is received with reference to expression characteristic value, by student's expressive features value of all learners with ginseng
Examine expressive features value to be compared, if comparison result difference proportion is more than or equal to 1/3rd, it is anti-to form prompting message
Be fed to the person of giving lessons, if comparison result difference proportion be less than three/first do not do any response；
The on-line payment module is used for learner and carries out on-line payment, and the data that formed after paying successfully obtains instruction and sent
To data displaying terminal；
The material upload module is used for the person of giving lessons and the real-time data of giving lessons is uploaded and stored, and then will give lessons in real time
Data is sent to data pushing module；
The data pushing module be used for receive from material upload module in real time give lessons data and push to network biography
Defeated module；
The data displaying terminal is connected with on-line payment module, network transmission module respectively, when data displaying terminal connects
When receiving the data acquisition instruction from on-line payment module, start to receive the data of giving lessons in real time from network transmission module.
Further, the expressive features value, with reference to expression characteristic value including the lip arc of curvature angle value of learner, eyebrow
Eye distance values, upper lower eyelid distance values.
Further, the network transmission module is any one in Internet network, 4G networks or LAN.
Further, the method for work of the system comprises the following steps：
Step 1：Learner is logged in online on computers by online log-in module and the reality of the remote watching person of giving lessons
When instructional video；
Step 2：Facial expression acquisition module, expressive features analysis module will be real-time in the whole learning process of learner
Facial expression is sent on the computer for the person of giving lessons by network；
Step 3：The person of giving lessons selects an expression as real-time reference expression and to observe in all real-time face expressions
The prompting message of data processor feedback；
Step 4：Course related data is uploaded and is pushed to learner by the person of giving lessons successively during giving lessons；
Step 5：Learner forms data acquisition instruction transmission to data after carrying out on-line payment by on-line payment module
Displaying terminal, then learner study is read out to course related data by data displaying terminal.
Further, the on-line payment module is e-Bank payment module or POS module.
The beneficial effects of the invention are as follows：
The present invention is by gathering and analyzing to the expression of learner so that the person of giving lessons is during whole give lessons, Neng Goushi
When recognize the learning state of student, so as to which flexible adjustment is given lessons mode, more with actual application value, improve study
The learning efficiency of person, it is worthy to be popularized and uses.
Brief description of the drawings
Accompanying drawing described herein is used for providing a further understanding of the present invention, forms the part of the application, this hair
Bright schematic description and description is used to explain the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings：
Fig. 1 is the system architecture diagram of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, rather than whole embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art are obtained all other under the premise of creative work is not made
Embodiment, belong to the scope of protection of the invention.
A kind of online course learning system caught based on face recognition expression as shown in Figure 1, including learning terminal, net
Network transport module, terminal of giving lessons, third party aid in terminal, and learning terminal includes facial expression acquisition module, expressive features are analyzed
Module, central processing unit, online log-in module, terminal of giving lessons include facial expression display module, with reference to expression selecting module, ginseng
Expression analysis module, data processor are examined, third party aids in terminal including in online payment module, data displaying terminal, data
Transmission module, data pushing module.
Facial expression acquisition module is used to be acquired the real-time face expression of learner and send to expressive features point
Analyse module；Expressive features analysis module is used to receive the real-time face expression from facial expression acquisition module and carry out feature to carry
Take, form student's expressive features value, then transmit student's expressive features value and real-time face expression to central processing unit；
Central processing unit is connected with expressive features analysis module, online log-in module, network transmission module respectively；Online log-in module is used
Logged in online on computers in learner and watch the video of giving lessons for the person of giving lessons.
The both-way communication connection that network transmission module is used to establish learning terminal between terminal of giving lessons, network transmission module
For any one in Internet network, 4G networks or LAN.
Data processor is used for student expressive features value and real-time face expression of the reception from network transmission module and gone forward side by side
Row processing；Facial expression display module is used to receive the real-time face expression from data processor and shown；Reference table
Feelings selecting module is selected all real-time face expressions for the person of giving lessons, and using the real-time face expression of selection as in real time
Sent with reference to expression to reference to Expression analysis module；It is used for reference to Expression analysis module to from the reality with reference to expression selecting module
When with reference to expression carry out signature analysis, and formed and sent with reference to expression characteristic value to data processor.
After data processor is received with reference to expression characteristic value, by student's expressive features value of all learners with ginseng
Examine expressive features value to be compared, if comparison result difference proportion is more than or equal to 1/3rd, it is anti-to form prompting message
Be fed to the person of giving lessons, if comparison result difference proportion be less than three/first do not do any response, expressive features value, reference table
Feelings characteristic value includes lip arc of curvature angle value, looks distance values, the upper lower eyelid distance values of learner.
On-line payment module is used for learner and carries out on-line payment, and formation data obtains instruction and sent to money after paying successfully
Expect displaying terminal；Material upload module is used for the person of giving lessons and the real-time data of giving lessons is uploaded and stored, and then will give lessons in real time
Data is sent to data pushing module；Data pushing module, which is used to receive giving lessons in real time from material upload module, data and to be pushed away
Deliver to network transmission module；Data displaying terminal is connected with on-line payment module, network transmission module respectively, when data is shown eventually
When termination receives the data acquisition instruction from on-line payment module, start to receive the money of giving lessons in real time from network transmission module
Material.
Wherein, the method for work of the system comprises the following steps：
Step 1：Learner is logged in online on computers by online log-in module and the reality of the remote watching person of giving lessons
When instructional video；
Step 2：Facial expression acquisition module, expressive features analysis module will be real-time in the whole learning process of learner
Facial expression is sent on the computer for the person of giving lessons by network；
Step 3：The person of giving lessons selects an expression as real-time reference expression and to observe in all real-time face expressions
The prompting message of data processor feedback；
Step 4：Course related data is uploaded and is pushed to learner by the person of giving lessons successively during giving lessons；
Step 5：Learner forms data acquisition instruction transmission to data after carrying out on-line payment by on-line payment module
Displaying terminal, then learner study is read out to course related data by data displaying terminal, on-line payment module is
E-Bank payment module or POS module.
The present invention is by gathering and analyzing to the expression of learner so that the person of giving lessons is during whole give lessons, Neng Goushi
When recognize the learning state of student, so as to which flexible adjustment is given lessons mode, more with actual application value, improve study
The learning efficiency of person, it is worthy to be popularized and uses.
In the description of this specification, the description of reference term " one embodiment ", " example ", " specific example " etc. means
At least one implementation of the present invention is contained in reference to specific features, structure, material or the feature that the embodiment or example describe
In example or example.In this manual, identical embodiment or example are not necessarily referring to the schematic representation of above-mentioned term.
Moreover, specific features, structure, material or the feature of description can close in any one or more embodiments or example
Suitable mode combines.
General principle, principal character and the advantages of the present invention of the present invention has been shown and described above.The technology of the industry
Personnel are it should be appreciated that the present invention is not limited to the above embodiments, and the simply explanation described in above-described embodiment and specification is originally
The principle of invention, without departing from the spirit and scope of the present invention, various changes and modifications of the present invention are possible, these changes
Change and improvement all fall within the protetion scope of the claimed invention.
Claims (5)
- A kind of 1. online course learning system caught based on face recognition expression, it is characterised in that：Including learning terminal, network Transport module, terminal of giving lessons, third party aid in terminal, and learning terminal includes facial expression acquisition module, expressive features analysis mould Block, central processing unit, online log-in module, terminal of giving lessons include facial expression display module, with reference to expression selecting module, reference Expression analysis module, data processor, third party aid in terminal to include online payment module, data displaying terminal, material upload Module, data pushing module；The facial expression acquisition module is used to be acquired the real-time face expression of learner and send to expressive features point Analyse module；The expressive features analysis module is used to receive the real-time face expression from facial expression acquisition module and carries out feature Extraction, student's expressive features value is formed, then transmit student's expressive features value and real-time face expression to central processing Device；The central processing unit is connected with expressive features analysis module, online log-in module, network transmission module respectively；The online log-in module is logged in and watches the video of giving lessons for the person of giving lessons online on computers for learner；The both-way communication connection that the network transmission module is used to establish learning terminal between terminal of giving lessons；The data processor is used for student expressive features value and real-time face expression of the reception from network transmission module and gone forward side by side Row processing；The facial expression display module is used to receive the real-time face expression from data processor and shown；It is described all real-time face expressions to be selected for the person of giving lessons with reference to expression selecting module, and by the real-time surface of selection Portion's expression is sent to reference to Expression analysis module as real-time reference expression；It is described to be used for reference to Expression analysis module to carrying out signature analysis from the real-time reference expression with reference to expression selecting module, And formed and sent with reference to expression characteristic value to data processor；After data processor is received with reference to expression characteristic value, by student's expressive features value of all learners and reference table Feelings characteristic value is compared, if comparison result difference proportion is more than or equal to 1/3rd, forms prompting message and feeds back to The person of giving lessons, if comparison result difference proportion be less than three/first do not do any response；The on-line payment module is used for learner and carries out on-line payment, and formation data obtains instruction and sent to money after paying successfully Expect displaying terminal；The material upload module is used for the person of giving lessons and the real-time data of giving lessons is uploaded and stored, then by data of giving lessons in real time Send to data pushing module；The data pushing module is used to receive giving lessons in real time from material upload module and data and pushes to network transmission mould Block；The data displaying terminal is connected with on-line payment module, network transmission module respectively, when data displaying terminal receives When data from on-line payment module obtains instruction, start to receive the data of giving lessons in real time from network transmission module.
- 2. a kind of online course learning system caught based on face recognition expression according to claim 1, its feature are existed In：The expressive features value, with reference to expression characteristic value including the lip arc of curvature angle value of learner, looks distance values, up and down Eyelid distance values.
- 3. a kind of online course learning system caught based on face recognition expression according to claim 1, its feature are existed In：The network transmission module is any one in Internet network, 4G networks or LAN.
- 4. a kind of online course learning system caught based on face recognition expression according to claim 1, its feature are existed In：The method of work of the system comprises the following steps：Step 1：Learner is logged in online on computers by online log-in module and the real-time religion of the remote watching person of giving lessons Learn video；Step 2：Facial expression acquisition module, expressive features analysis module are by the real-time face in the whole learning process of learner Expression is sent on the computer for the person of giving lessons by network；Step 3：The person of giving lessons selects an expression as real-time reference expression and observed data in all real-time face expressions The prompting message of processor feedback；Step 4：Course related data is uploaded and is pushed to learner by the person of giving lessons successively during giving lessons；Step 5：Formation data acquisition instruction transmission to data is shown after learner carries out on-line payment by on-line payment module Terminal, then learner study is read out to course related data by data displaying terminal.
- 5. a kind of online course learning system caught based on face recognition expression according to claim 4, its feature are existed In：The on-line payment module is e-Bank payment module or POS module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711077917.1A CN107871416A (en) | 2017-11-06 | 2017-11-06 | A kind of online course learning system caught based on face recognition expression |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711077917.1A CN107871416A (en) | 2017-11-06 | 2017-11-06 | A kind of online course learning system caught based on face recognition expression |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107871416A true CN107871416A (en) | 2018-04-03 |
Family
ID=61753531
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711077917.1A Pending CN107871416A (en) | 2017-11-06 | 2017-11-06 | A kind of online course learning system caught based on face recognition expression |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107871416A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108924608A (en) * | 2018-08-21 | 2018-11-30 | 广东小天才科技有限公司 | A kind of householder method and smart machine of video teaching |
| CN108961115A (en) * | 2018-07-02 | 2018-12-07 | 百度在线网络技术（北京）有限公司 | Method, apparatus, equipment and the computer readable storage medium of teaching data analysis |
| CN109147430A (en) * | 2018-10-19 | 2019-01-04 | 渭南师范学院 | A kind of teleeducation system based on cloud platform |
| CN109192050A (en) * | 2018-10-25 | 2019-01-11 | 重庆鲁班机器人技术研究院有限公司 | Experience type language teaching method, device and educational robot |
| CN109829441A (en) * | 2019-02-19 | 2019-05-31 | 山东大学 | A kind of human facial expression recognition method and device based on course learning |
| CN110910689A (en) * | 2018-09-18 | 2020-03-24 | 上海盛育信息技术有限公司 | AR online teaching system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102013176A (en) * | 2010-12-01 | 2011-04-13 | 曹乃承 | Online learning system |
| CN102945624A (en) * | 2012-11-14 | 2013-02-27 | 南京航空航天大学 | Intelligent video teaching system based on cloud calculation model and expression information feedback |
| CN105609098A (en) * | 2015-12-18 | 2016-05-25 | 江苏易乐网络科技有限公司 | Internet-based online learning system |
| CN106850846A (en) * | 2017-03-10 | 2017-06-13 | 重庆智绘点途科技有限公司 | A kind of telelearning system and method |
-
2017
- 2017-11-06 CN CN201711077917.1A patent/CN107871416A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102013176A (en) * | 2010-12-01 | 2011-04-13 | 曹乃承 | Online learning system |
| CN102945624A (en) * | 2012-11-14 | 2013-02-27 | 南京航空航天大学 | Intelligent video teaching system based on cloud calculation model and expression information feedback |
| CN105609098A (en) * | 2015-12-18 | 2016-05-25 | 江苏易乐网络科技有限公司 | Internet-based online learning system |
| CN106850846A (en) * | 2017-03-10 | 2017-06-13 | 重庆智绘点途科技有限公司 | A kind of telelearning system and method |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108961115A (en) * | 2018-07-02 | 2018-12-07 | 百度在线网络技术（北京）有限公司 | Method, apparatus, equipment and the computer readable storage medium of teaching data analysis |
| CN108924608A (en) * | 2018-08-21 | 2018-11-30 | 广东小天才科技有限公司 | A kind of householder method and smart machine of video teaching |
| CN108924608B (en) * | 2018-08-21 | 2021-04-30 | 广东小天才科技有限公司 | Auxiliary method for video teaching and intelligent equipment |
| CN110910689A (en) * | 2018-09-18 | 2020-03-24 | 上海盛育信息技术有限公司 | AR online teaching system |
| CN110910689B (en) * | 2018-09-18 | 2022-05-10 | 上海盛育信息技术有限公司 | AR online teaching system |
| CN109147430A (en) * | 2018-10-19 | 2019-01-04 | 渭南师范学院 | A kind of teleeducation system based on cloud platform |
| CN109192050A (en) * | 2018-10-25 | 2019-01-11 | 重庆鲁班机器人技术研究院有限公司 | Experience type language teaching method, device and educational robot |
| CN109829441A (en) * | 2019-02-19 | 2019-05-31 | 山东大学 | A kind of human facial expression recognition method and device based on course learning |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107871416A (en) | A kind of online course learning system caught based on face recognition expression | |
| CN107203953B (en) | Teaching system based on internet, expression recognition and voice recognition and implementation method thereof | |
| EP3998550A1 (en) | Scene interaction method and apparatus, electronic device, and computer storage medium | |
| CN107038765A (en) | A kind of dynamic check class attendance system and method | |
| CN108280785A (en) | Applied mathematics Education Administration Information System | |
| CN113486709B (en) | Intelligent education platform and method based on virtual reality multi-source deep interaction | |
| CN107705639A (en) | A kind of Online class caught based on face recognition puts question to answer system | |
| CN111935264A (en) | Intelligent classroom interaction system | |
| CN111292568A (en) | Remote online education system based on VR technology | |
| CN108389235A (en) | A kind of intelligence child drawing entertainment systems and its application method | |
| CN107862637A (en) | Wisdom education system | |
| CN111161574A (en) | Graphic programming online teaching system and online grouping teaching method | |
| US20170270812A1 (en) | Method for learning assessment | |
| CN114257776B (en) | Classroom interaction system | |
| CN108806374A (en) | A kind of tutoring system | |
| CN110348328A (en) | Appraisal procedure, device, storage medium and the electronic equipment of quality of instruction | |
| CN110794952A (en) | Virtual reality cooperative processing method, device and system | |
| CN108806375A (en) | A kind of interactive teaching method and system based on image recognition | |
| KR101808631B1 (en) | Method of posting poll response and a poll service server providing the method thereof | |
| CN108630056A (en) | A kind of music online teaching platform | |
| CN109951736B (en) | Filter method and system for online real-time video | |
| CN107644557A (en) | A kind of Classroom Teaching analysis system based on eyeball analysis | |
| CN115018676A (en) | Interactive equipment is used in online education based on VR technique | |
| CN107644558A (en) | Multimedia interaction method and system | |
| CN107622462A (en) | A kind of educational resource management system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180403 |