CN109284713A - A kind of Emotion identification analysis system based on camera acquisition expression data - Google Patents
A kind of Emotion identification analysis system based on camera acquisition expression data Download PDFInfo
- Publication number
- CN109284713A CN109284713A CN201811105106.2A CN201811105106A CN109284713A CN 109284713 A CN109284713 A CN 109284713A CN 201811105106 A CN201811105106 A CN 201811105106A CN 109284713 A CN109284713 A CN 109284713A
- Authority
- CN
- China
- Prior art keywords
- expression
- analysis
- image
- module
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/213—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
- G06F18/2135—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods based on approximation criteria, e.g. principal component analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
- G06F18/2411—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on the proximity to a decision surface, e.g. support vector machines
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/084—Backpropagation, e.g. using gradient descent
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Life Sciences & Earth Sciences (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Computational Linguistics (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a kind of Emotion identification analysis systems based on camera acquisition expression data, belong to educational facilities field.It includes image capture module, Emotion identification module and analysis and processing module, and image capture module is for acquiring facial image；Classification of the Emotion identification module for identification and the pretreatment, the extraction of human face expression feature and human face expression of facial image；Analysis and processing module is used to handle the analysis after facial expression classification, and it is fed back in time, the collected facial image of image capture module, obtain face image data, face image data enters in Emotion identification module the classification for successively carrying out facial image identification and pretreatment, the extraction of human face expression feature and human face expression, and sorted data enter analysis processing.To solve the problems, such as that teacher has careless omission judgement to the learning state of student, how targetedly to fill a vacancy to the study weak link for tracking and recording each student and to each student progress leakage detection and play very big help.
Description
Technical field
The present invention relates to a kind of Emotion identification analysis systems based on camera acquisition expression data, belong to educational facilities neck
Domain.
Background technique
Under traditional teaching mode, teacher on classroom per tens students in one class of secondary guidance, in addition along with religion
Task is heavy, inevitably has careless omission to the judgement of the learning state of student, then thin to the study for tracking and recording each student
Weak link and how targetedly to each student carry out leakage detection fill a vacancy and can have an impact, to cause teaching efficiency bad.
Summary of the invention
Technical problem to be solved by the present invention lies in: a kind of Emotion identification based on camera acquisition expression data is provided
Analysis system, it solves the problems, such as that teacher has careless omission judgement to the learning state of student.
The technical problems to be solved by the invention take following technical scheme to realize:
A kind of Emotion identification analysis system based on camera acquisition expression data, including image capture module, Emotion identification mould
Block and analysis and processing module,
Described image acquisition module is for acquiring facial image；
Identification and pretreatment, the extraction of human face expression feature and human face expression of the Emotion identification module for facial image
Classification；
The analysis and processing module is used to handle the analysis after facial expression classification, and the result obtained after analysis processing is used to sentence
The case where disconnected attention of student is concentrated,
The collected facial image of described image acquisition module, obtains face image data, and the face image data enters feelings
The classification of facial image identification and pretreatment, the extraction of human face expression feature and human face expression is successively carried out in thread identification module,
Classify according to pleasure, anger, sorrow, happiness in human face expression, sorted data enter analysis processing, obtain after the analysis processing
Result be used to judge attention of student concentrate the case where.
As preferred embodiment, facial image identification and pretreatment in the Emotion identification module successively include load inspection
Survey, image ashing, Face datection, expression picture frame and reading data.
As preferred embodiment, the method for the facial expression classification is as follows:
A. the data that human face expression is extracted are received, carry out pleasure, anger, sorrow, happiness judgement respectively；
B. judgement is one of pleasure, anger, sorrow, happiness, is just directly analyzed and processed；If not one of pleasure, anger, sorrow, happiness,
It will rejudge, until judging one of pleasure, anger, sorrow, happiness, then be analyzed and processed.
As preferred embodiment, described image pretreatment uses geometrical normalization and histogram equalization method, the expression
Feature extraction carries out Feature Dimension Reduction using PCA algorithm, and the facial expression classification uses BP neural network, svm classifier method.
The beneficial effects of the present invention are: the present invention provides a kind of Emotion identifications point based on camera acquisition expression data
Analysis system is used to help teacher and pays close attention to pleasure, anger, sorrow, happiness caused by the study of each child in class, mainly uses with lower section
Method first uses the collected facial image of image capture module, obtains face image data, then face image data enters mood
The classification that facial image identification and pretreatment, the extraction of human face expression feature and human face expression are successively carried out in identification module, is pressed
Classify according to pleasure, anger, sorrow, happiness in human face expression, sorted data enter analysis processing, the result obtained after analysis processing
For judging that the attention of student concentrates situation, situation is concentrated according to attention, teacher is easier to learn that student corresponds in study
The learning effect of knowledge point, to solve the problems, such as that teacher has careless omission judgement to the learning state of student, to tracking and note
It records the study weak link of each student and how targetedly to fill a vacancy each student progress leakage detection and play very big help.
Detailed description of the invention
Fig. 1 is schematic diagram of the invention；
Fig. 2 is facial image identification and pretreated schematic diagram in the present invention;
Fig. 3 is the schematic diagram of part A in Fig. 1.
Specific embodiment
In order to be easy to understand to technical means, creative features, achievable purpose and effectiveness of the invention, below with reference to tool
Body embodiment, the present invention is further explained.
As shown in Figure 1-3, a kind of Emotion identification analysis system based on camera acquisition expression data, including Image Acquisition
Module, Emotion identification module and analysis and processing module,
Image capture module is for acquiring facial image；
Point of the Emotion identification module for identification and the pretreatment, the extraction of human face expression feature and human face expression of facial image
Class；
Analysis and processing module is used to handle the analysis after facial expression classification, and the result obtained after analysis processing is used to judge to learn
The case where raw attention is concentrated,
The collected facial image of image capture module, obtains face image data, and face image data enters Emotion identification mould
The classification that facial image identification and pretreatment, the extraction of human face expression feature and human face expression are successively carried out in block, according to face
Pleasure, anger, sorrow, happiness are classified in expression, and sorted data enter analysis processing, and the result obtained after analysis processing is used to sentence
The case where disconnected attention of student is concentrated.
Facial image identification and pretreatment in Emotion identification module successively include load detection, image ashing, face inspection
Survey, expression picture frame and reading data.
The method of facial expression classification is as follows:
A. the data that human face expression is extracted are received, carry out pleasure, anger, sorrow, happiness judgement respectively；
B. judgement is one of pleasure, anger, sorrow, happiness, is just directly analyzed and processed；If not one of pleasure, anger, sorrow, happiness,
It will rejudge, until judging one of pleasure, anger, sorrow, happiness, then be analyzed and processed.
Image preprocessing use geometrical normalization and histogram equalization method, human facial feature extraction using PCA algorithm into
Row Feature Dimension Reduction, facial expression classification use BP neural network, svm classifier method.
The collected facial image of image capture module first, obtains face image data, and face image data enters feelings
It is initially entered in thread identification module in facial image identification and preprocessing process, successively by facial image identification and pretreatment
Load detection, image ashing, Face datection, expression picture frame and read data, then data using PCA algorithm progress face table
The extraction of feelings feature and BP neural network is utilized, svm classifier method classifies to human face expression, and carries out first in classification
The judgement of happiness, anger, grief and joy is carried out in facial expression classification first, then judgement is one of pleasure, anger, sorrow, happiness, with regard to directly carrying out
Analysis processing；If not one of pleasure, anger, sorrow, happiness are it is necessary to rejudge, until judging one in pleasure, anger, sorrow, happiness
Kind, then be analyzed and processed, the result that ultimate analysis processing obtains is used to judge the case where attention of student is concentrated, to assist
Teacher imparts knowledge to students to student.
The above shows and describes the basic principles and main features of the present invention and the advantages of the present invention.The technology of the industry
Personnel are it should be appreciated that the present invention is not limited to the above embodiments, without departing from the spirit and scope of the present invention, this hair
Bright to will also have various changes and improvements, these changes and improvements all fall within the protetion scope of the claimed invention.The present invention claims
Protection scope is defined by the appending claims and its equivalent thereof.
Claims (4)
1. a kind of Emotion identification analysis system based on camera acquisition expression data, it is characterised in that: including Image Acquisition mould
Block, Emotion identification module and analysis and processing module,
Described image acquisition module is for acquiring facial image；
Identification and pretreatment, the extraction of human face expression feature and human face expression of the Emotion identification module for facial image
Classification；
The analysis and processing module is used to handle the analysis after facial expression classification, and the result obtained after analysis processing is used to sentence
The case where disconnected attention of student is concentrated,
The collected facial image of described image acquisition module, obtains face image data, and the face image data enters feelings
The classification of facial image identification and pretreatment, the extraction of human face expression feature and human face expression is successively carried out in thread identification module,
Classify according to pleasure, anger, sorrow, happiness in human face expression, sorted data enter analysis processing, obtain after the analysis processing
Result be used to judge attention of student concentrate the case where.
2. a kind of Emotion identification analysis system based on camera acquisition expression data, feature exist according to claim 1
In: facial image identification and pretreatment in the Emotion identification module successively include load detection, image ashing, face inspection
Survey, expression picture frame and reading data.
3. a kind of Emotion identification analysis system based on camera acquisition expression data, feature exist according to claim 1
In: the method for the facial expression classification is as follows:
A, the data that human face expression is extracted are received, carry out pleasure, anger, sorrow, happiness judgement respectively；
B, judgement is one of pleasure, anger, sorrow, happiness, is just directly analyzed and processed；If not one of pleasure, anger, sorrow, happiness,
It will rejudge, until judging one of pleasure, anger, sorrow, happiness, then be analyzed and processed.
4. a kind of Emotion identification analysis system based on camera acquisition expression data, feature exist according to claim 1
In: described image pretreatment uses geometrical normalization and histogram equalization method, and the human facial feature extraction uses PCA algorithm
Feature Dimension Reduction is carried out, the facial expression classification uses BP neural network, svm classifier method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811105106.2A CN109284713A (en) | 2018-09-21 | 2018-09-21 | A kind of Emotion identification analysis system based on camera acquisition expression data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811105106.2A CN109284713A (en) | 2018-09-21 | 2018-09-21 | A kind of Emotion identification analysis system based on camera acquisition expression data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109284713A true CN109284713A (en) | 2019-01-29 |
Family
ID=65181320
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811105106.2A Pending CN109284713A (en) | 2018-09-21 | 2018-09-21 | A kind of Emotion identification analysis system based on camera acquisition expression data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109284713A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110119723A (en) * | 2019-05-17 | 2019-08-13 | 北京深醒科技有限公司 | One kind carries out blocking facial expression recognizing method based on ACNN |
| CN110222623A (en) * | 2019-05-31 | 2019-09-10 | 深圳市恩钛控股有限公司 | Micro- expression analysis method and system |
| CN110969073A (en) * | 2019-08-23 | 2020-04-07 | 贵州大学 | Facial expression recognition method based on feature fusion and BP neural network |
| CN111178263A (en) * | 2019-12-30 | 2020-05-19 | 湖北美和易思教育科技有限公司 | Real-time expression analysis method and device |
| CN111553311A (en) * | 2020-05-13 | 2020-08-18 | 吉林工程技术师范学院 | Micro-expression recognition robot and control method thereof |
| CN111956243A (en) * | 2020-08-20 | 2020-11-20 | 大连理工大学 | Stress assessment system for counter |
| WO2021047185A1 (en) * | 2019-09-12 | 2021-03-18 | 深圳壹账通智能科技有限公司 | Monitoring method and apparatus based on facial recognition, and storage medium and computer device |
| CN116597497A (en) * | 2023-06-16 | 2023-08-15 | 绍兴市麦芒智能科技有限公司 | Data acquisition and analysis method for AI (advanced technology attachment) recognition of facial expressions |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101034433A (en) * | 2007-01-12 | 2007-09-12 | 郑文明 | Method for classification human facial expression and semantics judgement quantization method |
| CN106599881A (en) * | 2016-12-30 | 2017-04-26 | 首都师范大学 | Student state determination method, device and system |
| CN107292271A (en) * | 2017-06-23 | 2017-10-24 | 北京易真学思教育科技有限公司 | Learning-memory behavior method, device and electronic equipment |
| CN107316261A (en) * | 2017-07-10 | 2017-11-03 | 湖北科技学院 | A kind of Evaluation System for Teaching Quality based on human face analysis |
| CN107392159A (en) * | 2017-07-27 | 2017-11-24 | 竹间智能科技（上海）有限公司 | A kind of facial focus detecting system and method |
| CN107767313A (en) * | 2017-05-18 | 2018-03-06 | 青岛陶知电子科技有限公司 | A kind of intelligent interaction tutoring system with emotion recognition function |
-
2018
- 2018-09-21 CN CN201811105106.2A patent/CN109284713A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101034433A (en) * | 2007-01-12 | 2007-09-12 | 郑文明 | Method for classification human facial expression and semantics judgement quantization method |
| CN106599881A (en) * | 2016-12-30 | 2017-04-26 | 首都师范大学 | Student state determination method, device and system |
| CN107767313A (en) * | 2017-05-18 | 2018-03-06 | 青岛陶知电子科技有限公司 | A kind of intelligent interaction tutoring system with emotion recognition function |
| CN107292271A (en) * | 2017-06-23 | 2017-10-24 | 北京易真学思教育科技有限公司 | Learning-memory behavior method, device and electronic equipment |
| CN107316261A (en) * | 2017-07-10 | 2017-11-03 | 湖北科技学院 | A kind of Evaluation System for Teaching Quality based on human face analysis |
| CN107392159A (en) * | 2017-07-27 | 2017-11-24 | 竹间智能科技（上海）有限公司 | A kind of facial focus detecting system and method |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110119723A (en) * | 2019-05-17 | 2019-08-13 | 北京深醒科技有限公司 | One kind carries out blocking facial expression recognizing method based on ACNN |
| CN110222623A (en) * | 2019-05-31 | 2019-09-10 | 深圳市恩钛控股有限公司 | Micro- expression analysis method and system |
| CN110969073A (en) * | 2019-08-23 | 2020-04-07 | 贵州大学 | Facial expression recognition method based on feature fusion and BP neural network |
| CN110969073B (en) * | 2019-08-23 | 2023-02-03 | 贵州大学 | Facial expression recognition method based on feature fusion and BP neural network |
| WO2021047185A1 (en) * | 2019-09-12 | 2021-03-18 | 深圳壹账通智能科技有限公司 | Monitoring method and apparatus based on facial recognition, and storage medium and computer device |
| CN111178263A (en) * | 2019-12-30 | 2020-05-19 | 湖北美和易思教育科技有限公司 | Real-time expression analysis method and device |
| CN111178263B (en) * | 2019-12-30 | 2023-09-05 | 武汉美和易思数字科技有限公司 | Real-time expression analysis method and device |
| CN111553311A (en) * | 2020-05-13 | 2020-08-18 | 吉林工程技术师范学院 | Micro-expression recognition robot and control method thereof |
| CN111956243A (en) * | 2020-08-20 | 2020-11-20 | 大连理工大学 | Stress assessment system for counter |
| CN116597497A (en) * | 2023-06-16 | 2023-08-15 | 绍兴市麦芒智能科技有限公司 | Data acquisition and analysis method for AI (advanced technology attachment) recognition of facial expressions |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109284713A (en) | A kind of Emotion identification analysis system based on camera acquisition expression data | |
| CN108648757B (en) | Analysis method based on multi-dimensional classroom information | |
| US9666088B2 (en) | Video-based teacher assistance | |
| Dehghan et al. | View independent vehicle make, model and color recognition using convolutional neural network | |
| CN109740446A (en) | Classroom students ' behavior analysis method and device | |
| Saudagare et al. | Facial expression recognition using neural network–An overview | |
| CN107918821A (en) | Teachers ' classroom teaching process analysis method and system based on artificial intelligence technology | |
| CN108399376A (en) | Student classroom learning interest intelligent analysis method and system | |
| CN107316261A (en) | A kind of Evaluation System for Teaching Quality based on human face analysis | |
| CN113657168B (en) | Student learning emotion recognition method based on convolutional neural network | |
| Bouhlal et al. | Emotions recognition as innovative tool for improving students’ performance and learning approaches | |
| CN110427977B (en) | Detection method for classroom interaction behavior | |
| CN109492105A (en) | A kind of text sentiment classification method based on multiple features integrated study | |
| Butko et al. | Automated facial affect analysis for one-on-one tutoring applications | |
| Setialana et al. | Intelligent attendance system with face recognition using the deep convolutional neural network method | |
| Agarwal et al. | Face recognition based smart and robust attendance monitoring using deep CNN | |
| Adewale et al. | Conversion of sign language to text and speech using machine learning techniques | |
| Krishnamoorthy et al. | E-Learning Platform for Hearing Impaired Students | |
| CN114638988A (en) | Teaching video automatic classification method and system based on different presentation modes | |
| CN114005054A (en) | AI intelligence system of grading | |
| Ning et al. | Application of psychological analysis of micro-expression recognition in teaching evaluation | |
| Zin et al. | OCR perspectives in mobile teaching and learning for early school years in basic education | |
| CN111950472A (en) | Teacher grinding evaluation method and system | |
| Liu | AI proctoring for offline examinations with 2-Longitudinal-Stream Convolutional Neural Networks | |
| Pandimurugan et al. | Facial Emotion Recognition for Students Using Machine Learning |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190129 |
|
| RJ01 | Rejection of invention patent application after publication |