CN114787883A - 自动情绪识别方法、系统、计算设备及计算机可读存储介质 - Google Patents
自动情绪识别方法、系统、计算设备及计算机可读存储介质 Download PDFInfo
- Publication number
- CN114787883A CN114787883A CN202080002247.0A CN202080002247A CN114787883A CN 114787883 A CN114787883 A CN 114787883A CN 202080002247 A CN202080002247 A CN 202080002247A CN 114787883 A CN114787883 A CN 114787883A
- Authority
- CN
- China
- Prior art keywords
- data
- emotion recognition
- emotion
- automatic
- face
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000008909 emotion recognition Effects 0.000 title claims abstract description 119
- 238000000034 method Methods 0.000 title claims abstract description 56
- 230000008451 emotion Effects 0.000 claims abstract description 56
- 238000000605 extraction Methods 0.000 claims description 26
- 238000013527 convolutional neural network Methods 0.000 claims description 20
- 238000012549 training Methods 0.000 claims description 17
- 238000010606 normalization Methods 0.000 claims description 14
- 238000012360 testing method Methods 0.000 claims description 12
- 238000013528 artificial neural network Methods 0.000 claims description 8
- 238000007781 pre-processing Methods 0.000 claims description 8
- 210000003128 head Anatomy 0.000 claims description 6
- 238000012545 processing Methods 0.000 claims description 6
- 230000001815 facial effect Effects 0.000 claims description 5
- 210000001747 pupil Anatomy 0.000 claims description 5
- 238000000537 electroencephalography Methods 0.000 claims description 3
- 238000011156 evaluation Methods 0.000 claims description 3
- 238000013519 translation Methods 0.000 claims description 3
- 238000007499 fusion processing Methods 0.000 claims description 2
- 230000009323 psychological health Effects 0.000 abstract description 4
- 238000001514 detection method Methods 0.000 abstract description 3
- 238000011176 pooling Methods 0.000 description 16
- 230000004913 activation Effects 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 7
- 210000002569 neuron Anatomy 0.000 description 7
- 238000004891 communication Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 230000004630 mental health Effects 0.000 description 5
- 230000037007 arousal Effects 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000013135 deep learning Methods 0.000 description 3
- 230000002996 emotional effect Effects 0.000 description 3
- 238000002360 preparation method Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 208000019901 Anxiety disease Diseases 0.000 description 2
- 230000002411 adverse Effects 0.000 description 2
- 230000036506 anxiety Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 125000004122 cyclic group Chemical group 0.000 description 2
- 238000013136 deep learning model Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000036651 mood Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 206010022998 Irritability Diseases 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000003066 decision tree Methods 0.000 description 1
- 201000010099 disease Diseases 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 230000004399 eye closure Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000006386 memory function Effects 0.000 description 1
- 238000003062 neural network model Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 208000020016 psychiatric disease Diseases 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 241000894007 species Species 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012706 support-vector machine Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Life Sciences & Earth Sciences (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Artificial Intelligence (AREA)
- Image Analysis (AREA)
Abstract
一种自动情绪识别方法、系统、计算设备及计算机可读存储介质。所述自动情绪识别方法包括：获取来自多个不同数据源的情绪识别数据；将所述情绪识别数据输入至已经过训练的情绪识别模型进行识别，获取情绪识别结果。该方法，可以可靠的自动识别受试者的心理情绪，有助于对受试者的心理健康状况的评估和辅助检测。
Description
PCT国内申请，说明书已公开。
Claims (20)
- PCT国内申请，权利要求书已公开。
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2020/118887 WO2022067524A1 (zh) | 2020-09-29 | 2020-09-29 | 自动情绪识别方法、系统、计算设备及计算机可读存储介质 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114787883A true CN114787883A (zh) | 2022-07-22 |
Family
ID=80949269
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202080002247.0A Pending CN114787883A (zh) | 2020-09-29 | 2020-09-29 | 自动情绪识别方法、系统、计算设备及计算机可读存储介质 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN114787883A (zh) |
| WO (1) | WO2022067524A1 (zh) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115099311B (zh) * | 2022-06-06 | 2024-03-19 | 陕西师范大学 | 基于脑电时空频特征和眼动特征的多模态情绪分类方法 |
| CN114998440B (zh) * | 2022-08-08 | 2022-11-11 | 广东数业智能科技有限公司 | 基于多模态的测评方法、装置、介质及设备 |
| CN115186146A (zh) * | 2022-09-13 | 2022-10-14 | 北京科技大学 | 一种半结构化访谈与跨模态融合的情绪识别方法及装置 |
| CN116369949B (zh) * | 2023-06-06 | 2023-09-15 | 南昌航空大学 | 一种脑电信号分级情绪识别方法、系统、电子设备及介质 |
| CN116570289A (zh) * | 2023-07-11 | 2023-08-11 | 北京视友科技有限责任公司 | 一种基于便携式脑电的抑郁状态评估系统 |
| CN117171557B (zh) * | 2023-08-03 | 2024-03-22 | 武汉纺织大学 | 基于脑电信号的自监督情绪识别模型的预训练方法及装置 |
| CN116825365B (zh) * | 2023-08-30 | 2023-11-28 | 安徽爱学堂教育科技有限公司 | 基于多角度微表情的心理健康分析方法 |
| CN117520826B (zh) * | 2024-01-03 | 2024-04-05 | 武汉纺织大学 | 一种基于可穿戴设备的多模态情绪识别方法及系统 |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110163063A (zh) * | 2018-11-28 | 2019-08-23 | 腾讯数码（天津）有限公司 | 表情处理方法、装置、计算机可读存储介质和计算机设备 |
| CN110464366A (zh) * | 2019-07-01 | 2019-11-19 | 华南师范大学 | 一种情绪识别方法、系统及存储介质 |
| CN111190484A (zh) * | 2019-12-25 | 2020-05-22 | 中国人民解放军军事科学院国防科技创新研究院 | 一种多模态交互系统和方法 |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10255487B2 (en) * | 2015-12-24 | 2019-04-09 | Casio Computer Co., Ltd. | Emotion estimation apparatus using facial images of target individual, emotion estimation method, and non-transitory computer readable medium |
| CN109199412B (zh) * | 2018-09-28 | 2021-11-09 | 南京工程学院 | 基于眼动数据分析的异常情绪识别方法 |
| CN109730701B (zh) * | 2019-01-03 | 2022-07-26 | 中国电子科技集团公司电子科学研究院 | 一种情绪数据的获取方法及装置 |
| CN111000556A (zh) * | 2019-11-29 | 2020-04-14 | 上海师范大学 | 一种基于深度模糊森林的情绪识别方法 |
-
2020
- 2020-09-29 CN CN202080002247.0A patent/CN114787883A/zh active Pending
- 2020-09-29 WO PCT/CN2020/118887 patent/WO2022067524A1/zh active Application Filing
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110163063A (zh) * | 2018-11-28 | 2019-08-23 | 腾讯数码（天津）有限公司 | 表情处理方法、装置、计算机可读存储介质和计算机设备 |
| CN110464366A (zh) * | 2019-07-01 | 2019-11-19 | 华南师范大学 | 一种情绪识别方法、系统及存储介质 |
| CN111190484A (zh) * | 2019-12-25 | 2020-05-22 | 中国人民解放军军事科学院国防科技创新研究院 | 一种多模态交互系统和方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022067524A1 (zh) | 2022-04-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2022067524A1 (zh) | 自动情绪识别方法、系统、计算设备及计算机可读存储介质 | |
| Cimtay et al. | Cross-subject multimodal emotion recognition based on hybrid fusion | |
| Xu et al. | A one-dimensional CNN-LSTM model for epileptic seizure recognition using EEG signal analysis | |
| Pham et al. | Classification of short time series in early Parkinsonʼ s disease with deep learning of fuzzy recurrence plots | |
| Zhang et al. | Video-based stress detection through deep learning | |
| De Melo et al. | A deep multiscale spatiotemporal network for assessing depression from facial dynamics | |
| Karnati et al. | LieNet: A deep convolution neural network framework for detecting deception | |
| Joo et al. | Automated coding of televised leader displays: Detecting nonverbal political behavior with computer vision and deep learning | |
| Ertugrul et al. | Crossing domains for au coding: Perspectives, approaches, and measures | |
| Chen et al. | Smg: A micro-gesture dataset towards spontaneous body gestures for emotional stress state analysis | |
| Gupta et al. | Enhancing text using emotion detected from EEG signals | |
| Thomas et al. | A framework for analyzing financial behavior using machine learning classification of personality through handwriting analysis | |
| Xie et al. | Interpreting depression from question-wise long-term video recording of SDS evaluation | |
| Boloukian et al. | Recognition of words from brain-generated signals of speech-impaired people: Application of autoencoders as a neural Turing machine controller in deep neural networks | |
| CN117557941A (zh) | 基于多模态数据融合的视频智能分析系统及方法 | |
| Gomez et al. | Exploring facial expressions and action unit domains for Parkinson detection | |
| Bibbo’ et al. | Emotional Health Detection in HAR: New Approach Using Ensemble SNN | |
| Lopes Silva et al. | Chimerical dataset creation protocol based on Doddington zoo: A biometric application with face, eye, and ECG | |
| Asaad | Review on Deep Learning and Neural Network Implementation for Emotions Recognition | |
| Yadav et al. | Review of automated depression detection: Social posts, audio and video, open challenges and future direction | |
| Prome et al. | Deception detection using ML and DL techniques: A systematic review | |
| ALISAWI et al. | Real-Time Emotion Recognition Using Deep Learning Methods: Systematic Review | |
| Jo et al. | Diagnosis of depression based on four-stream model of bi-LSTM and CNN from audio and text information | |
| Lu et al. | Transformer encoder with multiscale deep learning for pain classification using physiological signals | |
| Kanna et al. | Detection of Emotion Employing Deep Learning Modelling Approach |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |