CN109034099A - 一种表情识别方法及装置 - Google Patents
一种表情识别方法及装置 Download PDFInfo
- Publication number
- CN109034099A CN109034099A CN201810920958.0A CN201810920958A CN109034099A CN 109034099 A CN109034099 A CN 109034099A CN 201810920958 A CN201810920958 A CN 201810920958A CN 109034099 A CN109034099 A CN 109034099A
- Authority
- CN
- China
- Prior art keywords
- facial expression
- facial
- expression image
- image
- point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000014509 gene expression Effects 0.000 title claims abstract description 119
- 238000000034 method Methods 0.000 title claims abstract description 30
- 230000008921 facial expression Effects 0.000 claims abstract description 299
- 230000001815 facial effect Effects 0.000 claims abstract description 88
- 239000000284 extract Substances 0.000 claims abstract description 8
- 238000010606 normalization Methods 0.000 claims description 34
- 238000000605 extraction Methods 0.000 claims description 6
- 230000008859 change Effects 0.000 abstract description 15
- 210000003128 head Anatomy 0.000 description 30
- 210000000744 eyelid Anatomy 0.000 description 12
- 230000008569 process Effects 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 5
- 230000008451 emotion Effects 0.000 description 4
- 239000011159 matrix material Substances 0.000 description 4
- 230000003542 behavioural effect Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000013079 data visualisation Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000002474 experimental method Methods 0.000 description 2
- 210000004709 eyebrow Anatomy 0.000 description 2
- 210000000887 face Anatomy 0.000 description 2
- 230000000717 retained effect Effects 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 238000013519 translation Methods 0.000 description 2
- 206010053238 Amimia Diseases 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 210000001097 facial muscle Anatomy 0.000 description 1
- 238000009432 framing Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 210000004209 hair Anatomy 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012706 support-vector machine Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Analysis (AREA)
Abstract
Description
特征点角度ID | 特征描述 | 面部标记点 | 变化趋势 |
F28 | 嘴角下拉 | (58,33,61)(64,39,61) | 增大 |
F29 | 嘴角上扬 | (57,33,30)(65,39,32) | 增大 |
F30 | 眼睛变小 | (12,14,16)(20,22,24) | 减小 |
F31 | 眼睛变大 | (12,10,16)(20,18,24) | 增大 |
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810920958.0A CN109034099B (zh) | 2018-08-14 | 2018-08-14 | 一种表情识别方法及装置 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810920958.0A CN109034099B (zh) | 2018-08-14 | 2018-08-14 | 一种表情识别方法及装置 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109034099A true CN109034099A (zh) | 2018-12-18 |
CN109034099B CN109034099B (zh) | 2021-07-13 |
Family
ID=64634014
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810920958.0A Active CN109034099B (zh) | 2018-08-14 | 2018-08-14 | 一种表情识别方法及装置 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109034099B (zh) |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109753950A (zh) * | 2019-02-11 | 2019-05-14 | 河北工业大学 | 动态人脸表情识别方法 |
CN109902656A (zh) * | 2019-03-12 | 2019-06-18 | 吉林大学 | 一种面部动作单元的识别方法、系统 |
CN110020638A (zh) * | 2019-04-17 | 2019-07-16 | 唐晓颖 | 人脸表情识别方法、装置、设备和介质 |
CN110091874A (zh) * | 2019-05-07 | 2019-08-06 | 绍兴天宏激光科技有限公司 | 一种基于表情识别的安全驾驶系统及识别方法 |
CN110154757A (zh) * | 2019-05-30 | 2019-08-23 | 电子科技大学 | 公交车多方位安全驾驶保障方法 |
CN111523467A (zh) * | 2020-04-23 | 2020-08-11 | 北京百度网讯科技有限公司 | 人脸跟踪方法和装置 |
CN112150594A (zh) * | 2020-09-23 | 2020-12-29 | 网易(杭州)网络有限公司 | 表情制作的方法、装置和电子设备 |
CN113076916A (zh) * | 2021-04-19 | 2021-07-06 | 山东大学 | 基于几何特征加权融合的动态人脸表情识别方法及系统 |
CN115546868A (zh) * | 2022-10-25 | 2022-12-30 | 湖南芒果无际科技有限公司 | 面部动画采集设备、方法及可读存储介质 |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101908149A (zh) * | 2010-07-06 | 2010-12-08 | 北京理工大学 | 一种从人脸图像序列中识别脸部表情的方法 |
CN103246875A (zh) * | 2013-05-09 | 2013-08-14 | 东南大学 | 一种基于面部曲线弹性匹配的三维人脸识别方法 |
CN103971137A (zh) * | 2014-05-07 | 2014-08-06 | 上海电力学院 | 基于结构性稀疏特征学习的三维动态人脸表情识别方法 |
CN105354527A (zh) * | 2014-08-20 | 2016-02-24 | 南京普爱射线影像设备有限公司 | 一种消极表情识别鼓励系统 |
CN106815309A (zh) * | 2016-12-20 | 2017-06-09 | 北京奇虎科技有限公司 | 一种图像推送方法、装置以及移动终端 |
CN107045618A (zh) * | 2016-02-05 | 2017-08-15 | 北京陌上花科技有限公司 | 一种人脸表情识别方法及装置 |
CN108073855A (zh) * | 2016-11-11 | 2018-05-25 | 腾讯科技(深圳)有限公司 | 一种人脸表情的识别方法及系统 |
-
2018
- 2018-08-14 CN CN201810920958.0A patent/CN109034099B/zh active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101908149A (zh) * | 2010-07-06 | 2010-12-08 | 北京理工大学 | 一种从人脸图像序列中识别脸部表情的方法 |
CN103246875A (zh) * | 2013-05-09 | 2013-08-14 | 东南大学 | 一种基于面部曲线弹性匹配的三维人脸识别方法 |
CN103971137A (zh) * | 2014-05-07 | 2014-08-06 | 上海电力学院 | 基于结构性稀疏特征学习的三维动态人脸表情识别方法 |
CN105354527A (zh) * | 2014-08-20 | 2016-02-24 | 南京普爱射线影像设备有限公司 | 一种消极表情识别鼓励系统 |
CN107045618A (zh) * | 2016-02-05 | 2017-08-15 | 北京陌上花科技有限公司 | 一种人脸表情识别方法及装置 |
CN108073855A (zh) * | 2016-11-11 | 2018-05-25 | 腾讯科技(深圳)有限公司 | 一种人脸表情的识别方法及系统 |
CN106815309A (zh) * | 2016-12-20 | 2017-06-09 | 北京奇虎科技有限公司 | 一种图像推送方法、装置以及移动终端 |
Non-Patent Citations (3)
Title |
---|
N.HUASSAIN 等: "3D Facial Action Units Recognition for Emotional Expression", 《ARXIV:1712.00195[CS.CV]》 * |
何秀玲 等: "融合特征基于深度多核学习的动态表情识别", 《计算机应用与软件》 * |
岳雷 等: "基于自动提取特征点的三维人脸表情识别", 《北京理工大学学报》 * |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109753950A (zh) * | 2019-02-11 | 2019-05-14 | 河北工业大学 | 动态人脸表情识别方法 |
CN109753950B (zh) * | 2019-02-11 | 2020-08-04 | 河北工业大学 | 动态人脸表情识别方法 |
CN109902656A (zh) * | 2019-03-12 | 2019-06-18 | 吉林大学 | 一种面部动作单元的识别方法、系统 |
CN110020638A (zh) * | 2019-04-17 | 2019-07-16 | 唐晓颖 | 人脸表情识别方法、装置、设备和介质 |
CN110091874A (zh) * | 2019-05-07 | 2019-08-06 | 绍兴天宏激光科技有限公司 | 一种基于表情识别的安全驾驶系统及识别方法 |
CN110154757A (zh) * | 2019-05-30 | 2019-08-23 | 电子科技大学 | 公交车多方位安全驾驶保障方法 |
CN111523467A (zh) * | 2020-04-23 | 2020-08-11 | 北京百度网讯科技有限公司 | 人脸跟踪方法和装置 |
CN111523467B (zh) * | 2020-04-23 | 2023-08-08 | 北京百度网讯科技有限公司 | 人脸跟踪方法和装置 |
CN112150594A (zh) * | 2020-09-23 | 2020-12-29 | 网易(杭州)网络有限公司 | 表情制作的方法、装置和电子设备 |
CN112150594B (zh) * | 2020-09-23 | 2023-07-04 | 网易(杭州)网络有限公司 | 表情制作的方法、装置和电子设备 |
CN113076916A (zh) * | 2021-04-19 | 2021-07-06 | 山东大学 | 基于几何特征加权融合的动态人脸表情识别方法及系统 |
CN115546868A (zh) * | 2022-10-25 | 2022-12-30 | 湖南芒果无际科技有限公司 | 面部动画采集设备、方法及可读存储介质 |
Also Published As
Publication number | Publication date |
---|---|
CN109034099B (zh) | 2021-07-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109034099A (zh) | 一种表情识别方法及装置 | |
CN110889672B (zh) | 一种基于深度学习的学生打卡及上课状态的检测系统 | |
Kliper-Gross et al. | Motion interchange patterns for action recognition in unconstrained videos | |
CN111563452B (zh) | 一种基于实例分割的多人体姿态检测及状态判别方法 | |
Murtaza et al. | Analysis of face recognition under varying facial expression: a survey. | |
CN102968643B (zh) | 一种基于李群论的多模态情感识别方法 | |
CN108776983A (zh) | 基于重建网络的人脸重建方法和装置、设备、介质、产品 | |
CN111028319B (zh) | 一种基于面部运动单元的三维非真实感表情生成方法 | |
CN110175534A (zh) | 基于多任务级联卷积神经网络的授课辅助系统 | |
US20230095182A1 (en) | Method and apparatus for extracting biological features, device, medium, and program product | |
CN110163567A (zh) | 基于多任务级联卷积神经网络的课堂点名系统 | |
CN106408579A (zh) | 一种基于视频的捏合指尖跟踪方法 | |
Agarwal et al. | Face recognition based smart and robust attendance monitoring using deep CNN | |
Guo et al. | PhyCoVIS: A visual analytic tool of physical coordination for cheer and dance training | |
Kaneko et al. | Processing of face images and its applications | |
Bilinski et al. | Representing visual appearance by video brownian covariance descriptor for human action recognition | |
Cao et al. | Facial Expression Study Based on 3D Facial Emotion Recognition | |
Kagalkar et al. | Mobile Application Based Translation of Sign Language to Text Description in Kannada Language. | |
Sathyanarayana et al. | Hand gestures for intelligent tutoring systems: dataset, techniques & evaluation | |
CN112749669A (zh) | 一种基于人面部图像的微表情智能识别系统 | |
Asthana et al. | Learning based automatic face annotation for arbitrary poses and expressions from frontal images only | |
CN110879966A (zh) | 一种基于人脸识别与图像处理的学生听课理解度评估方法 | |
Lo Presti et al. | Ensemble of Hankel matrices for face emotion recognition | |
CN111178141A (zh) | 一种基于注意力机制的lstm人体行为识别方法 | |
Hunyadi et al. | The outlines of a theory and technology of human-computer interaction as represented in the model of the HuComTech project |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20181218 Assignee: Hubei ZHENGBO Xusheng Technology Co.,Ltd. Assignor: CENTRAL CHINA NORMAL University Contract record no.: X2024980001275 Denomination of invention: A method and device for facial expression recognition Granted publication date: 20210713 License type: Common License Record date: 20240124 |
|
EE01 | Entry into force of recordation of patent licensing contract | ||
EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20181218 Assignee: Hubei Rongzhi Youan Technology Co.,Ltd. Assignor: CENTRAL CHINA NORMAL University Contract record no.: X2024980001548 Denomination of invention: A method and device for facial expression recognition Granted publication date: 20210713 License type: Common License Record date: 20240126 |
|
EE01 | Entry into force of recordation of patent licensing contract |