GB2588747B - Facial behaviour analysis - Google Patents

Facial behaviour analysis Download PDF

Info

Publication number
GB2588747B
GB2588747B GB1909300.4A GB201909300A GB2588747B GB 2588747 B GB2588747 B GB 2588747B GB 201909300 A GB201909300 A GB 201909300A GB 2588747 B GB2588747 B GB 2588747B
Authority
GB
United Kingdom
Prior art keywords
behaviour analysis
facial
facial behaviour
analysis
behaviour
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
GB1909300.4A
Other versions
GB201909300D0 (en
GB2588747A (en
Inventor
Zafeiriou Stefanos
Kollias Dimitrios
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to GB1909300.4A priority Critical patent/GB2588747B/en
Publication of GB201909300D0 publication Critical patent/GB201909300D0/en
Priority to PCT/GB2020/051503 priority patent/WO2020260862A1/en
Priority to CN202080044948.0A priority patent/CN113994341A/en
Publication of GB2588747A publication Critical patent/GB2588747A/en
Application granted granted Critical
Publication of GB2588747B publication Critical patent/GB2588747B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • G06V40/175—Static expression
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2413—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
    • G06F18/24133—Distances to prototypes
    • G06F18/24137—Distances to cluster centroïds
    • G06F18/2414—Smoothing the distance, e.g. radial basis function networks [RBFN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Computing Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Molecular Biology (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Human Computer Interaction (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Mathematical Physics (AREA)
  • Medical Informatics (AREA)
  • Databases & Information Systems (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Image Analysis (AREA)
GB1909300.4A 2019-06-28 2019-06-28 Facial behaviour analysis Active GB2588747B (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
GB1909300.4A GB2588747B (en) 2019-06-28 2019-06-28 Facial behaviour analysis
PCT/GB2020/051503 WO2020260862A1 (en) 2019-06-28 2020-06-22 Facial behaviour analysis
CN202080044948.0A CN113994341A (en) 2019-06-28 2020-06-22 Facial behavior analysis

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB1909300.4A GB2588747B (en) 2019-06-28 2019-06-28 Facial behaviour analysis

Publications (3)

Publication Number Publication Date
GB201909300D0 GB201909300D0 (en) 2019-08-14
GB2588747A GB2588747A (en) 2021-05-12
GB2588747B true GB2588747B (en) 2021-12-08

Family

ID=67540031

Family Applications (1)

Application Number Title Priority Date Filing Date
GB1909300.4A Active GB2588747B (en) 2019-06-28 2019-06-28 Facial behaviour analysis

Country Status (3)

Country Link
CN (1) CN113994341A (en)
GB (1) GB2588747B (en)
WO (1) WO2020260862A1 (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112395922A (en) * 2019-08-16 2021-02-23 杭州海康威视数字技术股份有限公司 Face action detection method, device and system
CN112488214A (en) * 2020-12-02 2021-03-12 浙江大华技术股份有限公司 Image emotion analysis method and related device
TWI811605B (en) * 2020-12-31 2023-08-11 宏碁股份有限公司 Method and system for mental index prediction
CN112949708B (en) * 2021-02-26 2023-10-24 平安科技（深圳）有限公司 Emotion recognition method, emotion recognition device, computer equipment and storage medium
CN113822183B (en) * 2021-09-08 2024-02-27 北京科技大学 Zero sample expression recognition method and system based on AU-EMO association and graph neural network
WO2023086585A1 (en) * 2021-11-12 2023-05-19 Covera Health Re-weighted self-influence for labeling noise removal in medical imaging data
CN115497146B (en) * 2022-10-18 2023-04-07 支付宝(杭州)信息技术有限公司 Model training method and device and identity verification method and device
CN116721457B (en) * 2023-08-09 2023-10-24 合肥综合性国家科学中心人工智能研究院(安徽省人工智能实验室) Multi-task facial expression recognition method guided by emotion priori topological graph

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090285456A1 (en) * 2008-05-19 2009-11-19 Hankyu Moon Method and system for measuring human response to visual stimulus based on changes in facial expression
US20140316881A1 (en) * 2013-02-13 2014-10-23 Emotient Estimation of affective valence and arousal with automatic facial expression measurement
CN109344760A (en) * 2018-09-26 2019-02-15 江西师范大学 A kind of construction method of natural scene human face expression data collection
CN109508654A (en) * 2018-10-26 2019-03-22 中国地质大学（武汉） Merge the human face analysis method and system of multitask and multiple dimensioned convolutional neural networks
CN109919047A (en) * 2019-02-18 2019-06-21 山东科技大学 A kind of mood detection method based on multitask, the residual error neural network of multi-tag

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107463888B (en) * 2017-07-21 2020-05-19 竹间智能科技（上海）有限公司 Face emotion analysis method and system based on multi-task learning and deep learning
CN108229298A (en) * 2017-09-30 2018-06-29 北京市商汤科技开发有限公司 The training of neural network and face identification method and device, equipment, storage medium
CN108388890A (en) * 2018-03-26 2018-08-10 南京邮电大学 A kind of neonatal pain degree assessment method and system based on human facial expression recognition
CN108764207B (en) * 2018-06-07 2021-10-19 厦门大学 Face expression recognition method based on multitask convolutional neural network
CN109800734A (en) * 2019-01-30 2019-05-24 北京津发科技股份有限公司 Human facial expression recognition method and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090285456A1 (en) * 2008-05-19 2009-11-19 Hankyu Moon Method and system for measuring human response to visual stimulus based on changes in facial expression
US20140316881A1 (en) * 2013-02-13 2014-10-23 Emotient Estimation of affective valence and arousal with automatic facial expression measurement
CN109344760A (en) * 2018-09-26 2019-02-15 江西师范大学 A kind of construction method of natural scene human face expression data collection
CN109508654A (en) * 2018-10-26 2019-03-22 中国地质大学（武汉） Merge the human face analysis method and system of multitask and multiple dimensioned convolutional neural networks
CN109919047A (en) * 2019-02-18 2019-06-21 山东科技大学 A kind of mood detection method based on multitask, the residual error neural network of multi-tag

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Pons, Gerard, and David Masip. "Multi-task, multi-label and multi-domain learning with residual convolutional networks for emotion recognition." arXiv preprint arXiv:1802.06664 (2018) *

Also Published As

Publication number Publication date
GB201909300D0 (en) 2019-08-14
WO2020260862A1 (en) 2020-12-30
GB2588747A (en) 2021-05-12
CN113994341A (en) 2022-01-28

Similar Documents

Publication Publication Date Title
GB2588747B (en) Facial behaviour analysis
SG11202110869QA (en) Microglia-sufficient brain organoids
IL290245A (en) Single cell analysis
AU201715280S (en) Analysis unit
GB201817893D0 (en) Predicting physological parameters
IL269168A (en) Single cell analysis
GB201813449D0 (en) Skin cell analysis
GB201910188D0 (en) Analyser
GB201708835D0 (en) Direct tissue analysis
EP3813710A4 (en) Implant fit analysis
GB2570742B (en) Optical-interference analysis
GB201813762D0 (en) Neural interface
GB201908045D0 (en) Object analysis
GB201904122D0 (en) Facial analysis
GB2579122B (en) Tissue analysis
CA189962S (en) Handbag
GB2596002B (en) Object analysis
GB201818285D0 (en) Sweat analysis
GB201820463D0 (en) Electrochemical sythenesis
GB2585410B (en) Analysis
EP3278086A4 (en) Spectral analysis through model switching
GB202112414D0 (en) Eyebrow postiche
CA189947S (en) Handbag
CA189963S (en) Handbag
CA189595S (en) Handbag

Legal Events

Date Code Title Description
COOA Change in applicant's name or ownership of the application

Owner name: HUAWEI TECHNOLOGIES CO., LTD

Free format text: FORMER OWNER: FACESOFT LTD.