CN115429272B - 基于多模态生理信号的心理健康状态评估方法及系统 - Google Patents
基于多模态生理信号的心理健康状态评估方法及系统 Download PDFInfo
- Publication number
- CN115429272B CN115429272B CN202211127908.XA CN202211127908A CN115429272B CN 115429272 B CN115429272 B CN 115429272B CN 202211127908 A CN202211127908 A CN 202211127908A CN 115429272 B CN115429272 B CN 115429272B
- Authority
- CN
- China
- Prior art keywords
- emotion
- physiological signals
- confidence coefficient
- psychological health
- physiological
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000009323 psychological health Effects 0.000 title claims abstract description 95
- 238000000034 method Methods 0.000 title claims abstract description 57
- 230000008451 emotion Effects 0.000 claims abstract description 193
- 230000008859 change Effects 0.000 claims abstract description 89
- 238000013145 classification model Methods 0.000 claims abstract description 33
- 230000002159 abnormal effect Effects 0.000 claims abstract description 29
- 230000006698 induction Effects 0.000 claims abstract description 27
- 230000008909 emotion recognition Effects 0.000 claims abstract description 20
- 230000004630 mental health Effects 0.000 claims description 38
- 238000012549 training Methods 0.000 claims description 24
- 239000011159 matrix material Substances 0.000 claims description 17
- 238000000605 extraction Methods 0.000 claims description 11
- 238000013528 artificial neural network Methods 0.000 claims description 10
- 230000008569 process Effects 0.000 claims description 10
- 239000012634 fragment Substances 0.000 claims description 9
- 238000007781 pre-processing Methods 0.000 claims description 9
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 claims description 6
- 238000001914 filtration Methods 0.000 claims description 6
- 238000010801 machine learning Methods 0.000 claims description 6
- 201000010099 disease Diseases 0.000 claims description 5
- 230000004424 eye movement Effects 0.000 claims description 5
- 230000009466 transformation Effects 0.000 claims description 5
- 210000004556 brain Anatomy 0.000 claims description 4
- 238000003745 diagnosis Methods 0.000 claims description 4
- 238000012880 independent component analysis Methods 0.000 claims description 4
- 230000002708 enhancing effect Effects 0.000 claims description 2
- 230000001131 transforming effect Effects 0.000 claims description 2
- 238000011156 evaluation Methods 0.000 abstract description 8
- 230000000638 stimulation Effects 0.000 description 7
- 238000012360 testing method Methods 0.000 description 7
- 230000002996 emotional effect Effects 0.000 description 3
- 230000001815 facial effect Effects 0.000 description 3
- 230000001939 inductive effect Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 241000282414 Homo sapiens Species 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000001149 cognitive effect Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 238000012216 screening Methods 0.000 description 2
- 239000013589 supplement Substances 0.000 description 2
- 208000019901 Anxiety disease Diseases 0.000 description 1
- 206010026749 Mania Diseases 0.000 description 1
- 206010062519 Poor quality sleep Diseases 0.000 description 1
- 210000003423 ankle Anatomy 0.000 description 1
- 230000036506 anxiety Effects 0.000 description 1
- 208000013404 behavioral symptom Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000994 depressogenic effect Effects 0.000 description 1
- 208000035475 disorder Diseases 0.000 description 1
- 239000002552 dosage form Substances 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 210000000750 endocrine system Anatomy 0.000 description 1
- 210000000245 forearm Anatomy 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000003183 myoelectrical effect Effects 0.000 description 1
- 210000000653 nervous system Anatomy 0.000 description 1
- 230000007935 neutral effect Effects 0.000 description 1
- 238000000513 principal component analysis Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000011514 reflex Effects 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 238000013077 scoring method Methods 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
- 210000000707 wrist Anatomy 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
- A61B5/165—Evaluating the state of mind, e.g. depression, anxiety
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
- A61B5/163—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state by tracking eye movement, gaze, or pupil change
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/318—Heart-related electrical modalities, e.g. electrocardiography [ECG]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/318—Heart-related electrical modalities, e.g. electrocardiography [ECG]
- A61B5/33—Heart-related electrical modalities, e.g. electrocardiography [ECG] specially adapted for cooperation with other devices
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/369—Electroencephalography [EEG]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/389—Electromyography [EMG]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7235—Details of waveform analysis
- A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
- A61B5/7267—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems involving training the classification device
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Veterinary Medicine (AREA)
- Animal Behavior & Ethology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Biophysics (AREA)
- Psychiatry (AREA)
- Artificial Intelligence (AREA)
- Psychology (AREA)
- Developmental Disabilities (AREA)
- Hospice & Palliative Care (AREA)
- Educational Technology (AREA)
- Social Psychology (AREA)
- Child & Adolescent Psychology (AREA)
- Cardiology (AREA)
- Evolutionary Computation (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physiology (AREA)
- Signal Processing (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
Description
Claims (9)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211127908.XA CN115429272B (zh) | 2022-09-16 | 2022-09-16 | 基于多模态生理信号的心理健康状态评估方法及系统 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211127908.XA CN115429272B (zh) | 2022-09-16 | 2022-09-16 | 基于多模态生理信号的心理健康状态评估方法及系统 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN115429272A CN115429272A (zh) | 2022-12-06 |
CN115429272B true CN115429272B (zh) | 2024-04-30 |
Family
ID=84248866
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202211127908.XA Active CN115429272B (zh) | 2022-09-16 | 2022-09-16 | 基于多模态生理信号的心理健康状态评估方法及系统 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN115429272B (zh) |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102498485A (zh) * | 2009-01-23 | 2012-06-13 | 利纳基金会 | 用于有表现力的语言、发育失调和情绪评估的系统和方法 |
CN111436957A (zh) * | 2019-12-31 | 2020-07-24 | 秒针信息技术有限公司 | 一种心理状态信息处理方法及装置 |
CN112083806A (zh) * | 2020-09-16 | 2020-12-15 | 华南理工大学 | 一种基于多模态识别的自学习情感交互方法 |
CN112307975A (zh) * | 2020-10-30 | 2021-02-02 | 江西理工大学 | 融合语音与微表情的多模态情感识别方法及系统 |
CN113197579A (zh) * | 2021-06-07 | 2021-08-03 | 山东大学 | 一种基于多模态信息融合的智能心理评估方法及系统 |
CN113397546A (zh) * | 2021-06-24 | 2021-09-17 | 福州大学 | 基于机器学习和生理信号的情绪识别模型构建方法及系统 |
CN114190943A (zh) * | 2021-12-22 | 2022-03-18 | 南通大学 | 一种基于ikap提高慢性肾病患者认知的方法及系统 |
CN114305325A (zh) * | 2020-09-30 | 2022-04-12 | 华为云计算技术有限公司 | 一种情绪检测方法和装置 |
CN114403877A (zh) * | 2022-01-21 | 2022-04-29 | 中山大学 | 基于二维连续模型的多生理信号情绪定量评估方法 |
EP4047561A1 (en) * | 2021-02-20 | 2022-08-24 | Bayerische Motoren Werke Aktiengesellschaft | Method for recognizing an emotion of a driver, apparatus, device, medium and vehicle |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220273907A1 (en) * | 2017-12-31 | 2022-09-01 | Neuroenhancement Lab, LLC | Method and apparatus for neuroenhancement to enhance emotional response |
US20190239791A1 (en) * | 2018-02-05 | 2019-08-08 | Panasonic Intellectual Property Management Co., Ltd. | System and method to evaluate and predict mental condition |
-
2022
- 2022-09-16 CN CN202211127908.XA patent/CN115429272B/zh active Active
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102498485A (zh) * | 2009-01-23 | 2012-06-13 | 利纳基金会 | 用于有表现力的语言、发育失调和情绪评估的系统和方法 |
CN111436957A (zh) * | 2019-12-31 | 2020-07-24 | 秒针信息技术有限公司 | 一种心理状态信息处理方法及装置 |
CN112083806A (zh) * | 2020-09-16 | 2020-12-15 | 华南理工大学 | 一种基于多模态识别的自学习情感交互方法 |
CN114305325A (zh) * | 2020-09-30 | 2022-04-12 | 华为云计算技术有限公司 | 一种情绪检测方法和装置 |
CN112307975A (zh) * | 2020-10-30 | 2021-02-02 | 江西理工大学 | 融合语音与微表情的多模态情感识别方法及系统 |
EP4047561A1 (en) * | 2021-02-20 | 2022-08-24 | Bayerische Motoren Werke Aktiengesellschaft | Method for recognizing an emotion of a driver, apparatus, device, medium and vehicle |
CN113197579A (zh) * | 2021-06-07 | 2021-08-03 | 山东大学 | 一种基于多模态信息融合的智能心理评估方法及系统 |
CN113397546A (zh) * | 2021-06-24 | 2021-09-17 | 福州大学 | 基于机器学习和生理信号的情绪识别模型构建方法及系统 |
CN114190943A (zh) * | 2021-12-22 | 2022-03-18 | 南通大学 | 一种基于ikap提高慢性肾病患者认知的方法及系统 |
CN114403877A (zh) * | 2022-01-21 | 2022-04-29 | 中山大学 | 基于二维连续模型的多生理信号情绪定量评估方法 |
Non-Patent Citations (2)
Title |
---|
基于脑电信号的情绪状态识别算法研究;王春晨;文治洪;王航;余明;杨鹏程;杨琳;代静;曹新生;;医疗卫生装备;20200215(第02期);全文 * |
基于脑电信号的驾驶员情绪状态识别研究;钟铭恩;吴平东;彭军强;洪汉池;;中国安全科学学报;20110915(第09期);全文 * |
Also Published As
Publication number | Publication date |
---|---|
CN115429272A (zh) | 2022-12-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110507335B (zh) | 基于多模态信息的服刑人员心理健康状态评估方法及系统 | |
Seal et al. | DeprNet: A deep convolution neural network framework for detecting depression using EEG | |
Wang et al. | Channel selection method for EEG emotion recognition using normalized mutual information | |
CN109993068B (zh) | 一种基于心率和面部特征的非接触式的人类情感识别方法 | |
Ghaderyan et al. | A new algorithm for kinematic analysis of handwriting data; towards a reliable handwriting-based tool for early detection of alzheimer's disease | |
RU2708807C2 (ru) | Алгоритм комплексного дистанционного бесконтактного мультиканального анализа психоэмоционального и физиологического состояния объекта по аудио- и видеоконтенту | |
CN111920420B (zh) | 一种基于统计学习的患者行为多模态分析与预测系统 | |
Soni et al. | Graphical representation learning-based approach for automatic classification of electroencephalogram signals in depression | |
CN105279380A (zh) | 一种基于表情分析的抑郁程度自动评估系统 | |
CN114565957A (zh) | 基于微表情识别的意识评估方法及系统 | |
CN113974627B (zh) | 一种基于脑机生成对抗的情绪识别方法 | |
Singh et al. | Prediction of pain intensity using multimedia data | |
Li et al. | Multi-modal emotion recognition based on deep learning of EEG and audio signals | |
CN117137488B (zh) | 基于脑电数据与面部表情影像的抑郁症病症辅助识别方法 | |
Chen et al. | DCTNet: Hybrid deep neural network-based EEG signal for detecting depression | |
CN117883082A (zh) | 一种异常情绪识别方法、系统、设备及介质 | |
Mohaghegh et al. | Identifying Parkinson’s disease using multimodal approach and deep learning | |
CN115429272B (zh) | 基于多模态生理信号的心理健康状态评估方法及系统 | |
CN111723869A (zh) | 一种面向特殊人员的行为风险智能预警方法及系统 | |
CN116484290A (zh) | 一种基于Stacking集成的抑郁症识别模型构建方法 | |
CN113974625B (zh) | 一种基于脑机跨模态迁移的情绪识别方法 | |
CN115022617A (zh) | 基于脑电信号和时空多尺度联合网络的视频质量评价方法 | |
Nikhil et al. | A conceptual analysis for the measurement of stress intensity by deep learning using EEG signals | |
Kim et al. | A study on user recognition using 2D ECG image based on ensemble networks for intelligent vehicles | |
Hollenstein | Leveraging Cognitive Processing Signals for Natural Language Understanding |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB03 | Change of inventor or designer information |
Inventor after: Hu Bin Inventor after: Chen Zhenxiang Inventor after: Wang Youmian Inventor after: Jiang Xiaoqing Inventor after: Li Kaiyun Inventor after: Liu Wenjuan Inventor after: Huang Helin Inventor after: Chen Jianzhang Inventor before: Chen Zhenxiang Inventor before: Hu Bin Inventor before: Wang Youmian Inventor before: Jiang Xiaoqing Inventor before: Li Kaiyun Inventor before: Liu Wenjuan Inventor before: Huang Helin Inventor before: Chen Jianzhang |
|
CB03 | Change of inventor or designer information | ||
GR01 | Patent grant | ||
GR01 | Patent grant |